Sep 29 18:11:35 devstack cinder-volume[75585]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 29 18:11:35 devstack cinder-volume[75585]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 29 18:11:35 devstack cinder-volume[75585]: we strongly recommend against using it for new projects. Sep 29 18:11:35 devstack cinder-volume[75585]: If you are already using Eventlet, we recommend migrating to a different Sep 29 18:11:35 devstack cinder-volume[75585]: framework. For more detail see Sep 29 18:11:35 devstack cinder-volume[75585]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 29 18:11:35 devstack cinder-volume[75585]: import eventlet # noqa Sep 29 18:11:37 devstack cinder-volume[75585]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75585) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 29 18:11:37 devstack cinder-volume[75585]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75585) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 29 18:11:37 devstack cinder-volume[75585]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75585) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 29 18:11:38 devstack cinder-volume[75585]: INFO dbcounter [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] Registered counter for database cinder Sep 29 18:11:38 devstack cinder-volume[75585]: DEBUG oslo_db.sqlalchemy.engines [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75585) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 29 18:11:39 devstack cinder-volume[75585]: DEBUG dbcounter [-] [75585] Writer thread running {{(pid=75585) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 29 18:11:39 devstack cinder-volume[75585]: INFO cinder.rpc [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 29 18:11:39 devstack cinder-volume[75585]: INFO cinder.rpc [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 29 18:11:39 devstack cinder-volume[75585]: DEBUG oslo_db.sqlalchemy.engines [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75585) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 29 18:11:39 devstack cinder-volume[75585]: INFO cinder.volume.manager [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] Determined volume DB was empty at startup. Sep 29 18:11:39 devstack cinder-volume[75585]: DEBUG cinder.volume.manager [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75585) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 29 18:11:39 devstack cinder-volume[75585]: INFO cinder.volume.manager [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 29 18:11:39 devstack cinder-volume[75585]: WARNING stevedore.named [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 29 18:11:39 devstack cinder-volume[75585]: WARNING castellan.key_manager [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 29 18:11:39 devstack cinder-volume[75585]: WARNING cinder.keymgr.conf_key_mgr [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 29 18:11:39 devstack cinder-volume[75585]: DEBUG cinder.volume.drivers.lvm [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75585) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Sep 29 18:11:39 devstack cinder-volume[75585]: DEBUG oslo_concurrency.processutils [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:11:39 devstack cinder-volume[75585]: DEBUG oslo_concurrency.processutils [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] CMD "cinder-rtstool verify" returned: 0 in 0.418s {{(pid=75585) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:11:39 devstack cinder-volume[75585]: DEBUG oslo_db.sqlalchemy.engines [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75585) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 29 18:11:39 devstack cinder-volume[75585]: INFO cinder.rpc [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Sep 29 18:11:39 devstack cinder-volume[75585]: INFO cinder.rpc [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Sep 29 18:11:39 devstack cinder-volume[75585]: WARNING stevedore.named [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 29 18:11:39 devstack cinder-volume[75585]: WARNING castellan.key_manager [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 29 18:11:39 devstack cinder-volume[75585]: INFO cinder.volume.manager [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Sep 29 18:11:39 devstack cinder-volume[75585]: DEBUG oslo_db.sqlalchemy.engines [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75585) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 29 18:11:40 devstack cinder-volume[75585]: INFO oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] Starting 1 workers Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] Started child 75740 {{(pid=75585) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] Full set of CONF: {{(pid=75585) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] ******************************************************************************** {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] Configuration options gathered from: {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] ================================================================================ {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] allow_availability_zone_fallback = False {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] allow_compression_on_image_upload = False {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] allowed_direct_url_schemes = [] {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] api_rate_limit = True {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] auth_strategy = keystone {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] az_cache_duration = 3600 {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] backend_availability_zone = None {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] backend_host = None {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] backend_name = None {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] backend_stats_polling_interval = 60 {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] backup_api_class = cinder.backup.api.API {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] backup_name_template = backup-%s {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] backup_use_same_host = False {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] backup_use_temp_snapshot = False {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] chap_password = **** {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] chap_username = {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] cinder_internal_tenant_project_id = 98c3bbed4ea04d8892505e8124d76ed3 {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] cinder_internal_tenant_user_id = 659377bd1cb343e8bbaa439133cdccd4 {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] cloned_volume_same_az = True {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75740]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.0) Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] cluster = None {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] compression_format = gzip {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] compute_api_class = cinder.compute.nova.API {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] config_dir = [] {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] config_source = [] {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] control_exchange = openstack {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] debug = True {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] default_availability_zone = None {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] default_group_type = None {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] default_volume_type = lvmdriver-1 {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] disk_geometry = None {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] driver_client_cert = None {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] driver_client_cert_key = None {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] driver_data_namespace = None {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] driver_ssl_cert_path = None {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] driver_ssl_cert_verify = False {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] driver_use_ssl = False {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] enable_force_upload = False {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] enable_new_services = True {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] enable_unsupported_driver = False {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] enabled_backends = ['lvmdriver-1'] {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] enforce_multipath_for_image_xfer = False {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] filter_function = None {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] glance_api_insecure = False {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] glance_api_servers = ['http://192.168.122.67/image'] {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] glance_api_ssl_compression = False {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] glance_ca_certificates_file = None {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] glance_catalog_info = image:glance:publicURL {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] glance_certfile = None {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] glance_keyfile = None {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] glance_num_retries = 3 {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] glance_request_timeout = None {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] goodness_function = None {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] graceful_shutdown_timeout = 5 {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] group_api_class = cinder.group.api.API {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] host = devstack {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] image_compress_on_upload = True {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] image_conversion_address_space_limit = 1 {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] image_conversion_cpu_limit = 60 {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] image_conversion_disable = False {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] image_introspection_address_space_limit = 1 {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] image_introspection_cpu_limit = 60 {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] image_upload_use_cinder_backend = False {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] image_upload_use_internal_tenant = False {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] image_volume_cache_enabled = False {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] image_volume_cache_max_count = 0 {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] image_volume_cache_max_size_gb = 0 {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] init_host_max_objects_retrieval = 0 {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] instance_format = [instance: %(uuid)s] {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] iscsi_target_flags = {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] iscsi_write_cache = on {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] iser_helper = tgtadm {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] iser_ip_address = 192.168.122.67 {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] iser_port = 3260 {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] log_color = False {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] log_config_append = None {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] log_dir = None {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] log_file = None {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] log_options = True {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] log_rotate_interval = 1 {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] log_rotate_interval_type = days {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] log_rotation_type = none {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] max_age = 0 {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] max_logfile_count = 30 {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] max_logfile_size_mb = 200 {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] max_over_subscription_ratio = 20.0 {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] message_reap_interval = 86400 {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] message_ttl = 2592000 {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] migration_create_volume_timeout_secs = 300 {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] monkey_patch = False {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] monkey_patch_modules = [] {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] my_ip = 192.168.122.67 {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] no_snapshot_gb_quota = False {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] num_iser_scan_tries = 3 {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] num_shell_tries = 3 {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] num_volume_device_scan_tries = 3 {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] nvmeof_conn_info_version = 1 {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] nvmet_ns_id = 10 {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] nvmet_port_id = 1 {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] osapi_max_limit = 1000 {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] osapi_volume_ext_list = [] {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] osapi_volume_listen = 0.0.0.0 {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] osapi_volume_listen_port = 8776 {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] osapi_volume_use_ssl = False {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] osapi_volume_workers = None {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] per_volume_size_limit = -1 {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] periodic_fuzzy_delay = 60 {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] periodic_interval = 60 {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] project_id_regex = [0-9a-f\-]+ {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] public_endpoint = None {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] publish_errors = False {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] quota_backup_gigabytes = 1000 {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] quota_backups = 10 {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] quota_gigabytes = 1000 {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] quota_groups = 10 {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] quota_snapshots = 10 {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] quota_volumes = 10 {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] rate_limit_burst = 0 {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] rate_limit_except_level = CRITICAL {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] rate_limit_interval = 0 {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] reinit_driver_count = 3 {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] replication_device = **** {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] report_discard_supported = False {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] report_interval = 120 {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] reservation_clean_interval = 86400 {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] reservation_expire = 86400 {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] reserved_image_namespaces = [] {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] reserved_percentage = 0 {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] rpc_response_timeout = 120 {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] run_external_periodic_tasks = True {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] scst_target_driver = iscsi {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] scst_target_iqn_name = None {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] service_down_time = 720 {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] shell_completion = None {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] snapshot_name_template = snapshot-%s {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] snapshot_same_host = True {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] split_loggers = False {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] state_path = /opt/stack/data/cinder {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] storage_availability_zone = nova {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] storage_protocol = iSCSI {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] syslog_log_facility = LOG_USER {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] target_helper = lioadm {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] target_ip_address = 192.168.122.67 {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] target_port = 3260 {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] target_protocol = iscsi {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] target_secondary_ip_addresses = [] {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] trace_flags = None {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] transfer_api_class = cinder.transfer.api.API {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] transport_url = **** {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] until_refresh = 0 {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] use_chap_auth = False {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] use_default_quota_class = True {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] use_journal = False {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] use_json = False {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] use_multipath_for_image_xfer = False {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] use_stderr = False {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] use_syslog = False {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] verify_glance_signatures = enabled {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] volume_api_class = cinder.volume.api.API {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] volume_backend_name = None {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] volume_clear = zero {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] volume_clear_ionice = None {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] volume_clear_size = 0 {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] volume_copy_bps_limit = 0 {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] volume_dd_blocksize = 1M {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] volume_name_template = volume-%s {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] volume_service_inithost_offload = False {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] volume_usage_audit_period = month {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] zoning_mode = None {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] oslo_concurrency.disable_process_locking = False {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] keystone_authtoken.auth_section = None {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] keystone_authtoken.auth_type = password {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] keystone_authtoken.auth_version = None {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] keystone_authtoken.cache = None {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] keystone_authtoken.certfile = None {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] keystone_authtoken.delay_auth_decision = False {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] keystone_authtoken.http_connect_timeout = None {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] keystone_authtoken.include_service_catalog = True {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] keystone_authtoken.insecure = False {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] keystone_authtoken.interface = public {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] keystone_authtoken.keyfile = None {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] keystone_authtoken.memcache_password = **** {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] keystone_authtoken.memcache_username = None {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] keystone_authtoken.region_name = None {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75740]: INFO cinder.volume.manager [None req-9353fa99-4dcf-479e-b08e-f5350399fcdb None None] Starting volume driver LVMVolumeDriver (3.0.0) Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] keystone_authtoken.service_token_roles_required = True {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] keystone_authtoken.service_type = None {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] keystone_authtoken.token_cache_time = 300 {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.67/identity {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] cache.backend = dogpile.cache.null {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] cache.backend_argument = **** {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75740]: DEBUG oslo_concurrency.processutils [None req-9353fa99-4dcf-479e-b08e-f5350399fcdb None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75740) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] cache.backend_expiration_time = None {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] cache.config_prefix = cache.oslo {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] cache.debug_cache_backend = False {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] cache.enable_retry_client = False {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] cache.enable_socket_keepalive = False {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] cache.enabled = False {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] cache.expiration_time = 600 {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] cache.hashclient_retry_attempts = 2 {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] cache.memcache_dead_retry = 300 {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] cache.memcache_pool_maxsize = 10 {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] cache.memcache_sasl_enabled = False {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] cache.password = **** {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] cache.proxies = [] {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] cache.redis_db = 0 {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] cache.redis_sentinel_service_name = mymaster {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] cache.redis_server = localhost:6379 {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] cache.retry_attempts = 2 {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] cache.retry_delay = 0.0 {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] cache.socket_keepalive_count = 1 {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] cache.socket_keepalive_idle = 1 {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] cache.socket_keepalive_interval = 1 {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] cache.socket_timeout = 1.0 {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] cache.tls_allowed_ciphers = None {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] cache.tls_cafile = None {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] cache.tls_certfile = None {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] cache.tls_enabled = False {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] cache.tls_keyfile = None {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] cache.username = None {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] coordination.backend_url = **** {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] database.asyncio_connection = **** {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] database.asyncio_slave_connection = **** {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] database.backend = sqlalchemy {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] database.connection = **** {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] database.connection_debug = 0 {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] database.connection_parameters = {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] database.connection_recycle_time = 3600 {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] database.connection_trace = False {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] database.db_inc_retry_interval = True {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] database.db_max_retries = 20 {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] database.db_max_retry_interval = 10 {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] database.db_retry_interval = 1 {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] database.max_overflow = 50 {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] database.max_pool_size = 5 {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] database.max_retries = 10 {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] database.mysql_wsrep_sync_wait = None {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] database.pool_timeout = None {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] database.retry_interval = 10 {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] database.slave_connection = **** {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] database.sqlite_synchronous = True {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] database.synchronous_reader = True {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] database.use_db_reconnect = False {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] oslo_messaging_tracing.insecure = False {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] profiler.connection_string = messaging:// {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] profiler.enabled = False {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] profiler.es_doc_type = notification {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] profiler.es_scroll_size = 10000 {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] profiler.es_scroll_time = 2m {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] profiler.filter_error_trace = False {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] profiler.hmac_keys = **** {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] profiler.sentinel_service_name = mymaster {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] profiler.socket_timeout = 0.1 {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] profiler.trace_requests = False {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] profiler.trace_sqlalchemy = False {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] profiler_jaeger.process_tags = {} {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] profiler_jaeger.service_name_prefix = None {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] profiler_otlp.service_name_prefix = None {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] oslo_policy.enforce_new_defaults = True {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] oslo_policy.policy_default_rule = default {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] oslo_policy.policy_file = policy.yaml {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] oslo_policy.remote_timeout = 60.0 {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] privsep_osbrick.group = None {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] privsep_osbrick.helper_command = None {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] privsep_osbrick.user = None {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] cinder_sys_admin.group = None {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] cinder_sys_admin.helper_command = None {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] cinder_sys_admin.user = None {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] service_user.auth_section = None {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] service_user.auth_type = password {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] service_user.cafile = None {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] service_user.certfile = None {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] service_user.collect_timing = False {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] service_user.insecure = False {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] service_user.keyfile = None {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] service_user.send_service_user_token = True {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] service_user.split_loggers = False {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] service_user.timeout = None {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75740]: DEBUG oslo_concurrency.processutils [None req-9353fa99-4dcf-479e-b08e-f5350399fcdb None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.046s {{(pid=75740) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] service_user.tls_ciphers = None {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] service_user.tls_min_version = None {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] glance.auth_section = None {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] glance.auth_type = password {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] glance.certfile = None {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] glance.collect_timing = False {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] glance.insecure = False {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] glance.keyfile = None {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] glance.region_name = None {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] glance.split_loggers = False {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] glance.timeout = None {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75740]: DEBUG oslo_concurrency.processutils [None req-9353fa99-4dcf-479e-b08e-f5350399fcdb None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75740) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] glance.tls_ciphers = None {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] glance.tls_min_version = None {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] backend_defaults.backend_availability_zone = None {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] backend_defaults.chap_password = **** {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] backend_defaults.chap_username = {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] backend_defaults.disk_geometry = None {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] backend_defaults.driver_client_cert = None {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] backend_defaults.driver_client_cert_key = None {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] backend_defaults.driver_data_namespace = None {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] backend_defaults.driver_use_ssl = False {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] backend_defaults.enable_unsupported_driver = False {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] backend_defaults.extra_capabilities = {} {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] backend_defaults.filter_function = None {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] backend_defaults.goodness_function = None {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] backend_defaults.iscsi_target_flags = {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] backend_defaults.iscsi_write_cache = on {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] backend_defaults.iser_helper = tgtadm {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] backend_defaults.iser_ip_address = 192.168.122.67 {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] backend_defaults.iser_port = 3260 {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] backend_defaults.lvm_mirrors = 0 {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] backend_defaults.lvm_share_target = False {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] backend_defaults.lvm_type = auto {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] backend_defaults.num_shell_tries = 3 {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] backend_defaults.nvmet_port_id = 1 {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] backend_defaults.replication_device = **** {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] backend_defaults.report_discard_supported = False {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] backend_defaults.reserved_percentage = 0 {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] backend_defaults.scst_target_driver = iscsi {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] backend_defaults.scst_target_iqn_name = None {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] backend_defaults.storage_protocol = iSCSI {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] backend_defaults.target_helper = tgtadm {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] backend_defaults.target_ip_address = 192.168.122.67 {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] backend_defaults.target_port = 3260 {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] backend_defaults.target_protocol = iscsi {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] backend_defaults.trace_flags = None {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] backend_defaults.unique_fqdn_network = True {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] backend_defaults.use_chap_auth = False {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] backend_defaults.volume_backend_name = None {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] backend_defaults.volume_clear = zero {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] backend_defaults.volume_clear_ionice = None {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] backend_defaults.volume_clear_size = 0 {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] backend_defaults.volume_group = cinder-volumes {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] oslo_reports.file_event_handler = None {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] oslo_reports.log_dir = None {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] lvmdriver-1.backend_availability_zone = None {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] lvmdriver-1.backend_host = None {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] lvmdriver-1.chap_password = **** {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] lvmdriver-1.chap_username = None {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] lvmdriver-1.chiscsi_conf = None {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] lvmdriver-1.disk_geometry = None {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] lvmdriver-1.driver_client_cert = None {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] lvmdriver-1.driver_data_namespace = None {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] lvmdriver-1.driver_use_ssl = None {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] lvmdriver-1.extra_capabilities = None {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] lvmdriver-1.filter_function = None {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] lvmdriver-1.goodness_function = None {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75740]: DEBUG oslo_concurrency.processutils [None req-9353fa99-4dcf-479e-b08e-f5350399fcdb None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.042s {{(pid=75740) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75740]: DEBUG oslo_concurrency.processutils [None req-9353fa99-4dcf-479e-b08e-f5350399fcdb None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75740) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] lvmdriver-1.iser_helper = None {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] lvmdriver-1.iser_ip_address = None {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] lvmdriver-1.iser_port = None {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] lvmdriver-1.iser_target_prefix = None {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] lvmdriver-1.lvm_conf_file = None {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] lvmdriver-1.lvm_mirrors = None {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] lvmdriver-1.lvm_share_target = None {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] lvmdriver-1.lvm_type = auto {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] lvmdriver-1.num_shell_tries = None {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] lvmdriver-1.nvmet_port_id = None {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] lvmdriver-1.replication_device = **** {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] lvmdriver-1.report_discard_supported = None {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] lvmdriver-1.reserved_percentage = None {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] lvmdriver-1.scst_target_driver = None {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] lvmdriver-1.storage_protocol = None {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] lvmdriver-1.target_helper = lioadm {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] lvmdriver-1.target_ip_address = None {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] lvmdriver-1.target_port = 3260 {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] lvmdriver-1.target_protocol = iscsi {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] lvmdriver-1.trace_flags = None {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] lvmdriver-1.use_chap_auth = None {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] lvmdriver-1.volume_clear = zero {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] lvmdriver-1.volume_clear_size = None {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] lvmdriver-1.volumes_dir = None {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] oslo_messaging_rabbit.ssl = False {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75740]: DEBUG oslo_concurrency.processutils [None req-9353fa99-4dcf-479e-b08e-f5350399fcdb None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.044s {{(pid=75740) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] oslo_messaging_rabbit.ssl_version = {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75740]: DEBUG oslo_concurrency.processutils [None req-9353fa99-4dcf-479e-b08e-f5350399fcdb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75740) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] oslo_messaging_notifications.driver = [] {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] oslo_messaging_notifications.retry = -1 {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] key_manager.fixed_key = **** {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] barbican.barbican_api_version = None {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] barbican.barbican_endpoint = None {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] barbican.barbican_endpoint_type = public {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] barbican.barbican_region_name = None {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] barbican.cafile = None {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] barbican.certfile = None {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] barbican.collect_timing = False {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] barbican.insecure = False {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] barbican.keyfile = None {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] barbican.number_of_retries = 60 {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] barbican.retry_delay = 1 {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] barbican.send_service_user_token = False {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack sudo[75746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] barbican.split_loggers = False {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] barbican.timeout = None {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] barbican.tls_ciphers = None {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] barbican.tls_min_version = None {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] barbican.verify_ssl = True {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] barbican.verify_ssl_path = None {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] barbican_service_user.auth_section = None {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack sudo[75746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] barbican_service_user.auth_type = None {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] barbican_service_user.cafile = None {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] barbican_service_user.certfile = None {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] barbican_service_user.collect_timing = False {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] barbican_service_user.insecure = False {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] barbican_service_user.keyfile = None {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] barbican_service_user.split_loggers = False {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] barbican_service_user.timeout = None {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] barbican_service_user.tls_ciphers = None {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] barbican_service_user.tls_min_version = None {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] vault.approle_role_id = **** {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] vault.approle_secret_id = **** {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] vault.auth_method = approle {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] vault.auth_path = None {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] vault.kv_mountpoint = secret {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] vault.kv_path = None {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] vault.kv_version = 2 {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] vault.namespace = None {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] vault.root_token_id = **** {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] vault.ssl_ca_crt_file = None {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] vault.timeout = 60.0 {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] vault.token_file = None {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] vault.token_role = None {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] vault.use_ssl = False {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:11:40 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] ******************************************************************************** {{(pid=75585) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 29 18:11:40 devstack sudo[75746]: pam_unix(sudo:session): session closed for user root Sep 29 18:11:40 devstack cinder-volume[75740]: DEBUG oslo_concurrency.processutils [None req-9353fa99-4dcf-479e-b08e-f5350399fcdb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.295s {{(pid=75740) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:11:40 devstack cinder-volume[75740]: DEBUG oslo_concurrency.processutils [None req-9353fa99-4dcf-479e-b08e-f5350399fcdb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75740) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:11:40 devstack sudo[75749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 29 18:11:40 devstack sudo[75749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:11:40 devstack sudo[75749]: pam_unix(sudo:session): session closed for user root Sep 29 18:11:40 devstack cinder-volume[75740]: DEBUG oslo_concurrency.processutils [None req-9353fa99-4dcf-479e-b08e-f5350399fcdb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.284s {{(pid=75740) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:11:40 devstack cinder-volume[75740]: DEBUG oslo_concurrency.processutils [None req-9353fa99-4dcf-479e-b08e-f5350399fcdb None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75740) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 29 18:11:40 devstack cinder-volume[75740]: INFO cinder.brick.local_dev.lvm [None req-9353fa99-4dcf-479e-b08e-f5350399fcdb None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Sep 29 18:11:40 devstack cinder-volume[75740]: DEBUG oslo_concurrency.processutils [None req-9353fa99-4dcf-479e-b08e-f5350399fcdb None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75740) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:11:40 devstack cinder-volume[75740]: DEBUG oslo_concurrency.processutils [None req-9353fa99-4dcf-479e-b08e-f5350399fcdb None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.028s {{(pid=75740) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:11:40 devstack cinder-volume[75740]: DEBUG oslo_concurrency.processutils [None req-9353fa99-4dcf-479e-b08e-f5350399fcdb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75740) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:11:40 devstack sudo[75839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 29 18:11:40 devstack sudo[75839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:11:41 devstack sudo[75839]: pam_unix(sudo:session): session closed for user root Sep 29 18:11:41 devstack cinder-volume[75740]: DEBUG oslo_concurrency.processutils [None req-9353fa99-4dcf-479e-b08e-f5350399fcdb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.327s {{(pid=75740) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:11:41 devstack cinder-volume[75740]: DEBUG cinder.brick.local_dev.lvm [None req-9353fa99-4dcf-479e-b08e-f5350399fcdb None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75740) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Sep 29 18:11:41 devstack cinder-volume[75740]: DEBUG oslo_concurrency.processutils [None req-9353fa99-4dcf-479e-b08e-f5350399fcdb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75740) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:11:41 devstack sudo[75947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 29 18:11:41 devstack sudo[75947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:11:41 devstack sudo[75947]: pam_unix(sudo:session): session closed for user root Sep 29 18:11:41 devstack cinder-volume[75740]: DEBUG oslo_concurrency.processutils [None req-9353fa99-4dcf-479e-b08e-f5350399fcdb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.518s {{(pid=75740) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:11:41 devstack cinder-volume[75740]: DEBUG oslo_concurrency.processutils [None req-9353fa99-4dcf-479e-b08e-f5350399fcdb None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75740) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:11:41 devstack cinder-volume[75740]: DEBUG oslo_concurrency.processutils [None req-9353fa99-4dcf-479e-b08e-f5350399fcdb None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=75740) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:11:41 devstack cinder-volume[75740]: DEBUG oslo_concurrency.processutils [None req-9353fa99-4dcf-479e-b08e-f5350399fcdb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75740) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:11:41 devstack sudo[76150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 29 18:11:41 devstack sudo[76150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:11:42 devstack sudo[76150]: pam_unix(sudo:session): session closed for user root Sep 29 18:11:42 devstack cinder-volume[75740]: DEBUG oslo_concurrency.processutils [None req-9353fa99-4dcf-479e-b08e-f5350399fcdb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.256s {{(pid=75740) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:11:42 devstack cinder-volume[75740]: DEBUG oslo_concurrency.processutils [None req-9353fa99-4dcf-479e-b08e-f5350399fcdb None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75740) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:11:42 devstack cinder-volume[75740]: DEBUG oslo_concurrency.processutils [None req-9353fa99-4dcf-479e-b08e-f5350399fcdb None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=75740) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:11:42 devstack cinder-volume[75740]: DEBUG oslo_concurrency.processutils [None req-9353fa99-4dcf-479e-b08e-f5350399fcdb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75740) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:11:42 devstack sudo[76240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Sep 29 18:11:42 devstack sudo[76240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:11:42 devstack sudo[76240]: pam_unix(sudo:session): session closed for user root Sep 29 18:11:42 devstack cinder-volume[75740]: DEBUG oslo_concurrency.processutils [None req-9353fa99-4dcf-479e-b08e-f5350399fcdb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.274s {{(pid=75740) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:11:42 devstack cinder-volume[75740]: DEBUG oslo_concurrency.processutils [None req-9353fa99-4dcf-479e-b08e-f5350399fcdb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75740) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:11:42 devstack sudo[76350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 29 18:11:42 devstack sudo[76350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:11:42 devstack sudo[76350]: pam_unix(sudo:session): session closed for user root Sep 29 18:11:42 devstack cinder-volume[75740]: DEBUG oslo_concurrency.processutils [None req-9353fa99-4dcf-479e-b08e-f5350399fcdb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.283s {{(pid=75740) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:11:42 devstack cinder-volume[75740]: DEBUG oslo_concurrency.processutils [None req-9353fa99-4dcf-479e-b08e-f5350399fcdb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75740) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:11:42 devstack sudo[76363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 29 18:11:42 devstack sudo[76363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:11:42 devstack sudo[76363]: pam_unix(sudo:session): session closed for user root Sep 29 18:11:42 devstack cinder-volume[75740]: DEBUG oslo_concurrency.processutils [None req-9353fa99-4dcf-479e-b08e-f5350399fcdb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.286s {{(pid=75740) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:11:42 devstack cinder-volume[75740]: DEBUG oslo_concurrency.processutils [None req-9353fa99-4dcf-479e-b08e-f5350399fcdb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75740) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:11:42 devstack sudo[76434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 29 18:11:42 devstack sudo[76434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:11:43 devstack sudo[76434]: pam_unix(sudo:session): session closed for user root Sep 29 18:11:43 devstack cinder-volume[75740]: DEBUG oslo_concurrency.processutils [None req-9353fa99-4dcf-479e-b08e-f5350399fcdb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.273s {{(pid=75740) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:11:43 devstack cinder-volume[75740]: DEBUG oslo_concurrency.processutils [None req-9353fa99-4dcf-479e-b08e-f5350399fcdb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75740) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:11:43 devstack sudo[76449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 29 18:11:43 devstack sudo[76449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:11:43 devstack sudo[76449]: pam_unix(sudo:session): session closed for user root Sep 29 18:11:43 devstack cinder-volume[75740]: DEBUG oslo_concurrency.processutils [None req-9353fa99-4dcf-479e-b08e-f5350399fcdb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.289s {{(pid=75740) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:11:43 devstack cinder-volume[75740]: DEBUG oslo_concurrency.processutils [None req-9353fa99-4dcf-479e-b08e-f5350399fcdb None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75740) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:11:43 devstack cinder-volume[75740]: DEBUG oslo_concurrency.processutils [None req-9353fa99-4dcf-479e-b08e-f5350399fcdb None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=75740) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:11:43 devstack cinder-volume[75740]: DEBUG oslo_concurrency.processutils [None req-9353fa99-4dcf-479e-b08e-f5350399fcdb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75740) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:11:43 devstack sudo[76481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 29 18:11:43 devstack sudo[76481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:11:43 devstack sudo[76481]: pam_unix(sudo:session): session closed for user root Sep 29 18:11:43 devstack cinder-volume[75740]: DEBUG oslo_concurrency.processutils [None req-9353fa99-4dcf-479e-b08e-f5350399fcdb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.316s {{(pid=75740) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:11:43 devstack cinder-volume[75740]: INFO cinder.volume.drivers.lvm [None req-9353fa99-4dcf-479e-b08e-f5350399fcdb None None] Enabling LVM thin provisioning by default because a thin pool exists. Sep 29 18:11:43 devstack cinder-volume[75740]: DEBUG oslo_concurrency.processutils [None req-9353fa99-4dcf-479e-b08e-f5350399fcdb None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75740) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:11:43 devstack cinder-volume[75740]: DEBUG oslo_concurrency.processutils [None req-9353fa99-4dcf-479e-b08e-f5350399fcdb None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=75740) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:11:43 devstack cinder-volume[75740]: DEBUG oslo_concurrency.processutils [None req-9353fa99-4dcf-479e-b08e-f5350399fcdb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75740) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:11:43 devstack sudo[76543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 29 18:11:43 devstack sudo[76543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:11:44 devstack sudo[76543]: pam_unix(sudo:session): session closed for user root Sep 29 18:11:44 devstack cinder-volume[75740]: DEBUG oslo_concurrency.processutils [None req-9353fa99-4dcf-479e-b08e-f5350399fcdb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.291s {{(pid=75740) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:11:44 devstack cinder-volume[75740]: DEBUG cinder.volume.drivers.lvm [None req-9353fa99-4dcf-479e-b08e-f5350399fcdb None None] Updating volume stats {{(pid=75740) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 29 18:11:44 devstack cinder-volume[75740]: DEBUG oslo_concurrency.processutils [None req-9353fa99-4dcf-479e-b08e-f5350399fcdb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75740) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:11:44 devstack sudo[76546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 29 18:11:44 devstack sudo[76546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:11:44 devstack sudo[76546]: pam_unix(sudo:session): session closed for user root Sep 29 18:11:44 devstack cinder-volume[75740]: DEBUG oslo_concurrency.processutils [None req-9353fa99-4dcf-479e-b08e-f5350399fcdb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.277s {{(pid=75740) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:11:44 devstack cinder-volume[75740]: DEBUG oslo_concurrency.processutils [None req-9353fa99-4dcf-479e-b08e-f5350399fcdb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75740) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:11:44 devstack sudo[76555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 29 18:11:44 devstack sudo[76555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:11:44 devstack sudo[76555]: pam_unix(sudo:session): session closed for user root Sep 29 18:11:44 devstack cinder-volume[75740]: DEBUG oslo_concurrency.processutils [None req-9353fa99-4dcf-479e-b08e-f5350399fcdb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.295s {{(pid=75740) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:11:44 devstack cinder-volume[75740]: DEBUG oslo_concurrency.processutils [None req-9353fa99-4dcf-479e-b08e-f5350399fcdb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75740) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:11:44 devstack sudo[76558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 29 18:11:44 devstack sudo[76558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:11:44 devstack sudo[76558]: pam_unix(sudo:session): session closed for user root Sep 29 18:11:44 devstack cinder-volume[75740]: DEBUG oslo_concurrency.processutils [None req-9353fa99-4dcf-479e-b08e-f5350399fcdb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.261s {{(pid=75740) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:11:44 devstack cinder-volume[75740]: DEBUG oslo_concurrency.processutils [None req-9353fa99-4dcf-479e-b08e-f5350399fcdb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75740) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:11:44 devstack sudo[76561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 29 18:11:44 devstack sudo[76561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:11:45 devstack sudo[76561]: pam_unix(sudo:session): session closed for user root Sep 29 18:11:45 devstack cinder-volume[75740]: DEBUG oslo_concurrency.processutils [None req-9353fa99-4dcf-479e-b08e-f5350399fcdb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.265s {{(pid=75740) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:11:45 devstack cinder-volume[75740]: INFO cinder.volume.driver [None req-9353fa99-4dcf-479e-b08e-f5350399fcdb None None] Driver hasn't implemented _init_vendor_properties() Sep 29 18:11:45 devstack cinder-volume[75740]: DEBUG cinder.volume.driver [None req-9353fa99-4dcf-479e-b08e-f5350399fcdb None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75740) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 29 18:11:45 devstack cinder-volume[75740]: DEBUG oslo_db.sqlalchemy.engines [None req-9353fa99-4dcf-479e-b08e-f5350399fcdb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75740) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 29 18:11:45 devstack cinder-volume[75740]: DEBUG dbcounter [-] [75740] Writer thread running {{(pid=75740) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 29 18:11:45 devstack cinder-volume[75740]: DEBUG cinder.db.api [None req-9353fa99-4dcf-479e-b08e-f5350399fcdb None None] Building query based on filter {{(pid=75740) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 29 18:11:45 devstack cinder-volume[75740]: DEBUG cinder.image.image_utils [None req-9353fa99-4dcf-479e-b08e-f5350399fcdb None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75740) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 29 18:11:45 devstack cinder-volume[75740]: INFO cinder.keymgr.migration [None req-dbc499c4-e3bc-473b-9fd5-0f273a85c94c None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 29 18:11:45 devstack cinder-volume[75740]: DEBUG cinder.volume.drivers.lvm [None req-9353fa99-4dcf-479e-b08e-f5350399fcdb None None] Updating volume stats {{(pid=75740) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 29 18:11:45 devstack cinder-volume[75740]: DEBUG oslo_concurrency.processutils [None req-9353fa99-4dcf-479e-b08e-f5350399fcdb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75740) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:11:45 devstack sudo[76565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 29 18:11:45 devstack sudo[76565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:11:45 devstack sudo[76565]: pam_unix(sudo:session): session closed for user root Sep 29 18:11:45 devstack cinder-volume[75740]: DEBUG oslo_concurrency.processutils [None req-9353fa99-4dcf-479e-b08e-f5350399fcdb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.272s {{(pid=75740) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:11:45 devstack cinder-volume[75740]: DEBUG oslo_concurrency.processutils [None req-9353fa99-4dcf-479e-b08e-f5350399fcdb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75740) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:11:45 devstack sudo[76568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 29 18:11:45 devstack sudo[76568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:11:45 devstack sudo[76568]: pam_unix(sudo:session): session closed for user root Sep 29 18:11:45 devstack cinder-volume[75740]: DEBUG oslo_concurrency.processutils [None req-9353fa99-4dcf-479e-b08e-f5350399fcdb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=75740) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:11:45 devstack cinder-volume[75740]: DEBUG oslo_concurrency.processutils [None req-9353fa99-4dcf-479e-b08e-f5350399fcdb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75740) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:11:45 devstack sudo[76573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 29 18:11:45 devstack sudo[76573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:11:46 devstack sudo[76573]: pam_unix(sudo:session): session closed for user root Sep 29 18:11:46 devstack cinder-volume[75740]: DEBUG oslo_concurrency.processutils [None req-9353fa99-4dcf-479e-b08e-f5350399fcdb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.243s {{(pid=75740) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:11:46 devstack cinder-volume[75740]: DEBUG oslo_concurrency.processutils [None req-9353fa99-4dcf-479e-b08e-f5350399fcdb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75740) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:11:46 devstack sudo[76576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 29 18:11:46 devstack sudo[76576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:11:46 devstack sudo[76576]: pam_unix(sudo:session): session closed for user root Sep 29 18:11:46 devstack cinder-volume[75740]: DEBUG oslo_concurrency.processutils [None req-9353fa99-4dcf-479e-b08e-f5350399fcdb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.279s {{(pid=75740) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:11:46 devstack cinder-volume[75740]: DEBUG cinder.manager [None req-9353fa99-4dcf-479e-b08e-f5350399fcdb None None] Notifying Schedulers of capabilities ... {{(pid=75740) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:11:46 devstack cinder-volume[75740]: INFO cinder.volume.manager [None req-9353fa99-4dcf-479e-b08e-f5350399fcdb None None] Driver initialization completed successfully. Sep 29 18:11:46 devstack cinder-volume[75740]: INFO cinder.manager [None req-9353fa99-4dcf-479e-b08e-f5350399fcdb None None] Initiating service 2 cleanup Sep 29 18:11:46 devstack cinder-volume[75740]: INFO cinder.manager [None req-9353fa99-4dcf-479e-b08e-f5350399fcdb None None] Service 2 cleanup completed. Sep 29 18:11:46 devstack cinder-volume[75740]: DEBUG cinder.service [None req-9353fa99-4dcf-479e-b08e-f5350399fcdb None None] Creating RPC server for service cinder-volume {{(pid=75740) start /opt/stack/cinder/cinder/service.py:231}} Sep 29 18:11:46 devstack cinder-volume[75740]: DEBUG cinder.service [None req-9353fa99-4dcf-479e-b08e-f5350399fcdb None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75740) start /opt/stack/cinder/cinder/service.py:237}} Sep 29 18:11:46 devstack cinder-volume[75740]: INFO cinder.volume.manager [None req-9353fa99-4dcf-479e-b08e-f5350399fcdb None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Sep 29 18:11:46 devstack cinder-volume[75740]: DEBUG cinder.volume.drivers.lvm [None req-9353fa99-4dcf-479e-b08e-f5350399fcdb None None] Updating volume stats {{(pid=75740) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 29 18:11:46 devstack cinder-volume[75740]: DEBUG oslo_concurrency.processutils [None req-9353fa99-4dcf-479e-b08e-f5350399fcdb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75740) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:11:46 devstack sudo[76580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 29 18:11:46 devstack sudo[76580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:11:46 devstack sudo[76580]: pam_unix(sudo:session): session closed for user root Sep 29 18:11:46 devstack cinder-volume[75740]: DEBUG oslo_concurrency.processutils [None req-9353fa99-4dcf-479e-b08e-f5350399fcdb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.286s {{(pid=75740) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:11:46 devstack cinder-volume[75740]: DEBUG oslo_concurrency.processutils [None req-9353fa99-4dcf-479e-b08e-f5350399fcdb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75740) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:11:46 devstack sudo[76583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 29 18:11:46 devstack sudo[76583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:11:47 devstack sudo[76583]: pam_unix(sudo:session): session closed for user root Sep 29 18:11:47 devstack cinder-volume[75740]: DEBUG oslo_concurrency.processutils [None req-9353fa99-4dcf-479e-b08e-f5350399fcdb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.279s {{(pid=75740) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:11:47 devstack cinder-volume[75740]: DEBUG oslo_concurrency.processutils [None req-9353fa99-4dcf-479e-b08e-f5350399fcdb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75740) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:11:47 devstack sudo[76588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 29 18:11:47 devstack sudo[76588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:11:47 devstack sudo[76588]: pam_unix(sudo:session): session closed for user root Sep 29 18:11:47 devstack cinder-volume[75740]: DEBUG oslo_concurrency.processutils [None req-9353fa99-4dcf-479e-b08e-f5350399fcdb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.270s {{(pid=75740) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:11:47 devstack cinder-volume[75740]: DEBUG oslo_concurrency.processutils [None req-9353fa99-4dcf-479e-b08e-f5350399fcdb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75740) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:11:47 devstack sudo[76594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 29 18:11:47 devstack sudo[76594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:11:47 devstack sudo[76594]: pam_unix(sudo:session): session closed for user root Sep 29 18:11:47 devstack cinder-volume[75740]: DEBUG oslo_concurrency.processutils [None req-9353fa99-4dcf-479e-b08e-f5350399fcdb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.246s {{(pid=75740) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:11:47 devstack cinder-volume[75740]: INFO cinder.volume.manager [None req-9353fa99-4dcf-479e-b08e-f5350399fcdb None None] Driver post RPC initialization completed successfully. Sep 29 18:11:50 devstack cinder-volume[75585]: DEBUG dbcounter [-] [75585] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75585) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 18:11:56 devstack cinder-volume[75740]: DEBUG dbcounter [-] [75740] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75740) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 18:11:57 devstack cinder-volume[75740]: DEBUG dbcounter [-] [75740] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=75740) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 18:12:05 devstack cinder-volume[75740]: DEBUG oslo_service.periodic_task [None req-281597d4-5218-4bc1-84a4-977a31984635 None None] Running periodic task VolumeManager._thread_info {{(pid=75740) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 18:12:05 devstack cinder-volume[75740]: DEBUG cinder.volume.manager [None req-281597d4-5218-4bc1-84a4-977a31984635 None None] thread count: 6 {{(pid=75740) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 29 18:12:05 devstack cinder-volume[75740]: DEBUG cinder.volume.manager [None req-281597d4-5218-4bc1-84a4-977a31984635 None None] thread info: [<_MainThread(MainThread, started 129247755542656)>, , , , , ] {{(pid=75740) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 29 18:13:05 devstack cinder-volume[75740]: DEBUG oslo_service.periodic_task [None req-281597d4-5218-4bc1-84a4-977a31984635 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75740) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 18:13:05 devstack cinder-volume[75740]: DEBUG cinder.volume.drivers.lvm [None req-281597d4-5218-4bc1-84a4-977a31984635 None None] Updating volume stats {{(pid=75740) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 29 18:13:05 devstack cinder-volume[75740]: DEBUG oslo_concurrency.processutils [None req-281597d4-5218-4bc1-84a4-977a31984635 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75740) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:13:05 devstack sudo[79123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 29 18:13:05 devstack sudo[79123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:13:06 devstack sudo[79123]: pam_unix(sudo:session): session closed for user root Sep 29 18:13:06 devstack cinder-volume[75740]: DEBUG oslo_concurrency.processutils [None req-281597d4-5218-4bc1-84a4-977a31984635 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=75740) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:13:06 devstack cinder-volume[75740]: DEBUG oslo_concurrency.processutils [None req-281597d4-5218-4bc1-84a4-977a31984635 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75740) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:13:06 devstack sudo[79127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 29 18:13:06 devstack sudo[79127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:13:06 devstack sudo[79127]: pam_unix(sudo:session): session closed for user root Sep 29 18:13:06 devstack cinder-volume[75740]: DEBUG oslo_concurrency.processutils [None req-281597d4-5218-4bc1-84a4-977a31984635 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.275s {{(pid=75740) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:13:06 devstack cinder-volume[75740]: DEBUG oslo_concurrency.processutils [None req-281597d4-5218-4bc1-84a4-977a31984635 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75740) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:13:06 devstack sudo[79130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 29 18:13:06 devstack sudo[79130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:13:06 devstack sudo[79130]: pam_unix(sudo:session): session closed for user root Sep 29 18:13:06 devstack cinder-volume[75740]: DEBUG oslo_concurrency.processutils [None req-281597d4-5218-4bc1-84a4-977a31984635 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.278s {{(pid=75740) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:13:06 devstack cinder-volume[75740]: DEBUG oslo_concurrency.processutils [None req-281597d4-5218-4bc1-84a4-977a31984635 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75740) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:13:06 devstack sudo[79133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 29 18:13:06 devstack sudo[79133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:13:06 devstack sudo[79133]: pam_unix(sudo:session): session closed for user root Sep 29 18:13:06 devstack cinder-volume[75740]: DEBUG oslo_concurrency.processutils [None req-281597d4-5218-4bc1-84a4-977a31984635 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.276s {{(pid=75740) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:13:06 devstack cinder-volume[75740]: DEBUG cinder.manager [None req-281597d4-5218-4bc1-84a4-977a31984635 None None] Notifying Schedulers of capabilities ... {{(pid=75740) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:13:06 devstack cinder-volume[75740]: DEBUG oslo_service.periodic_task [None req-281597d4-5218-4bc1-84a4-977a31984635 None None] Running periodic task VolumeManager._thread_info {{(pid=75740) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 18:13:06 devstack cinder-volume[75740]: DEBUG cinder.volume.manager [None req-281597d4-5218-4bc1-84a4-977a31984635 None None] thread count: 6 {{(pid=75740) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 29 18:13:06 devstack cinder-volume[75740]: DEBUG cinder.volume.manager [None req-281597d4-5218-4bc1-84a4-977a31984635 None None] thread info: [<_MainThread(MainThread, started 129247755542656)>, , , , , ] {{(pid=75740) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 29 18:13:57 devstack cinder-volume[75740]: DEBUG dbcounter [-] [75740] Writing DB stats cinder:SELECT=1 {{(pid=75740) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 18:13:57 devstack cinder-volume[75740]: DEBUG dbcounter [-] [75740] Writing DB stats cinder:UPDATE=1 {{(pid=75740) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 18:14:05 devstack cinder-volume[75740]: DEBUG oslo_service.periodic_task [None req-281597d4-5218-4bc1-84a4-977a31984635 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75740) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 18:14:05 devstack cinder-volume[75740]: DEBUG cinder.volume.drivers.lvm [None req-281597d4-5218-4bc1-84a4-977a31984635 None None] Updating volume stats {{(pid=75740) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 29 18:14:05 devstack cinder-volume[75740]: DEBUG oslo_concurrency.processutils [None req-281597d4-5218-4bc1-84a4-977a31984635 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75740) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:14:05 devstack sudo[82478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 29 18:14:05 devstack sudo[82478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:14:06 devstack sudo[82478]: pam_unix(sudo:session): session closed for user root Sep 29 18:14:06 devstack cinder-volume[75740]: DEBUG oslo_concurrency.processutils [None req-281597d4-5218-4bc1-84a4-977a31984635 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=75740) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:14:06 devstack cinder-volume[75740]: DEBUG oslo_concurrency.processutils [None req-281597d4-5218-4bc1-84a4-977a31984635 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75740) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:14:06 devstack sudo[82678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 29 18:14:06 devstack sudo[82678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:14:06 devstack sudo[82678]: pam_unix(sudo:session): session closed for user root Sep 29 18:14:06 devstack cinder-volume[75740]: DEBUG oslo_concurrency.processutils [None req-281597d4-5218-4bc1-84a4-977a31984635 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=75740) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:14:06 devstack cinder-volume[75740]: DEBUG oslo_concurrency.processutils [None req-281597d4-5218-4bc1-84a4-977a31984635 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75740) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:14:06 devstack sudo[82745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 29 18:14:06 devstack sudo[82745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:14:06 devstack sudo[82745]: pam_unix(sudo:session): session closed for user root Sep 29 18:14:06 devstack cinder-volume[75740]: DEBUG oslo_concurrency.processutils [None req-281597d4-5218-4bc1-84a4-977a31984635 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.254s {{(pid=75740) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:14:06 devstack cinder-volume[75740]: DEBUG oslo_concurrency.processutils [None req-281597d4-5218-4bc1-84a4-977a31984635 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75740) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:14:06 devstack sudo[82753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 29 18:14:06 devstack sudo[82753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:14:06 devstack sudo[82753]: pam_unix(sudo:session): session closed for user root Sep 29 18:14:06 devstack cinder-volume[75740]: DEBUG oslo_concurrency.processutils [None req-281597d4-5218-4bc1-84a4-977a31984635 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.249s {{(pid=75740) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:14:06 devstack cinder-volume[75740]: DEBUG cinder.manager [None req-281597d4-5218-4bc1-84a4-977a31984635 None None] Notifying Schedulers of capabilities ... {{(pid=75740) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:15:05 devstack cinder-volume[75740]: DEBUG oslo_service.periodic_task [None req-281597d4-5218-4bc1-84a4-977a31984635 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75740) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 18:15:05 devstack cinder-volume[75740]: DEBUG cinder.volume.drivers.lvm [None req-281597d4-5218-4bc1-84a4-977a31984635 None None] Updating volume stats {{(pid=75740) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 29 18:15:05 devstack cinder-volume[75740]: DEBUG oslo_concurrency.processutils [None req-281597d4-5218-4bc1-84a4-977a31984635 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75740) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:15:05 devstack sudo[84364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 29 18:15:05 devstack sudo[84364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:15:06 devstack sudo[84364]: pam_unix(sudo:session): session closed for user root Sep 29 18:15:06 devstack cinder-volume[75740]: DEBUG oslo_concurrency.processutils [None req-281597d4-5218-4bc1-84a4-977a31984635 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.285s {{(pid=75740) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:15:06 devstack cinder-volume[75740]: DEBUG oslo_concurrency.processutils [None req-281597d4-5218-4bc1-84a4-977a31984635 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75740) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:15:06 devstack sudo[84367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 29 18:15:06 devstack sudo[84367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:15:06 devstack sudo[84367]: pam_unix(sudo:session): session closed for user root Sep 29 18:15:06 devstack cinder-volume[75740]: DEBUG oslo_concurrency.processutils [None req-281597d4-5218-4bc1-84a4-977a31984635 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.293s {{(pid=75740) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:15:06 devstack cinder-volume[75740]: DEBUG oslo_concurrency.processutils [None req-281597d4-5218-4bc1-84a4-977a31984635 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75740) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:15:06 devstack sudo[84384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 29 18:15:06 devstack sudo[84384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:15:06 devstack sudo[84384]: pam_unix(sudo:session): session closed for user root Sep 29 18:15:06 devstack cinder-volume[75740]: DEBUG oslo_concurrency.processutils [None req-281597d4-5218-4bc1-84a4-977a31984635 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.279s {{(pid=75740) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:15:06 devstack cinder-volume[75740]: DEBUG oslo_concurrency.processutils [None req-281597d4-5218-4bc1-84a4-977a31984635 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75740) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:15:06 devstack sudo[84396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 29 18:15:06 devstack sudo[84396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:15:06 devstack sudo[84396]: pam_unix(sudo:session): session closed for user root Sep 29 18:15:06 devstack cinder-volume[75740]: DEBUG oslo_concurrency.processutils [None req-281597d4-5218-4bc1-84a4-977a31984635 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=75740) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:15:06 devstack cinder-volume[75740]: DEBUG cinder.manager [None req-281597d4-5218-4bc1-84a4-977a31984635 None None] Notifying Schedulers of capabilities ... {{(pid=75740) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:15:06 devstack cinder-volume[75740]: DEBUG oslo_service.periodic_task [None req-281597d4-5218-4bc1-84a4-977a31984635 None None] Running periodic task VolumeManager._thread_info {{(pid=75740) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 18:15:06 devstack cinder-volume[75740]: DEBUG cinder.volume.manager [None req-281597d4-5218-4bc1-84a4-977a31984635 None None] thread count: 6 {{(pid=75740) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 29 18:15:06 devstack cinder-volume[75740]: DEBUG cinder.volume.manager [None req-281597d4-5218-4bc1-84a4-977a31984635 None None] thread info: [<_MainThread(MainThread, started 129247755542656)>, , , , , ] {{(pid=75740) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 29 18:15:57 devstack cinder-volume[75740]: DEBUG dbcounter [-] [75740] Writing DB stats cinder:SELECT=1 {{(pid=75740) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 18:15:57 devstack cinder-volume[75740]: DEBUG dbcounter [-] [75740] Writing DB stats cinder:UPDATE=1 {{(pid=75740) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 18:16:05 devstack cinder-volume[75740]: DEBUG oslo_service.periodic_task [None req-281597d4-5218-4bc1-84a4-977a31984635 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75740) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 18:16:05 devstack cinder-volume[75740]: DEBUG cinder.volume.drivers.lvm [None req-281597d4-5218-4bc1-84a4-977a31984635 None None] Updating volume stats {{(pid=75740) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 29 18:16:05 devstack cinder-volume[75740]: DEBUG oslo_concurrency.processutils [None req-281597d4-5218-4bc1-84a4-977a31984635 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75740) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:16:05 devstack sudo[85549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 29 18:16:05 devstack sudo[85549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:16:06 devstack sudo[85549]: pam_unix(sudo:session): session closed for user root Sep 29 18:16:06 devstack cinder-volume[75740]: DEBUG oslo_concurrency.processutils [None req-281597d4-5218-4bc1-84a4-977a31984635 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=75740) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:16:06 devstack cinder-volume[75740]: DEBUG oslo_concurrency.processutils [None req-281597d4-5218-4bc1-84a4-977a31984635 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75740) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:16:06 devstack sudo[85552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 29 18:16:06 devstack sudo[85552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:16:06 devstack sudo[85552]: pam_unix(sudo:session): session closed for user root Sep 29 18:16:06 devstack cinder-volume[75740]: DEBUG oslo_concurrency.processutils [None req-281597d4-5218-4bc1-84a4-977a31984635 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.271s {{(pid=75740) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:16:06 devstack cinder-volume[75740]: DEBUG oslo_concurrency.processutils [None req-281597d4-5218-4bc1-84a4-977a31984635 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75740) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:16:06 devstack sudo[85578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 29 18:16:06 devstack sudo[85578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:16:06 devstack sudo[85578]: pam_unix(sudo:session): session closed for user root Sep 29 18:16:06 devstack cinder-volume[75740]: DEBUG oslo_concurrency.processutils [None req-281597d4-5218-4bc1-84a4-977a31984635 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.254s {{(pid=75740) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:16:06 devstack cinder-volume[75740]: DEBUG oslo_concurrency.processutils [None req-281597d4-5218-4bc1-84a4-977a31984635 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75740) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:16:06 devstack sudo[85581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 29 18:16:06 devstack sudo[85581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:16:06 devstack sudo[85581]: pam_unix(sudo:session): session closed for user root Sep 29 18:16:06 devstack cinder-volume[75740]: DEBUG oslo_concurrency.processutils [None req-281597d4-5218-4bc1-84a4-977a31984635 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=75740) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:16:06 devstack cinder-volume[75740]: DEBUG cinder.manager [None req-281597d4-5218-4bc1-84a4-977a31984635 None None] Notifying Schedulers of capabilities ... {{(pid=75740) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:16:06 devstack cinder-volume[75740]: DEBUG oslo_service.periodic_task [None req-281597d4-5218-4bc1-84a4-977a31984635 None None] Running periodic task VolumeManager._thread_info {{(pid=75740) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 18:16:06 devstack cinder-volume[75740]: DEBUG cinder.volume.manager [None req-281597d4-5218-4bc1-84a4-977a31984635 None None] thread count: 6 {{(pid=75740) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 29 18:16:06 devstack cinder-volume[75740]: DEBUG cinder.volume.manager [None req-281597d4-5218-4bc1-84a4-977a31984635 None None] thread info: [<_MainThread(MainThread, started 129247755542656)>, , , , , ] {{(pid=75740) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 29 18:16:08 devstack cinder-volume[75585]: INFO oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] Caught SIGTERM, stopping children Sep 29 18:16:08 devstack cinder-volume[75585]: DEBUG oslo_concurrency.lockutils [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] Acquiring lock "singleton_lock" {{(pid=75585) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 29 18:16:08 devstack cinder-volume[75585]: DEBUG oslo_concurrency.lockutils [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] Acquired lock "singleton_lock" {{(pid=75585) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 29 18:16:08 devstack cinder-volume[75585]: DEBUG oslo_concurrency.lockutils [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] Releasing lock "singleton_lock" {{(pid=75585) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 29 18:16:08 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] Stop services. {{(pid=75585) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 29 18:16:08 devstack cinder-volume[75585]: DEBUG oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] Killing children. {{(pid=75585) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 29 18:16:08 devstack cinder-volume[75585]: INFO oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] Waiting on 1 children to exit Sep 29 18:16:11 devstack cinder-volume[75740]: DEBUG oslo_concurrency.lockutils [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] Acquiring lock "singleton_lock" {{(pid=75740) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 29 18:16:11 devstack cinder-volume[75740]: DEBUG oslo_concurrency.lockutils [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] Acquired lock "singleton_lock" {{(pid=75740) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 29 18:16:11 devstack cinder-volume[75740]: DEBUG oslo_concurrency.lockutils [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] Releasing lock "singleton_lock" {{(pid=75740) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 29 18:16:11 devstack cinder-volume[75740]: WARNING amqp [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 29 18:16:11 devstack cinder-volume[75740]: WARNING amqp [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 29 18:16:11 devstack cinder-volume[75585]: INFO oslo_service.backend._eventlet.service [None req-581b756c-acb5-4b17-a005-7638a2260d94 None None] Child 75740 exited with status 0 Sep 29 18:16:12 devstack cinder-volume[85690]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 29 18:16:12 devstack cinder-volume[85690]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 29 18:16:12 devstack cinder-volume[85690]: we strongly recommend against using it for new projects. Sep 29 18:16:12 devstack cinder-volume[85690]: If you are already using Eventlet, we recommend migrating to a different Sep 29 18:16:12 devstack cinder-volume[85690]: framework. For more detail see Sep 29 18:16:12 devstack cinder-volume[85690]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 29 18:16:12 devstack cinder-volume[85690]: import eventlet # noqa Sep 29 18:16:14 devstack cinder-volume[85690]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=85690) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 29 18:16:14 devstack cinder-volume[85690]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=85690) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 29 18:16:14 devstack cinder-volume[85690]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=85690) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 29 18:16:14 devstack cinder-volume[85690]: INFO dbcounter [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] Registered counter for database cinder Sep 29 18:16:14 devstack cinder-volume[85690]: DEBUG oslo_db.sqlalchemy.engines [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85690) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG dbcounter [-] [85690] Writer thread running {{(pid=85690) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 29 18:16:15 devstack cinder-volume[85690]: INFO cinder.rpc [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 29 18:16:15 devstack cinder-volume[85690]: INFO cinder.rpc [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_db.sqlalchemy.engines [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85690) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 29 18:16:15 devstack cinder-volume[85690]: INFO cinder.volume.manager [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] Determined volume DB was empty at startup. Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG cinder.volume.manager [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] Cinder Volume DB check: vol_db_empty=True {{(pid=85690) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 29 18:16:15 devstack cinder-volume[85690]: INFO cinder.volume.manager [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 29 18:16:15 devstack cinder-volume[85690]: WARNING stevedore.named [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 29 18:16:15 devstack cinder-volume[85690]: WARNING castellan.key_manager [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 29 18:16:15 devstack cinder-volume[85690]: WARNING cinder.keymgr.conf_key_mgr [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 29 18:16:15 devstack cinder-volume[85690]: INFO cinder.volume.manager [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_db.sqlalchemy.engines [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85690) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 29 18:16:15 devstack cinder-volume[85690]: INFO oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] Starting 1 workers Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] Started child 85905 {{(pid=85690) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] Full set of CONF: {{(pid=85690) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] ******************************************************************************** {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] Configuration options gathered from: {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] ================================================================================ {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] allow_availability_zone_fallback = False {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] allow_compression_on_image_upload = False {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] allowed_direct_url_schemes = [] {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] api_rate_limit = True {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] auth_strategy = keystone {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] backend_availability_zone = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] backend_host = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] backend_name = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] backend_stats_polling_interval = 60 {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] backup_api_class = cinder.backup.api.API {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] backup_name_template = backup-%s {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] backup_use_same_host = False {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] backup_use_temp_snapshot = False {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] chap_password = **** {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] chap_username = {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] cinder_internal_tenant_project_id = 98c3bbed4ea04d8892505e8124d76ed3 {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85905]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.0) Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] cinder_internal_tenant_user_id = 659377bd1cb343e8bbaa439133cdccd4 {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] cluster = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] compression_format = gzip {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] compute_api_class = cinder.compute.nova.API {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] config_dir = [] {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] config_source = [] {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] control_exchange = openstack {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] debug = True {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] default_availability_zone = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] default_group_type = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] default_volume_type = QuobyteHD {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] disk_geometry = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] driver_client_cert = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] driver_client_cert_key = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] driver_data_namespace = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] driver_ssl_cert_path = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] driver_ssl_cert_verify = False {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] driver_use_ssl = False {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] enable_new_services = True {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] enable_unsupported_driver = False {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] enabled_backends = ['QuobyteHD'] {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] enforce_multipath_for_image_xfer = False {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] filter_function = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] glance_api_insecure = False {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] glance_api_servers = ['http://192.168.122.67/image'] {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] glance_api_ssl_compression = False {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] glance_ca_certificates_file = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] glance_catalog_info = image:glance:publicURL {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] glance_certfile = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] glance_keyfile = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] glance_num_retries = 3 {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] glance_request_timeout = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] goodness_function = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] graceful_shutdown_timeout = 5 {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] group_api_class = cinder.group.api.API {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] host = devstack {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] image_compress_on_upload = True {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] image_conversion_address_space_limit = 1 {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] image_conversion_cpu_limit = 60 {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] image_conversion_disable = False {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] image_introspection_address_space_limit = 1 {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] image_introspection_cpu_limit = 60 {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] image_upload_use_cinder_backend = False {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] image_upload_use_internal_tenant = False {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] image_volume_cache_enabled = False {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] image_volume_cache_max_count = 0 {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] image_volume_cache_max_size_gb = 0 {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] init_host_max_objects_retrieval = 0 {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] instance_format = [instance: %(uuid)s] {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] iscsi_target_flags = {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] iscsi_write_cache = on {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] iser_helper = tgtadm {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] iser_ip_address = 192.168.122.67 {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] iser_port = 3260 {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] log_color = False {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] log_config_append = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] log_dir = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] log_file = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] log_options = True {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] log_rotate_interval = 1 {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] log_rotate_interval_type = days {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] log_rotation_type = none {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] max_age = 0 {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] max_logfile_count = 30 {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] max_logfile_size_mb = 200 {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] max_over_subscription_ratio = 20.0 {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] message_reap_interval = 86400 {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] message_ttl = 2592000 {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] migration_create_volume_timeout_secs = 300 {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] monkey_patch = False {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] monkey_patch_modules = [] {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] my_ip = 192.168.122.67 {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] no_snapshot_gb_quota = False {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] num_iser_scan_tries = 3 {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] num_shell_tries = 3 {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] num_volume_device_scan_tries = 3 {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] nvmeof_conn_info_version = 1 {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] nvmet_ns_id = 10 {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] nvmet_port_id = 1 {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] osapi_max_limit = 1000 {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] osapi_volume_ext_list = [] {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] osapi_volume_listen = 0.0.0.0 {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] osapi_volume_listen_port = 8776 {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] osapi_volume_use_ssl = False {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] osapi_volume_workers = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] per_volume_size_limit = -1 {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] periodic_fuzzy_delay = 60 {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] periodic_interval = 60 {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] project_id_regex = [0-9a-f\-]+ {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] public_endpoint = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] publish_errors = False {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] quota_backup_gigabytes = 1000 {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] quota_backups = 10 {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] quota_gigabytes = 1000 {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] quota_groups = 10 {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] quota_snapshots = 10 {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] quota_volumes = 10 {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] rate_limit_burst = 0 {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] rate_limit_except_level = CRITICAL {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] rate_limit_interval = 0 {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] reinit_driver_count = 3 {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] replication_device = **** {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] report_discard_supported = False {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] report_interval = 120 {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] reservation_clean_interval = 86400 {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] reservation_expire = 86400 {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] reserved_image_namespaces = [] {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] reserved_percentage = 0 {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] rpc_response_timeout = 120 {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] run_external_periodic_tasks = True {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] scst_target_driver = iscsi {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] scst_target_iqn_name = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] service_down_time = 720 {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] shell_completion = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] snapshot_name_template = snapshot-%s {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] split_loggers = False {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] state_path = /opt/stack/data/cinder {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] storage_availability_zone = nova {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] storage_protocol = iSCSI {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] syslog_log_facility = LOG_USER {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] target_helper = lioadm {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] target_ip_address = 192.168.122.67 {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] target_port = 3260 {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] target_protocol = iscsi {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] target_secondary_ip_addresses = [] {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] trace_flags = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] transfer_api_class = cinder.transfer.api.API {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] transport_url = **** {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] until_refresh = 0 {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] use_chap_auth = False {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] use_default_quota_class = True {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] use_journal = False {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] use_json = False {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] use_multipath_for_image_xfer = False {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85905]: INFO cinder.volume.manager [None req-e675df55-ccfd-4710-a294-074e36f65ae6 None None] Starting volume driver QuobyteDriver (1.2.1) Sep 29 18:16:15 devstack cinder-volume[85905]: DEBUG cinder.volume.drivers.remotefs [None req-e675df55-ccfd-4710-a294-074e36f65ae6 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=85905) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] use_stderr = False {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] use_syslog = False {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] verify_glance_signatures = enabled {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] volume_api_class = cinder.volume.api.API {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] volume_backend_name = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] volume_clear = zero {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] volume_clear_ionice = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] volume_clear_size = 0 {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] volume_copy_bps_limit = 0 {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] volume_dd_blocksize = 1M {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] volume_name_template = volume-%s {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] volume_service_inithost_offload = False {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] volume_usage_audit_period = month {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] zoning_mode = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] oslo_concurrency.disable_process_locking = False {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] os_brick.lightos_discovery_client_address = localhost {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] os_brick.wait_mpath_device_interval = 1 {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] keystone_authtoken.auth_section = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] keystone_authtoken.auth_type = password {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] keystone_authtoken.auth_version = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] keystone_authtoken.cache = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] keystone_authtoken.certfile = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] keystone_authtoken.delay_auth_decision = False {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] keystone_authtoken.http_connect_timeout = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] keystone_authtoken.include_service_catalog = True {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] keystone_authtoken.insecure = False {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] keystone_authtoken.interface = public {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] keystone_authtoken.keyfile = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] keystone_authtoken.memcache_password = **** {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] keystone_authtoken.memcache_secret_key = **** {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] keystone_authtoken.memcache_security_strategy = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] keystone_authtoken.memcache_username = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] keystone_authtoken.region_name = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] keystone_authtoken.service_token_roles_required = True {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] keystone_authtoken.service_type = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] keystone_authtoken.token_cache_time = 300 {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.67/identity {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] cache.backend = dogpile.cache.null {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] cache.backend_argument = **** {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] cache.backend_expiration_time = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] cache.config_prefix = cache.oslo {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] cache.debug_cache_backend = False {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] cache.enable_retry_client = False {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] cache.enable_socket_keepalive = False {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] cache.enabled = False {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] cache.expiration_time = 600 {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] cache.hashclient_dead_timeout = 60.0 {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] cache.hashclient_retry_attempts = 2 {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] cache.hashclient_retry_timeout = 1.0 {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] cache.memcache_dead_retry = 300 {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] cache.memcache_pool_maxsize = 10 {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] cache.memcache_pool_unused_timeout = 60 {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] cache.memcache_sasl_enabled = False {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] cache.memcache_servers = ['localhost:11211'] {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] cache.password = **** {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] cache.proxies = [] {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] cache.redis_db = 0 {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] cache.redis_sentinel_service_name = mymaster {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] cache.redis_server = localhost:6379 {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] cache.retry_attempts = 2 {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] cache.retry_delay = 0.0 {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] cache.socket_keepalive_count = 1 {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] cache.socket_keepalive_idle = 1 {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] cache.socket_keepalive_interval = 1 {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] cache.socket_timeout = 1.0 {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] cache.tls_allowed_ciphers = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] cache.tls_cafile = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] cache.tls_certfile = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] cache.tls_enabled = False {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] cache.tls_keyfile = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] cache.username = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] coordination.backend_url = **** {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] database.asyncio_connection = **** {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] database.asyncio_slave_connection = **** {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] database.backend = sqlalchemy {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] database.connection = **** {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] database.connection_debug = 0 {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] database.connection_parameters = {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] database.connection_recycle_time = 3600 {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] database.connection_trace = False {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] database.db_inc_retry_interval = True {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] database.db_max_retries = 20 {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] database.db_max_retry_interval = 10 {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] database.db_retry_interval = 1 {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] database.max_overflow = 50 {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] database.max_pool_size = 5 {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] database.max_retries = 10 {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] database.mysql_sql_mode = TRADITIONAL {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] database.mysql_wsrep_sync_wait = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] database.pool_timeout = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] database.retry_interval = 10 {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] database.slave_connection = **** {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] database.sqlite_synchronous = True {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] database.synchronous_reader = True {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] database.use_db_reconnect = False {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] oslo_messaging_metrics.metrics_process_name = {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] oslo_messaging_tracing.insecure = False {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] profiler.connection_string = messaging:// {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] profiler.enabled = False {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] profiler.es_doc_type = notification {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] profiler.es_scroll_size = 10000 {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] profiler.es_scroll_time = 2m {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] profiler.filter_error_trace = False {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] profiler.hmac_keys = **** {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] profiler.sentinel_service_name = mymaster {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] profiler.socket_timeout = 0.1 {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] profiler.trace_requests = False {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] profiler.trace_sqlalchemy = False {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] profiler_jaeger.process_tags = {} {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] profiler_jaeger.service_name_prefix = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] profiler_otlp.service_name_prefix = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] oslo_policy.enforce_new_defaults = True {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] oslo_policy.policy_default_rule = default {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] oslo_policy.policy_file = policy.yaml {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] oslo_policy.remote_timeout = 60.0 {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] privsep_osbrick.capabilities = [21, 2] {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] privsep_osbrick.group = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] privsep_osbrick.helper_command = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] privsep_osbrick.log_daemon_traceback = False {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] privsep_osbrick.thread_pool_size = 4 {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] privsep_osbrick.user = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] cinder_sys_admin.group = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] cinder_sys_admin.helper_command = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] cinder_sys_admin.user = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] service_user.auth_section = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] service_user.auth_type = password {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] service_user.cafile = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] service_user.certfile = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] service_user.collect_timing = False {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] service_user.insecure = False {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] service_user.keyfile = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] service_user.send_service_user_token = True {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] service_user.split_loggers = False {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] service_user.timeout = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] service_user.tls_ciphers = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] service_user.tls_min_version = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] glance.auth_section = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] glance.auth_type = password {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] glance.certfile = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] glance.collect_timing = False {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] glance.insecure = False {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] glance.keyfile = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] glance.region_name = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] glance.split_loggers = False {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] glance.timeout = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] glance.tls_ciphers = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] glance.tls_min_version = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] backend_defaults.backend_availability_zone = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] backend_defaults.chap_password = **** {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] backend_defaults.chap_username = {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] backend_defaults.disk_geometry = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] backend_defaults.driver_client_cert = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] backend_defaults.driver_client_cert_key = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] backend_defaults.driver_data_namespace = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] backend_defaults.driver_ssl_cert_path = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] backend_defaults.driver_use_ssl = False {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] backend_defaults.enable_unsupported_driver = False {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] backend_defaults.extra_capabilities = {} {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] backend_defaults.filter_function = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] backend_defaults.goodness_function = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] backend_defaults.image_volume_cache_enabled = False {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85905]: DEBUG cinder.volume.drivers.quobyte [None req-e675df55-ccfd-4710-a294-074e36f65ae6 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=85905) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 29 18:16:15 devstack cinder-volume[85905]: WARNING cinder.volume.drivers.quobyte [None req-e675df55-ccfd-4710-a294-074e36f65ae6 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 29 18:16:15 devstack cinder-volume[85905]: WARNING cinder.volume.drivers.quobyte [None req-e675df55-ccfd-4710-a294-074e36f65ae6 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85905]: DEBUG oslo_concurrency.processutils [None req-e675df55-ccfd-4710-a294-074e36f65ae6 None None] Running cmd (subprocess): mount.quobyte {{(pid=85905) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] backend_defaults.iscsi_target_flags = {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] backend_defaults.iscsi_write_cache = on {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] backend_defaults.iser_helper = tgtadm {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] backend_defaults.iser_ip_address = 192.168.122.67 {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] backend_defaults.iser_port = 3260 {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] backend_defaults.nas_host = {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] backend_defaults.nas_login = admin {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] backend_defaults.nas_mount_options = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] backend_defaults.nas_password = **** {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] backend_defaults.nas_private_key = {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] backend_defaults.nas_secure_file_operations = auto {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] backend_defaults.nas_share_path = {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] backend_defaults.nas_ssh_port = 22 {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] backend_defaults.nas_volume_prov_type = thin {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] backend_defaults.num_shell_tries = 3 {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] backend_defaults.nvmet_ns_id = 10 {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] backend_defaults.nvmet_port_id = 1 {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] backend_defaults.quobyte_client_cfg = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] backend_defaults.quobyte_volume_url = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] backend_defaults.replication_device = **** {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] backend_defaults.report_discard_supported = False {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] backend_defaults.reserved_percentage = 0 {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] backend_defaults.scst_target_driver = iscsi {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] backend_defaults.scst_target_iqn_name = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] backend_defaults.storage_protocol = iSCSI {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] backend_defaults.target_helper = tgtadm {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] backend_defaults.target_ip_address = 192.168.122.67 {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] backend_defaults.target_port = 3260 {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] backend_defaults.target_protocol = iscsi {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] backend_defaults.trace_flags = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] backend_defaults.unique_fqdn_network = True {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] backend_defaults.use_chap_auth = False {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] backend_defaults.volume_backend_name = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] backend_defaults.volume_clear = zero {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] backend_defaults.volume_clear_ionice = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] backend_defaults.volume_clear_size = 0 {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] oslo_reports.file_event_handler = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] oslo_reports.file_event_handler_interval = 1 {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] oslo_reports.log_dir = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] QuobyteHD.backend_availability_zone = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] QuobyteHD.backend_host = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] QuobyteHD.chap_password = **** {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] QuobyteHD.chap_username = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] QuobyteHD.chiscsi_conf = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] QuobyteHD.disk_geometry = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] QuobyteHD.driver_client_cert = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] QuobyteHD.driver_client_cert_key = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] QuobyteHD.driver_data_namespace = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] QuobyteHD.driver_use_ssl = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] QuobyteHD.enable_unsupported_driver = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] QuobyteHD.extra_capabilities = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] QuobyteHD.filter_function = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] QuobyteHD.goodness_function = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] QuobyteHD.iscsi_target_flags = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] QuobyteHD.iscsi_write_cache = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] QuobyteHD.iser_helper = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] QuobyteHD.iser_ip_address = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] QuobyteHD.iser_port = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] QuobyteHD.iser_target_prefix = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] QuobyteHD.nas_host = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] QuobyteHD.nas_login = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] QuobyteHD.nas_mount_options = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] QuobyteHD.nas_password = **** {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] QuobyteHD.nas_private_key = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] QuobyteHD.nas_secure_file_operations = false {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] QuobyteHD.nas_share_path = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] QuobyteHD.nas_ssh_port = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] QuobyteHD.nas_volume_prov_type = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] QuobyteHD.num_iser_scan_tries = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] QuobyteHD.num_shell_tries = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] QuobyteHD.nvmet_ns_id = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] QuobyteHD.nvmet_port_id = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] QuobyteHD.replication_device = **** {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] QuobyteHD.report_discard_supported = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] QuobyteHD.reserved_percentage = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] QuobyteHD.scst_target_driver = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] QuobyteHD.scst_target_iqn_name = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] QuobyteHD.storage_protocol = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] QuobyteHD.target_helper = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] QuobyteHD.target_ip_address = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] QuobyteHD.target_port = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] QuobyteHD.target_prefix = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] QuobyteHD.target_protocol = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] QuobyteHD.trace_flags = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] QuobyteHD.unique_fqdn_network = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] QuobyteHD.use_chap_auth = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] QuobyteHD.volume_clear = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] QuobyteHD.volume_clear_ionice = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] QuobyteHD.volume_clear_size = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] QuobyteHD.volume_dd_blocksize = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] QuobyteHD.volumes_dir = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack quobyte-client[85906]: Reading configuration file: /etc/quobyte/client.cfg Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack quobyte-client[85906]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] oslo_messaging_rabbit.hostname = devstack {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85905]: DEBUG oslo_concurrency.processutils [None req-e675df55-ccfd-4710-a294-074e36f65ae6 None None] CMD "mount.quobyte" returned: 1 in 0.139s {{(pid=85905) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:16:15 devstack cinder-volume[85905]: DEBUG oslo_concurrency.lockutils [None req-e675df55-ccfd-4710-a294-074e36f65ae6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85905) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85905]: DEBUG oslo_concurrency.lockutils [None req-e675df55-ccfd-4710-a294-074e36f65ae6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=85905) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:16:15 devstack cinder-volume[85905]: DEBUG cinder.volume.drivers.quobyte [None req-e675df55-ccfd-4710-a294-074e36f65ae6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=85905) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85905]: INFO cinder.volume.drivers.quobyte [None req-e675df55-ccfd-4710-a294-074e36f65ae6 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 ... Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85905]: DEBUG oslo_concurrency.processutils [None req-e675df55-ccfd-4710-a294-074e36f65ae6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe -c /etc/quobyte/client-cinder.cfg {{(pid=85905) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] oslo_messaging_rabbit.ssl = False {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] oslo_messaging_rabbit.ssl_version = {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] oslo_messaging_notifications.driver = [] {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] oslo_messaging_notifications.retry = -1 {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] oslo_messaging_notifications.transport_url = **** {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] key_manager.fixed_key = **** {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] barbican.barbican_api_version = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] barbican.barbican_endpoint = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] barbican.barbican_endpoint_type = public {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] barbican.barbican_region_name = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] barbican.cafile = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] barbican.certfile = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] barbican.collect_timing = False {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] barbican.insecure = False {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] barbican.keyfile = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] barbican.number_of_retries = 60 {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] barbican.retry_delay = 1 {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] barbican.send_service_user_token = False {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] barbican.split_loggers = False {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] barbican.timeout = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] barbican.tls_ciphers = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] barbican.tls_min_version = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] barbican.verify_ssl = True {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] barbican.verify_ssl_path = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] barbican_service_user.auth_section = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] barbican_service_user.auth_type = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] barbican_service_user.cafile = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] barbican_service_user.certfile = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] barbican_service_user.collect_timing = False {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] barbican_service_user.insecure = False {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] barbican_service_user.keyfile = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] barbican_service_user.split_loggers = False {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] barbican_service_user.timeout = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] barbican_service_user.tls_ciphers = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] barbican_service_user.tls_min_version = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack sudo[85911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe -c /etc/quobyte/client-cinder.cfg Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] vault.approle_role_id = **** {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] vault.approle_secret_id = **** {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] vault.auth_method = approle {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] vault.auth_path = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] vault.kv_mountpoint = secret {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] vault.kv_path = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] vault.kv_version = 2 {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] vault.namespace = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] vault.root_token_id = **** {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] vault.ssl_ca_crt_file = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack sudo[85911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] vault.timeout = 60.0 {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] vault.token_file = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] vault.token_role = None {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] vault.use_ssl = False {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:15 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] ******************************************************************************** {{(pid=85690) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 29 18:16:16 devstack sudo[85911]: pam_unix(sudo:session): session closed for user root Sep 29 18:16:16 devstack cinder-volume[85905]: DEBUG oslo_concurrency.processutils [None req-e675df55-ccfd-4710-a294-074e36f65ae6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.412s {{(pid=85905) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:16:16 devstack cinder-volume[85905]: INFO cinder.volume.drivers.quobyte [None req-e675df55-ccfd-4710-a294-074e36f65ae6 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 succeeded Sep 29 18:16:16 devstack cinder-volume[85905]: DEBUG cinder.volume.drivers.quobyte [None req-e675df55-ccfd-4710-a294-074e36f65ae6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=85905) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:16:16 devstack cinder-volume[85905]: DEBUG oslo_concurrency.lockutils [None req-e675df55-ccfd-4710-a294-074e36f65ae6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.427s {{(pid=85905) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:16:16 devstack cinder-volume[85905]: DEBUG oslo_concurrency.processutils [None req-e675df55-ccfd-4710-a294-074e36f65ae6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=85905) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:16:16 devstack sudo[86013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:16:16 devstack sudo[86013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:16:16 devstack sudo[86013]: pam_unix(sudo:session): session closed for user root Sep 29 18:16:16 devstack cinder-volume[85905]: DEBUG oslo_concurrency.processutils [None req-e675df55-ccfd-4710-a294-074e36f65ae6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.247s {{(pid=85905) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:16:16 devstack cinder-volume[85905]: INFO cinder.volume.driver [None req-e675df55-ccfd-4710-a294-074e36f65ae6 None None] Driver hasn't implemented _init_vendor_properties() Sep 29 18:16:16 devstack cinder-volume[85905]: DEBUG cinder.volume.driver [None req-e675df55-ccfd-4710-a294-074e36f65ae6 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.014518737793, 'free_capacity_gb': 1775.014518737793, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=85905) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 29 18:16:16 devstack cinder-volume[85905]: DEBUG oslo_db.sqlalchemy.engines [None req-e675df55-ccfd-4710-a294-074e36f65ae6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85905) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 29 18:16:16 devstack cinder-volume[85905]: DEBUG dbcounter [-] [85905] Writer thread running {{(pid=85905) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 29 18:16:16 devstack cinder-volume[85905]: DEBUG cinder.db.api [None req-e675df55-ccfd-4710-a294-074e36f65ae6 None None] Building query based on filter {{(pid=85905) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 29 18:16:16 devstack cinder-volume[85905]: DEBUG cinder.image.image_utils [None req-e675df55-ccfd-4710-a294-074e36f65ae6 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=85905) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 29 18:16:16 devstack cinder-volume[85905]: INFO cinder.keymgr.migration [None req-48f3626b-c048-40b5-9a47-80396a972237 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 29 18:16:16 devstack cinder-volume[85905]: DEBUG oslo_concurrency.lockutils [None req-e675df55-ccfd-4710-a294-074e36f65ae6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85905) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:16:16 devstack cinder-volume[85905]: DEBUG oslo_concurrency.lockutils [None req-e675df55-ccfd-4710-a294-074e36f65ae6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85905) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:16:16 devstack cinder-volume[85905]: DEBUG cinder.volume.drivers.quobyte [None req-e675df55-ccfd-4710-a294-074e36f65ae6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=85905) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:16:16 devstack cinder-volume[85905]: DEBUG cinder.volume.drivers.quobyte [None req-e675df55-ccfd-4710-a294-074e36f65ae6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=85905) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:16:16 devstack cinder-volume[85905]: DEBUG oslo_concurrency.lockutils [None req-e675df55-ccfd-4710-a294-074e36f65ae6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85905) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:16:16 devstack cinder-volume[85905]: DEBUG oslo_concurrency.processutils [None req-e675df55-ccfd-4710-a294-074e36f65ae6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=85905) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:16:16 devstack sudo[86017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:16:16 devstack sudo[86017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:16:16 devstack sudo[86017]: pam_unix(sudo:session): session closed for user root Sep 29 18:16:16 devstack cinder-volume[85905]: DEBUG oslo_concurrency.processutils [None req-e675df55-ccfd-4710-a294-074e36f65ae6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.223s {{(pid=85905) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:16:16 devstack cinder-volume[85905]: DEBUG cinder.manager [None req-e675df55-ccfd-4710-a294-074e36f65ae6 None None] Notifying Schedulers of capabilities ... {{(pid=85905) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:16:16 devstack cinder-volume[85905]: INFO cinder.volume.manager [None req-e675df55-ccfd-4710-a294-074e36f65ae6 None None] Driver initialization completed successfully. Sep 29 18:16:16 devstack cinder-volume[85905]: INFO cinder.manager [None req-e675df55-ccfd-4710-a294-074e36f65ae6 None None] Initiating service 3 cleanup Sep 29 18:16:16 devstack cinder-volume[85905]: INFO cinder.manager [None req-e675df55-ccfd-4710-a294-074e36f65ae6 None None] Service 3 cleanup completed. Sep 29 18:16:16 devstack cinder-volume[85905]: DEBUG cinder.service [None req-e675df55-ccfd-4710-a294-074e36f65ae6 None None] Creating RPC server for service cinder-volume {{(pid=85905) start /opt/stack/cinder/cinder/service.py:231}} Sep 29 18:16:16 devstack cinder-volume[85905]: DEBUG cinder.service [None req-e675df55-ccfd-4710-a294-074e36f65ae6 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=85905) start /opt/stack/cinder/cinder/service.py:237}} Sep 29 18:16:17 devstack cinder-volume[85905]: INFO cinder.volume.manager [None req-e675df55-ccfd-4710-a294-074e36f65ae6 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 29 18:16:17 devstack cinder-volume[85905]: DEBUG oslo_concurrency.lockutils [None req-e675df55-ccfd-4710-a294-074e36f65ae6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85905) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:16:17 devstack cinder-volume[85905]: DEBUG oslo_concurrency.lockutils [None req-e675df55-ccfd-4710-a294-074e36f65ae6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85905) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:16:17 devstack cinder-volume[85905]: DEBUG cinder.volume.drivers.quobyte [None req-e675df55-ccfd-4710-a294-074e36f65ae6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=85905) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:16:17 devstack cinder-volume[85905]: DEBUG cinder.volume.drivers.quobyte [None req-e675df55-ccfd-4710-a294-074e36f65ae6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=85905) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:16:17 devstack cinder-volume[85905]: DEBUG oslo_concurrency.lockutils [None req-e675df55-ccfd-4710-a294-074e36f65ae6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85905) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:16:17 devstack cinder-volume[85905]: DEBUG oslo_concurrency.processutils [None req-e675df55-ccfd-4710-a294-074e36f65ae6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=85905) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:16:17 devstack sudo[86020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:16:17 devstack sudo[86020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:16:17 devstack sudo[86020]: pam_unix(sudo:session): session closed for user root Sep 29 18:16:17 devstack cinder-volume[85905]: DEBUG oslo_concurrency.processutils [None req-e675df55-ccfd-4710-a294-074e36f65ae6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.262s {{(pid=85905) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:16:17 devstack cinder-volume[85905]: INFO cinder.volume.manager [None req-e675df55-ccfd-4710-a294-074e36f65ae6 None None] Driver post RPC initialization completed successfully. Sep 29 18:16:20 devstack cinder-volume[85905]: DEBUG oslo_service.periodic_task [None req-7c10d212-cdbf-44bb-a312-bf4e525a3906 None None] Running periodic task VolumeManager._thread_info {{(pid=85905) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 18:16:20 devstack cinder-volume[85905]: DEBUG cinder.volume.manager [None req-7c10d212-cdbf-44bb-a312-bf4e525a3906 None None] thread count: 6 {{(pid=85905) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 29 18:16:20 devstack cinder-volume[85905]: DEBUG cinder.volume.manager [None req-7c10d212-cdbf-44bb-a312-bf4e525a3906 None None] thread info: [<_MainThread(MainThread, started 134769551511680)>, , , , , ] {{(pid=85905) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 29 18:16:21 devstack cinder-volume[85905]: DEBUG oslo_concurrency.lockutils [None req-353a6214-d2d3-47ea-a963-789b2c4e3154 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85905) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:16:21 devstack cinder-volume[85905]: DEBUG oslo_concurrency.lockutils [None req-353a6214-d2d3-47ea-a963-789b2c4e3154 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85905) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:16:21 devstack cinder-volume[85905]: DEBUG cinder.volume.drivers.quobyte [None req-353a6214-d2d3-47ea-a963-789b2c4e3154 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=85905) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:16:21 devstack cinder-volume[85905]: DEBUG cinder.volume.drivers.quobyte [None req-353a6214-d2d3-47ea-a963-789b2c4e3154 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=85905) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:16:21 devstack cinder-volume[85905]: DEBUG oslo_concurrency.lockutils [None req-353a6214-d2d3-47ea-a963-789b2c4e3154 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85905) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:16:21 devstack cinder-volume[85905]: DEBUG oslo_concurrency.processutils [None req-353a6214-d2d3-47ea-a963-789b2c4e3154 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=85905) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:16:21 devstack sudo[86166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:16:21 devstack sudo[86166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:16:21 devstack sudo[86166]: pam_unix(sudo:session): session closed for user root Sep 29 18:16:21 devstack cinder-volume[85905]: DEBUG oslo_concurrency.processutils [None req-353a6214-d2d3-47ea-a963-789b2c4e3154 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.234s {{(pid=85905) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:16:21 devstack cinder-volume[85905]: DEBUG cinder.manager [None req-353a6214-d2d3-47ea-a963-789b2c4e3154 None None] Notifying Schedulers of capabilities ... {{(pid=85905) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:16:22 devstack cinder-volume[85690]: INFO oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] Caught SIGTERM, stopping children Sep 29 18:16:22 devstack cinder-volume[85690]: DEBUG oslo_concurrency.lockutils [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] Acquiring lock "singleton_lock" {{(pid=85690) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 29 18:16:22 devstack cinder-volume[85690]: DEBUG oslo_concurrency.lockutils [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] Acquired lock "singleton_lock" {{(pid=85690) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 29 18:16:22 devstack cinder-volume[85690]: DEBUG oslo_concurrency.lockutils [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] Releasing lock "singleton_lock" {{(pid=85690) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 29 18:16:22 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] Stop services. {{(pid=85690) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 29 18:16:22 devstack cinder-volume[85690]: DEBUG oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] Killing children. {{(pid=85690) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 29 18:16:22 devstack cinder-volume[85690]: INFO oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] Waiting on 1 children to exit Sep 29 18:16:25 devstack cinder-volume[85905]: DEBUG oslo_concurrency.lockutils [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] Acquiring lock "singleton_lock" {{(pid=85905) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 29 18:16:25 devstack cinder-volume[85905]: DEBUG oslo_concurrency.lockutils [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] Acquired lock "singleton_lock" {{(pid=85905) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 29 18:16:25 devstack cinder-volume[85905]: DEBUG oslo_concurrency.lockutils [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] Releasing lock "singleton_lock" {{(pid=85905) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 29 18:16:25 devstack cinder-volume[85905]: WARNING amqp [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 29 18:16:25 devstack cinder-volume[85905]: WARNING amqp [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 29 18:16:25 devstack cinder-volume[85690]: INFO oslo_service.backend._eventlet.service [None req-a4609ea5-837f-4dac-a9c3-3420cd28242c None None] Child 85905 exited with status 0 Sep 29 18:16:25 devstack cinder-volume[86222]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 29 18:16:25 devstack cinder-volume[86222]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 29 18:16:25 devstack cinder-volume[86222]: we strongly recommend against using it for new projects. Sep 29 18:16:25 devstack cinder-volume[86222]: If you are already using Eventlet, we recommend migrating to a different Sep 29 18:16:25 devstack cinder-volume[86222]: framework. For more detail see Sep 29 18:16:25 devstack cinder-volume[86222]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 29 18:16:25 devstack cinder-volume[86222]: import eventlet # noqa Sep 29 18:16:28 devstack cinder-volume[86222]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86222) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 29 18:16:28 devstack cinder-volume[86222]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86222) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 29 18:16:28 devstack cinder-volume[86222]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86222) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 29 18:16:29 devstack cinder-volume[86222]: INFO dbcounter [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] Registered counter for database cinder Sep 29 18:16:29 devstack cinder-volume[86222]: DEBUG oslo_db.sqlalchemy.engines [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86222) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 29 18:16:29 devstack cinder-volume[86222]: DEBUG dbcounter [-] [86222] Writer thread running {{(pid=86222) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 29 18:16:29 devstack cinder-volume[86222]: INFO cinder.rpc [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 29 18:16:29 devstack cinder-volume[86222]: INFO cinder.rpc [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_db.sqlalchemy.engines [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86222) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 29 18:16:30 devstack cinder-volume[86222]: INFO cinder.volume.manager [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] Determined volume DB was empty at startup. Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG cinder.volume.manager [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86222) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 29 18:16:30 devstack cinder-volume[86222]: WARNING stevedore.named [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 29 18:16:30 devstack cinder-volume[86222]: WARNING castellan.key_manager [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 29 18:16:30 devstack cinder-volume[86222]: WARNING cinder.keymgr.conf_key_mgr [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 29 18:16:30 devstack cinder-volume[86222]: INFO cinder.volume.manager [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_db.sqlalchemy.engines [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86222) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 29 18:16:30 devstack cinder-volume[86222]: INFO oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] Starting 1 workers Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] Started child 86512 {{(pid=86222) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] Full set of CONF: {{(pid=86222) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] ******************************************************************************** {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] Configuration options gathered from: {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] ================================================================================ {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] allow_availability_zone_fallback = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] allow_compression_on_image_upload = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86512]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.0) Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] allowed_direct_url_schemes = [] {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] api_rate_limit = True {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] auth_strategy = keystone {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] backend_availability_zone = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] backend_host = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] backend_name = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] backend_stats_polling_interval = 60 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] backup_api_class = cinder.backup.api.API {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] backup_name_template = backup-%s {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] backup_use_same_host = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] backup_use_temp_snapshot = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] chap_password = **** {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] chap_username = {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] cinder_internal_tenant_project_id = 98c3bbed4ea04d8892505e8124d76ed3 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] cinder_internal_tenant_user_id = 659377bd1cb343e8bbaa439133cdccd4 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] cluster = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] compression_format = gzip {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] compute_api_class = cinder.compute.nova.API {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] config_dir = [] {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] config_source = [] {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] control_exchange = openstack {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] debug = True {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] default_availability_zone = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] default_group_type = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] default_volume_type = QuobyteHD {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] disk_geometry = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] driver_client_cert = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] driver_client_cert_key = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] driver_data_namespace = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] driver_ssl_cert_path = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] driver_ssl_cert_verify = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] driver_use_ssl = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] enable_new_services = True {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] enable_unsupported_driver = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] enabled_backends = ['QuobyteHD'] {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] enforce_multipath_for_image_xfer = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] filter_function = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] glance_api_insecure = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] glance_api_servers = ['http://192.168.122.67/image'] {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] glance_api_ssl_compression = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] glance_ca_certificates_file = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] glance_catalog_info = image:glance:publicURL {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] glance_certfile = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] glance_keyfile = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] glance_num_retries = 3 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] glance_request_timeout = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] goodness_function = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] graceful_shutdown_timeout = 5 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] group_api_class = cinder.group.api.API {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] host = devstack {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] image_compress_on_upload = True {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] image_conversion_address_space_limit = 1 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] image_conversion_cpu_limit = 60 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] image_conversion_disable = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] image_introspection_address_space_limit = 1 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] image_introspection_cpu_limit = 60 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] image_upload_use_cinder_backend = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] image_upload_use_internal_tenant = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] image_volume_cache_enabled = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] image_volume_cache_max_count = 0 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] image_volume_cache_max_size_gb = 0 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] init_host_max_objects_retrieval = 0 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] instance_format = [instance: %(uuid)s] {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] iscsi_target_flags = {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] iscsi_write_cache = on {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] iser_helper = tgtadm {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] iser_ip_address = 192.168.122.67 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] iser_port = 3260 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] log_color = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] log_config_append = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] log_dir = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] log_file = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] log_options = True {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] log_rotate_interval = 1 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] log_rotate_interval_type = days {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] log_rotation_type = none {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] max_age = 0 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] max_logfile_count = 30 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] max_logfile_size_mb = 200 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] max_over_subscription_ratio = 20.0 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] message_reap_interval = 86400 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] message_ttl = 2592000 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] migration_create_volume_timeout_secs = 300 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] monkey_patch = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] monkey_patch_modules = [] {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] my_ip = 192.168.122.67 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] no_snapshot_gb_quota = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] num_iser_scan_tries = 3 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] num_shell_tries = 3 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] num_volume_device_scan_tries = 3 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] nvmeof_conn_info_version = 1 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] nvmet_ns_id = 10 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] nvmet_port_id = 1 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] osapi_max_limit = 1000 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] osapi_volume_ext_list = [] {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] osapi_volume_listen = 0.0.0.0 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] osapi_volume_listen_port = 8776 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] osapi_volume_use_ssl = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] osapi_volume_workers = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] per_volume_size_limit = -1 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] periodic_fuzzy_delay = 60 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] periodic_interval = 60 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] project_id_regex = [0-9a-f\-]+ {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] public_endpoint = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] publish_errors = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] quota_backup_gigabytes = 1000 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] quota_backups = 10 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] quota_gigabytes = 1000 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] quota_groups = 10 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] quota_snapshots = 10 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] quota_volumes = 10 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] rate_limit_burst = 0 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] rate_limit_except_level = CRITICAL {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] rate_limit_interval = 0 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] reinit_driver_count = 3 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] replication_device = **** {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] report_discard_supported = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] report_interval = 120 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] reservation_clean_interval = 86400 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] reservation_expire = 86400 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] reserved_image_namespaces = [] {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] reserved_percentage = 0 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] rpc_response_timeout = 120 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] run_external_periodic_tasks = True {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] scst_target_driver = iscsi {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] scst_target_iqn_name = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] service_down_time = 720 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] shell_completion = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] snapshot_name_template = snapshot-%s {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] split_loggers = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] state_path = /opt/stack/data/cinder {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] storage_availability_zone = nova {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] storage_protocol = iSCSI {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] syslog_log_facility = LOG_USER {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] target_helper = lioadm {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] target_ip_address = 192.168.122.67 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] target_port = 3260 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] target_protocol = iscsi {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] target_secondary_ip_addresses = [] {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] trace_flags = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] transfer_api_class = cinder.transfer.api.API {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] transport_url = **** {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] until_refresh = 0 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] use_chap_auth = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] use_default_quota_class = True {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] use_journal = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] use_json = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] use_multipath_for_image_xfer = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] use_stderr = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] use_syslog = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] verify_glance_signatures = enabled {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] volume_api_class = cinder.volume.api.API {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] volume_backend_name = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] volume_clear = zero {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] volume_clear_ionice = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] volume_clear_size = 0 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] volume_copy_bps_limit = 0 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] volume_dd_blocksize = 1M {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] volume_name_template = volume-%s {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] volume_service_inithost_offload = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] volume_usage_audit_period = month {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] zoning_mode = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] oslo_concurrency.disable_process_locking = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] keystone_authtoken.auth_section = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] keystone_authtoken.auth_type = password {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] keystone_authtoken.auth_version = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] keystone_authtoken.cache = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] keystone_authtoken.certfile = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-a86a87b1-5945-411d-baf1-f23498931875 None None] Starting volume driver QuobyteDriver (1.2.1) Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] keystone_authtoken.delay_auth_decision = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] keystone_authtoken.http_connect_timeout = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] keystone_authtoken.include_service_catalog = True {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] keystone_authtoken.insecure = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] keystone_authtoken.interface = public {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] keystone_authtoken.keyfile = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] keystone_authtoken.memcache_password = **** {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-a86a87b1-5945-411d-baf1-f23498931875 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86512) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] keystone_authtoken.memcache_username = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] keystone_authtoken.region_name = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] keystone_authtoken.service_token_roles_required = True {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] keystone_authtoken.service_type = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] keystone_authtoken.token_cache_time = 300 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.67/identity {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] cache.backend = dogpile.cache.null {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] cache.backend_argument = **** {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] cache.backend_expiration_time = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] cache.config_prefix = cache.oslo {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] cache.debug_cache_backend = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] cache.enable_retry_client = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] cache.enable_socket_keepalive = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] cache.enabled = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] cache.expiration_time = 600 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] cache.hashclient_retry_attempts = 2 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] cache.memcache_dead_retry = 300 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] cache.memcache_pool_maxsize = 10 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] cache.memcache_sasl_enabled = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] cache.password = **** {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] cache.proxies = [] {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] cache.redis_db = 0 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] cache.redis_sentinel_service_name = mymaster {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] cache.redis_server = localhost:6379 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] cache.retry_attempts = 2 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] cache.retry_delay = 0.0 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] cache.socket_keepalive_count = 1 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] cache.socket_keepalive_idle = 1 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] cache.socket_keepalive_interval = 1 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] cache.socket_timeout = 1.0 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] cache.tls_allowed_ciphers = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] cache.tls_cafile = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] cache.tls_certfile = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] cache.tls_enabled = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] cache.tls_keyfile = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] cache.username = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] coordination.backend_url = **** {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] database.asyncio_connection = **** {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] database.asyncio_slave_connection = **** {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] database.backend = sqlalchemy {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] database.connection = **** {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] database.connection_debug = 0 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] database.connection_parameters = {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] database.connection_recycle_time = 3600 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] database.connection_trace = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] database.db_inc_retry_interval = True {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] database.db_max_retries = 20 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] database.db_max_retry_interval = 10 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] database.db_retry_interval = 1 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] database.max_overflow = 50 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] database.max_pool_size = 5 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] database.max_retries = 10 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] database.mysql_wsrep_sync_wait = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] database.pool_timeout = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] database.retry_interval = 10 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] database.slave_connection = **** {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] database.sqlite_synchronous = True {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] database.synchronous_reader = True {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] database.use_db_reconnect = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] oslo_messaging_tracing.insecure = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] profiler.connection_string = messaging:// {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] profiler.enabled = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] profiler.es_doc_type = notification {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] profiler.es_scroll_size = 10000 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] profiler.es_scroll_time = 2m {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] profiler.filter_error_trace = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] profiler.hmac_keys = **** {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] profiler.sentinel_service_name = mymaster {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] profiler.socket_timeout = 0.1 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] profiler.trace_requests = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] profiler.trace_sqlalchemy = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] profiler_jaeger.process_tags = {} {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] profiler_jaeger.service_name_prefix = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] profiler_otlp.service_name_prefix = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] oslo_policy.enforce_new_defaults = True {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] oslo_policy.policy_default_rule = default {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] oslo_policy.policy_file = policy.yaml {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] oslo_policy.remote_timeout = 60.0 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] privsep_osbrick.group = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] privsep_osbrick.helper_command = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] privsep_osbrick.user = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] cinder_sys_admin.group = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] cinder_sys_admin.helper_command = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] cinder_sys_admin.user = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] service_user.auth_section = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] service_user.auth_type = password {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] service_user.cafile = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] service_user.certfile = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] service_user.collect_timing = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] service_user.insecure = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] service_user.keyfile = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] service_user.send_service_user_token = True {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] service_user.split_loggers = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] service_user.timeout = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] service_user.tls_ciphers = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] service_user.tls_min_version = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] glance.auth_section = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] glance.auth_type = password {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] glance.certfile = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] glance.collect_timing = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] glance.insecure = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] glance.keyfile = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] glance.region_name = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] glance.split_loggers = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] glance.timeout = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] glance.tls_ciphers = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] glance.tls_min_version = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] backend_defaults.backend_availability_zone = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] backend_defaults.chap_password = **** {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] backend_defaults.chap_username = {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] backend_defaults.disk_geometry = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] backend_defaults.driver_client_cert = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] backend_defaults.driver_client_cert_key = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] backend_defaults.driver_data_namespace = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] backend_defaults.driver_use_ssl = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] backend_defaults.enable_unsupported_driver = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] backend_defaults.extra_capabilities = {} {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] backend_defaults.filter_function = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] backend_defaults.goodness_function = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] backend_defaults.iscsi_target_flags = {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] backend_defaults.iscsi_write_cache = on {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] backend_defaults.iser_helper = tgtadm {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] backend_defaults.iser_ip_address = 192.168.122.67 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] backend_defaults.iser_port = 3260 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] backend_defaults.nas_host = {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] backend_defaults.nas_login = admin {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] backend_defaults.nas_mount_options = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] backend_defaults.nas_password = **** {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] backend_defaults.nas_private_key = {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] backend_defaults.nas_share_path = {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] backend_defaults.nas_ssh_port = 22 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] backend_defaults.num_shell_tries = 3 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] backend_defaults.nvmet_port_id = 1 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] backend_defaults.quobyte_client_cfg = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] backend_defaults.quobyte_volume_url = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] backend_defaults.replication_device = **** {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] backend_defaults.report_discard_supported = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] backend_defaults.reserved_percentage = 0 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] backend_defaults.scst_target_driver = iscsi {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] backend_defaults.scst_target_iqn_name = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] backend_defaults.storage_protocol = iSCSI {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] backend_defaults.target_helper = tgtadm {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] backend_defaults.target_ip_address = 192.168.122.67 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] backend_defaults.target_port = 3260 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] backend_defaults.target_protocol = iscsi {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] backend_defaults.trace_flags = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] backend_defaults.unique_fqdn_network = True {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] backend_defaults.use_chap_auth = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] backend_defaults.volume_backend_name = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] backend_defaults.volume_clear = zero {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] backend_defaults.volume_clear_ionice = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] backend_defaults.volume_clear_size = 0 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] oslo_reports.file_event_handler = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack quobyte-client[86521]: Reading configuration file: /etc/quobyte/client.cfg Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] oslo_reports.log_dir = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] QuobyteHD.backend_availability_zone = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] QuobyteHD.backend_host = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] QuobyteHD.chap_password = **** {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack quobyte-client[86521]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] QuobyteHD.chap_username = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] QuobyteHD.chiscsi_conf = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] QuobyteHD.disk_geometry = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] QuobyteHD.driver_client_cert = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] QuobyteHD.driver_client_cert_key = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] QuobyteHD.driver_data_namespace = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] QuobyteHD.driver_use_ssl = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] QuobyteHD.extra_capabilities = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] QuobyteHD.filter_function = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] QuobyteHD.goodness_function = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] QuobyteHD.iscsi_target_flags = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] QuobyteHD.iscsi_write_cache = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] QuobyteHD.iser_helper = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] QuobyteHD.iser_ip_address = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] QuobyteHD.iser_port = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] QuobyteHD.iser_target_prefix = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] QuobyteHD.nas_host = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] QuobyteHD.nas_login = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] QuobyteHD.nas_mount_options = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] QuobyteHD.nas_password = **** {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] QuobyteHD.nas_private_key = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] QuobyteHD.nas_share_path = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] QuobyteHD.nas_ssh_port = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] QuobyteHD.num_shell_tries = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] QuobyteHD.nvmet_ns_id = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] QuobyteHD.nvmet_port_id = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] QuobyteHD.replication_device = **** {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] QuobyteHD.report_discard_supported = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] QuobyteHD.reserved_percentage = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] QuobyteHD.scst_target_driver = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] QuobyteHD.storage_protocol = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] QuobyteHD.target_helper = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] QuobyteHD.target_ip_address = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] QuobyteHD.target_port = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] QuobyteHD.target_prefix = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] QuobyteHD.target_protocol = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] QuobyteHD.trace_flags = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] QuobyteHD.unique_fqdn_network = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] QuobyteHD.use_chap_auth = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] QuobyteHD.volume_clear = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] QuobyteHD.volume_clear_ionice = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] QuobyteHD.volume_clear_size = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack sudo[86522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] QuobyteHD.volumes_dir = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack sudo[86522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] oslo_messaging_rabbit.ssl = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] oslo_messaging_rabbit.ssl_version = {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] oslo_messaging_notifications.driver = [] {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] oslo_messaging_notifications.retry = -1 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] oslo_messaging_notifications.transport_url = **** {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] key_manager.fixed_key = **** {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] barbican.barbican_api_version = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] barbican.barbican_endpoint = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] barbican.barbican_endpoint_type = public {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] barbican.barbican_region_name = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] barbican.cafile = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] barbican.certfile = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] barbican.collect_timing = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] barbican.insecure = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] barbican.keyfile = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] barbican.number_of_retries = 60 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] barbican.retry_delay = 1 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] barbican.send_service_user_token = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] barbican.split_loggers = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] barbican.timeout = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] barbican.tls_ciphers = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] barbican.tls_min_version = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] barbican.verify_ssl = True {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] barbican.verify_ssl_path = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] barbican_service_user.auth_section = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] barbican_service_user.auth_type = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] barbican_service_user.cafile = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] barbican_service_user.certfile = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] barbican_service_user.collect_timing = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] barbican_service_user.insecure = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] barbican_service_user.keyfile = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] barbican_service_user.split_loggers = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] barbican_service_user.timeout = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] barbican_service_user.tls_ciphers = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] barbican_service_user.tls_min_version = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] vault.approle_role_id = **** {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] vault.approle_secret_id = **** {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] vault.auth_method = approle {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] vault.auth_path = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] vault.kv_mountpoint = secret {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] vault.kv_path = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] vault.kv_version = 2 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] vault.namespace = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] vault.root_token_id = **** {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] vault.ssl_ca_crt_file = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] vault.timeout = 60.0 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] vault.token_file = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] vault.token_role = None {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] vault.use_ssl = False {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:16:30 devstack cinder-volume[86222]: DEBUG oslo_service.backend._eventlet.service [None req-78f2024a-15cf-4dbf-9592-eb577da698fa None None] ******************************************************************************** {{(pid=86222) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 29 18:16:30 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-a86a87b1-5945-411d-baf1-f23498931875 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86512) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 29 18:16:30 devstack cinder-volume[86512]: WARNING cinder.volume.drivers.quobyte [None req-a86a87b1-5945-411d-baf1-f23498931875 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 29 18:16:30 devstack cinder-volume[86512]: WARNING cinder.volume.drivers.quobyte [None req-a86a87b1-5945-411d-baf1-f23498931875 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 29 18:16:30 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a86a87b1-5945-411d-baf1-f23498931875 None None] Running cmd (subprocess): mount.quobyte {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:16:30 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a86a87b1-5945-411d-baf1-f23498931875 None None] CMD "mount.quobyte" returned: 1 in 0.071s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:16:30 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-a86a87b1-5945-411d-baf1-f23498931875 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:16:30 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-a86a87b1-5945-411d-baf1-f23498931875 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:16:30 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-a86a87b1-5945-411d-baf1-f23498931875 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:16:30 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-a86a87b1-5945-411d-baf1-f23498931875 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:16:30 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-a86a87b1-5945-411d-baf1-f23498931875 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:16:30 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a86a87b1-5945-411d-baf1-f23498931875 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:16:30 devstack sudo[86522]: pam_unix(sudo:session): session closed for user root Sep 29 18:16:30 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a86a87b1-5945-411d-baf1-f23498931875 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.236s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:16:30 devstack cinder-volume[86512]: INFO cinder.volume.driver [None req-a86a87b1-5945-411d-baf1-f23498931875 None None] Driver hasn't implemented _init_vendor_properties() Sep 29 18:16:30 devstack cinder-volume[86512]: DEBUG cinder.volume.driver [None req-a86a87b1-5945-411d-baf1-f23498931875 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.014518737793, 'free_capacity_gb': 1775.014518737793, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86512) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 29 18:16:30 devstack cinder-volume[86512]: DEBUG oslo_db.sqlalchemy.engines [None req-a86a87b1-5945-411d-baf1-f23498931875 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86512) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 29 18:16:30 devstack cinder-volume[86512]: DEBUG dbcounter [-] [86512] Writer thread running {{(pid=86512) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 29 18:16:30 devstack cinder-volume[86512]: DEBUG cinder.db.api [None req-a86a87b1-5945-411d-baf1-f23498931875 None None] Building query based on filter {{(pid=86512) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 29 18:16:30 devstack cinder-volume[86512]: DEBUG cinder.image.image_utils [None req-a86a87b1-5945-411d-baf1-f23498931875 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86512) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 29 18:16:30 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-a86a87b1-5945-411d-baf1-f23498931875 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:16:30 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-a86a87b1-5945-411d-baf1-f23498931875 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:16:30 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-a86a87b1-5945-411d-baf1-f23498931875 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:16:30 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-a86a87b1-5945-411d-baf1-f23498931875 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:16:30 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-a86a87b1-5945-411d-baf1-f23498931875 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:16:30 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a86a87b1-5945-411d-baf1-f23498931875 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:16:30 devstack cinder-volume[86512]: INFO cinder.keymgr.migration [None req-c8886995-e079-44f8-905c-c4bffbb31612 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 29 18:16:30 devstack sudo[86533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:16:30 devstack sudo[86533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:16:31 devstack sudo[86533]: pam_unix(sudo:session): session closed for user root Sep 29 18:16:31 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a86a87b1-5945-411d-baf1-f23498931875 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.235s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:16:31 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-a86a87b1-5945-411d-baf1-f23498931875 None None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:16:31 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-a86a87b1-5945-411d-baf1-f23498931875 None None] Driver initialization completed successfully. Sep 29 18:16:31 devstack cinder-volume[86512]: INFO cinder.manager [None req-a86a87b1-5945-411d-baf1-f23498931875 None None] Initiating service 3 cleanup Sep 29 18:16:31 devstack cinder-volume[86512]: INFO cinder.manager [None req-a86a87b1-5945-411d-baf1-f23498931875 None None] Service 3 cleanup completed. Sep 29 18:16:31 devstack cinder-volume[86512]: DEBUG cinder.service [None req-a86a87b1-5945-411d-baf1-f23498931875 None None] Creating RPC server for service cinder-volume {{(pid=86512) start /opt/stack/cinder/cinder/service.py:231}} Sep 29 18:16:31 devstack cinder-volume[86512]: DEBUG cinder.service [None req-a86a87b1-5945-411d-baf1-f23498931875 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86512) start /opt/stack/cinder/cinder/service.py:237}} Sep 29 18:16:31 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-a86a87b1-5945-411d-baf1-f23498931875 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 29 18:16:31 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-a86a87b1-5945-411d-baf1-f23498931875 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:16:31 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-a86a87b1-5945-411d-baf1-f23498931875 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:16:31 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-a86a87b1-5945-411d-baf1-f23498931875 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:16:31 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-a86a87b1-5945-411d-baf1-f23498931875 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:16:31 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-a86a87b1-5945-411d-baf1-f23498931875 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:16:31 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a86a87b1-5945-411d-baf1-f23498931875 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:16:31 devstack sudo[86546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:16:31 devstack sudo[86546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:16:31 devstack sudo[86546]: pam_unix(sudo:session): session closed for user root Sep 29 18:16:31 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a86a87b1-5945-411d-baf1-f23498931875 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.253s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:16:31 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-a86a87b1-5945-411d-baf1-f23498931875 None None] Driver post RPC initialization completed successfully. Sep 29 18:16:40 devstack cinder-volume[86222]: DEBUG dbcounter [-] [86222] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86222) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 18:16:41 devstack cinder-volume[86512]: DEBUG dbcounter [-] [86512] Writing DB stats cinder:SELECT=1 {{(pid=86512) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 18:16:41 devstack cinder-volume[86512]: DEBUG dbcounter [-] [86512] Writing DB stats cinder:SELECT=9,cinder:UPDATE=1 {{(pid=86512) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 18:16:50 devstack cinder-volume[86512]: DEBUG oslo_service.periodic_task [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Running periodic task VolumeManager._thread_info {{(pid=86512) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 18:16:50 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] thread count: 6 {{(pid=86512) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 29 18:16:50 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] thread info: [<_MainThread(MainThread, started 135593654804608)>, , , , , ] {{(pid=86512) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 29 18:17:30 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-30a09150-696a-4caa-b3fc-4522b6aaf746 tempest-TaggedAttachmentsTest-493839450 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86512) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:17:30 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-30a09150-696a-4caa-b3fc-4522b6aaf746 tempest-TaggedAttachmentsTest-493839450 None] Flow 'volume_create_manager' (94313058-961d-4c11-aa86-95c93e6f0522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:17:30 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-30a09150-696a-4caa-b3fc-4522b6aaf746 tempest-TaggedAttachmentsTest-493839450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (453074a6-45f7-4046-9c6c-a3a0651437f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:17:30 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-30a09150-696a-4caa-b3fc-4522b6aaf746 tempest-TaggedAttachmentsTest-493839450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (453074a6-45f7-4046-9c6c-a3a0651437f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:17:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1546245968',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2ba4247-aaa7-4843-b0a3-95347d8e2300,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d55f8bf09d9449d6bf8d0c8ef80123c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:17:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:17:31Z,use_quota=True,user_id='a394a37ba6474023bb4a9a68eb793278',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:17:30 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-30a09150-696a-4caa-b3fc-4522b6aaf746 tempest-TaggedAttachmentsTest-493839450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47c9abea-8952-45cb-9c17-05d391ac0078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:17:30 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-30a09150-696a-4caa-b3fc-4522b6aaf746 tempest-TaggedAttachmentsTest-493839450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47c9abea-8952-45cb-9c17-05d391ac0078) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:17:30 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-30a09150-696a-4caa-b3fc-4522b6aaf746 tempest-TaggedAttachmentsTest-493839450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68162c51-8f54-49a8-bb9a-be82bf0ede9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:17:30 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-30a09150-696a-4caa-b3fc-4522b6aaf746 tempest-TaggedAttachmentsTest-493839450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68162c51-8f54-49a8-bb9a-be82bf0ede9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2ba4247-aaa7-4843-b0a3-95347d8e2300', 'volume_name': 'volume-e2ba4247-aaa7-4843-b0a3-95347d8e2300', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:17:30 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-30a09150-696a-4caa-b3fc-4522b6aaf746 tempest-TaggedAttachmentsTest-493839450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65caed5b-e608-407d-87ce-3e8326231caa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:17:30 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-30a09150-696a-4caa-b3fc-4522b6aaf746 tempest-TaggedAttachmentsTest-493839450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65caed5b-e608-407d-87ce-3e8326231caa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:17:30 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-30a09150-696a-4caa-b3fc-4522b6aaf746 tempest-TaggedAttachmentsTest-493839450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (192f1de8-d472-4d31-b9e0-e49dae7f1853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:17:30 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-30a09150-696a-4caa-b3fc-4522b6aaf746 tempest-TaggedAttachmentsTest-493839450 None] Volume e2ba4247-aaa7-4843-b0a3-95347d8e2300: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2ba4247-aaa7-4843-b0a3-95347d8e2300', 'volume_size': 1} Sep 29 18:17:30 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-30a09150-696a-4caa-b3fc-4522b6aaf746 tempest-TaggedAttachmentsTest-493839450 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:17:30 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-30a09150-696a-4caa-b3fc-4522b6aaf746 tempest-TaggedAttachmentsTest-493839450 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:17:30 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-30a09150-696a-4caa-b3fc-4522b6aaf746 tempest-TaggedAttachmentsTest-493839450 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:17:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1546245968',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2ba4247-aaa7-4843-b0a3-95347d8e2300,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d55f8bf09d9449d6bf8d0c8ef80123c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:17:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:17:31Z,use_quota=True,user_id='a394a37ba6474023bb4a9a68eb793278',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)}" {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:17:30 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-30a09150-696a-4caa-b3fc-4522b6aaf746 tempest-TaggedAttachmentsTest-493839450 None] Creating volume e2ba4247-aaa7-4843-b0a3-95347d8e2300 {{(pid=86512) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:17:30 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-30a09150-696a-4caa-b3fc-4522b6aaf746 tempest-TaggedAttachmentsTest-493839450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:17:30 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-30a09150-696a-4caa-b3fc-4522b6aaf746 tempest-TaggedAttachmentsTest-493839450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:17:30 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-30a09150-696a-4caa-b3fc-4522b6aaf746 tempest-TaggedAttachmentsTest-493839450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:17:30 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-30a09150-696a-4caa-b3fc-4522b6aaf746 tempest-TaggedAttachmentsTest-493839450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:17:30 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-30a09150-696a-4caa-b3fc-4522b6aaf746 tempest-TaggedAttachmentsTest-493839450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:17:30 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-30a09150-696a-4caa-b3fc-4522b6aaf746 tempest-TaggedAttachmentsTest-493839450 None] Selected osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 as target Quobyte volume. {{(pid=86512) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:17:30 devstack cinder-volume[86512]: INFO cinder.volume.drivers.remotefs [None req-30a09150-696a-4caa-b3fc-4522b6aaf746 tempest-TaggedAttachmentsTest-493839450 None] casted to osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 Sep 29 18:17:30 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-30a09150-696a-4caa-b3fc-4522b6aaf746 tempest-TaggedAttachmentsTest-493839450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e2ba4247-aaa7-4843-b0a3-95347d8e2300 1073741824 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:17:31 devstack sudo[86967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e2ba4247-aaa7-4843-b0a3-95347d8e2300 1073741824 Sep 29 18:17:31 devstack sudo[86967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:17:31 devstack sudo[86967]: pam_unix(sudo:session): session closed for user root Sep 29 18:17:31 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-30a09150-696a-4caa-b3fc-4522b6aaf746 tempest-TaggedAttachmentsTest-493839450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e2ba4247-aaa7-4843-b0a3-95347d8e2300 1073741824" returned: 0 in 0.542s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:17:31 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-30a09150-696a-4caa-b3fc-4522b6aaf746 tempest-TaggedAttachmentsTest-493839450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e2ba4247-aaa7-4843-b0a3-95347d8e2300 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:17:31 devstack sudo[87297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e2ba4247-aaa7-4843-b0a3-95347d8e2300 Sep 29 18:17:31 devstack sudo[87297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:17:31 devstack sudo[87297]: pam_unix(sudo:session): session closed for user root Sep 29 18:17:31 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-30a09150-696a-4caa-b3fc-4522b6aaf746 tempest-TaggedAttachmentsTest-493839450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e2ba4247-aaa7-4843-b0a3-95347d8e2300" returned: 0 in 0.301s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:17:31 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-30a09150-696a-4caa-b3fc-4522b6aaf746 tempest-TaggedAttachmentsTest-493839450 None] <== create_volume: return (911ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'} {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:17:31 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-30a09150-696a-4caa-b3fc-4522b6aaf746 tempest-TaggedAttachmentsTest-493839450 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.914s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:17:31 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-30a09150-696a-4caa-b3fc-4522b6aaf746 tempest-TaggedAttachmentsTest-493839450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (192f1de8-d472-4d31-b9e0-e49dae7f1853) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2ba4247-aaa7-4843-b0a3-95347d8e2300', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:17:31 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-30a09150-696a-4caa-b3fc-4522b6aaf746 tempest-TaggedAttachmentsTest-493839450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9af9e0a4-f1ef-4f55-95bf-62a5a9c64b92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:17:31 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-30a09150-696a-4caa-b3fc-4522b6aaf746 tempest-TaggedAttachmentsTest-493839450 None] Volume volume-e2ba4247-aaa7-4843-b0a3-95347d8e2300 (e2ba4247-aaa7-4843-b0a3-95347d8e2300): created successfully Sep 29 18:17:31 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-30a09150-696a-4caa-b3fc-4522b6aaf746 tempest-TaggedAttachmentsTest-493839450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9af9e0a4-f1ef-4f55-95bf-62a5a9c64b92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:17:31 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-30a09150-696a-4caa-b3fc-4522b6aaf746 tempest-TaggedAttachmentsTest-493839450 None] Flow 'volume_create_manager' (94313058-961d-4c11-aa86-95c93e6f0522) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:17:31 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-30a09150-696a-4caa-b3fc-4522b6aaf746 tempest-TaggedAttachmentsTest-493839450 None] Created volume successfully. Sep 29 18:17:41 devstack cinder-volume[86512]: DEBUG dbcounter [-] [86512] Writing DB stats cinder:SELECT=3,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=86512) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 18:17:41 devstack cinder-volume[86512]: DEBUG dbcounter [-] [86512] Writing DB stats cinder:UPDATE=4,cinder:SELECT=1,cinder:DELETE=1 {{(pid=86512) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 18:17:50 devstack cinder-volume[86512]: DEBUG oslo_service.periodic_task [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86512) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 18:17:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:17:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:17:50 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:17:50 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:17:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.077s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:17:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:17:50 devstack sudo[87560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:17:50 devstack sudo[87560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:17:51 devstack sudo[87560]: pam_unix(sudo:session): session closed for user root Sep 29 18:17:51 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.646s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:17:51 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:17:51 devstack cinder-volume[86512]: DEBUG oslo_service.periodic_task [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Running periodic task VolumeManager._thread_info {{(pid=86512) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 18:17:51 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] thread count: 6 {{(pid=86512) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 29 18:17:51 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] thread info: [<_MainThread(MainThread, started 135593654804608)>, , , , , ] {{(pid=86512) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 29 18:18:10 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-fdb6045a-906d-427f-b137-66a820fb4343 tempest-VolumesAdminNegativeTest-1024780715 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86512) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:18:10 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-fdb6045a-906d-427f-b137-66a820fb4343 tempest-VolumesAdminNegativeTest-1024780715 None] Flow 'volume_create_manager' (52a6e991-6fd9-410d-8a88-2e5701b11584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:18:10 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-fdb6045a-906d-427f-b137-66a820fb4343 tempest-VolumesAdminNegativeTest-1024780715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b93679b7-7a4e-47d2-8282-6a7caf480424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:18:10 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-fdb6045a-906d-427f-b137-66a820fb4343 tempest-VolumesAdminNegativeTest-1024780715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b93679b7-7a4e-47d2-8282-6a7caf480424) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:18:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1709611750',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1074ba4f-ff44-43ef-85d0-1d35f1d7c5a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a70f8d325684487fbe860e9555ea402d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:18:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:18:10Z,use_quota=True,user_id='f5075045e19e43db847fc9d263254f1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:18:10 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-fdb6045a-906d-427f-b137-66a820fb4343 tempest-VolumesAdminNegativeTest-1024780715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ae13d91-8f39-4504-aa32-31cf902b302d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:18:10 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-fdb6045a-906d-427f-b137-66a820fb4343 tempest-VolumesAdminNegativeTest-1024780715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ae13d91-8f39-4504-aa32-31cf902b302d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:18:10 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-fdb6045a-906d-427f-b137-66a820fb4343 tempest-VolumesAdminNegativeTest-1024780715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5181005-e812-40f5-88d5-4732f78e87e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:18:10 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-fdb6045a-906d-427f-b137-66a820fb4343 tempest-VolumesAdminNegativeTest-1024780715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5181005-e812-40f5-88d5-4732f78e87e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1074ba4f-ff44-43ef-85d0-1d35f1d7c5a5', 'volume_name': 'volume-1074ba4f-ff44-43ef-85d0-1d35f1d7c5a5', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:18:10 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-fdb6045a-906d-427f-b137-66a820fb4343 tempest-VolumesAdminNegativeTest-1024780715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30219932-cba0-488c-8eec-a35a0d36f6ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:18:10 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-fdb6045a-906d-427f-b137-66a820fb4343 tempest-VolumesAdminNegativeTest-1024780715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30219932-cba0-488c-8eec-a35a0d36f6ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:18:10 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-fdb6045a-906d-427f-b137-66a820fb4343 tempest-VolumesAdminNegativeTest-1024780715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (110baf15-00ac-4201-b7a5-52df7aaebf08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:18:10 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-fdb6045a-906d-427f-b137-66a820fb4343 tempest-VolumesAdminNegativeTest-1024780715 None] Volume 1074ba4f-ff44-43ef-85d0-1d35f1d7c5a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1074ba4f-ff44-43ef-85d0-1d35f1d7c5a5', 'volume_size': 1} Sep 29 18:18:10 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-fdb6045a-906d-427f-b137-66a820fb4343 tempest-VolumesAdminNegativeTest-1024780715 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:18:10 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-fdb6045a-906d-427f-b137-66a820fb4343 tempest-VolumesAdminNegativeTest-1024780715 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:18:10 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-fdb6045a-906d-427f-b137-66a820fb4343 tempest-VolumesAdminNegativeTest-1024780715 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:18:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1709611750',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1074ba4f-ff44-43ef-85d0-1d35f1d7c5a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a70f8d325684487fbe860e9555ea402d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:18:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:18:10Z,use_quota=True,user_id='f5075045e19e43db847fc9d263254f1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)}" {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:18:10 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-fdb6045a-906d-427f-b137-66a820fb4343 tempest-VolumesAdminNegativeTest-1024780715 None] Creating volume 1074ba4f-ff44-43ef-85d0-1d35f1d7c5a5 {{(pid=86512) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:18:10 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-fdb6045a-906d-427f-b137-66a820fb4343 tempest-VolumesAdminNegativeTest-1024780715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:18:10 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-fdb6045a-906d-427f-b137-66a820fb4343 tempest-VolumesAdminNegativeTest-1024780715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:18:10 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-fdb6045a-906d-427f-b137-66a820fb4343 tempest-VolumesAdminNegativeTest-1024780715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:18:10 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-fdb6045a-906d-427f-b137-66a820fb4343 tempest-VolumesAdminNegativeTest-1024780715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:18:10 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-fdb6045a-906d-427f-b137-66a820fb4343 tempest-VolumesAdminNegativeTest-1024780715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:18:10 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-fdb6045a-906d-427f-b137-66a820fb4343 tempest-VolumesAdminNegativeTest-1024780715 None] Selected osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 as target Quobyte volume. {{(pid=86512) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:18:10 devstack cinder-volume[86512]: INFO cinder.volume.drivers.remotefs [None req-fdb6045a-906d-427f-b137-66a820fb4343 tempest-VolumesAdminNegativeTest-1024780715 None] casted to osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 Sep 29 18:18:10 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-fdb6045a-906d-427f-b137-66a820fb4343 tempest-VolumesAdminNegativeTest-1024780715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-1074ba4f-ff44-43ef-85d0-1d35f1d7c5a5 1073741824 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:18:10 devstack sudo[87914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-1074ba4f-ff44-43ef-85d0-1d35f1d7c5a5 1073741824 Sep 29 18:18:10 devstack sudo[87914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:18:11 devstack sudo[87914]: pam_unix(sudo:session): session closed for user root Sep 29 18:18:11 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-fdb6045a-906d-427f-b137-66a820fb4343 tempest-VolumesAdminNegativeTest-1024780715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-1074ba4f-ff44-43ef-85d0-1d35f1d7c5a5 1073741824" returned: 0 in 0.679s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:18:11 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-fdb6045a-906d-427f-b137-66a820fb4343 tempest-VolumesAdminNegativeTest-1024780715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-1074ba4f-ff44-43ef-85d0-1d35f1d7c5a5 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:18:11 devstack sudo[87920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-1074ba4f-ff44-43ef-85d0-1d35f1d7c5a5 Sep 29 18:18:11 devstack sudo[87920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:18:11 devstack sudo[87920]: pam_unix(sudo:session): session closed for user root Sep 29 18:18:11 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-fdb6045a-906d-427f-b137-66a820fb4343 tempest-VolumesAdminNegativeTest-1024780715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-1074ba4f-ff44-43ef-85d0-1d35f1d7c5a5" returned: 0 in 0.620s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:18:11 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-fdb6045a-906d-427f-b137-66a820fb4343 tempest-VolumesAdminNegativeTest-1024780715 None] <== create_volume: return (1384ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'} {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:18:11 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-fdb6045a-906d-427f-b137-66a820fb4343 tempest-VolumesAdminNegativeTest-1024780715 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.391s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:18:11 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-fdb6045a-906d-427f-b137-66a820fb4343 tempest-VolumesAdminNegativeTest-1024780715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (110baf15-00ac-4201-b7a5-52df7aaebf08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1074ba4f-ff44-43ef-85d0-1d35f1d7c5a5', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:18:11 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-fdb6045a-906d-427f-b137-66a820fb4343 tempest-VolumesAdminNegativeTest-1024780715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d06e6c02-e6dc-49cf-ae00-b0649abc6a61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:18:11 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-fdb6045a-906d-427f-b137-66a820fb4343 tempest-VolumesAdminNegativeTest-1024780715 None] Volume volume-1074ba4f-ff44-43ef-85d0-1d35f1d7c5a5 (1074ba4f-ff44-43ef-85d0-1d35f1d7c5a5): created successfully Sep 29 18:18:11 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-fdb6045a-906d-427f-b137-66a820fb4343 tempest-VolumesAdminNegativeTest-1024780715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d06e6c02-e6dc-49cf-ae00-b0649abc6a61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:18:11 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-fdb6045a-906d-427f-b137-66a820fb4343 tempest-VolumesAdminNegativeTest-1024780715 None] Flow 'volume_create_manager' (52a6e991-6fd9-410d-8a88-2e5701b11584) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:18:11 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-fdb6045a-906d-427f-b137-66a820fb4343 tempest-VolumesAdminNegativeTest-1024780715 None] Created volume successfully. Sep 29 18:18:13 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5753a68-b609-4c17-a45d-928964783178 tempest-ServerRescueNegativeTestJSON-2082859818 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86512) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:18:13 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-b5753a68-b609-4c17-a45d-928964783178 tempest-ServerRescueNegativeTestJSON-2082859818 None] Flow 'volume_create_manager' (c83b4632-9e72-493e-82d9-0fcb3d80b912) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:18:13 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-b5753a68-b609-4c17-a45d-928964783178 tempest-ServerRescueNegativeTestJSON-2082859818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0900dbf-59dd-4494-9ca1-0a271d2d01b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:18:13 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-8c4aff27-079d-48e2-9893-947f76751977 tempest-VolumesAdminNegativeTest-1024780715 None] Acquiring lock "cinder-1074ba4f-ff44-43ef-85d0-1d35f1d7c5a5-delete_volume" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:18:13 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-b5753a68-b609-4c17-a45d-928964783178 tempest-ServerRescueNegativeTestJSON-2082859818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0900dbf-59dd-4494-9ca1-0a271d2d01b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:18:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-891586149',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48ec0502-d416-42a6-8778-76b52812f22e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b0b04d09501482ca7416a821c69db1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:18:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:18:13Z,use_quota=True,user_id='dd64257dee6641dd9230efbc87c8a248',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:18:13 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-b5753a68-b609-4c17-a45d-928964783178 tempest-ServerRescueNegativeTestJSON-2082859818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a02f9056-65f4-4fb7-b1f5-d2a9928f337d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:18:13 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-b5753a68-b609-4c17-a45d-928964783178 tempest-ServerRescueNegativeTestJSON-2082859818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a02f9056-65f4-4fb7-b1f5-d2a9928f337d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:18:13 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-b5753a68-b609-4c17-a45d-928964783178 tempest-ServerRescueNegativeTestJSON-2082859818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cf3e76f-25f0-437e-9ecb-112dce84b1cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:18:13 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-b5753a68-b609-4c17-a45d-928964783178 tempest-ServerRescueNegativeTestJSON-2082859818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cf3e76f-25f0-437e-9ecb-112dce84b1cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48ec0502-d416-42a6-8778-76b52812f22e', 'volume_name': 'volume-48ec0502-d416-42a6-8778-76b52812f22e', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:18:13 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-b5753a68-b609-4c17-a45d-928964783178 tempest-ServerRescueNegativeTestJSON-2082859818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8910c51c-e041-4836-a8df-54ff363bbfc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:18:13 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-b5753a68-b609-4c17-a45d-928964783178 tempest-ServerRescueNegativeTestJSON-2082859818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8910c51c-e041-4836-a8df-54ff363bbfc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:18:13 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-b5753a68-b609-4c17-a45d-928964783178 tempest-ServerRescueNegativeTestJSON-2082859818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da55eb0c-c7c0-46bc-8df0-621b2312b694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:18:13 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-b5753a68-b609-4c17-a45d-928964783178 tempest-ServerRescueNegativeTestJSON-2082859818 None] Volume 48ec0502-d416-42a6-8778-76b52812f22e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48ec0502-d416-42a6-8778-76b52812f22e', 'volume_size': 1} Sep 29 18:18:13 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-b5753a68-b609-4c17-a45d-928964783178 tempest-ServerRescueNegativeTestJSON-2082859818 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:18:13 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-b5753a68-b609-4c17-a45d-928964783178 tempest-ServerRescueNegativeTestJSON-2082859818 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:18:13 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-b5753a68-b609-4c17-a45d-928964783178 tempest-ServerRescueNegativeTestJSON-2082859818 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:18:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-891586149',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48ec0502-d416-42a6-8778-76b52812f22e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b0b04d09501482ca7416a821c69db1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:18:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:18:13Z,use_quota=True,user_id='dd64257dee6641dd9230efbc87c8a248',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)}" {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:18:13 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-b5753a68-b609-4c17-a45d-928964783178 tempest-ServerRescueNegativeTestJSON-2082859818 None] Creating volume 48ec0502-d416-42a6-8778-76b52812f22e {{(pid=86512) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:18:13 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-b5753a68-b609-4c17-a45d-928964783178 tempest-ServerRescueNegativeTestJSON-2082859818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:18:13 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-b5753a68-b609-4c17-a45d-928964783178 tempest-ServerRescueNegativeTestJSON-2082859818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:18:13 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-b5753a68-b609-4c17-a45d-928964783178 tempest-ServerRescueNegativeTestJSON-2082859818 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:18:13 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-b5753a68-b609-4c17-a45d-928964783178 tempest-ServerRescueNegativeTestJSON-2082859818 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:18:13 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-b5753a68-b609-4c17-a45d-928964783178 tempest-ServerRescueNegativeTestJSON-2082859818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:18:13 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-b5753a68-b609-4c17-a45d-928964783178 tempest-ServerRescueNegativeTestJSON-2082859818 None] Selected osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 as target Quobyte volume. {{(pid=86512) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:18:13 devstack cinder-volume[86512]: INFO cinder.volume.drivers.remotefs [None req-b5753a68-b609-4c17-a45d-928964783178 tempest-ServerRescueNegativeTestJSON-2082859818 None] casted to osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 Sep 29 18:18:13 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-b5753a68-b609-4c17-a45d-928964783178 tempest-ServerRescueNegativeTestJSON-2082859818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-48ec0502-d416-42a6-8778-76b52812f22e 1073741824 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:18:13 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-8c4aff27-079d-48e2-9893-947f76751977 tempest-VolumesAdminNegativeTest-1024780715 None] Lock "cinder-1074ba4f-ff44-43ef-85d0-1d35f1d7c5a5-delete_volume" acquired by "delete_volume" :: waited 0.215s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:18:13 devstack sudo[87924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-48ec0502-d416-42a6-8778-76b52812f22e 1073741824 Sep 29 18:18:13 devstack sudo[87924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:18:13 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-8c4aff27-079d-48e2-9893-947f76751977 tempest-VolumesAdminNegativeTest-1024780715 None] Acquiring lock "cinder-quobyte-1074ba4f-ff44-43ef-85d0-1d35f1d7c5a5" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:18:13 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-8c4aff27-079d-48e2-9893-947f76751977 tempest-VolumesAdminNegativeTest-1024780715 None] Lock "cinder-quobyte-1074ba4f-ff44-43ef-85d0-1d35f1d7c5a5" acquired by "delete_volume" :: waited 0.054s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:18:13 devstack cinder-volume[86512]: INFO oslo.privsep.daemon [None req-8c4aff27-079d-48e2-9893-947f76751977 tempest-VolumesAdminNegativeTest-1024780715 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp0a0fli7f/privsep.sock'] Sep 29 18:18:13 devstack sudo[87926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp0a0fli7f/privsep.sock Sep 29 18:18:13 devstack sudo[87926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:18:14 devstack sudo[87924]: pam_unix(sudo:session): session closed for user root Sep 29 18:18:14 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-b5753a68-b609-4c17-a45d-928964783178 tempest-ServerRescueNegativeTestJSON-2082859818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-48ec0502-d416-42a6-8778-76b52812f22e 1073741824" returned: 0 in 1.267s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:18:14 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-b5753a68-b609-4c17-a45d-928964783178 tempest-ServerRescueNegativeTestJSON-2082859818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-48ec0502-d416-42a6-8778-76b52812f22e {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:18:14 devstack sudo[87933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-48ec0502-d416-42a6-8778-76b52812f22e Sep 29 18:18:14 devstack sudo[87933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:18:15 devstack sudo[87933]: pam_unix(sudo:session): session closed for user root Sep 29 18:18:15 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-b5753a68-b609-4c17-a45d-928964783178 tempest-ServerRescueNegativeTestJSON-2082859818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-48ec0502-d416-42a6-8778-76b52812f22e" returned: 0 in 0.738s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:18:15 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-b5753a68-b609-4c17-a45d-928964783178 tempest-ServerRescueNegativeTestJSON-2082859818 None] <== create_volume: return (2094ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'} {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:18:15 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-b5753a68-b609-4c17-a45d-928964783178 tempest-ServerRescueNegativeTestJSON-2082859818 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.100s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:18:15 devstack cinder-volume[86512]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Sep 29 18:18:15 devstack cinder-volume[86512]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 29 18:18:15 devstack cinder-volume[86512]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Sep 29 18:18:15 devstack cinder-volume[86512]: WARNING oslo.privsep.daemon [-] privsep log: Sep 29 18:18:15 devstack cinder-volume[86512]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Sep 29 18:18:15 devstack cinder-volume[86512]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Sep 29 18:18:15 devstack cinder-volume[86512]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 29 18:18:15 devstack cinder-volume[86512]: WARNING oslo.privsep.daemon [-] privsep log: Sep 29 18:18:15 devstack cinder-volume[86512]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Sep 29 18:18:15 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-b5753a68-b609-4c17-a45d-928964783178 tempest-ServerRescueNegativeTestJSON-2082859818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da55eb0c-c7c0-46bc-8df0-621b2312b694) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48ec0502-d416-42a6-8778-76b52812f22e', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:18:15 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-b5753a68-b609-4c17-a45d-928964783178 tempest-ServerRescueNegativeTestJSON-2082859818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb188f79-7937-45a5-85c0-9ff080ae5c0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:18:15 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-b5753a68-b609-4c17-a45d-928964783178 tempest-ServerRescueNegativeTestJSON-2082859818 None] Volume volume-48ec0502-d416-42a6-8778-76b52812f22e (48ec0502-d416-42a6-8778-76b52812f22e): created successfully Sep 29 18:18:15 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-b5753a68-b609-4c17-a45d-928964783178 tempest-ServerRescueNegativeTestJSON-2082859818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb188f79-7937-45a5-85c0-9ff080ae5c0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:18:15 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-b5753a68-b609-4c17-a45d-928964783178 tempest-ServerRescueNegativeTestJSON-2082859818 None] Flow 'volume_create_manager' (c83b4632-9e72-493e-82d9-0fcb3d80b912) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:18:15 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-b5753a68-b609-4c17-a45d-928964783178 tempest-ServerRescueNegativeTestJSON-2082859818 None] Created volume successfully. Sep 29 18:18:16 devstack sudo[87926]: pam_unix(sudo:session): session closed for user root Sep 29 18:18:16 devstack cinder-volume[86512]: INFO oslo.privsep.daemon [None req-8c4aff27-079d-48e2-9893-947f76751977 tempest-VolumesAdminNegativeTest-1024780715 None] Spawned new privsep daemon via rootwrap Sep 29 18:18:16 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [None req-8c4aff27-079d-48e2-9893-947f76751977 tempest-VolumesAdminNegativeTest-1024780715 None] Accepted privsep connection to /tmp/tmp0a0fli7f/privsep.sock {{(pid=86512) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Sep 29 18:18:16 devstack cinder-volume[86512]: INFO oslo.privsep.daemon [-] privsep daemon starting Sep 29 18:18:16 devstack cinder-volume[86512]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Sep 29 18:18:16 devstack cinder-volume[86512]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Sep 29 18:18:16 devstack cinder-volume[86512]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 87936 Sep 29 18:18:16 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5d104e6-c927-4384-8976-9366f5ae0eee]: (2,) {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:18:16 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[94ac1a0b-2125-4264-931e-13a3706fac57]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:18:16 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-8c4aff27-079d-48e2-9893-947f76751977 tempest-VolumesAdminNegativeTest-1024780715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-1074ba4f-ff44-43ef-85d0-1d35f1d7c5a5 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:18:16 devstack sudo[87938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-1074ba4f-ff44-43ef-85d0-1d35f1d7c5a5 Sep 29 18:18:16 devstack sudo[87938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:18:17 devstack sudo[87938]: pam_unix(sudo:session): session closed for user root Sep 29 18:18:17 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-8c4aff27-079d-48e2-9893-947f76751977 tempest-VolumesAdminNegativeTest-1024780715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-1074ba4f-ff44-43ef-85d0-1d35f1d7c5a5" returned: 0 in 0.981s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:18:17 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-8c4aff27-079d-48e2-9893-947f76751977 tempest-VolumesAdminNegativeTest-1024780715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-1074ba4f-ff44-43ef-85d0-1d35f1d7c5a5 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:18:17 devstack sudo[87944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-1074ba4f-ff44-43ef-85d0-1d35f1d7c5a5 Sep 29 18:18:17 devstack sudo[87944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:18:17 devstack sudo[87944]: pam_unix(sudo:session): session closed for user root Sep 29 18:18:17 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-8c4aff27-079d-48e2-9893-947f76751977 tempest-VolumesAdminNegativeTest-1024780715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-1074ba4f-ff44-43ef-85d0-1d35f1d7c5a5" returned: 0 in 0.826s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:18:17 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-8c4aff27-079d-48e2-9893-947f76751977 tempest-VolumesAdminNegativeTest-1024780715 None] Lock "cinder-quobyte-1074ba4f-ff44-43ef-85d0-1d35f1d7c5a5" released by "delete_volume" :: held 4.238s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:18:18 devstack cinder-volume[86512]: WARNING cinder.quota [None req-8c4aff27-079d-48e2-9893-947f76751977 tempest-VolumesAdminNegativeTest-1024780715 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 29 18:18:18 devstack cinder-volume[86512]: WARNING cinder.quota [None req-8c4aff27-079d-48e2-9893-947f76751977 tempest-VolumesAdminNegativeTest-1024780715 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 29 18:18:18 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-8c4aff27-079d-48e2-9893-947f76751977 tempest-VolumesAdminNegativeTest-1024780715 None] Created reservations ['b6dce07b-b12c-4cc4-8b88-60a9e6cd1c6d', '02e57cf9-34d9-4c1a-93d2-673dd3846b26', '1d9fc484-bb7c-4179-bcea-11a1b714fb59', '1d1912f6-ad8f-4938-a5f5-6ca200aa621b'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:18:18 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-8c4aff27-079d-48e2-9893-947f76751977 tempest-VolumesAdminNegativeTest-1024780715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:18:18 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-8c4aff27-079d-48e2-9893-947f76751977 tempest-VolumesAdminNegativeTest-1024780715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:18:18 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-8c4aff27-079d-48e2-9893-947f76751977 tempest-VolumesAdminNegativeTest-1024780715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:18:18 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-8c4aff27-079d-48e2-9893-947f76751977 tempest-VolumesAdminNegativeTest-1024780715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:18:18 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-8c4aff27-079d-48e2-9893-947f76751977 tempest-VolumesAdminNegativeTest-1024780715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:18:18 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-8c4aff27-079d-48e2-9893-947f76751977 tempest-VolumesAdminNegativeTest-1024780715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:18:18 devstack sudo[87949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:18:18 devstack sudo[87949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:18:19 devstack sudo[87949]: pam_unix(sudo:session): session closed for user root Sep 29 18:18:19 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-8c4aff27-079d-48e2-9893-947f76751977 tempest-VolumesAdminNegativeTest-1024780715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.804s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:18:19 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-8c4aff27-079d-48e2-9893-947f76751977 tempest-VolumesAdminNegativeTest-1024780715 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:18:19 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-8c4aff27-079d-48e2-9893-947f76751977 tempest-VolumesAdminNegativeTest-1024780715 None] Deleted volume successfully. Sep 29 18:18:19 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-8c4aff27-079d-48e2-9893-947f76751977 tempest-VolumesAdminNegativeTest-1024780715 None] Lock "cinder-1074ba4f-ff44-43ef-85d0-1d35f1d7c5a5-delete_volume" released by "delete_volume" :: held 5.846s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:18:28 devstack cinder-volume[86512]: DEBUG dbcounter [-] [86512] Writing DB stats cinder:SELECT=12,cinder:UPDATE=14,cinder:DELETE=1,cinder:INSERT=2 {{(pid=86512) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 18:18:29 devstack cinder-volume[86512]: DEBUG dbcounter [-] [86512] Writing DB stats cinder:SELECT=6,cinder:UPDATE=14,cinder:INSERT=4,cinder:DELETE=2 {{(pid=86512) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 18:18:39 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-07912e32-3424-4f68-9549-3a82556ed01b tempest-ServerRescueNegativeTestJSON-2082859818 None] Acquiring lock "cinder-48ec0502-d416-42a6-8778-76b52812f22e-delete_volume" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:18:39 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-07912e32-3424-4f68-9549-3a82556ed01b tempest-ServerRescueNegativeTestJSON-2082859818 None] Lock "cinder-48ec0502-d416-42a6-8778-76b52812f22e-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:18:39 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-07912e32-3424-4f68-9549-3a82556ed01b tempest-ServerRescueNegativeTestJSON-2082859818 None] Acquiring lock "cinder-quobyte-48ec0502-d416-42a6-8778-76b52812f22e" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:18:39 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-07912e32-3424-4f68-9549-3a82556ed01b tempest-ServerRescueNegativeTestJSON-2082859818 None] Lock "cinder-quobyte-48ec0502-d416-42a6-8778-76b52812f22e" acquired by "delete_volume" :: waited 0.032s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:18:39 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[a94936c2-bbe8-4434-96ff-00c5f2ce8979]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:18:39 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-07912e32-3424-4f68-9549-3a82556ed01b tempest-ServerRescueNegativeTestJSON-2082859818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-48ec0502-d416-42a6-8778-76b52812f22e {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:18:39 devstack sudo[88223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-48ec0502-d416-42a6-8778-76b52812f22e Sep 29 18:18:39 devstack sudo[88223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:18:40 devstack sudo[88223]: pam_unix(sudo:session): session closed for user root Sep 29 18:18:40 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-07912e32-3424-4f68-9549-3a82556ed01b tempest-ServerRescueNegativeTestJSON-2082859818 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-48ec0502-d416-42a6-8778-76b52812f22e" returned: 0 in 0.685s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:18:40 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-07912e32-3424-4f68-9549-3a82556ed01b tempest-ServerRescueNegativeTestJSON-2082859818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-48ec0502-d416-42a6-8778-76b52812f22e {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:18:40 devstack sudo[88229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-48ec0502-d416-42a6-8778-76b52812f22e Sep 29 18:18:40 devstack sudo[88229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:18:40 devstack sudo[88229]: pam_unix(sudo:session): session closed for user root Sep 29 18:18:40 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-07912e32-3424-4f68-9549-3a82556ed01b tempest-ServerRescueNegativeTestJSON-2082859818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-48ec0502-d416-42a6-8778-76b52812f22e" returned: 0 in 0.378s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:18:40 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-07912e32-3424-4f68-9549-3a82556ed01b tempest-ServerRescueNegativeTestJSON-2082859818 None] Lock "cinder-quobyte-48ec0502-d416-42a6-8778-76b52812f22e" released by "delete_volume" :: held 1.190s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:18:40 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-07912e32-3424-4f68-9549-3a82556ed01b tempest-ServerRescueNegativeTestJSON-2082859818 None] Created reservations ['82042251-3dfb-48d9-a47e-434af893ef9b', 'd8b4e94c-9a02-4689-870f-9e5b2549499f', 'a4ac93da-75ed-46ca-90d5-25ba34ce369a', '443f3233-44ad-4217-8248-6f24321c3b83'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:18:41 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-07912e32-3424-4f68-9549-3a82556ed01b tempest-ServerRescueNegativeTestJSON-2082859818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:18:41 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-07912e32-3424-4f68-9549-3a82556ed01b tempest-ServerRescueNegativeTestJSON-2082859818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:18:41 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-07912e32-3424-4f68-9549-3a82556ed01b tempest-ServerRescueNegativeTestJSON-2082859818 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:18:41 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-07912e32-3424-4f68-9549-3a82556ed01b tempest-ServerRescueNegativeTestJSON-2082859818 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:18:41 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-07912e32-3424-4f68-9549-3a82556ed01b tempest-ServerRescueNegativeTestJSON-2082859818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:18:41 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-07912e32-3424-4f68-9549-3a82556ed01b tempest-ServerRescueNegativeTestJSON-2082859818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:18:41 devstack sudo[88232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:18:41 devstack sudo[88232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:18:41 devstack sudo[88232]: pam_unix(sudo:session): session closed for user root Sep 29 18:18:41 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-07912e32-3424-4f68-9549-3a82556ed01b tempest-ServerRescueNegativeTestJSON-2082859818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.439s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:18:41 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-07912e32-3424-4f68-9549-3a82556ed01b tempest-ServerRescueNegativeTestJSON-2082859818 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:18:41 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-07912e32-3424-4f68-9549-3a82556ed01b tempest-ServerRescueNegativeTestJSON-2082859818 None] Deleted volume successfully. Sep 29 18:18:41 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-07912e32-3424-4f68-9549-3a82556ed01b tempest-ServerRescueNegativeTestJSON-2082859818 None] Lock "cinder-48ec0502-d416-42a6-8778-76b52812f22e-delete_volume" released by "delete_volume" :: held 2.042s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:18:50 devstack cinder-volume[86512]: DEBUG oslo_service.periodic_task [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86512) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 18:18:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:18:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:18:50 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:18:50 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:18:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:18:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:18:50 devstack sudo[88407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:18:50 devstack sudo[88407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:18:50 devstack sudo[88407]: pam_unix(sudo:session): session closed for user root Sep 29 18:18:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.300s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:18:50 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:18:51 devstack cinder-volume[86512]: DEBUG dbcounter [-] [86512] Writing DB stats cinder:UPDATE=10,cinder:SELECT=6,cinder:INSERT=2 {{(pid=86512) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 18:18:51 devstack cinder-volume[86512]: DEBUG dbcounter [-] [86512] Writing DB stats cinder:SELECT=5,cinder:INSERT=2,cinder:UPDATE=7,cinder:DELETE=1 {{(pid=86512) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 18:18:54 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2712c8a-d8f4-48f9-b6af-10d94c924ee3 tempest-DeleteServersTestJSON-817303494 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86512) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:18:54 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-c2712c8a-d8f4-48f9-b6af-10d94c924ee3 tempest-DeleteServersTestJSON-817303494 None] Flow 'volume_create_manager' (7a9d7120-4790-4490-ab90-f2a19c411089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:18:54 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-c2712c8a-d8f4-48f9-b6af-10d94c924ee3 tempest-DeleteServersTestJSON-817303494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afb5b400-ee76-4992-8cbc-326875a97819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:18:54 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-c2712c8a-d8f4-48f9-b6af-10d94c924ee3 tempest-DeleteServersTestJSON-817303494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afb5b400-ee76-4992-8cbc-326875a97819) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:18:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1123100499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c30e8568-aa98-4409-85f2-d94eed1a117a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38a51decdd7f4013bdf13ce4d6d0e67b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:18:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:18:54Z,use_quota=True,user_id='eaae5bbbfdcc4582ba63e442148e205c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:18:54 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-c2712c8a-d8f4-48f9-b6af-10d94c924ee3 tempest-DeleteServersTestJSON-817303494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f625272-33c5-45e3-b9b1-d4c6c6b653c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:18:54 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-c2712c8a-d8f4-48f9-b6af-10d94c924ee3 tempest-DeleteServersTestJSON-817303494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f625272-33c5-45e3-b9b1-d4c6c6b653c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:18:54 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-c2712c8a-d8f4-48f9-b6af-10d94c924ee3 tempest-DeleteServersTestJSON-817303494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b85672c-ce3b-4f67-83a6-60d4b6c2d952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:18:54 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-c2712c8a-d8f4-48f9-b6af-10d94c924ee3 tempest-DeleteServersTestJSON-817303494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b85672c-ce3b-4f67-83a6-60d4b6c2d952) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c30e8568-aa98-4409-85f2-d94eed1a117a', 'volume_name': 'volume-c30e8568-aa98-4409-85f2-d94eed1a117a', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:18:54 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-c2712c8a-d8f4-48f9-b6af-10d94c924ee3 tempest-DeleteServersTestJSON-817303494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a10aa970-fd63-410d-8955-7bb76ce2f521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:18:54 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-c2712c8a-d8f4-48f9-b6af-10d94c924ee3 tempest-DeleteServersTestJSON-817303494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a10aa970-fd63-410d-8955-7bb76ce2f521) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:18:54 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-c2712c8a-d8f4-48f9-b6af-10d94c924ee3 tempest-DeleteServersTestJSON-817303494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0f16f3a-9ea5-464f-b6c0-f573a926b601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:18:54 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-c2712c8a-d8f4-48f9-b6af-10d94c924ee3 tempest-DeleteServersTestJSON-817303494 None] Volume c30e8568-aa98-4409-85f2-d94eed1a117a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c30e8568-aa98-4409-85f2-d94eed1a117a', 'volume_size': 1} Sep 29 18:18:54 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-c2712c8a-d8f4-48f9-b6af-10d94c924ee3 tempest-DeleteServersTestJSON-817303494 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:18:54 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-c2712c8a-d8f4-48f9-b6af-10d94c924ee3 tempest-DeleteServersTestJSON-817303494 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:18:54 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-c2712c8a-d8f4-48f9-b6af-10d94c924ee3 tempest-DeleteServersTestJSON-817303494 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:18:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1123100499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c30e8568-aa98-4409-85f2-d94eed1a117a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38a51decdd7f4013bdf13ce4d6d0e67b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:18:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:18:54Z,use_quota=True,user_id='eaae5bbbfdcc4582ba63e442148e205c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)}" {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:18:54 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-c2712c8a-d8f4-48f9-b6af-10d94c924ee3 tempest-DeleteServersTestJSON-817303494 None] Creating volume c30e8568-aa98-4409-85f2-d94eed1a117a {{(pid=86512) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:18:54 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-c2712c8a-d8f4-48f9-b6af-10d94c924ee3 tempest-DeleteServersTestJSON-817303494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:18:54 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-c2712c8a-d8f4-48f9-b6af-10d94c924ee3 tempest-DeleteServersTestJSON-817303494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:18:54 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-c2712c8a-d8f4-48f9-b6af-10d94c924ee3 tempest-DeleteServersTestJSON-817303494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:18:54 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-c2712c8a-d8f4-48f9-b6af-10d94c924ee3 tempest-DeleteServersTestJSON-817303494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:18:54 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-c2712c8a-d8f4-48f9-b6af-10d94c924ee3 tempest-DeleteServersTestJSON-817303494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:18:54 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-c2712c8a-d8f4-48f9-b6af-10d94c924ee3 tempest-DeleteServersTestJSON-817303494 None] Selected osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 as target Quobyte volume. {{(pid=86512) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:18:54 devstack cinder-volume[86512]: INFO cinder.volume.drivers.remotefs [None req-c2712c8a-d8f4-48f9-b6af-10d94c924ee3 tempest-DeleteServersTestJSON-817303494 None] casted to osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 Sep 29 18:18:54 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-c2712c8a-d8f4-48f9-b6af-10d94c924ee3 tempest-DeleteServersTestJSON-817303494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-c30e8568-aa98-4409-85f2-d94eed1a117a 1073741824 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:18:54 devstack sudo[88415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-c30e8568-aa98-4409-85f2-d94eed1a117a 1073741824 Sep 29 18:18:54 devstack sudo[88415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:18:55 devstack sudo[88415]: pam_unix(sudo:session): session closed for user root Sep 29 18:18:55 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-c2712c8a-d8f4-48f9-b6af-10d94c924ee3 tempest-DeleteServersTestJSON-817303494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-c30e8568-aa98-4409-85f2-d94eed1a117a 1073741824" returned: 0 in 0.671s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:18:55 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-c2712c8a-d8f4-48f9-b6af-10d94c924ee3 tempest-DeleteServersTestJSON-817303494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-c30e8568-aa98-4409-85f2-d94eed1a117a {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:18:55 devstack sudo[88430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-c30e8568-aa98-4409-85f2-d94eed1a117a Sep 29 18:18:55 devstack sudo[88430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:18:55 devstack sudo[88430]: pam_unix(sudo:session): session closed for user root Sep 29 18:18:55 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-c2712c8a-d8f4-48f9-b6af-10d94c924ee3 tempest-DeleteServersTestJSON-817303494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-c30e8568-aa98-4409-85f2-d94eed1a117a" returned: 0 in 0.389s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:18:55 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-c2712c8a-d8f4-48f9-b6af-10d94c924ee3 tempest-DeleteServersTestJSON-817303494 None] <== create_volume: return (1131ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'} {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:18:55 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-c2712c8a-d8f4-48f9-b6af-10d94c924ee3 tempest-DeleteServersTestJSON-817303494 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.134s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:18:55 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-c2712c8a-d8f4-48f9-b6af-10d94c924ee3 tempest-DeleteServersTestJSON-817303494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0f16f3a-9ea5-464f-b6c0-f573a926b601) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c30e8568-aa98-4409-85f2-d94eed1a117a', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:18:55 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-c2712c8a-d8f4-48f9-b6af-10d94c924ee3 tempest-DeleteServersTestJSON-817303494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f27d4fca-3e19-40e8-a0b3-0b87ac52e946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:18:55 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-c2712c8a-d8f4-48f9-b6af-10d94c924ee3 tempest-DeleteServersTestJSON-817303494 None] Volume volume-c30e8568-aa98-4409-85f2-d94eed1a117a (c30e8568-aa98-4409-85f2-d94eed1a117a): created successfully Sep 29 18:18:55 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-c2712c8a-d8f4-48f9-b6af-10d94c924ee3 tempest-DeleteServersTestJSON-817303494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f27d4fca-3e19-40e8-a0b3-0b87ac52e946) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:18:55 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-c2712c8a-d8f4-48f9-b6af-10d94c924ee3 tempest-DeleteServersTestJSON-817303494 None] Flow 'volume_create_manager' (7a9d7120-4790-4490-ab90-f2a19c411089) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:18:55 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-c2712c8a-d8f4-48f9-b6af-10d94c924ee3 tempest-DeleteServersTestJSON-817303494 None] Created volume successfully. Sep 29 18:19:02 devstack cinder-volume[86512]: WARNING py.warnings [req-48ed65c0-e8af-43a0-bbba-0b8873e3b7bd req-000a057b-37b5-4887-9fb9-f787efd5dd10 tempest-DeleteServersTestJSON-817303494 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volume_attachment", "volumes_1" and FROM element "volumes". Apply join condition(s) between each element to resolve. Sep 29 18:19:02 devstack cinder-volume[86512]: .first() Sep 29 18:19:02 devstack cinder-volume[86512]: Sep 29 18:19:02 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [req-48ed65c0-e8af-43a0-bbba-0b8873e3b7bd req-000a057b-37b5-4887-9fb9-f787efd5dd10 tempest-DeleteServersTestJSON-817303494 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:19:02 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [req-48ed65c0-e8af-43a0-bbba-0b8873e3b7bd req-000a057b-37b5-4887-9fb9-f787efd5dd10 tempest-DeleteServersTestJSON-817303494 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:19:02 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [req-48ed65c0-e8af-43a0-bbba-0b8873e3b7bd req-000a057b-37b5-4887-9fb9-f787efd5dd10 tempest-DeleteServersTestJSON-817303494 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.091s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:19:02 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [req-48ed65c0-e8af-43a0-bbba-0b8873e3b7bd req-000a057b-37b5-4887-9fb9-f787efd5dd10 tempest-DeleteServersTestJSON-817303494 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883', 'name': 'volume-c30e8568-aa98-4409-85f2-d94eed1a117a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'acadec51-83b2-4242-b50e-1dded439f8e3', 'enforce_multipath': True} {{(pid=86512) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 29 18:19:02 devstack cinder-volume[86512]: INFO cinder.volume.manager [req-48ed65c0-e8af-43a0-bbba-0b8873e3b7bd req-000a057b-37b5-4887-9fb9-f787efd5dd10 tempest-DeleteServersTestJSON-817303494 None] attachment_update completed successfully. Sep 29 18:19:05 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [req-12b95c23-e51b-40db-8ff2-2efda036a71a req-13773359-b228-4c7e-a700-c4eef7cdd286 tempest-TaggedAttachmentsTest-493839450 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:19:05 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [req-12b95c23-e51b-40db-8ff2-2efda036a71a req-13773359-b228-4c7e-a700-c4eef7cdd286 tempest-TaggedAttachmentsTest-493839450 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:19:05 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [req-12b95c23-e51b-40db-8ff2-2efda036a71a req-13773359-b228-4c7e-a700-c4eef7cdd286 tempest-TaggedAttachmentsTest-493839450 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:19:05 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [req-12b95c23-e51b-40db-8ff2-2efda036a71a req-13773359-b228-4c7e-a700-c4eef7cdd286 tempest-TaggedAttachmentsTest-493839450 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883', 'name': 'volume-e2ba4247-aaa7-4843-b0a3-95347d8e2300', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '897086cb-378a-4a37-9072-89b0c69e29a1', 'enforce_multipath': True} {{(pid=86512) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 29 18:19:05 devstack cinder-volume[86512]: INFO cinder.volume.manager [req-12b95c23-e51b-40db-8ff2-2efda036a71a req-13773359-b228-4c7e-a700-c4eef7cdd286 tempest-TaggedAttachmentsTest-493839450 None] attachment_update completed successfully. Sep 29 18:19:09 devstack cinder-volume[86512]: INFO cinder.volume.manager [req-a24518ac-1c5e-4fe7-a139-cd836fb6afc4 req-aa37918a-4059-46ad-97ef-893aeaded4a2 tempest-DeleteServersTestJSON-817303494 None] Terminate volume connection completed successfully. Sep 29 18:19:09 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [req-a24518ac-1c5e-4fe7-a139-cd836fb6afc4 req-aa37918a-4059-46ad-97ef-893aeaded4a2 tempest-DeleteServersTestJSON-817303494 None] Deleting attachment acadec51-83b2-4242-b50e-1dded439f8e3. {{(pid=86512) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 29 18:19:12 devstack cinder-volume[86512]: INFO cinder.volume.manager [req-e048715b-eb39-457b-bf63-1cefaeaf1987 req-f5aeec21-43a9-4bfc-a2ed-9918299c40c1 tempest-TaggedAttachmentsTest-493839450 None] Terminate volume connection completed successfully. Sep 29 18:19:12 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [req-e048715b-eb39-457b-bf63-1cefaeaf1987 req-f5aeec21-43a9-4bfc-a2ed-9918299c40c1 tempest-TaggedAttachmentsTest-493839450 None] Deleting attachment 897086cb-378a-4a37-9072-89b0c69e29a1. {{(pid=86512) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 29 18:19:12 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-9b88a7ae-9f68-4f6e-b1cc-e0a93bde17f9 tempest-DeleteServersTestJSON-817303494 None] Acquiring lock "cinder-c30e8568-aa98-4409-85f2-d94eed1a117a-delete_volume" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:19:12 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-9b88a7ae-9f68-4f6e-b1cc-e0a93bde17f9 tempest-DeleteServersTestJSON-817303494 None] Lock "cinder-c30e8568-aa98-4409-85f2-d94eed1a117a-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:19:12 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-9b88a7ae-9f68-4f6e-b1cc-e0a93bde17f9 tempest-DeleteServersTestJSON-817303494 None] Acquiring lock "cinder-quobyte-c30e8568-aa98-4409-85f2-d94eed1a117a" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:19:12 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-9b88a7ae-9f68-4f6e-b1cc-e0a93bde17f9 tempest-DeleteServersTestJSON-817303494 None] Lock "cinder-quobyte-c30e8568-aa98-4409-85f2-d94eed1a117a" acquired by "delete_volume" :: waited 0.021s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:19:12 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[443abdab-c569-457d-861f-e908b3f9ea9b]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:19:12 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-9b88a7ae-9f68-4f6e-b1cc-e0a93bde17f9 tempest-DeleteServersTestJSON-817303494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-c30e8568-aa98-4409-85f2-d94eed1a117a {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:19:12 devstack sudo[89064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-c30e8568-aa98-4409-85f2-d94eed1a117a Sep 29 18:19:12 devstack sudo[89064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:19:13 devstack sudo[89064]: pam_unix(sudo:session): session closed for user root Sep 29 18:19:13 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-9b88a7ae-9f68-4f6e-b1cc-e0a93bde17f9 tempest-DeleteServersTestJSON-817303494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-c30e8568-aa98-4409-85f2-d94eed1a117a" returned: 0 in 0.547s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:19:13 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-9b88a7ae-9f68-4f6e-b1cc-e0a93bde17f9 tempest-DeleteServersTestJSON-817303494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-c30e8568-aa98-4409-85f2-d94eed1a117a {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:19:13 devstack sudo[89073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-c30e8568-aa98-4409-85f2-d94eed1a117a Sep 29 18:19:13 devstack sudo[89073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:19:13 devstack sudo[89073]: pam_unix(sudo:session): session closed for user root Sep 29 18:19:13 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-9b88a7ae-9f68-4f6e-b1cc-e0a93bde17f9 tempest-DeleteServersTestJSON-817303494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-c30e8568-aa98-4409-85f2-d94eed1a117a" returned: 0 in 0.529s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:19:13 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-9b88a7ae-9f68-4f6e-b1cc-e0a93bde17f9 tempest-DeleteServersTestJSON-817303494 None] Lock "cinder-quobyte-c30e8568-aa98-4409-85f2-d94eed1a117a" released by "delete_volume" :: held 1.141s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:19:13 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-9b88a7ae-9f68-4f6e-b1cc-e0a93bde17f9 tempest-DeleteServersTestJSON-817303494 None] Created reservations ['44211fbe-e09b-4ca7-898a-93a1fddbbe51', 'b63084f6-9c5b-43b8-8c68-263d01ca0447', 'a0fda3e4-c2c8-4827-ab7f-63e897d5bba9', 'b38686e7-32b8-4ae8-b30f-5dafe6253fcd'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:19:14 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-9b88a7ae-9f68-4f6e-b1cc-e0a93bde17f9 tempest-DeleteServersTestJSON-817303494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:19:14 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-9b88a7ae-9f68-4f6e-b1cc-e0a93bde17f9 tempest-DeleteServersTestJSON-817303494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:19:14 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-9b88a7ae-9f68-4f6e-b1cc-e0a93bde17f9 tempest-DeleteServersTestJSON-817303494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:19:14 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-9b88a7ae-9f68-4f6e-b1cc-e0a93bde17f9 tempest-DeleteServersTestJSON-817303494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:19:14 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-9b88a7ae-9f68-4f6e-b1cc-e0a93bde17f9 tempest-DeleteServersTestJSON-817303494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:19:14 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-9b88a7ae-9f68-4f6e-b1cc-e0a93bde17f9 tempest-DeleteServersTestJSON-817303494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:19:14 devstack sudo[89090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:19:14 devstack sudo[89090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:19:14 devstack sudo[89090]: pam_unix(sudo:session): session closed for user root Sep 29 18:19:14 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-9b88a7ae-9f68-4f6e-b1cc-e0a93bde17f9 tempest-DeleteServersTestJSON-817303494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.450s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:19:14 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-9b88a7ae-9f68-4f6e-b1cc-e0a93bde17f9 tempest-DeleteServersTestJSON-817303494 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:19:14 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-9b88a7ae-9f68-4f6e-b1cc-e0a93bde17f9 tempest-DeleteServersTestJSON-817303494 None] Deleted volume successfully. Sep 29 18:19:14 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-9b88a7ae-9f68-4f6e-b1cc-e0a93bde17f9 tempest-DeleteServersTestJSON-817303494 None] Lock "cinder-c30e8568-aa98-4409-85f2-d94eed1a117a-delete_volume" released by "delete_volume" :: held 2.011s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:19:24 devstack cinder-volume[86512]: DEBUG dbcounter [-] [86512] Writing DB stats cinder:UPDATE=13,cinder:SELECT=21,cinder:INSERT=3 {{(pid=86512) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 18:19:24 devstack cinder-volume[86512]: DEBUG dbcounter [-] [86512] Writing DB stats cinder:SELECT=23,cinder:UPDATE=15,cinder:DELETE=2,cinder:INSERT=2 {{(pid=86512) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 18:19:26 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-62d9b31d-22b7-4fb4-9ca2-d13fd87159d3 tempest-TaggedAttachmentsTest-493839450 None] Acquiring lock "cinder-e2ba4247-aaa7-4843-b0a3-95347d8e2300-delete_volume" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:19:26 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-62d9b31d-22b7-4fb4-9ca2-d13fd87159d3 tempest-TaggedAttachmentsTest-493839450 None] Lock "cinder-e2ba4247-aaa7-4843-b0a3-95347d8e2300-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:19:26 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-62d9b31d-22b7-4fb4-9ca2-d13fd87159d3 tempest-TaggedAttachmentsTest-493839450 None] Acquiring lock "cinder-quobyte-e2ba4247-aaa7-4843-b0a3-95347d8e2300" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:19:26 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-62d9b31d-22b7-4fb4-9ca2-d13fd87159d3 tempest-TaggedAttachmentsTest-493839450 None] Lock "cinder-quobyte-e2ba4247-aaa7-4843-b0a3-95347d8e2300" acquired by "delete_volume" :: waited 0.034s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:19:26 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f490dd2-af7e-4265-84f4-888d49588592]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:19:26 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-62d9b31d-22b7-4fb4-9ca2-d13fd87159d3 tempest-TaggedAttachmentsTest-493839450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e2ba4247-aaa7-4843-b0a3-95347d8e2300 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:19:26 devstack sudo[89223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e2ba4247-aaa7-4843-b0a3-95347d8e2300 Sep 29 18:19:26 devstack sudo[89223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:19:26 devstack sudo[89223]: pam_unix(sudo:session): session closed for user root Sep 29 18:19:26 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-62d9b31d-22b7-4fb4-9ca2-d13fd87159d3 tempest-TaggedAttachmentsTest-493839450 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e2ba4247-aaa7-4843-b0a3-95347d8e2300" returned: 0 in 0.564s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:19:26 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-62d9b31d-22b7-4fb4-9ca2-d13fd87159d3 tempest-TaggedAttachmentsTest-493839450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e2ba4247-aaa7-4843-b0a3-95347d8e2300 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:19:27 devstack sudo[89244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e2ba4247-aaa7-4843-b0a3-95347d8e2300 Sep 29 18:19:27 devstack sudo[89244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:19:27 devstack sudo[89244]: pam_unix(sudo:session): session closed for user root Sep 29 18:19:27 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-62d9b31d-22b7-4fb4-9ca2-d13fd87159d3 tempest-TaggedAttachmentsTest-493839450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e2ba4247-aaa7-4843-b0a3-95347d8e2300" returned: 0 in 0.404s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:19:27 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-62d9b31d-22b7-4fb4-9ca2-d13fd87159d3 tempest-TaggedAttachmentsTest-493839450 None] Lock "cinder-quobyte-e2ba4247-aaa7-4843-b0a3-95347d8e2300" released by "delete_volume" :: held 1.038s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:19:27 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-62d9b31d-22b7-4fb4-9ca2-d13fd87159d3 tempest-TaggedAttachmentsTest-493839450 None] Created reservations ['0d5202e0-43a8-4a3b-8429-a599544f1958', '5bdc45f5-32de-44b2-9a1e-ecf12392297f', '3c20d794-9a71-478e-9448-bfaddf8ce053', 'fe007b67-e8fb-4b87-b11e-285c3adc2e36'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:19:27 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-62d9b31d-22b7-4fb4-9ca2-d13fd87159d3 tempest-TaggedAttachmentsTest-493839450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:19:27 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-62d9b31d-22b7-4fb4-9ca2-d13fd87159d3 tempest-TaggedAttachmentsTest-493839450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:19:27 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-62d9b31d-22b7-4fb4-9ca2-d13fd87159d3 tempest-TaggedAttachmentsTest-493839450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:19:27 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-62d9b31d-22b7-4fb4-9ca2-d13fd87159d3 tempest-TaggedAttachmentsTest-493839450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:19:27 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-62d9b31d-22b7-4fb4-9ca2-d13fd87159d3 tempest-TaggedAttachmentsTest-493839450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:19:27 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-62d9b31d-22b7-4fb4-9ca2-d13fd87159d3 tempest-TaggedAttachmentsTest-493839450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:19:27 devstack sudo[89252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:19:27 devstack sudo[89252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:19:28 devstack sudo[89252]: pam_unix(sudo:session): session closed for user root Sep 29 18:19:28 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-62d9b31d-22b7-4fb4-9ca2-d13fd87159d3 tempest-TaggedAttachmentsTest-493839450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.443s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:19:28 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-62d9b31d-22b7-4fb4-9ca2-d13fd87159d3 tempest-TaggedAttachmentsTest-493839450 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:19:28 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-62d9b31d-22b7-4fb4-9ca2-d13fd87159d3 tempest-TaggedAttachmentsTest-493839450 None] Deleted volume successfully. Sep 29 18:19:28 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-62d9b31d-22b7-4fb4-9ca2-d13fd87159d3 tempest-TaggedAttachmentsTest-493839450 None] Lock "cinder-e2ba4247-aaa7-4843-b0a3-95347d8e2300-delete_volume" released by "delete_volume" :: held 1.912s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:19:37 devstack cinder-volume[86512]: DEBUG dbcounter [-] [86512] Writing DB stats cinder:SELECT=4,cinder:INSERT=2,cinder:UPDATE=8 {{(pid=86512) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 18:19:38 devstack cinder-volume[86512]: DEBUG dbcounter [-] [86512] Writing DB stats cinder:SELECT=6,cinder:UPDATE=8,cinder:INSERT=2,cinder:DELETE=1 {{(pid=86512) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 18:19:50 devstack cinder-volume[86512]: DEBUG oslo_service.periodic_task [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86512) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 18:19:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:19:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:19:50 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:19:50 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:19:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:19:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:19:50 devstack sudo[89357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:19:50 devstack sudo[89357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:19:51 devstack sudo[89357]: pam_unix(sudo:session): session closed for user root Sep 29 18:19:51 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.566s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:19:51 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:19:51 devstack cinder-volume[86512]: DEBUG oslo_service.periodic_task [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Running periodic task VolumeManager._thread_info {{(pid=86512) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 18:19:51 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] thread count: 8 {{(pid=86512) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 29 18:19:51 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] thread info: [<_MainThread(MainThread, started 135593654804608)>, , , , , , , ] {{(pid=86512) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 29 18:19:52 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-430af9dc-d23e-423a-976a-a4d8cedc4e19 tempest-AttachVolumeShelveTestJSON-1381023116 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86512) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:19:52 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-430af9dc-d23e-423a-976a-a4d8cedc4e19 tempest-AttachVolumeShelveTestJSON-1381023116 None] Flow 'volume_create_manager' (d7c112c6-7553-4318-9fa9-85c389445828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:19:52 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-430af9dc-d23e-423a-976a-a4d8cedc4e19 tempest-AttachVolumeShelveTestJSON-1381023116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce8c1a10-4bc8-44ac-b662-74cb4e60f72b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:19:52 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-430af9dc-d23e-423a-976a-a4d8cedc4e19 tempest-AttachVolumeShelveTestJSON-1381023116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce8c1a10-4bc8-44ac-b662-74cb4e60f72b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:19:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1979076244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80deef43-55f2-44fc-b1d0-8271a3e9fefd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='372298b16a484e5399e735ae5f1b1c5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:19:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:19:52Z,use_quota=True,user_id='a52671f7e66a47e0ac497fb044f39440',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:19:52 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-430af9dc-d23e-423a-976a-a4d8cedc4e19 tempest-AttachVolumeShelveTestJSON-1381023116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6b4b86f-2686-475b-b337-07b64b46860e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:19:52 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-430af9dc-d23e-423a-976a-a4d8cedc4e19 tempest-AttachVolumeShelveTestJSON-1381023116 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6b4b86f-2686-475b-b337-07b64b46860e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:19:52 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-430af9dc-d23e-423a-976a-a4d8cedc4e19 tempest-AttachVolumeShelveTestJSON-1381023116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2eb970e0-db28-45c5-b271-93337623394c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:19:52 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-430af9dc-d23e-423a-976a-a4d8cedc4e19 tempest-AttachVolumeShelveTestJSON-1381023116 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2eb970e0-db28-45c5-b271-93337623394c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80deef43-55f2-44fc-b1d0-8271a3e9fefd', 'volume_name': 'volume-80deef43-55f2-44fc-b1d0-8271a3e9fefd', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:19:52 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-430af9dc-d23e-423a-976a-a4d8cedc4e19 tempest-AttachVolumeShelveTestJSON-1381023116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52fa007c-2d9f-4217-8d5f-d58db9b382a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:19:52 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-430af9dc-d23e-423a-976a-a4d8cedc4e19 tempest-AttachVolumeShelveTestJSON-1381023116 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52fa007c-2d9f-4217-8d5f-d58db9b382a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:19:52 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-430af9dc-d23e-423a-976a-a4d8cedc4e19 tempest-AttachVolumeShelveTestJSON-1381023116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0007ff3-74b4-447e-9dd0-681d5ce9b4e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:19:52 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-430af9dc-d23e-423a-976a-a4d8cedc4e19 tempest-AttachVolumeShelveTestJSON-1381023116 None] Volume 80deef43-55f2-44fc-b1d0-8271a3e9fefd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80deef43-55f2-44fc-b1d0-8271a3e9fefd', 'volume_size': 1} Sep 29 18:19:52 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-430af9dc-d23e-423a-976a-a4d8cedc4e19 tempest-AttachVolumeShelveTestJSON-1381023116 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:19:52 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-430af9dc-d23e-423a-976a-a4d8cedc4e19 tempest-AttachVolumeShelveTestJSON-1381023116 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:19:52 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-430af9dc-d23e-423a-976a-a4d8cedc4e19 tempest-AttachVolumeShelveTestJSON-1381023116 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:19:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1979076244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80deef43-55f2-44fc-b1d0-8271a3e9fefd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='372298b16a484e5399e735ae5f1b1c5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:19:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:19:52Z,use_quota=True,user_id='a52671f7e66a47e0ac497fb044f39440',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)}" {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:19:52 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-430af9dc-d23e-423a-976a-a4d8cedc4e19 tempest-AttachVolumeShelveTestJSON-1381023116 None] Creating volume 80deef43-55f2-44fc-b1d0-8271a3e9fefd {{(pid=86512) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:19:52 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-430af9dc-d23e-423a-976a-a4d8cedc4e19 tempest-AttachVolumeShelveTestJSON-1381023116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:19:52 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-430af9dc-d23e-423a-976a-a4d8cedc4e19 tempest-AttachVolumeShelveTestJSON-1381023116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:19:52 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-430af9dc-d23e-423a-976a-a4d8cedc4e19 tempest-AttachVolumeShelveTestJSON-1381023116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:19:52 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-430af9dc-d23e-423a-976a-a4d8cedc4e19 tempest-AttachVolumeShelveTestJSON-1381023116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:19:52 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-430af9dc-d23e-423a-976a-a4d8cedc4e19 tempest-AttachVolumeShelveTestJSON-1381023116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:19:52 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-430af9dc-d23e-423a-976a-a4d8cedc4e19 tempest-AttachVolumeShelveTestJSON-1381023116 None] Selected osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 as target Quobyte volume. {{(pid=86512) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:19:52 devstack cinder-volume[86512]: INFO cinder.volume.drivers.remotefs [None req-430af9dc-d23e-423a-976a-a4d8cedc4e19 tempest-AttachVolumeShelveTestJSON-1381023116 None] casted to osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 Sep 29 18:19:52 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-430af9dc-d23e-423a-976a-a4d8cedc4e19 tempest-AttachVolumeShelveTestJSON-1381023116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-80deef43-55f2-44fc-b1d0-8271a3e9fefd 1073741824 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:19:52 devstack sudo[89435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-80deef43-55f2-44fc-b1d0-8271a3e9fefd 1073741824 Sep 29 18:19:52 devstack sudo[89435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:19:53 devstack sudo[89435]: pam_unix(sudo:session): session closed for user root Sep 29 18:19:53 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-430af9dc-d23e-423a-976a-a4d8cedc4e19 tempest-AttachVolumeShelveTestJSON-1381023116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-80deef43-55f2-44fc-b1d0-8271a3e9fefd 1073741824" returned: 0 in 0.528s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:19:53 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-430af9dc-d23e-423a-976a-a4d8cedc4e19 tempest-AttachVolumeShelveTestJSON-1381023116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-80deef43-55f2-44fc-b1d0-8271a3e9fefd {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:19:53 devstack sudo[89453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-80deef43-55f2-44fc-b1d0-8271a3e9fefd Sep 29 18:19:53 devstack sudo[89453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:19:53 devstack sudo[89453]: pam_unix(sudo:session): session closed for user root Sep 29 18:19:53 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-430af9dc-d23e-423a-976a-a4d8cedc4e19 tempest-AttachVolumeShelveTestJSON-1381023116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-80deef43-55f2-44fc-b1d0-8271a3e9fefd" returned: 0 in 0.384s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:19:53 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-430af9dc-d23e-423a-976a-a4d8cedc4e19 tempest-AttachVolumeShelveTestJSON-1381023116 None] <== create_volume: return (976ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'} {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:19:53 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-430af9dc-d23e-423a-976a-a4d8cedc4e19 tempest-AttachVolumeShelveTestJSON-1381023116 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.980s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:19:53 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-430af9dc-d23e-423a-976a-a4d8cedc4e19 tempest-AttachVolumeShelveTestJSON-1381023116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0007ff3-74b4-447e-9dd0-681d5ce9b4e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80deef43-55f2-44fc-b1d0-8271a3e9fefd', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:19:53 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-430af9dc-d23e-423a-976a-a4d8cedc4e19 tempest-AttachVolumeShelveTestJSON-1381023116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95a0f5d5-26e0-4cb2-ae1a-1cd5425e2bd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:19:53 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-430af9dc-d23e-423a-976a-a4d8cedc4e19 tempest-AttachVolumeShelveTestJSON-1381023116 None] Volume volume-80deef43-55f2-44fc-b1d0-8271a3e9fefd (80deef43-55f2-44fc-b1d0-8271a3e9fefd): created successfully Sep 29 18:19:53 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-430af9dc-d23e-423a-976a-a4d8cedc4e19 tempest-AttachVolumeShelveTestJSON-1381023116 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95a0f5d5-26e0-4cb2-ae1a-1cd5425e2bd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:19:53 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-430af9dc-d23e-423a-976a-a4d8cedc4e19 tempest-AttachVolumeShelveTestJSON-1381023116 None] Flow 'volume_create_manager' (d7c112c6-7553-4318-9fa9-85c389445828) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:19:53 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-430af9dc-d23e-423a-976a-a4d8cedc4e19 tempest-AttachVolumeShelveTestJSON-1381023116 None] Created volume successfully. Sep 29 18:20:03 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-90976d34-3a36-498a-baac-f73f0e3ca35c tempest-VolumesTransfersV355Test-1745901804 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86512) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:20:03 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-90976d34-3a36-498a-baac-f73f0e3ca35c tempest-VolumesTransfersV355Test-1745901804 None] Flow 'volume_create_manager' (602a74c0-475f-4794-882d-8ee33002195c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:20:03 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-90976d34-3a36-498a-baac-f73f0e3ca35c tempest-VolumesTransfersV355Test-1745901804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5750a04-e23e-4125-8774-27156617533c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:20:03 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-90976d34-3a36-498a-baac-f73f0e3ca35c tempest-VolumesTransfersV355Test-1745901804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5750a04-e23e-4125-8774-27156617533c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:20:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2019160192',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c1f70d2-faf9-4280-989b-3a4828464b44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7a57d0d939c4a8aaffb64f45ff017f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:20:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:20:03Z,use_quota=True,user_id='d7cc134563104e49ad1ba3da67038112',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:20:03 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-90976d34-3a36-498a-baac-f73f0e3ca35c tempest-VolumesTransfersV355Test-1745901804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79d51931-5931-4ac1-8262-16537c0a89e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:20:03 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-90976d34-3a36-498a-baac-f73f0e3ca35c tempest-VolumesTransfersV355Test-1745901804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79d51931-5931-4ac1-8262-16537c0a89e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:20:03 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-90976d34-3a36-498a-baac-f73f0e3ca35c tempest-VolumesTransfersV355Test-1745901804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (686b1a6f-5aba-47ae-88e0-9c5a8ff904ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:20:03 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-90976d34-3a36-498a-baac-f73f0e3ca35c tempest-VolumesTransfersV355Test-1745901804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (686b1a6f-5aba-47ae-88e0-9c5a8ff904ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c1f70d2-faf9-4280-989b-3a4828464b44', 'volume_name': 'volume-4c1f70d2-faf9-4280-989b-3a4828464b44', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:20:03 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-90976d34-3a36-498a-baac-f73f0e3ca35c tempest-VolumesTransfersV355Test-1745901804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d352a38f-2011-44c9-8dba-ce5b112d7259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:20:03 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-90976d34-3a36-498a-baac-f73f0e3ca35c tempest-VolumesTransfersV355Test-1745901804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d352a38f-2011-44c9-8dba-ce5b112d7259) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:20:03 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-90976d34-3a36-498a-baac-f73f0e3ca35c tempest-VolumesTransfersV355Test-1745901804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50dbd736-bf94-43b6-bf7f-8f9868aa3d62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:20:03 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-90976d34-3a36-498a-baac-f73f0e3ca35c tempest-VolumesTransfersV355Test-1745901804 None] Volume 4c1f70d2-faf9-4280-989b-3a4828464b44: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c1f70d2-faf9-4280-989b-3a4828464b44', 'volume_size': 1} Sep 29 18:20:03 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-90976d34-3a36-498a-baac-f73f0e3ca35c tempest-VolumesTransfersV355Test-1745901804 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:20:03 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-90976d34-3a36-498a-baac-f73f0e3ca35c tempest-VolumesTransfersV355Test-1745901804 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:20:03 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-90976d34-3a36-498a-baac-f73f0e3ca35c tempest-VolumesTransfersV355Test-1745901804 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:20:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2019160192',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c1f70d2-faf9-4280-989b-3a4828464b44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7a57d0d939c4a8aaffb64f45ff017f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:20:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:20:03Z,use_quota=True,user_id='d7cc134563104e49ad1ba3da67038112',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)}" {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:20:03 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-90976d34-3a36-498a-baac-f73f0e3ca35c tempest-VolumesTransfersV355Test-1745901804 None] Creating volume 4c1f70d2-faf9-4280-989b-3a4828464b44 {{(pid=86512) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:20:03 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-90976d34-3a36-498a-baac-f73f0e3ca35c tempest-VolumesTransfersV355Test-1745901804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:20:03 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-90976d34-3a36-498a-baac-f73f0e3ca35c tempest-VolumesTransfersV355Test-1745901804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:20:03 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-90976d34-3a36-498a-baac-f73f0e3ca35c tempest-VolumesTransfersV355Test-1745901804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:20:03 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-90976d34-3a36-498a-baac-f73f0e3ca35c tempest-VolumesTransfersV355Test-1745901804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:20:03 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-90976d34-3a36-498a-baac-f73f0e3ca35c tempest-VolumesTransfersV355Test-1745901804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:20:03 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-90976d34-3a36-498a-baac-f73f0e3ca35c tempest-VolumesTransfersV355Test-1745901804 None] Selected osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 as target Quobyte volume. {{(pid=86512) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:20:03 devstack cinder-volume[86512]: INFO cinder.volume.drivers.remotefs [None req-90976d34-3a36-498a-baac-f73f0e3ca35c tempest-VolumesTransfersV355Test-1745901804 None] casted to osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 Sep 29 18:20:03 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-90976d34-3a36-498a-baac-f73f0e3ca35c tempest-VolumesTransfersV355Test-1745901804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-4c1f70d2-faf9-4280-989b-3a4828464b44 1073741824 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:20:03 devstack sudo[89491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-4c1f70d2-faf9-4280-989b-3a4828464b44 1073741824 Sep 29 18:20:03 devstack sudo[89491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:20:04 devstack sudo[89491]: pam_unix(sudo:session): session closed for user root Sep 29 18:20:04 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-90976d34-3a36-498a-baac-f73f0e3ca35c tempest-VolumesTransfersV355Test-1745901804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-4c1f70d2-faf9-4280-989b-3a4828464b44 1073741824" returned: 0 in 0.782s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:20:04 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-90976d34-3a36-498a-baac-f73f0e3ca35c tempest-VolumesTransfersV355Test-1745901804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-4c1f70d2-faf9-4280-989b-3a4828464b44 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:20:04 devstack sudo[89498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-4c1f70d2-faf9-4280-989b-3a4828464b44 Sep 29 18:20:04 devstack sudo[89498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:20:04 devstack sudo[89498]: pam_unix(sudo:session): session closed for user root Sep 29 18:20:04 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-90976d34-3a36-498a-baac-f73f0e3ca35c tempest-VolumesTransfersV355Test-1745901804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-4c1f70d2-faf9-4280-989b-3a4828464b44" returned: 0 in 0.321s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:20:04 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-90976d34-3a36-498a-baac-f73f0e3ca35c tempest-VolumesTransfersV355Test-1745901804 None] <== create_volume: return (1204ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'} {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:20:04 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-90976d34-3a36-498a-baac-f73f0e3ca35c tempest-VolumesTransfersV355Test-1745901804 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.207s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:20:04 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-90976d34-3a36-498a-baac-f73f0e3ca35c tempest-VolumesTransfersV355Test-1745901804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50dbd736-bf94-43b6-bf7f-8f9868aa3d62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c1f70d2-faf9-4280-989b-3a4828464b44', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:20:04 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-90976d34-3a36-498a-baac-f73f0e3ca35c tempest-VolumesTransfersV355Test-1745901804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56e0b270-0ec8-4b95-925f-00fca4c8e8de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:20:04 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-90976d34-3a36-498a-baac-f73f0e3ca35c tempest-VolumesTransfersV355Test-1745901804 None] Volume volume-4c1f70d2-faf9-4280-989b-3a4828464b44 (4c1f70d2-faf9-4280-989b-3a4828464b44): created successfully Sep 29 18:20:04 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-90976d34-3a36-498a-baac-f73f0e3ca35c tempest-VolumesTransfersV355Test-1745901804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56e0b270-0ec8-4b95-925f-00fca4c8e8de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:20:04 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-90976d34-3a36-498a-baac-f73f0e3ca35c tempest-VolumesTransfersV355Test-1745901804 None] Flow 'volume_create_manager' (602a74c0-475f-4794-882d-8ee33002195c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:20:04 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-90976d34-3a36-498a-baac-f73f0e3ca35c tempest-VolumesTransfersV355Test-1745901804 None] Created volume successfully. Sep 29 18:20:06 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-3dfed2cf-f48a-497b-b967-ae5ab44951b4 tempest-VolumesTransfersV355Test-2039783845 None] Transfer volume completed successfully. Sep 29 18:20:07 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-bfe5ad86-90f5-4161-8f9e-ae1b314fed4f tempest-VolumesTransfersV355Test-543731210 None] Acquiring lock "cinder-4c1f70d2-faf9-4280-989b-3a4828464b44-delete_volume" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:20:07 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-bfe5ad86-90f5-4161-8f9e-ae1b314fed4f tempest-VolumesTransfersV355Test-543731210 None] Lock "cinder-4c1f70d2-faf9-4280-989b-3a4828464b44-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:20:07 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-bfe5ad86-90f5-4161-8f9e-ae1b314fed4f tempest-VolumesTransfersV355Test-543731210 None] Acquiring lock "cinder-quobyte-4c1f70d2-faf9-4280-989b-3a4828464b44" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:20:07 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-bfe5ad86-90f5-4161-8f9e-ae1b314fed4f tempest-VolumesTransfersV355Test-543731210 None] Lock "cinder-quobyte-4c1f70d2-faf9-4280-989b-3a4828464b44" acquired by "delete_volume" :: waited 0.026s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:20:07 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5df6528-25fc-425e-9564-b269615f3db2]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:20:07 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-bfe5ad86-90f5-4161-8f9e-ae1b314fed4f tempest-VolumesTransfersV355Test-543731210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-4c1f70d2-faf9-4280-989b-3a4828464b44 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:20:07 devstack sudo[89540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-4c1f70d2-faf9-4280-989b-3a4828464b44 Sep 29 18:20:07 devstack sudo[89540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:20:07 devstack sudo[89540]: pam_unix(sudo:session): session closed for user root Sep 29 18:20:08 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-bfe5ad86-90f5-4161-8f9e-ae1b314fed4f tempest-VolumesTransfersV355Test-543731210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-4c1f70d2-faf9-4280-989b-3a4828464b44" returned: 0 in 0.423s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:20:08 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-bfe5ad86-90f5-4161-8f9e-ae1b314fed4f tempest-VolumesTransfersV355Test-543731210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-4c1f70d2-faf9-4280-989b-3a4828464b44 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:20:08 devstack sudo[89546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-4c1f70d2-faf9-4280-989b-3a4828464b44 Sep 29 18:20:08 devstack sudo[89546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:20:08 devstack sudo[89546]: pam_unix(sudo:session): session closed for user root Sep 29 18:20:08 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-bfe5ad86-90f5-4161-8f9e-ae1b314fed4f tempest-VolumesTransfersV355Test-543731210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-4c1f70d2-faf9-4280-989b-3a4828464b44" returned: 0 in 0.287s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:20:08 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-bfe5ad86-90f5-4161-8f9e-ae1b314fed4f tempest-VolumesTransfersV355Test-543731210 None] Lock "cinder-quobyte-4c1f70d2-faf9-4280-989b-3a4828464b44" released by "delete_volume" :: held 0.764s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:20:08 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-bfe5ad86-90f5-4161-8f9e-ae1b314fed4f tempest-VolumesTransfersV355Test-543731210 None] Created reservations ['c28d12d8-533d-4d1f-8bb8-314bc4c472d5', 'b9800bb9-37fb-40c3-a594-4c093a4eae00', 'b80ad7b1-7ff3-4d40-8a5d-08049977180c', '03adcf58-d637-4951-a6e9-dc795405dca7'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:20:08 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-bfe5ad86-90f5-4161-8f9e-ae1b314fed4f tempest-VolumesTransfersV355Test-543731210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:20:08 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-bfe5ad86-90f5-4161-8f9e-ae1b314fed4f tempest-VolumesTransfersV355Test-543731210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:20:08 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-bfe5ad86-90f5-4161-8f9e-ae1b314fed4f tempest-VolumesTransfersV355Test-543731210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:20:08 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-bfe5ad86-90f5-4161-8f9e-ae1b314fed4f tempest-VolumesTransfersV355Test-543731210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:20:08 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-bfe5ad86-90f5-4161-8f9e-ae1b314fed4f tempest-VolumesTransfersV355Test-543731210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:20:08 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-bfe5ad86-90f5-4161-8f9e-ae1b314fed4f tempest-VolumesTransfersV355Test-543731210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:20:08 devstack sudo[89552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:20:08 devstack sudo[89552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:20:08 devstack sudo[89552]: pam_unix(sudo:session): session closed for user root Sep 29 18:20:08 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-bfe5ad86-90f5-4161-8f9e-ae1b314fed4f tempest-VolumesTransfersV355Test-543731210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.290s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:20:08 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-bfe5ad86-90f5-4161-8f9e-ae1b314fed4f tempest-VolumesTransfersV355Test-543731210 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:20:08 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-bfe5ad86-90f5-4161-8f9e-ae1b314fed4f tempest-VolumesTransfersV355Test-543731210 None] Deleted volume successfully. Sep 29 18:20:08 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-bfe5ad86-90f5-4161-8f9e-ae1b314fed4f tempest-VolumesTransfersV355Test-543731210 None] Lock "cinder-4c1f70d2-faf9-4280-989b-3a4828464b44-delete_volume" released by "delete_volume" :: held 1.308s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:20:09 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-25c538e8-07a9-41ae-b0bc-c5b9da1272b2 tempest-VolumesTransfersV355Test-1745901804 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86512) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:20:09 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-25c538e8-07a9-41ae-b0bc-c5b9da1272b2 tempest-VolumesTransfersV355Test-1745901804 None] Flow 'volume_create_manager' (f46b6af0-78b9-4b25-936a-3567928c1cb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:20:09 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-25c538e8-07a9-41ae-b0bc-c5b9da1272b2 tempest-VolumesTransfersV355Test-1745901804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a70c465a-2ee9-4cb3-85ca-b9e3245b58a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:20:09 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-25c538e8-07a9-41ae-b0bc-c5b9da1272b2 tempest-VolumesTransfersV355Test-1745901804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a70c465a-2ee9-4cb3-85ca-b9e3245b58a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:20:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-705229638',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cddf74b2-2d95-4aba-be6b-14c7d7747a08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7a57d0d939c4a8aaffb64f45ff017f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:20:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:20:09Z,use_quota=True,user_id='d7cc134563104e49ad1ba3da67038112',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:20:09 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-25c538e8-07a9-41ae-b0bc-c5b9da1272b2 tempest-VolumesTransfersV355Test-1745901804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45890048-8979-46c8-9c66-f1f6c3a86d42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:20:09 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-25c538e8-07a9-41ae-b0bc-c5b9da1272b2 tempest-VolumesTransfersV355Test-1745901804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45890048-8979-46c8-9c66-f1f6c3a86d42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:20:09 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-25c538e8-07a9-41ae-b0bc-c5b9da1272b2 tempest-VolumesTransfersV355Test-1745901804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fcfbb0a-39a5-40c1-a46c-6ca7de08401e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:20:09 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-25c538e8-07a9-41ae-b0bc-c5b9da1272b2 tempest-VolumesTransfersV355Test-1745901804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fcfbb0a-39a5-40c1-a46c-6ca7de08401e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cddf74b2-2d95-4aba-be6b-14c7d7747a08', 'volume_name': 'volume-cddf74b2-2d95-4aba-be6b-14c7d7747a08', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:20:09 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-25c538e8-07a9-41ae-b0bc-c5b9da1272b2 tempest-VolumesTransfersV355Test-1745901804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b833c4e5-88a4-4ae3-aea8-34096c4e23fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:20:09 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-25c538e8-07a9-41ae-b0bc-c5b9da1272b2 tempest-VolumesTransfersV355Test-1745901804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b833c4e5-88a4-4ae3-aea8-34096c4e23fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:20:09 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-25c538e8-07a9-41ae-b0bc-c5b9da1272b2 tempest-VolumesTransfersV355Test-1745901804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59dca353-0b49-42e7-a5f8-8a11be05d231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:20:09 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-25c538e8-07a9-41ae-b0bc-c5b9da1272b2 tempest-VolumesTransfersV355Test-1745901804 None] Volume cddf74b2-2d95-4aba-be6b-14c7d7747a08: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cddf74b2-2d95-4aba-be6b-14c7d7747a08', 'volume_size': 1} Sep 29 18:20:09 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-25c538e8-07a9-41ae-b0bc-c5b9da1272b2 tempest-VolumesTransfersV355Test-1745901804 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:20:09 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-25c538e8-07a9-41ae-b0bc-c5b9da1272b2 tempest-VolumesTransfersV355Test-1745901804 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:20:09 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-25c538e8-07a9-41ae-b0bc-c5b9da1272b2 tempest-VolumesTransfersV355Test-1745901804 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:20:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-705229638',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cddf74b2-2d95-4aba-be6b-14c7d7747a08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7a57d0d939c4a8aaffb64f45ff017f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:20:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:20:09Z,use_quota=True,user_id='d7cc134563104e49ad1ba3da67038112',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)}" {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:20:09 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-25c538e8-07a9-41ae-b0bc-c5b9da1272b2 tempest-VolumesTransfersV355Test-1745901804 None] Creating volume cddf74b2-2d95-4aba-be6b-14c7d7747a08 {{(pid=86512) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:20:09 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-25c538e8-07a9-41ae-b0bc-c5b9da1272b2 tempest-VolumesTransfersV355Test-1745901804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:20:09 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-25c538e8-07a9-41ae-b0bc-c5b9da1272b2 tempest-VolumesTransfersV355Test-1745901804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:20:09 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-25c538e8-07a9-41ae-b0bc-c5b9da1272b2 tempest-VolumesTransfersV355Test-1745901804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:20:09 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-25c538e8-07a9-41ae-b0bc-c5b9da1272b2 tempest-VolumesTransfersV355Test-1745901804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:20:09 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-25c538e8-07a9-41ae-b0bc-c5b9da1272b2 tempest-VolumesTransfersV355Test-1745901804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:20:09 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-25c538e8-07a9-41ae-b0bc-c5b9da1272b2 tempest-VolumesTransfersV355Test-1745901804 None] Selected osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 as target Quobyte volume. {{(pid=86512) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:20:09 devstack cinder-volume[86512]: INFO cinder.volume.drivers.remotefs [None req-25c538e8-07a9-41ae-b0bc-c5b9da1272b2 tempest-VolumesTransfersV355Test-1745901804 None] casted to osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 Sep 29 18:20:09 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-25c538e8-07a9-41ae-b0bc-c5b9da1272b2 tempest-VolumesTransfersV355Test-1745901804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-cddf74b2-2d95-4aba-be6b-14c7d7747a08 1073741824 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:20:09 devstack sudo[89557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-cddf74b2-2d95-4aba-be6b-14c7d7747a08 1073741824 Sep 29 18:20:09 devstack sudo[89557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:20:09 devstack sudo[89557]: pam_unix(sudo:session): session closed for user root Sep 29 18:20:09 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-25c538e8-07a9-41ae-b0bc-c5b9da1272b2 tempest-VolumesTransfersV355Test-1745901804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-cddf74b2-2d95-4aba-be6b-14c7d7747a08 1073741824" returned: 0 in 0.627s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:20:10 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [req-58df6aba-f0d9-4cac-832b-27151d27eb1b req-3f1cbfd8-7614-4c93-9630-3eeb8b88f0b8 tempest-AttachVolumeShelveTestJSON-1381023116 None] No connector for attachment cce5f6e5-1819-44b8-a8ac-62a377836ec6; skipping storage backend terminate_connection call. {{(pid=86512) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Sep 29 18:20:10 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [req-58df6aba-f0d9-4cac-832b-27151d27eb1b req-3f1cbfd8-7614-4c93-9630-3eeb8b88f0b8 tempest-AttachVolumeShelveTestJSON-1381023116 None] Deleting attachment cce5f6e5-1819-44b8-a8ac-62a377836ec6. {{(pid=86512) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 29 18:20:10 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-25c538e8-07a9-41ae-b0bc-c5b9da1272b2 tempest-VolumesTransfersV355Test-1745901804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-cddf74b2-2d95-4aba-be6b-14c7d7747a08 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:20:10 devstack sudo[89568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-cddf74b2-2d95-4aba-be6b-14c7d7747a08 Sep 29 18:20:10 devstack sudo[89568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:20:10 devstack sudo[89568]: pam_unix(sudo:session): session closed for user root Sep 29 18:20:10 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-25c538e8-07a9-41ae-b0bc-c5b9da1272b2 tempest-VolumesTransfersV355Test-1745901804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-cddf74b2-2d95-4aba-be6b-14c7d7747a08" returned: 0 in 0.375s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:20:10 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-25c538e8-07a9-41ae-b0bc-c5b9da1272b2 tempest-VolumesTransfersV355Test-1745901804 None] <== create_volume: return (1130ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'} {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:20:10 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-25c538e8-07a9-41ae-b0bc-c5b9da1272b2 tempest-VolumesTransfersV355Test-1745901804 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.133s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:20:10 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-25c538e8-07a9-41ae-b0bc-c5b9da1272b2 tempest-VolumesTransfersV355Test-1745901804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59dca353-0b49-42e7-a5f8-8a11be05d231) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cddf74b2-2d95-4aba-be6b-14c7d7747a08', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:20:10 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-25c538e8-07a9-41ae-b0bc-c5b9da1272b2 tempest-VolumesTransfersV355Test-1745901804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10b410e7-23b2-43ae-8a6e-49e53862b33b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:20:10 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-25c538e8-07a9-41ae-b0bc-c5b9da1272b2 tempest-VolumesTransfersV355Test-1745901804 None] Volume volume-cddf74b2-2d95-4aba-be6b-14c7d7747a08 (cddf74b2-2d95-4aba-be6b-14c7d7747a08): created successfully Sep 29 18:20:10 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-25c538e8-07a9-41ae-b0bc-c5b9da1272b2 tempest-VolumesTransfersV355Test-1745901804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10b410e7-23b2-43ae-8a6e-49e53862b33b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:20:10 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-25c538e8-07a9-41ae-b0bc-c5b9da1272b2 tempest-VolumesTransfersV355Test-1745901804 None] Flow 'volume_create_manager' (f46b6af0-78b9-4b25-936a-3567928c1cb8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:20:10 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-25c538e8-07a9-41ae-b0bc-c5b9da1272b2 tempest-VolumesTransfersV355Test-1745901804 None] Created volume successfully. Sep 29 18:20:11 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-efe64dbc-d33a-4ce9-ba11-d96d7cb12dca tempest-VolumesTransfersV355Test-543731210 None] Acquiring lock "cinder-cddf74b2-2d95-4aba-be6b-14c7d7747a08-delete_volume" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:20:11 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-efe64dbc-d33a-4ce9-ba11-d96d7cb12dca tempest-VolumesTransfersV355Test-543731210 None] Lock "cinder-cddf74b2-2d95-4aba-be6b-14c7d7747a08-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:20:11 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-efe64dbc-d33a-4ce9-ba11-d96d7cb12dca tempest-VolumesTransfersV355Test-543731210 None] Acquiring lock "cinder-quobyte-cddf74b2-2d95-4aba-be6b-14c7d7747a08" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:20:11 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-efe64dbc-d33a-4ce9-ba11-d96d7cb12dca tempest-VolumesTransfersV355Test-543731210 None] Lock "cinder-quobyte-cddf74b2-2d95-4aba-be6b-14c7d7747a08" acquired by "delete_volume" :: waited 0.020s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:20:11 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b7f5309-b95a-4b12-a699-df5497860f8f]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:20:11 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-efe64dbc-d33a-4ce9-ba11-d96d7cb12dca tempest-VolumesTransfersV355Test-543731210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-cddf74b2-2d95-4aba-be6b-14c7d7747a08 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:20:11 devstack sudo[89586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-cddf74b2-2d95-4aba-be6b-14c7d7747a08 Sep 29 18:20:11 devstack sudo[89586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:20:12 devstack sudo[89586]: pam_unix(sudo:session): session closed for user root Sep 29 18:20:12 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-efe64dbc-d33a-4ce9-ba11-d96d7cb12dca tempest-VolumesTransfersV355Test-543731210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-cddf74b2-2d95-4aba-be6b-14c7d7747a08" returned: 0 in 0.535s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:20:12 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-efe64dbc-d33a-4ce9-ba11-d96d7cb12dca tempest-VolumesTransfersV355Test-543731210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-cddf74b2-2d95-4aba-be6b-14c7d7747a08 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:20:12 devstack sudo[89593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-cddf74b2-2d95-4aba-be6b-14c7d7747a08 Sep 29 18:20:12 devstack sudo[89593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:20:12 devstack sudo[89593]: pam_unix(sudo:session): session closed for user root Sep 29 18:20:12 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-efe64dbc-d33a-4ce9-ba11-d96d7cb12dca tempest-VolumesTransfersV355Test-543731210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-cddf74b2-2d95-4aba-be6b-14c7d7747a08" returned: 0 in 0.334s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:20:12 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-efe64dbc-d33a-4ce9-ba11-d96d7cb12dca tempest-VolumesTransfersV355Test-543731210 None] Lock "cinder-quobyte-cddf74b2-2d95-4aba-be6b-14c7d7747a08" released by "delete_volume" :: held 0.952s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:20:12 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-efe64dbc-d33a-4ce9-ba11-d96d7cb12dca tempest-VolumesTransfersV355Test-543731210 None] Created reservations ['440cd324-bd5f-4cdb-950c-c03a889338f9', '6c9187ac-0812-45e6-b07f-78a27c971b5c', '9393ec8c-c5f3-4d79-b5fa-2f20a9ae2289', 'a4492428-fede-4500-80cf-63421e3a93ab'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:20:13 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-efe64dbc-d33a-4ce9-ba11-d96d7cb12dca tempest-VolumesTransfersV355Test-543731210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:20:13 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-efe64dbc-d33a-4ce9-ba11-d96d7cb12dca tempest-VolumesTransfersV355Test-543731210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:20:13 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-efe64dbc-d33a-4ce9-ba11-d96d7cb12dca tempest-VolumesTransfersV355Test-543731210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:20:13 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-efe64dbc-d33a-4ce9-ba11-d96d7cb12dca tempest-VolumesTransfersV355Test-543731210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:20:13 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-efe64dbc-d33a-4ce9-ba11-d96d7cb12dca tempest-VolumesTransfersV355Test-543731210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:20:13 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-efe64dbc-d33a-4ce9-ba11-d96d7cb12dca tempest-VolumesTransfersV355Test-543731210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:20:13 devstack sudo[89630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:20:13 devstack sudo[89630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:20:13 devstack sudo[89630]: pam_unix(sudo:session): session closed for user root Sep 29 18:20:13 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-efe64dbc-d33a-4ce9-ba11-d96d7cb12dca tempest-VolumesTransfersV355Test-543731210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.514s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:20:13 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-efe64dbc-d33a-4ce9-ba11-d96d7cb12dca tempest-VolumesTransfersV355Test-543731210 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:20:13 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-efe64dbc-d33a-4ce9-ba11-d96d7cb12dca tempest-VolumesTransfersV355Test-543731210 None] Deleted volume successfully. Sep 29 18:20:13 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-efe64dbc-d33a-4ce9-ba11-d96d7cb12dca tempest-VolumesTransfersV355Test-543731210 None] Lock "cinder-cddf74b2-2d95-4aba-be6b-14c7d7747a08-delete_volume" released by "delete_volume" :: held 1.997s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:20:21 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-37e55610-cfd4-47b5-bf3a-39680ba77998 tempest-ServerActionsTestOtherA-2039946361 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86512) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:20:21 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-37e55610-cfd4-47b5-bf3a-39680ba77998 tempest-ServerActionsTestOtherA-2039946361 None] Flow 'volume_create_manager' (21c86d20-c008-4beb-8169-cbb57e477c3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:20:21 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-37e55610-cfd4-47b5-bf3a-39680ba77998 tempest-ServerActionsTestOtherA-2039946361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23f7ee02-3a7d-4096-8c07-ba7c36c7dead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:20:21 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-37e55610-cfd4-47b5-bf3a-39680ba77998 tempest-ServerActionsTestOtherA-2039946361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23f7ee02-3a7d-4096-8c07-ba7c36c7dead) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:20:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1481965251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca107c68-21e2-4c3b-a3b6-98a640e627a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f3d887fc4e845ef80c9bb8ffc45ec58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:20:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:20:21Z,use_quota=True,user_id='cfc3f4f30c5849dc955e4a322a35d496',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:20:21 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-37e55610-cfd4-47b5-bf3a-39680ba77998 tempest-ServerActionsTestOtherA-2039946361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (684f34be-0210-4980-8e33-e163baf921c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:20:21 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-37e55610-cfd4-47b5-bf3a-39680ba77998 tempest-ServerActionsTestOtherA-2039946361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (684f34be-0210-4980-8e33-e163baf921c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:20:21 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-37e55610-cfd4-47b5-bf3a-39680ba77998 tempest-ServerActionsTestOtherA-2039946361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41d9ee9f-0ca1-4c17-b6fb-ea0a703b619e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:20:21 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-37e55610-cfd4-47b5-bf3a-39680ba77998 tempest-ServerActionsTestOtherA-2039946361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41d9ee9f-0ca1-4c17-b6fb-ea0a703b619e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca107c68-21e2-4c3b-a3b6-98a640e627a0', 'volume_name': 'volume-ca107c68-21e2-4c3b-a3b6-98a640e627a0', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:20:21 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-37e55610-cfd4-47b5-bf3a-39680ba77998 tempest-ServerActionsTestOtherA-2039946361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79fdc1a6-0e7a-4cf9-a174-1b04d1e539fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:20:21 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-37e55610-cfd4-47b5-bf3a-39680ba77998 tempest-ServerActionsTestOtherA-2039946361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79fdc1a6-0e7a-4cf9-a174-1b04d1e539fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:20:21 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-37e55610-cfd4-47b5-bf3a-39680ba77998 tempest-ServerActionsTestOtherA-2039946361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (436a93e9-d4ae-43ab-9e62-9ebf22d9394a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:20:21 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-37e55610-cfd4-47b5-bf3a-39680ba77998 tempest-ServerActionsTestOtherA-2039946361 None] Volume ca107c68-21e2-4c3b-a3b6-98a640e627a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca107c68-21e2-4c3b-a3b6-98a640e627a0', 'volume_size': 1} Sep 29 18:20:21 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-37e55610-cfd4-47b5-bf3a-39680ba77998 tempest-ServerActionsTestOtherA-2039946361 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:20:21 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-37e55610-cfd4-47b5-bf3a-39680ba77998 tempest-ServerActionsTestOtherA-2039946361 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:20:21 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-37e55610-cfd4-47b5-bf3a-39680ba77998 tempest-ServerActionsTestOtherA-2039946361 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:20:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1481965251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca107c68-21e2-4c3b-a3b6-98a640e627a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f3d887fc4e845ef80c9bb8ffc45ec58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:20:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:20:21Z,use_quota=True,user_id='cfc3f4f30c5849dc955e4a322a35d496',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)}" {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:20:21 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-37e55610-cfd4-47b5-bf3a-39680ba77998 tempest-ServerActionsTestOtherA-2039946361 None] Creating volume ca107c68-21e2-4c3b-a3b6-98a640e627a0 {{(pid=86512) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:20:21 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-37e55610-cfd4-47b5-bf3a-39680ba77998 tempest-ServerActionsTestOtherA-2039946361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:20:21 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-37e55610-cfd4-47b5-bf3a-39680ba77998 tempest-ServerActionsTestOtherA-2039946361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:20:21 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-37e55610-cfd4-47b5-bf3a-39680ba77998 tempest-ServerActionsTestOtherA-2039946361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:20:21 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-37e55610-cfd4-47b5-bf3a-39680ba77998 tempest-ServerActionsTestOtherA-2039946361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:20:21 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-37e55610-cfd4-47b5-bf3a-39680ba77998 tempest-ServerActionsTestOtherA-2039946361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:20:21 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-37e55610-cfd4-47b5-bf3a-39680ba77998 tempest-ServerActionsTestOtherA-2039946361 None] Selected osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 as target Quobyte volume. {{(pid=86512) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:20:21 devstack cinder-volume[86512]: INFO cinder.volume.drivers.remotefs [None req-37e55610-cfd4-47b5-bf3a-39680ba77998 tempest-ServerActionsTestOtherA-2039946361 None] casted to osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 Sep 29 18:20:21 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-37e55610-cfd4-47b5-bf3a-39680ba77998 tempest-ServerActionsTestOtherA-2039946361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ca107c68-21e2-4c3b-a3b6-98a640e627a0 1073741824 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:20:21 devstack sudo[89730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ca107c68-21e2-4c3b-a3b6-98a640e627a0 1073741824 Sep 29 18:20:21 devstack sudo[89730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:20:22 devstack sudo[89730]: pam_unix(sudo:session): session closed for user root Sep 29 18:20:22 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-37e55610-cfd4-47b5-bf3a-39680ba77998 tempest-ServerActionsTestOtherA-2039946361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ca107c68-21e2-4c3b-a3b6-98a640e627a0 1073741824" returned: 0 in 1.289s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:20:22 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-37e55610-cfd4-47b5-bf3a-39680ba77998 tempest-ServerActionsTestOtherA-2039946361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ca107c68-21e2-4c3b-a3b6-98a640e627a0 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:20:22 devstack sudo[89736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ca107c68-21e2-4c3b-a3b6-98a640e627a0 Sep 29 18:20:22 devstack sudo[89736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:20:23 devstack sudo[89736]: pam_unix(sudo:session): session closed for user root Sep 29 18:20:23 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-37e55610-cfd4-47b5-bf3a-39680ba77998 tempest-ServerActionsTestOtherA-2039946361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ca107c68-21e2-4c3b-a3b6-98a640e627a0" returned: 0 in 0.563s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:20:23 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-37e55610-cfd4-47b5-bf3a-39680ba77998 tempest-ServerActionsTestOtherA-2039946361 None] <== create_volume: return (2013ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'} {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:20:23 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-37e55610-cfd4-47b5-bf3a-39680ba77998 tempest-ServerActionsTestOtherA-2039946361 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.017s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:20:23 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-37e55610-cfd4-47b5-bf3a-39680ba77998 tempest-ServerActionsTestOtherA-2039946361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (436a93e9-d4ae-43ab-9e62-9ebf22d9394a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca107c68-21e2-4c3b-a3b6-98a640e627a0', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:20:23 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-37e55610-cfd4-47b5-bf3a-39680ba77998 tempest-ServerActionsTestOtherA-2039946361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e4e9eae-7904-42cc-9d61-2cd741b73566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:20:23 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-37e55610-cfd4-47b5-bf3a-39680ba77998 tempest-ServerActionsTestOtherA-2039946361 None] Volume volume-ca107c68-21e2-4c3b-a3b6-98a640e627a0 (ca107c68-21e2-4c3b-a3b6-98a640e627a0): created successfully Sep 29 18:20:23 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-37e55610-cfd4-47b5-bf3a-39680ba77998 tempest-ServerActionsTestOtherA-2039946361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e4e9eae-7904-42cc-9d61-2cd741b73566) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:20:23 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-37e55610-cfd4-47b5-bf3a-39680ba77998 tempest-ServerActionsTestOtherA-2039946361 None] Flow 'volume_create_manager' (21c86d20-c008-4beb-8169-cbb57e477c3a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:20:23 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-37e55610-cfd4-47b5-bf3a-39680ba77998 tempest-ServerActionsTestOtherA-2039946361 None] Created volume successfully. Sep 29 18:20:28 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e2f2698-8a01-42d4-8904-980762ca63c2 tempest-VolumesExtendTest-1968261416 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86512) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:20:28 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-8e2f2698-8a01-42d4-8904-980762ca63c2 tempest-VolumesExtendTest-1968261416 None] Flow 'volume_create_manager' (f8fce74b-937b-4c5f-9ae4-00830eccaa99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:20:28 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-8e2f2698-8a01-42d4-8904-980762ca63c2 tempest-VolumesExtendTest-1968261416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42cafda8-94ca-41a2-9cd0-630e07e0308f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:20:28 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-8e2f2698-8a01-42d4-8904-980762ca63c2 tempest-VolumesExtendTest-1968261416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42cafda8-94ca-41a2-9cd0-630e07e0308f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:20:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1652156424',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad569af7-14d4-42b3-9698-860ed6ed9f40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfc6583626b541b99efb148cc231bad3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:20:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:20:29Z,use_quota=True,user_id='e310a1e36d2c46d4a481aa9a77192ac0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:20:28 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-8e2f2698-8a01-42d4-8904-980762ca63c2 tempest-VolumesExtendTest-1968261416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84343e29-c95c-47a6-b44d-7b6da0e0f6cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:20:29 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-8e2f2698-8a01-42d4-8904-980762ca63c2 tempest-VolumesExtendTest-1968261416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84343e29-c95c-47a6-b44d-7b6da0e0f6cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:20:29 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-8e2f2698-8a01-42d4-8904-980762ca63c2 tempest-VolumesExtendTest-1968261416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a7d21aa-8304-4a32-8bc1-d23cfd45024b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:20:29 devstack cinder-volume[86512]: DEBUG cinder.image.glance [None req-8e2f2698-8a01-42d4-8904-980762ca63c2 tempest-VolumesExtendTest-1968261416 None] Creating Keystone auth plugin from conf {{(pid=86512) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 29 18:20:30 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-8e2f2698-8a01-42d4-8904-980762ca63c2 tempest-VolumesExtendTest-1968261416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a7d21aa-8304-4a32-8bc1-d23cfd45024b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ad569af7-14d4-42b3-9698-860ed6ed9f40', 'volume_name': 'volume-ad569af7-14d4-42b3-9698-860ed6ed9f40', 'volume_size': 1, 'image_id': 'd8ebca63-1178-4b36-a1a2-e10949cbc87f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d8ebca63-1178-4b36-a1a2-e10949cbc87f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '987aeb00888a4b9bb9954392d91b8741', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd8ebca63-1178-4b36-a1a2-e10949cbc87f', 'created_at': datetime.datetime(2026, 9, 29, 16, 11, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 16, 11, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d8ebca63-1178-4b36-a1a2-e10949cbc87f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:20:30 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-8e2f2698-8a01-42d4-8904-980762ca63c2 tempest-VolumesExtendTest-1968261416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e85c1860-a3c1-429f-bb31-3e3dedc2e0f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:20:30 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-8e2f2698-8a01-42d4-8904-980762ca63c2 tempest-VolumesExtendTest-1968261416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e85c1860-a3c1-429f-bb31-3e3dedc2e0f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:20:30 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-8e2f2698-8a01-42d4-8904-980762ca63c2 tempest-VolumesExtendTest-1968261416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ef3d880-31b0-4bb1-8083-77afc7da75c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:20:30 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-8e2f2698-8a01-42d4-8904-980762ca63c2 tempest-VolumesExtendTest-1968261416 None] Volume ad569af7-14d4-42b3-9698-860ed6ed9f40: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ad569af7-14d4-42b3-9698-860ed6ed9f40', 'volume_size': 1, 'image_id': 'd8ebca63-1178-4b36-a1a2-e10949cbc87f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d8ebca63-1178-4b36-a1a2-e10949cbc87f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '987aeb00888a4b9bb9954392d91b8741', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd8ebca63-1178-4b36-a1a2-e10949cbc87f', 'created_at': datetime.datetime(2026, 9, 29, 16, 11, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 16, 11, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d8ebca63-1178-4b36-a1a2-e10949cbc87f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 29 18:20:30 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e2f2698-8a01-42d4-8904-980762ca63c2 tempest-VolumesExtendTest-1968261416 None] Trying to clone ad569af7-14d4-42b3-9698-860ed6ed9f40 from image d8ebca63-1178-4b36-a1a2-e10949cbc87f at location (None, [{'url': 'file:///opt/stack/data/glance/images/d8ebca63-1178-4b36-a1a2-e10949cbc87f', 'metadata': {}}]). {{(pid=86512) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 29 18:20:31 devstack cinder-volume[86512]: DEBUG cinder.image.image_utils [None req-8e2f2698-8a01-42d4-8904-980762ca63c2 tempest-VolumesExtendTest-1968261416 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d8ebca63-1178-4b36-a1a2-e10949cbc87f_jpe7l36rdevstack@QuobyteHD, size 20.69 MB, duration 1.01 sec {{(pid=86512) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 29 18:20:31 devstack cinder-volume[86512]: INFO cinder.image.image_utils [None req-8e2f2698-8a01-42d4-8904-980762ca63c2 tempest-VolumesExtendTest-1968261416 None] Image download 20.69 MB at 20.56 MB/s Sep 29 18:20:31 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[96c77a64-76e2-43c6-a752-aa36d0997221]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:20:31 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-8e2f2698-8a01-42d4-8904-980762ca63c2 tempest-VolumesExtendTest-1968261416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d8ebca63-1178-4b36-a1a2-e10949cbc87f_jpe7l36rdevstack@QuobyteHD {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:20:31 devstack sudo[89959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d8ebca63-1178-4b36-a1a2-e10949cbc87f_jpe7l36rdevstack@QuobyteHD Sep 29 18:20:31 devstack sudo[89959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:20:32 devstack sudo[89959]: pam_unix(sudo:session): session closed for user root Sep 29 18:20:32 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-8e2f2698-8a01-42d4-8904-980762ca63c2 tempest-VolumesExtendTest-1968261416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d8ebca63-1178-4b36-a1a2-e10949cbc87f_jpe7l36rdevstack@QuobyteHD" returned: 0 in 0.859s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:20:32 devstack cinder-volume[86512]: DEBUG cinder.image.image_utils [None req-8e2f2698-8a01-42d4-8904-980762ca63c2 tempest-VolumesExtendTest-1968261416 None] Temporary image d8ebca63-1178-4b36-a1a2-e10949cbc87f is fetched for user e310a1e36d2c46d4a481aa9a77192ac0. {{(pid=86512) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 29 18:20:32 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e010a8c-27ce-4c80-ad1d-546fa02c37a6]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:20:32 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-8e2f2698-8a01-42d4-8904-980762ca63c2 tempest-VolumesExtendTest-1968261416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d8ebca63-1178-4b36-a1a2-e10949cbc87f_jpe7l36rdevstack@QuobyteHD {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:20:32 devstack sudo[89982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d8ebca63-1178-4b36-a1a2-e10949cbc87f_jpe7l36rdevstack@QuobyteHD Sep 29 18:20:32 devstack sudo[89982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:20:32 devstack sudo[89982]: pam_unix(sudo:session): session closed for user root Sep 29 18:20:32 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-8e2f2698-8a01-42d4-8904-980762ca63c2 tempest-VolumesExtendTest-1968261416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d8ebca63-1178-4b36-a1a2-e10949cbc87f_jpe7l36rdevstack@QuobyteHD" returned: 0 in 0.376s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:20:32 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-8e2f2698-8a01-42d4-8904-980762ca63c2 tempest-VolumesExtendTest-1968261416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:20:32 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-8e2f2698-8a01-42d4-8904-980762ca63c2 tempest-VolumesExtendTest-1968261416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:20:32 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-8e2f2698-8a01-42d4-8904-980762ca63c2 tempest-VolumesExtendTest-1968261416 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:20:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1652156424',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad569af7-14d4-42b3-9698-860ed6ed9f40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfc6583626b541b99efb148cc231bad3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:20:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:20:29Z,use_quota=True,user_id='e310a1e36d2c46d4a481aa9a77192ac0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)}" {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:20:32 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-8e2f2698-8a01-42d4-8904-980762ca63c2 tempest-VolumesExtendTest-1968261416 None] Creating volume ad569af7-14d4-42b3-9698-860ed6ed9f40 {{(pid=86512) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:20:32 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-8e2f2698-8a01-42d4-8904-980762ca63c2 tempest-VolumesExtendTest-1968261416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:20:32 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-8e2f2698-8a01-42d4-8904-980762ca63c2 tempest-VolumesExtendTest-1968261416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:20:32 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-8e2f2698-8a01-42d4-8904-980762ca63c2 tempest-VolumesExtendTest-1968261416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:20:32 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-8e2f2698-8a01-42d4-8904-980762ca63c2 tempest-VolumesExtendTest-1968261416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:20:32 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-8e2f2698-8a01-42d4-8904-980762ca63c2 tempest-VolumesExtendTest-1968261416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:20:32 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-8e2f2698-8a01-42d4-8904-980762ca63c2 tempest-VolumesExtendTest-1968261416 None] Selected osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 as target Quobyte volume. {{(pid=86512) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:20:32 devstack cinder-volume[86512]: INFO cinder.volume.drivers.remotefs [None req-8e2f2698-8a01-42d4-8904-980762ca63c2 tempest-VolumesExtendTest-1968261416 None] casted to osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 Sep 29 18:20:32 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-8e2f2698-8a01-42d4-8904-980762ca63c2 tempest-VolumesExtendTest-1968261416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ad569af7-14d4-42b3-9698-860ed6ed9f40 1073741824 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:20:32 devstack sudo[90000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ad569af7-14d4-42b3-9698-860ed6ed9f40 1073741824 Sep 29 18:20:32 devstack sudo[90000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:20:33 devstack sudo[90000]: pam_unix(sudo:session): session closed for user root Sep 29 18:20:33 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-8e2f2698-8a01-42d4-8904-980762ca63c2 tempest-VolumesExtendTest-1968261416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ad569af7-14d4-42b3-9698-860ed6ed9f40 1073741824" returned: 0 in 0.815s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:20:33 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-8e2f2698-8a01-42d4-8904-980762ca63c2 tempest-VolumesExtendTest-1968261416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ad569af7-14d4-42b3-9698-860ed6ed9f40 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:20:33 devstack sudo[90007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ad569af7-14d4-42b3-9698-860ed6ed9f40 Sep 29 18:20:33 devstack sudo[90007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:20:34 devstack sudo[90007]: pam_unix(sudo:session): session closed for user root Sep 29 18:20:34 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-8e2f2698-8a01-42d4-8904-980762ca63c2 tempest-VolumesExtendTest-1968261416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ad569af7-14d4-42b3-9698-860ed6ed9f40" returned: 0 in 0.510s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:20:34 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-8e2f2698-8a01-42d4-8904-980762ca63c2 tempest-VolumesExtendTest-1968261416 None] <== create_volume: return (1406ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'} {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:20:34 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-8e2f2698-8a01-42d4-8904-980762ca63c2 tempest-VolumesExtendTest-1968261416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.411s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:20:34 devstack cinder-volume[86512]: DEBUG cinder.volume.volume_utils [None req-8e2f2698-8a01-42d4-8904-980762ca63c2 tempest-VolumesExtendTest-1968261416 None] Attempting download of d8ebca63-1178-4b36-a1a2-e10949cbc87f ((None, [{'url': 'file:///opt/stack/data/glance/images/d8ebca63-1178-4b36-a1a2-e10949cbc87f', 'metadata': {}}])) to volume ad569af7-14d4-42b3-9698-860ed6ed9f40. {{(pid=86512) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 29 18:20:34 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c840105-642b-44ab-a68e-270a9f42aae6]: (4, 'raw') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:20:34 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-8e2f2698-8a01-42d4-8904-980762ca63c2 tempest-VolumesExtendTest-1968261416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d8ebca63-1178-4b36-a1a2-e10949cbc87f_nfogy6dp {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:20:34 devstack sudo[90016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d8ebca63-1178-4b36-a1a2-e10949cbc87f_nfogy6dp Sep 29 18:20:34 devstack sudo[90016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:20:35 devstack sudo[90016]: pam_unix(sudo:session): session closed for user root Sep 29 18:20:35 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-8e2f2698-8a01-42d4-8904-980762ca63c2 tempest-VolumesExtendTest-1968261416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d8ebca63-1178-4b36-a1a2-e10949cbc87f_nfogy6dp" returned: 0 in 0.991s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:20:35 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-8e2f2698-8a01-42d4-8904-980762ca63c2 tempest-VolumesExtendTest-1968261416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d8ebca63-1178-4b36-a1a2-e10949cbc87f_nfogy6dp {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:20:36 devstack sudo[90042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d8ebca63-1178-4b36-a1a2-e10949cbc87f_nfogy6dp Sep 29 18:20:36 devstack sudo[90042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:20:36 devstack sudo[90042]: pam_unix(sudo:session): session closed for user root Sep 29 18:20:37 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-8e2f2698-8a01-42d4-8904-980762ca63c2 tempest-VolumesExtendTest-1968261416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d8ebca63-1178-4b36-a1a2-e10949cbc87f_nfogy6dp" returned: 1 in 1.412s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:20:37 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-8e2f2698-8a01-42d4-8904-980762ca63c2 tempest-VolumesExtendTest-1968261416 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d8ebca63-1178-4b36-a1a2-e10949cbc87f_nfogy6dp' failed. Not Retrying. {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 29 18:20:37 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b18981c-dc62-477f-8720-cd0c0c73df02]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:20:37 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-8e2f2698-8a01-42d4-8904-980762ca63c2 tempest-VolumesExtendTest-1968261416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d8ebca63-1178-4b36-a1a2-e10949cbc87f_jpe7l36rdevstack@QuobyteHD {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:20:37 devstack sudo[90088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d8ebca63-1178-4b36-a1a2-e10949cbc87f_jpe7l36rdevstack@QuobyteHD Sep 29 18:20:37 devstack sudo[90088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:20:37 devstack sudo[90088]: pam_unix(sudo:session): session closed for user root Sep 29 18:20:37 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-8e2f2698-8a01-42d4-8904-980762ca63c2 tempest-VolumesExtendTest-1968261416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d8ebca63-1178-4b36-a1a2-e10949cbc87f_jpe7l36rdevstack@QuobyteHD" returned: 0 in 0.676s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:20:37 devstack cinder-volume[86512]: DEBUG cinder.image.image_utils [None req-8e2f2698-8a01-42d4-8904-980762ca63c2 tempest-VolumesExtendTest-1968261416 None] d8ebca63-1178-4b36-a1a2-e10949cbc87f was qcow2, converting to qcow2 {{(pid=86512) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 29 18:20:37 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-8e2f2698-8a01-42d4-8904-980762ca63c2 tempest-VolumesExtendTest-1968261416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d8ebca63-1178-4b36-a1a2-e10949cbc87f_jpe7l36rdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ad569af7-14d4-42b3-9698-860ed6ed9f40 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:20:37 devstack sudo[90108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d8ebca63-1178-4b36-a1a2-e10949cbc87f_jpe7l36rdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ad569af7-14d4-42b3-9698-860ed6ed9f40 Sep 29 18:20:37 devstack sudo[90108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:20:41 devstack sudo[90108]: pam_unix(sudo:session): session closed for user root Sep 29 18:20:41 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-8e2f2698-8a01-42d4-8904-980762ca63c2 tempest-VolumesExtendTest-1968261416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d8ebca63-1178-4b36-a1a2-e10949cbc87f_jpe7l36rdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ad569af7-14d4-42b3-9698-860ed6ed9f40" returned: 0 in 3.444s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:20:41 devstack cinder-volume[86512]: DEBUG cinder.image.image_utils [None req-8e2f2698-8a01-42d4-8904-980762ca63c2 tempest-VolumesExtendTest-1968261416 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d8ebca63-1178-4b36-a1a2-e10949cbc87f_jpe7l36rdevstack@QuobyteHD, size 112.00 MB, duration 3.44 sec, destination /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ad569af7-14d4-42b3-9698-860ed6ed9f40 {{(pid=86512) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 29 18:20:41 devstack cinder-volume[86512]: INFO cinder.image.image_utils [None req-8e2f2698-8a01-42d4-8904-980762ca63c2 tempest-VolumesExtendTest-1968261416 None] Converted 112.00 MB image at 32.51 MB/s Sep 29 18:20:41 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-8e2f2698-8a01-42d4-8904-980762ca63c2 tempest-VolumesExtendTest-1968261416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ad569af7-14d4-42b3-9698-860ed6ed9f40 1G {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:20:41 devstack sudo[90151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ad569af7-14d4-42b3-9698-860ed6ed9f40 1G Sep 29 18:20:41 devstack sudo[90151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:20:41 devstack sudo[90151]: pam_unix(sudo:session): session closed for user root Sep 29 18:20:41 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-8e2f2698-8a01-42d4-8904-980762ca63c2 tempest-VolumesExtendTest-1968261416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ad569af7-14d4-42b3-9698-860ed6ed9f40 1G" returned: 0 in 0.712s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:20:41 devstack cinder-volume[86512]: DEBUG cinder.volume.volume_utils [None req-8e2f2698-8a01-42d4-8904-980762ca63c2 tempest-VolumesExtendTest-1968261416 None] Downloaded image d8ebca63-1178-4b36-a1a2-e10949cbc87f ((None, [{'url': 'file:///opt/stack/data/glance/images/d8ebca63-1178-4b36-a1a2-e10949cbc87f', 'metadata': {}}])) to volume ad569af7-14d4-42b3-9698-860ed6ed9f40 successfully. {{(pid=86512) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 29 18:20:41 devstack cinder-volume[86512]: DEBUG cinder.image.image_utils [None req-8e2f2698-8a01-42d4-8904-980762ca63c2 tempest-VolumesExtendTest-1968261416 None] Temporary image d8ebca63-1178-4b36-a1a2-e10949cbc87f for user e310a1e36d2c46d4a481aa9a77192ac0 is deleted. {{(pid=86512) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 29 18:20:41 devstack cinder-volume[86512]: DEBUG cinder.volume.volume_utils [None req-8e2f2698-8a01-42d4-8904-980762ca63c2 tempest-VolumesExtendTest-1968261416 None] Marking volume ad569af7-14d4-42b3-9698-860ed6ed9f40 as bootable. {{(pid=86512) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 29 18:20:41 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e2f2698-8a01-42d4-8904-980762ca63c2 tempest-VolumesExtendTest-1968261416 None] Copying metadata from image d8ebca63-1178-4b36-a1a2-e10949cbc87f to ad569af7-14d4-42b3-9698-860ed6ed9f40. {{(pid=86512) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 29 18:20:41 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e2f2698-8a01-42d4-8904-980762ca63c2 tempest-VolumesExtendTest-1968261416 None] Creating volume glance metadata for volume ad569af7-14d4-42b3-9698-860ed6ed9f40 backed by image d8ebca63-1178-4b36-a1a2-e10949cbc87f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'd8ebca63-1178-4b36-a1a2-e10949cbc87f', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86512) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 29 18:20:42 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-8e2f2698-8a01-42d4-8904-980762ca63c2 tempest-VolumesExtendTest-1968261416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ef3d880-31b0-4bb1-8083-77afc7da75c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad569af7-14d4-42b3-9698-860ed6ed9f40', 'volume_size': 1, 'image_id': 'd8ebca63-1178-4b36-a1a2-e10949cbc87f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d8ebca63-1178-4b36-a1a2-e10949cbc87f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '987aeb00888a4b9bb9954392d91b8741', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd8ebca63-1178-4b36-a1a2-e10949cbc87f', 'created_at': datetime.datetime(2026, 9, 29, 16, 11, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 16, 11, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d8ebca63-1178-4b36-a1a2-e10949cbc87f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:20:42 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-8e2f2698-8a01-42d4-8904-980762ca63c2 tempest-VolumesExtendTest-1968261416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee5210cf-fbc5-4994-bf47-afa1de617910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:20:42 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-8e2f2698-8a01-42d4-8904-980762ca63c2 tempest-VolumesExtendTest-1968261416 None] Volume volume-ad569af7-14d4-42b3-9698-860ed6ed9f40 (ad569af7-14d4-42b3-9698-860ed6ed9f40): created successfully Sep 29 18:20:42 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-8e2f2698-8a01-42d4-8904-980762ca63c2 tempest-VolumesExtendTest-1968261416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee5210cf-fbc5-4994-bf47-afa1de617910) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:20:42 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-8e2f2698-8a01-42d4-8904-980762ca63c2 tempest-VolumesExtendTest-1968261416 None] Flow 'volume_create_manager' (f8fce74b-937b-4c5f-9ae4-00830eccaa99) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:20:42 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-8e2f2698-8a01-42d4-8904-980762ca63c2 tempest-VolumesExtendTest-1968261416 None] Created volume successfully. Sep 29 18:20:42 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-c41e6967-5198-41ea-976b-cabf32157f93 tempest-ServersNegativeTestJSON-518620236 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86512) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:20:42 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-c41e6967-5198-41ea-976b-cabf32157f93 tempest-ServersNegativeTestJSON-518620236 None] Flow 'volume_create_manager' (9db151e3-4ed8-4cbf-a73b-b0fb03b6f1a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:20:42 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-c41e6967-5198-41ea-976b-cabf32157f93 tempest-ServersNegativeTestJSON-518620236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b74688dd-c556-44bd-b496-fcf8c5ed3ca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:20:42 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-c41e6967-5198-41ea-976b-cabf32157f93 tempest-ServersNegativeTestJSON-518620236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b74688dd-c556-44bd-b496-fcf8c5ed3ca9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:20:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2083086428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62702760-7bb5-4ea0-8625-98dc66edfead,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71d7635dd70842eba7c59f195ca8132c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:20:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:20:42Z,use_quota=True,user_id='4e6d3cc71a454bbc93fb1b4f998ada14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:20:42 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-c41e6967-5198-41ea-976b-cabf32157f93 tempest-ServersNegativeTestJSON-518620236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47abf92e-ca5e-4128-a88a-054be7f0caa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:20:42 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-c41e6967-5198-41ea-976b-cabf32157f93 tempest-ServersNegativeTestJSON-518620236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47abf92e-ca5e-4128-a88a-054be7f0caa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:20:42 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-c41e6967-5198-41ea-976b-cabf32157f93 tempest-ServersNegativeTestJSON-518620236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71985197-a134-47fb-b5ba-5f8eeb54660e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:20:42 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-c41e6967-5198-41ea-976b-cabf32157f93 tempest-ServersNegativeTestJSON-518620236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71985197-a134-47fb-b5ba-5f8eeb54660e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62702760-7bb5-4ea0-8625-98dc66edfead', 'volume_name': 'volume-62702760-7bb5-4ea0-8625-98dc66edfead', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:20:42 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-c41e6967-5198-41ea-976b-cabf32157f93 tempest-ServersNegativeTestJSON-518620236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (683cba4b-efdf-4cc9-8e9a-32ff85d95ee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:20:42 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-c41e6967-5198-41ea-976b-cabf32157f93 tempest-ServersNegativeTestJSON-518620236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (683cba4b-efdf-4cc9-8e9a-32ff85d95ee9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:20:42 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-c41e6967-5198-41ea-976b-cabf32157f93 tempest-ServersNegativeTestJSON-518620236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b488fcf-eb93-4377-9b2c-41084494cc66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:20:42 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-c41e6967-5198-41ea-976b-cabf32157f93 tempest-ServersNegativeTestJSON-518620236 None] Volume 62702760-7bb5-4ea0-8625-98dc66edfead: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62702760-7bb5-4ea0-8625-98dc66edfead', 'volume_size': 1} Sep 29 18:20:42 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-c41e6967-5198-41ea-976b-cabf32157f93 tempest-ServersNegativeTestJSON-518620236 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:20:42 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-c41e6967-5198-41ea-976b-cabf32157f93 tempest-ServersNegativeTestJSON-518620236 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:20:42 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-c41e6967-5198-41ea-976b-cabf32157f93 tempest-ServersNegativeTestJSON-518620236 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:20:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2083086428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62702760-7bb5-4ea0-8625-98dc66edfead,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71d7635dd70842eba7c59f195ca8132c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:20:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:20:42Z,use_quota=True,user_id='4e6d3cc71a454bbc93fb1b4f998ada14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)}" {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:20:42 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-c41e6967-5198-41ea-976b-cabf32157f93 tempest-ServersNegativeTestJSON-518620236 None] Creating volume 62702760-7bb5-4ea0-8625-98dc66edfead {{(pid=86512) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:20:42 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-c41e6967-5198-41ea-976b-cabf32157f93 tempest-ServersNegativeTestJSON-518620236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:20:42 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-c41e6967-5198-41ea-976b-cabf32157f93 tempest-ServersNegativeTestJSON-518620236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:20:42 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-c41e6967-5198-41ea-976b-cabf32157f93 tempest-ServersNegativeTestJSON-518620236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:20:42 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-c41e6967-5198-41ea-976b-cabf32157f93 tempest-ServersNegativeTestJSON-518620236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:20:42 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-c41e6967-5198-41ea-976b-cabf32157f93 tempest-ServersNegativeTestJSON-518620236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:20:42 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-c41e6967-5198-41ea-976b-cabf32157f93 tempest-ServersNegativeTestJSON-518620236 None] Selected osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 as target Quobyte volume. {{(pid=86512) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:20:42 devstack cinder-volume[86512]: INFO cinder.volume.drivers.remotefs [None req-c41e6967-5198-41ea-976b-cabf32157f93 tempest-ServersNegativeTestJSON-518620236 None] casted to osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 Sep 29 18:20:42 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-c41e6967-5198-41ea-976b-cabf32157f93 tempest-ServersNegativeTestJSON-518620236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-62702760-7bb5-4ea0-8625-98dc66edfead 1073741824 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:20:42 devstack sudo[90183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-62702760-7bb5-4ea0-8625-98dc66edfead 1073741824 Sep 29 18:20:42 devstack sudo[90183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:20:42 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-a7a13fa7-ab47-4e75-ad78-7be1013aa534 tempest-VolumesExtendTest-1968261416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:20:43 devstack sudo[90183]: pam_unix(sudo:session): session closed for user root Sep 29 18:20:43 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-c41e6967-5198-41ea-976b-cabf32157f93 tempest-ServersNegativeTestJSON-518620236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-62702760-7bb5-4ea0-8625-98dc66edfead 1073741824" returned: 0 in 0.538s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:20:43 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-c41e6967-5198-41ea-976b-cabf32157f93 tempest-ServersNegativeTestJSON-518620236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-62702760-7bb5-4ea0-8625-98dc66edfead {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:20:43 devstack sudo[90190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-62702760-7bb5-4ea0-8625-98dc66edfead Sep 29 18:20:43 devstack sudo[90190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:20:43 devstack sudo[90190]: pam_unix(sudo:session): session closed for user root Sep 29 18:20:43 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-c41e6967-5198-41ea-976b-cabf32157f93 tempest-ServersNegativeTestJSON-518620236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-62702760-7bb5-4ea0-8625-98dc66edfead" returned: 0 in 0.443s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:20:43 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-c41e6967-5198-41ea-976b-cabf32157f93 tempest-ServersNegativeTestJSON-518620236 None] <== create_volume: return (1035ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'} {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:20:43 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-c41e6967-5198-41ea-976b-cabf32157f93 tempest-ServersNegativeTestJSON-518620236 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.037s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:20:43 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-a7a13fa7-ab47-4e75-ad78-7be1013aa534 tempest-VolumesExtendTest-1968261416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.879s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:20:43 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-c41e6967-5198-41ea-976b-cabf32157f93 tempest-ServersNegativeTestJSON-518620236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b488fcf-eb93-4377-9b2c-41084494cc66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62702760-7bb5-4ea0-8625-98dc66edfead', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:20:43 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-c41e6967-5198-41ea-976b-cabf32157f93 tempest-ServersNegativeTestJSON-518620236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f816ba4-3d2e-4cd2-9e73-b85e24b9b8d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:20:43 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad3f73f2-76b8-4f63-b1f9-41b33b09ccbd]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:20:43 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a7a13fa7-ab47-4e75-ad78-7be1013aa534 tempest-VolumesExtendTest-1968261416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ad569af7-14d4-42b3-9698-860ed6ed9f40 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:20:43 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-c41e6967-5198-41ea-976b-cabf32157f93 tempest-ServersNegativeTestJSON-518620236 None] Volume volume-62702760-7bb5-4ea0-8625-98dc66edfead (62702760-7bb5-4ea0-8625-98dc66edfead): created successfully Sep 29 18:20:43 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-c41e6967-5198-41ea-976b-cabf32157f93 tempest-ServersNegativeTestJSON-518620236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f816ba4-3d2e-4cd2-9e73-b85e24b9b8d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:20:43 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-c41e6967-5198-41ea-976b-cabf32157f93 tempest-ServersNegativeTestJSON-518620236 None] Flow 'volume_create_manager' (9db151e3-4ed8-4cbf-a73b-b0fb03b6f1a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:20:43 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-c41e6967-5198-41ea-976b-cabf32157f93 tempest-ServersNegativeTestJSON-518620236 None] Created volume successfully. Sep 29 18:20:44 devstack sudo[90196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ad569af7-14d4-42b3-9698-860ed6ed9f40 Sep 29 18:20:44 devstack sudo[90196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:20:44 devstack sudo[90196]: pam_unix(sudo:session): session closed for user root Sep 29 18:20:44 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a7a13fa7-ab47-4e75-ad78-7be1013aa534 tempest-VolumesExtendTest-1968261416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ad569af7-14d4-42b3-9698-860ed6ed9f40" returned: 0 in 0.541s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:20:44 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a7a13fa7-ab47-4e75-ad78-7be1013aa534 tempest-VolumesExtendTest-1968261416 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ad569af7-14d4-42b3-9698-860ed6ed9f40 2G {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:20:44 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a7a13fa7-ab47-4e75-ad78-7be1013aa534 tempest-VolumesExtendTest-1968261416 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ad569af7-14d4-42b3-9698-860ed6ed9f40 2G" returned: 0 in 0.150s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:20:44 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-a7a13fa7-ab47-4e75-ad78-7be1013aa534 tempest-VolumesExtendTest-1968261416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.777s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:20:44 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-a7a13fa7-ab47-4e75-ad78-7be1013aa534 tempest-VolumesExtendTest-1968261416 None] Extend volume completed successfully. Sep 29 18:20:45 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-142817a3-e42a-4961-89ba-c1592d5dc195 tempest-VolumesExtendTest-1968261416 None] Acquiring lock "cinder-ad569af7-14d4-42b3-9698-860ed6ed9f40-delete_volume" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:20:45 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-142817a3-e42a-4961-89ba-c1592d5dc195 tempest-VolumesExtendTest-1968261416 None] Lock "cinder-ad569af7-14d4-42b3-9698-860ed6ed9f40-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:20:45 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-142817a3-e42a-4961-89ba-c1592d5dc195 tempest-VolumesExtendTest-1968261416 None] Acquiring lock "cinder-quobyte-ad569af7-14d4-42b3-9698-860ed6ed9f40" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:20:45 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-142817a3-e42a-4961-89ba-c1592d5dc195 tempest-VolumesExtendTest-1968261416 None] Lock "cinder-quobyte-ad569af7-14d4-42b3-9698-860ed6ed9f40" acquired by "delete_volume" :: waited 0.026s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:20:45 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[557d5b6e-f81d-4888-b285-d47f78a025f5]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:20:45 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-142817a3-e42a-4961-89ba-c1592d5dc195 tempest-VolumesExtendTest-1968261416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ad569af7-14d4-42b3-9698-860ed6ed9f40 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:20:45 devstack sudo[90210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ad569af7-14d4-42b3-9698-860ed6ed9f40 Sep 29 18:20:45 devstack sudo[90210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:20:46 devstack sudo[90210]: pam_unix(sudo:session): session closed for user root Sep 29 18:20:46 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-142817a3-e42a-4961-89ba-c1592d5dc195 tempest-VolumesExtendTest-1968261416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ad569af7-14d4-42b3-9698-860ed6ed9f40" returned: 0 in 0.613s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:20:46 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-142817a3-e42a-4961-89ba-c1592d5dc195 tempest-VolumesExtendTest-1968261416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ad569af7-14d4-42b3-9698-860ed6ed9f40 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:20:46 devstack sudo[90215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ad569af7-14d4-42b3-9698-860ed6ed9f40 Sep 29 18:20:46 devstack sudo[90215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:20:46 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c9ba822-1638-49c4-8ec1-69524a44fb9d tempest-ServersNegativeTestJSON-518620236 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86512) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:20:46 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-6c9ba822-1638-49c4-8ec1-69524a44fb9d tempest-ServersNegativeTestJSON-518620236 None] Flow 'volume_create_manager' (1cf01c32-c298-430d-a87e-b0398da632d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:20:46 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-6c9ba822-1638-49c4-8ec1-69524a44fb9d tempest-ServersNegativeTestJSON-518620236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d84414f3-f072-4d52-9b39-0539afeba303) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:20:46 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-6c9ba822-1638-49c4-8ec1-69524a44fb9d tempest-ServersNegativeTestJSON-518620236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d84414f3-f072-4d52-9b39-0539afeba303) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:20:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-164755864',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f3c24d9-ebf5-4350-9d93-7a6ab27e2fc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71d7635dd70842eba7c59f195ca8132c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:20:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:20:46Z,use_quota=True,user_id='4e6d3cc71a454bbc93fb1b4f998ada14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:20:46 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-6c9ba822-1638-49c4-8ec1-69524a44fb9d tempest-ServersNegativeTestJSON-518620236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b727130-9c26-4dbf-a14f-c2eec7867b31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:20:46 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-6c9ba822-1638-49c4-8ec1-69524a44fb9d tempest-ServersNegativeTestJSON-518620236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b727130-9c26-4dbf-a14f-c2eec7867b31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:20:46 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-6c9ba822-1638-49c4-8ec1-69524a44fb9d tempest-ServersNegativeTestJSON-518620236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e8a1327-207d-481f-809a-ab517c4093b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:20:46 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-6c9ba822-1638-49c4-8ec1-69524a44fb9d tempest-ServersNegativeTestJSON-518620236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e8a1327-207d-481f-809a-ab517c4093b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f3c24d9-ebf5-4350-9d93-7a6ab27e2fc3', 'volume_name': 'volume-0f3c24d9-ebf5-4350-9d93-7a6ab27e2fc3', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:20:46 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-6c9ba822-1638-49c4-8ec1-69524a44fb9d tempest-ServersNegativeTestJSON-518620236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e68464f1-c60f-4772-82f0-41bfe165cbdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:20:46 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-6c9ba822-1638-49c4-8ec1-69524a44fb9d tempest-ServersNegativeTestJSON-518620236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e68464f1-c60f-4772-82f0-41bfe165cbdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:20:46 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-6c9ba822-1638-49c4-8ec1-69524a44fb9d tempest-ServersNegativeTestJSON-518620236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8fbcdd6-e417-4ae8-8e11-1b464eb21228) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:20:46 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-6c9ba822-1638-49c4-8ec1-69524a44fb9d tempest-ServersNegativeTestJSON-518620236 None] Volume 0f3c24d9-ebf5-4350-9d93-7a6ab27e2fc3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f3c24d9-ebf5-4350-9d93-7a6ab27e2fc3', 'volume_size': 1} Sep 29 18:20:46 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-6c9ba822-1638-49c4-8ec1-69524a44fb9d tempest-ServersNegativeTestJSON-518620236 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:20:46 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-6c9ba822-1638-49c4-8ec1-69524a44fb9d tempest-ServersNegativeTestJSON-518620236 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:20:46 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-6c9ba822-1638-49c4-8ec1-69524a44fb9d tempest-ServersNegativeTestJSON-518620236 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:20:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-164755864',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f3c24d9-ebf5-4350-9d93-7a6ab27e2fc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71d7635dd70842eba7c59f195ca8132c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:20:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:20:46Z,use_quota=True,user_id='4e6d3cc71a454bbc93fb1b4f998ada14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)}" {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:20:46 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-6c9ba822-1638-49c4-8ec1-69524a44fb9d tempest-ServersNegativeTestJSON-518620236 None] Creating volume 0f3c24d9-ebf5-4350-9d93-7a6ab27e2fc3 {{(pid=86512) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:20:46 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-6c9ba822-1638-49c4-8ec1-69524a44fb9d tempest-ServersNegativeTestJSON-518620236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:20:46 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-6c9ba822-1638-49c4-8ec1-69524a44fb9d tempest-ServersNegativeTestJSON-518620236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:20:46 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-6c9ba822-1638-49c4-8ec1-69524a44fb9d tempest-ServersNegativeTestJSON-518620236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:20:46 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-6c9ba822-1638-49c4-8ec1-69524a44fb9d tempest-ServersNegativeTestJSON-518620236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:20:46 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-6c9ba822-1638-49c4-8ec1-69524a44fb9d tempest-ServersNegativeTestJSON-518620236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:20:46 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-6c9ba822-1638-49c4-8ec1-69524a44fb9d tempest-ServersNegativeTestJSON-518620236 None] Selected osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 as target Quobyte volume. {{(pid=86512) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:20:46 devstack cinder-volume[86512]: INFO cinder.volume.drivers.remotefs [None req-6c9ba822-1638-49c4-8ec1-69524a44fb9d tempest-ServersNegativeTestJSON-518620236 None] casted to osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 Sep 29 18:20:46 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-6c9ba822-1638-49c4-8ec1-69524a44fb9d tempest-ServersNegativeTestJSON-518620236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0f3c24d9-ebf5-4350-9d93-7a6ab27e2fc3 1073741824 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:20:46 devstack sudo[90218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0f3c24d9-ebf5-4350-9d93-7a6ab27e2fc3 1073741824 Sep 29 18:20:46 devstack sudo[90218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:20:46 devstack sudo[90215]: pam_unix(sudo:session): session closed for user root Sep 29 18:20:46 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-142817a3-e42a-4961-89ba-c1592d5dc195 tempest-VolumesExtendTest-1968261416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ad569af7-14d4-42b3-9698-860ed6ed9f40" returned: 0 in 0.318s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:20:46 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-142817a3-e42a-4961-89ba-c1592d5dc195 tempest-VolumesExtendTest-1968261416 None] Lock "cinder-quobyte-ad569af7-14d4-42b3-9698-860ed6ed9f40" released by "delete_volume" :: held 1.012s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:20:46 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-142817a3-e42a-4961-89ba-c1592d5dc195 tempest-VolumesExtendTest-1968261416 None] Created reservations ['9f00990e-52b9-43ef-9381-be88f6340f14', '1c1b2192-3300-4182-87dc-ba375cfa28a3', '85bf51af-0777-45d6-818b-6eb4261e0c78', '42661223-17d9-4e8e-b401-b4dd20691c09'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:20:46 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-142817a3-e42a-4961-89ba-c1592d5dc195 tempest-VolumesExtendTest-1968261416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:20:46 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-142817a3-e42a-4961-89ba-c1592d5dc195 tempest-VolumesExtendTest-1968261416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:20:46 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-142817a3-e42a-4961-89ba-c1592d5dc195 tempest-VolumesExtendTest-1968261416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:20:46 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-142817a3-e42a-4961-89ba-c1592d5dc195 tempest-VolumesExtendTest-1968261416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:20:46 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-142817a3-e42a-4961-89ba-c1592d5dc195 tempest-VolumesExtendTest-1968261416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:20:46 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-142817a3-e42a-4961-89ba-c1592d5dc195 tempest-VolumesExtendTest-1968261416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:20:47 devstack sudo[90222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:20:47 devstack sudo[90222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:20:47 devstack sudo[90218]: pam_unix(sudo:session): session closed for user root Sep 29 18:20:47 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-6c9ba822-1638-49c4-8ec1-69524a44fb9d tempest-ServersNegativeTestJSON-518620236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0f3c24d9-ebf5-4350-9d93-7a6ab27e2fc3 1073741824" returned: 0 in 0.609s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:20:47 devstack sudo[90222]: pam_unix(sudo:session): session closed for user root Sep 29 18:20:47 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-142817a3-e42a-4961-89ba-c1592d5dc195 tempest-VolumesExtendTest-1968261416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.375s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:20:47 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-142817a3-e42a-4961-89ba-c1592d5dc195 tempest-VolumesExtendTest-1968261416 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:20:47 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-142817a3-e42a-4961-89ba-c1592d5dc195 tempest-VolumesExtendTest-1968261416 None] Deleted volume successfully. Sep 29 18:20:47 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-6c9ba822-1638-49c4-8ec1-69524a44fb9d tempest-ServersNegativeTestJSON-518620236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0f3c24d9-ebf5-4350-9d93-7a6ab27e2fc3 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:20:47 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-142817a3-e42a-4961-89ba-c1592d5dc195 tempest-VolumesExtendTest-1968261416 None] Lock "cinder-ad569af7-14d4-42b3-9698-860ed6ed9f40-delete_volume" released by "delete_volume" :: held 1.735s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:20:47 devstack sudo[90228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0f3c24d9-ebf5-4350-9d93-7a6ab27e2fc3 Sep 29 18:20:47 devstack sudo[90228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:20:47 devstack sudo[90228]: pam_unix(sudo:session): session closed for user root Sep 29 18:20:47 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-6c9ba822-1638-49c4-8ec1-69524a44fb9d tempest-ServersNegativeTestJSON-518620236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0f3c24d9-ebf5-4350-9d93-7a6ab27e2fc3" returned: 0 in 0.317s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:20:47 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-6c9ba822-1638-49c4-8ec1-69524a44fb9d tempest-ServersNegativeTestJSON-518620236 None] <== create_volume: return (1005ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'} {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:20:47 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-6c9ba822-1638-49c4-8ec1-69524a44fb9d tempest-ServersNegativeTestJSON-518620236 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.010s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:20:47 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-6c9ba822-1638-49c4-8ec1-69524a44fb9d tempest-ServersNegativeTestJSON-518620236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8fbcdd6-e417-4ae8-8e11-1b464eb21228) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f3c24d9-ebf5-4350-9d93-7a6ab27e2fc3', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:20:47 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-6c9ba822-1638-49c4-8ec1-69524a44fb9d tempest-ServersNegativeTestJSON-518620236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58c166a9-432e-4889-9316-93410e7440a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:20:47 devstack cinder-volume[86512]: DEBUG dbcounter [-] [86512] Writing DB stats cinder:SELECT=34,cinder:UPDATE=50,cinder:DELETE=5,cinder:INSERT=19 {{(pid=86512) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 18:20:47 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-6c9ba822-1638-49c4-8ec1-69524a44fb9d tempest-ServersNegativeTestJSON-518620236 None] Volume volume-0f3c24d9-ebf5-4350-9d93-7a6ab27e2fc3 (0f3c24d9-ebf5-4350-9d93-7a6ab27e2fc3): created successfully Sep 29 18:20:47 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-6c9ba822-1638-49c4-8ec1-69524a44fb9d tempest-ServersNegativeTestJSON-518620236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58c166a9-432e-4889-9316-93410e7440a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:20:47 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-6c9ba822-1638-49c4-8ec1-69524a44fb9d tempest-ServersNegativeTestJSON-518620236 None] Flow 'volume_create_manager' (1cf01c32-c298-430d-a87e-b0398da632d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:20:47 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-6c9ba822-1638-49c4-8ec1-69524a44fb9d tempest-ServersNegativeTestJSON-518620236 None] Created volume successfully. Sep 29 18:20:48 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-639b0aa3-8fa0-48b8-9af0-fdd3817ab74d tempest-VolumesExtendTest-1968261416 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86512) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:20:48 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-639b0aa3-8fa0-48b8-9af0-fdd3817ab74d tempest-VolumesExtendTest-1968261416 None] Flow 'volume_create_manager' (bfcf06aa-b345-432e-8205-f5b66f35e7f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:20:48 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-639b0aa3-8fa0-48b8-9af0-fdd3817ab74d tempest-VolumesExtendTest-1968261416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b946110e-8300-4855-b901-90db9571c12d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:20:48 devstack cinder-volume[86512]: DEBUG dbcounter [-] [86512] Writing DB stats cinder:SELECT=47,cinder:UPDATE=49,cinder:INSERT=13,cinder:DELETE=5 {{(pid=86512) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 18:20:48 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-639b0aa3-8fa0-48b8-9af0-fdd3817ab74d tempest-VolumesExtendTest-1968261416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b946110e-8300-4855-b901-90db9571c12d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:20:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1490455653',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fc43c25-88a4-4037-a35d-474f1112f7eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfc6583626b541b99efb148cc231bad3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:20:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:20:48Z,use_quota=True,user_id='e310a1e36d2c46d4a481aa9a77192ac0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:20:48 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-639b0aa3-8fa0-48b8-9af0-fdd3817ab74d tempest-VolumesExtendTest-1968261416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85e0819e-81d5-41bc-a774-0d97b8b24e2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:20:48 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-639b0aa3-8fa0-48b8-9af0-fdd3817ab74d tempest-VolumesExtendTest-1968261416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85e0819e-81d5-41bc-a774-0d97b8b24e2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:20:48 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-639b0aa3-8fa0-48b8-9af0-fdd3817ab74d tempest-VolumesExtendTest-1968261416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (559ae531-2485-484d-ae0e-4dfcf6f53e5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:20:48 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-639b0aa3-8fa0-48b8-9af0-fdd3817ab74d tempest-VolumesExtendTest-1968261416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (559ae531-2485-484d-ae0e-4dfcf6f53e5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0fc43c25-88a4-4037-a35d-474f1112f7eb', 'volume_name': 'volume-0fc43c25-88a4-4037-a35d-474f1112f7eb', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:20:48 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-639b0aa3-8fa0-48b8-9af0-fdd3817ab74d tempest-VolumesExtendTest-1968261416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43990d62-d7e5-4827-9e2b-845ef2e831d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:20:48 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-639b0aa3-8fa0-48b8-9af0-fdd3817ab74d tempest-VolumesExtendTest-1968261416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43990d62-d7e5-4827-9e2b-845ef2e831d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:20:48 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-639b0aa3-8fa0-48b8-9af0-fdd3817ab74d tempest-VolumesExtendTest-1968261416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fd62678-06d3-42d4-9095-cdd04e14d334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:20:48 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-639b0aa3-8fa0-48b8-9af0-fdd3817ab74d tempest-VolumesExtendTest-1968261416 None] Volume 0fc43c25-88a4-4037-a35d-474f1112f7eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0fc43c25-88a4-4037-a35d-474f1112f7eb', 'volume_size': 1} Sep 29 18:20:48 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-639b0aa3-8fa0-48b8-9af0-fdd3817ab74d tempest-VolumesExtendTest-1968261416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:20:48 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-639b0aa3-8fa0-48b8-9af0-fdd3817ab74d tempest-VolumesExtendTest-1968261416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:20:48 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-639b0aa3-8fa0-48b8-9af0-fdd3817ab74d tempest-VolumesExtendTest-1968261416 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:20:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1490455653',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fc43c25-88a4-4037-a35d-474f1112f7eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfc6583626b541b99efb148cc231bad3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:20:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:20:48Z,use_quota=True,user_id='e310a1e36d2c46d4a481aa9a77192ac0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)}" {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:20:48 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-639b0aa3-8fa0-48b8-9af0-fdd3817ab74d tempest-VolumesExtendTest-1968261416 None] Creating volume 0fc43c25-88a4-4037-a35d-474f1112f7eb {{(pid=86512) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:20:48 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-639b0aa3-8fa0-48b8-9af0-fdd3817ab74d tempest-VolumesExtendTest-1968261416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:20:48 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-639b0aa3-8fa0-48b8-9af0-fdd3817ab74d tempest-VolumesExtendTest-1968261416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:20:48 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-639b0aa3-8fa0-48b8-9af0-fdd3817ab74d tempest-VolumesExtendTest-1968261416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:20:48 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-639b0aa3-8fa0-48b8-9af0-fdd3817ab74d tempest-VolumesExtendTest-1968261416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:20:48 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-639b0aa3-8fa0-48b8-9af0-fdd3817ab74d tempest-VolumesExtendTest-1968261416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:20:48 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-639b0aa3-8fa0-48b8-9af0-fdd3817ab74d tempest-VolumesExtendTest-1968261416 None] Selected osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 as target Quobyte volume. {{(pid=86512) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:20:48 devstack cinder-volume[86512]: INFO cinder.volume.drivers.remotefs [None req-639b0aa3-8fa0-48b8-9af0-fdd3817ab74d tempest-VolumesExtendTest-1968261416 None] casted to osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 Sep 29 18:20:48 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-639b0aa3-8fa0-48b8-9af0-fdd3817ab74d tempest-VolumesExtendTest-1968261416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0fc43c25-88a4-4037-a35d-474f1112f7eb 1073741824 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:20:48 devstack sudo[90233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0fc43c25-88a4-4037-a35d-474f1112f7eb 1073741824 Sep 29 18:20:48 devstack sudo[90233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:20:48 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-f04855e6-f38a-479f-9c06-d3ef5fdb9158 tempest-ServersNegativeTestJSON-518620236 None] Acquiring lock "cinder-0f3c24d9-ebf5-4350-9d93-7a6ab27e2fc3-delete_volume" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:20:49 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-f04855e6-f38a-479f-9c06-d3ef5fdb9158 tempest-ServersNegativeTestJSON-518620236 None] Lock "cinder-0f3c24d9-ebf5-4350-9d93-7a6ab27e2fc3-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:20:49 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-f04855e6-f38a-479f-9c06-d3ef5fdb9158 tempest-ServersNegativeTestJSON-518620236 None] Acquiring lock "cinder-quobyte-0f3c24d9-ebf5-4350-9d93-7a6ab27e2fc3" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:20:49 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-f04855e6-f38a-479f-9c06-d3ef5fdb9158 tempest-ServersNegativeTestJSON-518620236 None] Lock "cinder-quobyte-0f3c24d9-ebf5-4350-9d93-7a6ab27e2fc3" acquired by "delete_volume" :: waited 0.016s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:20:49 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[1569294a-3d80-4e9b-89da-3c6cfbc4d0dc]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:20:49 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-f04855e6-f38a-479f-9c06-d3ef5fdb9158 tempest-ServersNegativeTestJSON-518620236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0f3c24d9-ebf5-4350-9d93-7a6ab27e2fc3 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:20:49 devstack sudo[90233]: pam_unix(sudo:session): session closed for user root Sep 29 18:20:49 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-639b0aa3-8fa0-48b8-9af0-fdd3817ab74d tempest-VolumesExtendTest-1968261416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0fc43c25-88a4-4037-a35d-474f1112f7eb 1073741824" returned: 0 in 0.537s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:20:49 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-639b0aa3-8fa0-48b8-9af0-fdd3817ab74d tempest-VolumesExtendTest-1968261416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0fc43c25-88a4-4037-a35d-474f1112f7eb {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:20:49 devstack sudo[90239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0f3c24d9-ebf5-4350-9d93-7a6ab27e2fc3 Sep 29 18:20:49 devstack sudo[90239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:20:49 devstack sudo[90240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0fc43c25-88a4-4037-a35d-474f1112f7eb Sep 29 18:20:49 devstack sudo[90240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:20:49 devstack sudo[90240]: pam_unix(sudo:session): session closed for user root Sep 29 18:20:49 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-639b0aa3-8fa0-48b8-9af0-fdd3817ab74d tempest-VolumesExtendTest-1968261416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0fc43c25-88a4-4037-a35d-474f1112f7eb" returned: 0 in 0.283s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:20:49 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-639b0aa3-8fa0-48b8-9af0-fdd3817ab74d tempest-VolumesExtendTest-1968261416 None] <== create_volume: return (865ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'} {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:20:49 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-639b0aa3-8fa0-48b8-9af0-fdd3817ab74d tempest-VolumesExtendTest-1968261416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.868s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:20:49 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-639b0aa3-8fa0-48b8-9af0-fdd3817ab74d tempest-VolumesExtendTest-1968261416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fd62678-06d3-42d4-9095-cdd04e14d334) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0fc43c25-88a4-4037-a35d-474f1112f7eb', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:20:49 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-639b0aa3-8fa0-48b8-9af0-fdd3817ab74d tempest-VolumesExtendTest-1968261416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f92a0f2b-7f03-4344-9179-fb41b0a5b521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:20:49 devstack sudo[90239]: pam_unix(sudo:session): session closed for user root Sep 29 18:20:49 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-f04855e6-f38a-479f-9c06-d3ef5fdb9158 tempest-ServersNegativeTestJSON-518620236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0f3c24d9-ebf5-4350-9d93-7a6ab27e2fc3" returned: 0 in 0.427s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:20:49 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-f04855e6-f38a-479f-9c06-d3ef5fdb9158 tempest-ServersNegativeTestJSON-518620236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0f3c24d9-ebf5-4350-9d93-7a6ab27e2fc3 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:20:49 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-639b0aa3-8fa0-48b8-9af0-fdd3817ab74d tempest-VolumesExtendTest-1968261416 None] Volume volume-0fc43c25-88a4-4037-a35d-474f1112f7eb (0fc43c25-88a4-4037-a35d-474f1112f7eb): created successfully Sep 29 18:20:49 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-639b0aa3-8fa0-48b8-9af0-fdd3817ab74d tempest-VolumesExtendTest-1968261416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f92a0f2b-7f03-4344-9179-fb41b0a5b521) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:20:49 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-639b0aa3-8fa0-48b8-9af0-fdd3817ab74d tempest-VolumesExtendTest-1968261416 None] Flow 'volume_create_manager' (bfcf06aa-b345-432e-8205-f5b66f35e7f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:20:49 devstack sudo[90247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0f3c24d9-ebf5-4350-9d93-7a6ab27e2fc3 Sep 29 18:20:49 devstack sudo[90247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:20:49 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-639b0aa3-8fa0-48b8-9af0-fdd3817ab74d tempest-VolumesExtendTest-1968261416 None] Created volume successfully. Sep 29 18:20:49 devstack sudo[90247]: pam_unix(sudo:session): session closed for user root Sep 29 18:20:49 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-f04855e6-f38a-479f-9c06-d3ef5fdb9158 tempest-ServersNegativeTestJSON-518620236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0f3c24d9-ebf5-4350-9d93-7a6ab27e2fc3" returned: 0 in 0.270s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:20:49 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-f04855e6-f38a-479f-9c06-d3ef5fdb9158 tempest-ServersNegativeTestJSON-518620236 None] Lock "cinder-quobyte-0f3c24d9-ebf5-4350-9d93-7a6ab27e2fc3" released by "delete_volume" :: held 0.740s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:20:49 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-f04855e6-f38a-479f-9c06-d3ef5fdb9158 tempest-ServersNegativeTestJSON-518620236 None] Created reservations ['ba2b5956-6d86-494e-baed-500c4a5c87fd', 'f3b13cb8-6a09-44b5-97a9-aac5e4390ed8', '9eb3c0b6-3dff-4f33-b931-504d710fcd6c', '1d1d4b3f-5115-47ac-aa28-4392b18c659a'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:20:49 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-f04855e6-f38a-479f-9c06-d3ef5fdb9158 tempest-ServersNegativeTestJSON-518620236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:20:49 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-f04855e6-f38a-479f-9c06-d3ef5fdb9158 tempest-ServersNegativeTestJSON-518620236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:20:49 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-f04855e6-f38a-479f-9c06-d3ef5fdb9158 tempest-ServersNegativeTestJSON-518620236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:20:49 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-f04855e6-f38a-479f-9c06-d3ef5fdb9158 tempest-ServersNegativeTestJSON-518620236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:20:49 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-f04855e6-f38a-479f-9c06-d3ef5fdb9158 tempest-ServersNegativeTestJSON-518620236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:20:49 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-f04855e6-f38a-479f-9c06-d3ef5fdb9158 tempest-ServersNegativeTestJSON-518620236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:20:49 devstack sudo[90250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:20:49 devstack sudo[90250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:20:50 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-67b0b53d-8a43-44c3-ad97-9ea5239996f1 tempest-ServersNegativeTestJSON-518620236 None] Acquiring lock "cinder-62702760-7bb5-4ea0-8625-98dc66edfead-delete_volume" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:20:50 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-67b0b53d-8a43-44c3-ad97-9ea5239996f1 tempest-ServersNegativeTestJSON-518620236 None] Lock "cinder-62702760-7bb5-4ea0-8625-98dc66edfead-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:20:50 devstack sudo[90250]: pam_unix(sudo:session): session closed for user root Sep 29 18:20:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-f04855e6-f38a-479f-9c06-d3ef5fdb9158 tempest-ServersNegativeTestJSON-518620236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.285s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:20:50 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-f04855e6-f38a-479f-9c06-d3ef5fdb9158 tempest-ServersNegativeTestJSON-518620236 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:20:50 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-67b0b53d-8a43-44c3-ad97-9ea5239996f1 tempest-ServersNegativeTestJSON-518620236 None] Acquiring lock "cinder-quobyte-62702760-7bb5-4ea0-8625-98dc66edfead" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:20:50 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-f04855e6-f38a-479f-9c06-d3ef5fdb9158 tempest-ServersNegativeTestJSON-518620236 None] Deleted volume successfully. Sep 29 18:20:50 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-67b0b53d-8a43-44c3-ad97-9ea5239996f1 tempest-ServersNegativeTestJSON-518620236 None] Lock "cinder-quobyte-62702760-7bb5-4ea0-8625-98dc66edfead" acquired by "delete_volume" :: waited 0.027s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:20:50 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-f04855e6-f38a-479f-9c06-d3ef5fdb9158 tempest-ServersNegativeTestJSON-518620236 None] Lock "cinder-0f3c24d9-ebf5-4350-9d93-7a6ab27e2fc3-delete_volume" released by "delete_volume" :: held 1.289s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:20:50 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[31f1e312-841e-4b1e-8ad5-4e44efca2ec6]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:20:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-67b0b53d-8a43-44c3-ad97-9ea5239996f1 tempest-ServersNegativeTestJSON-518620236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-62702760-7bb5-4ea0-8625-98dc66edfead {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:20:50 devstack sudo[90253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-62702760-7bb5-4ea0-8625-98dc66edfead Sep 29 18:20:50 devstack sudo[90253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:20:50 devstack cinder-volume[86512]: DEBUG oslo_service.periodic_task [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86512) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 18:20:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:20:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:20:50 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:20:50 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:20:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:20:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:20:50 devstack sudo[90255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:20:50 devstack sudo[90255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:20:50 devstack sudo[90253]: pam_unix(sudo:session): session closed for user root Sep 29 18:20:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-67b0b53d-8a43-44c3-ad97-9ea5239996f1 tempest-ServersNegativeTestJSON-518620236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-62702760-7bb5-4ea0-8625-98dc66edfead" returned: 0 in 0.400s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:20:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-67b0b53d-8a43-44c3-ad97-9ea5239996f1 tempest-ServersNegativeTestJSON-518620236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-62702760-7bb5-4ea0-8625-98dc66edfead {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:20:50 devstack sudo[90260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-62702760-7bb5-4ea0-8625-98dc66edfead Sep 29 18:20:50 devstack sudo[90260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:20:50 devstack sudo[90255]: pam_unix(sudo:session): session closed for user root Sep 29 18:20:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.348s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:20:50 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:20:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-e4872d84-f3fe-4071-9feb-8e7155a6122c tempest-VolumesExtendTest-1968261416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:20:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-e4872d84-f3fe-4071-9feb-8e7155a6122c tempest-VolumesExtendTest-1968261416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:20:50 devstack cinder-volume[86512]: DEBUG oslo_service.periodic_task [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Running periodic task VolumeManager._thread_info {{(pid=86512) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 18:20:50 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] thread count: 28 {{(pid=86512) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 29 18:20:50 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] thread info: [<_MainThread(MainThread, started 135593654804608)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86512) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 29 18:20:50 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-e4872d84-f3fe-4071-9feb-8e7155a6122c tempest-VolumesExtendTest-1968261416 None] Creating offline snapshot f64e8e20-314c-48a8-8c37-6c0e8655e4a3 of volume 0fc43c25-88a4-4037-a35d-474f1112f7eb {{(pid=86512) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 18:20:50 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[506dbe82-d2f5-4a6a-8d88-6dda704e2c6b]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:20:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-e4872d84-f3fe-4071-9feb-8e7155a6122c tempest-VolumesExtendTest-1968261416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0fc43c25-88a4-4037-a35d-474f1112f7eb {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:20:50 devstack sudo[90260]: pam_unix(sudo:session): session closed for user root Sep 29 18:20:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-67b0b53d-8a43-44c3-ad97-9ea5239996f1 tempest-ServersNegativeTestJSON-518620236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-62702760-7bb5-4ea0-8625-98dc66edfead" returned: 0 in 0.305s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:20:51 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-67b0b53d-8a43-44c3-ad97-9ea5239996f1 tempest-ServersNegativeTestJSON-518620236 None] Lock "cinder-quobyte-62702760-7bb5-4ea0-8625-98dc66edfead" released by "delete_volume" :: held 0.760s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:20:51 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-67b0b53d-8a43-44c3-ad97-9ea5239996f1 tempest-ServersNegativeTestJSON-518620236 None] Created reservations ['6608be8a-ea6f-4d79-811f-ecc9da8f8f69', 'd4ccfafd-258e-4947-b2ab-468da7a016ec', '71c9b292-1371-4b41-bc3e-e4e03437fd8e', 'b66ba8d7-de08-413d-b8fe-70c31abfceca'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:20:51 devstack sudo[90264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0fc43c25-88a4-4037-a35d-474f1112f7eb Sep 29 18:20:51 devstack sudo[90264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:20:51 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-67b0b53d-8a43-44c3-ad97-9ea5239996f1 tempest-ServersNegativeTestJSON-518620236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:20:51 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-67b0b53d-8a43-44c3-ad97-9ea5239996f1 tempest-ServersNegativeTestJSON-518620236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:20:51 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-67b0b53d-8a43-44c3-ad97-9ea5239996f1 tempest-ServersNegativeTestJSON-518620236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:20:51 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-67b0b53d-8a43-44c3-ad97-9ea5239996f1 tempest-ServersNegativeTestJSON-518620236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:20:51 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-67b0b53d-8a43-44c3-ad97-9ea5239996f1 tempest-ServersNegativeTestJSON-518620236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:20:51 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-67b0b53d-8a43-44c3-ad97-9ea5239996f1 tempest-ServersNegativeTestJSON-518620236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:20:51 devstack sudo[90266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:20:51 devstack sudo[90266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:20:51 devstack sudo[90264]: pam_unix(sudo:session): session closed for user root Sep 29 18:20:51 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-e4872d84-f3fe-4071-9feb-8e7155a6122c tempest-VolumesExtendTest-1968261416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0fc43c25-88a4-4037-a35d-474f1112f7eb" returned: 0 in 0.418s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:20:51 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-e4872d84-f3fe-4071-9feb-8e7155a6122c tempest-VolumesExtendTest-1968261416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0fc43c25-88a4-4037-a35d-474f1112f7eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0fc43c25-88a4-4037-a35d-474f1112f7eb.f64e8e20-314c-48a8-8c37-6c0e8655e4a3 1G {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:20:51 devstack sudo[90272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0fc43c25-88a4-4037-a35d-474f1112f7eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0fc43c25-88a4-4037-a35d-474f1112f7eb.f64e8e20-314c-48a8-8c37-6c0e8655e4a3 1G Sep 29 18:20:51 devstack sudo[90272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:20:51 devstack sudo[90266]: pam_unix(sudo:session): session closed for user root Sep 29 18:20:51 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-67b0b53d-8a43-44c3-ad97-9ea5239996f1 tempest-ServersNegativeTestJSON-518620236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.304s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:20:51 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-67b0b53d-8a43-44c3-ad97-9ea5239996f1 tempest-ServersNegativeTestJSON-518620236 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:20:51 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-67b0b53d-8a43-44c3-ad97-9ea5239996f1 tempest-ServersNegativeTestJSON-518620236 None] Deleted volume successfully. Sep 29 18:20:51 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-67b0b53d-8a43-44c3-ad97-9ea5239996f1 tempest-ServersNegativeTestJSON-518620236 None] Lock "cinder-62702760-7bb5-4ea0-8625-98dc66edfead-delete_volume" released by "delete_volume" :: held 1.317s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:20:51 devstack sudo[90272]: pam_unix(sudo:session): session closed for user root Sep 29 18:20:51 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-e4872d84-f3fe-4071-9feb-8e7155a6122c tempest-VolumesExtendTest-1968261416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0fc43c25-88a4-4037-a35d-474f1112f7eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0fc43c25-88a4-4037-a35d-474f1112f7eb.f64e8e20-314c-48a8-8c37-6c0e8655e4a3 1G" returned: 0 in 0.515s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:20:51 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-e4872d84-f3fe-4071-9feb-8e7155a6122c tempest-VolumesExtendTest-1968261416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0fc43c25-88a4-4037-a35d-474f1112f7eb -F qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0fc43c25-88a4-4037-a35d-474f1112f7eb.f64e8e20-314c-48a8-8c37-6c0e8655e4a3 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:20:51 devstack sudo[90284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0fc43c25-88a4-4037-a35d-474f1112f7eb -F qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0fc43c25-88a4-4037-a35d-474f1112f7eb.f64e8e20-314c-48a8-8c37-6c0e8655e4a3 Sep 29 18:20:51 devstack sudo[90284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:20:52 devstack sudo[90284]: pam_unix(sudo:session): session closed for user root Sep 29 18:20:52 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-e4872d84-f3fe-4071-9feb-8e7155a6122c tempest-VolumesExtendTest-1968261416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0fc43c25-88a4-4037-a35d-474f1112f7eb -F qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0fc43c25-88a4-4037-a35d-474f1112f7eb.f64e8e20-314c-48a8-8c37-6c0e8655e4a3" returned: 0 in 0.529s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:20:52 devstack cinder-volume[86512]: WARNING cinder.volume.drivers.remotefs [None req-e4872d84-f3fe-4071-9feb-8e7155a6122c tempest-VolumesExtendTest-1968261416 None] /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0fc43c25-88a4-4037-a35d-474f1112f7eb.f64e8e20-314c-48a8-8c37-6c0e8655e4a3 is being set with open permissions: ugo+rw Sep 29 18:20:52 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-e4872d84-f3fe-4071-9feb-8e7155a6122c tempest-VolumesExtendTest-1968261416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0fc43c25-88a4-4037-a35d-474f1112f7eb.f64e8e20-314c-48a8-8c37-6c0e8655e4a3 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:20:52 devstack sudo[90309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0fc43c25-88a4-4037-a35d-474f1112f7eb.f64e8e20-314c-48a8-8c37-6c0e8655e4a3 Sep 29 18:20:52 devstack sudo[90309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:20:52 devstack sudo[90309]: pam_unix(sudo:session): session closed for user root Sep 29 18:20:52 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-e4872d84-f3fe-4071-9feb-8e7155a6122c tempest-VolumesExtendTest-1968261416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0fc43c25-88a4-4037-a35d-474f1112f7eb.f64e8e20-314c-48a8-8c37-6c0e8655e4a3" returned: 0 in 0.349s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:20:52 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-e4872d84-f3fe-4071-9feb-8e7155a6122c tempest-VolumesExtendTest-1968261416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0fc43c25-88a4-4037-a35d-474f1112f7eb.info {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:20:52 devstack sudo[90314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0fc43c25-88a4-4037-a35d-474f1112f7eb.info Sep 29 18:20:52 devstack sudo[90314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:20:53 devstack sudo[90314]: pam_unix(sudo:session): session closed for user root Sep 29 18:20:53 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-e4872d84-f3fe-4071-9feb-8e7155a6122c tempest-VolumesExtendTest-1968261416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0fc43c25-88a4-4037-a35d-474f1112f7eb.info" returned: 0 in 0.392s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:20:53 devstack cinder-volume[86512]: WARNING cinder.volume.drivers.remotefs [None req-e4872d84-f3fe-4071-9feb-8e7155a6122c tempest-VolumesExtendTest-1968261416 None] /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0fc43c25-88a4-4037-a35d-474f1112f7eb.info is being set with open permissions: ugo+rw Sep 29 18:20:53 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-e4872d84-f3fe-4071-9feb-8e7155a6122c tempest-VolumesExtendTest-1968261416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0fc43c25-88a4-4037-a35d-474f1112f7eb.info {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:20:53 devstack sudo[90318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0fc43c25-88a4-4037-a35d-474f1112f7eb.info Sep 29 18:20:53 devstack sudo[90318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:20:53 devstack sudo[90318]: pam_unix(sudo:session): session closed for user root Sep 29 18:20:53 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-e4872d84-f3fe-4071-9feb-8e7155a6122c tempest-VolumesExtendTest-1968261416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0fc43c25-88a4-4037-a35d-474f1112f7eb.info" returned: 0 in 0.555s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:20:53 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-e4872d84-f3fe-4071-9feb-8e7155a6122c tempest-VolumesExtendTest-1968261416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.893s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:20:53 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-e4872d84-f3fe-4071-9feb-8e7155a6122c tempest-VolumesExtendTest-1968261416 None] Create snapshot completed successfully Sep 29 18:20:54 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-23aab40f-a7b3-44a7-871d-2e793ba0436e tempest-VolumesExtendTest-1968261416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:20:54 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-23aab40f-a7b3-44a7-871d-2e793ba0436e tempest-VolumesExtendTest-1968261416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:20:54 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc9203c9-8292-4cc5-b429-2a35f37b4924]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:20:54 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-23aab40f-a7b3-44a7-871d-2e793ba0436e tempest-VolumesExtendTest-1968261416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0fc43c25-88a4-4037-a35d-474f1112f7eb {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:20:54 devstack sudo[90325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0fc43c25-88a4-4037-a35d-474f1112f7eb Sep 29 18:20:54 devstack sudo[90325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:20:54 devstack sudo[90325]: pam_unix(sudo:session): session closed for user root Sep 29 18:20:54 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-23aab40f-a7b3-44a7-871d-2e793ba0436e tempest-VolumesExtendTest-1968261416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0fc43c25-88a4-4037-a35d-474f1112f7eb" returned: 0 in 0.370s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:20:54 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-23aab40f-a7b3-44a7-871d-2e793ba0436e tempest-VolumesExtendTest-1968261416 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0fc43c25-88a4-4037-a35d-474f1112f7eb.f64e8e20-314c-48a8-8c37-6c0e8655e4a3 2G {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:20:54 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-23aab40f-a7b3-44a7-871d-2e793ba0436e tempest-VolumesExtendTest-1968261416 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0fc43c25-88a4-4037-a35d-474f1112f7eb.f64e8e20-314c-48a8-8c37-6c0e8655e4a3 2G" returned: 0 in 0.168s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:20:54 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-23aab40f-a7b3-44a7-871d-2e793ba0436e tempest-VolumesExtendTest-1968261416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.582s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:20:54 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-23aab40f-a7b3-44a7-871d-2e793ba0436e tempest-VolumesExtendTest-1968261416 None] Extend volume completed successfully. Sep 29 18:20:55 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-21296cdf-007e-451c-bb8a-8fac9dd165ba tempest-VolumesExtendTest-1968261416 None] Acquiring lock "cinder-f64e8e20-314c-48a8-8c37-6c0e8655e4a3-delete_snapshot" by "delete_snapshot" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:20:55 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-21296cdf-007e-451c-bb8a-8fac9dd165ba tempest-VolumesExtendTest-1968261416 None] Lock "cinder-f64e8e20-314c-48a8-8c37-6c0e8655e4a3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:20:55 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-21296cdf-007e-451c-bb8a-8fac9dd165ba tempest-VolumesExtendTest-1968261416 None] Acquiring lock "cinder-quobyte-0fc43c25-88a4-4037-a35d-474f1112f7eb" by "delete_snapshot" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:20:55 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-21296cdf-007e-451c-bb8a-8fac9dd165ba tempest-VolumesExtendTest-1968261416 None] Lock "cinder-quobyte-0fc43c25-88a4-4037-a35d-474f1112f7eb" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:20:55 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-21296cdf-007e-451c-bb8a-8fac9dd165ba tempest-VolumesExtendTest-1968261416 None] Acquiring lock "cinder-quobyte-f64e8e20-314c-48a8-8c37-6c0e8655e4a3" by "_delete_snapshot" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:20:55 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-21296cdf-007e-451c-bb8a-8fac9dd165ba tempest-VolumesExtendTest-1968261416 None] Lock "cinder-quobyte-f64e8e20-314c-48a8-8c37-6c0e8655e4a3" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:20:55 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-21296cdf-007e-451c-bb8a-8fac9dd165ba tempest-VolumesExtendTest-1968261416 None] Deleting offline snapshot f64e8e20-314c-48a8-8c37-6c0e8655e4a3 of volume 0fc43c25-88a4-4037-a35d-474f1112f7eb {{(pid=86512) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 18:20:55 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-21296cdf-007e-451c-bb8a-8fac9dd165ba tempest-VolumesExtendTest-1968261416 None] snapshot_file for this snap is: volume-0fc43c25-88a4-4037-a35d-474f1112f7eb.f64e8e20-314c-48a8-8c37-6c0e8655e4a3 {{(pid=86512) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 18:20:55 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbb6e6b2-9504-4c01-b5c6-14f3460348eb]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:20:55 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-21296cdf-007e-451c-bb8a-8fac9dd165ba tempest-VolumesExtendTest-1968261416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0fc43c25-88a4-4037-a35d-474f1112f7eb.f64e8e20-314c-48a8-8c37-6c0e8655e4a3 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:20:55 devstack sudo[90342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0fc43c25-88a4-4037-a35d-474f1112f7eb.f64e8e20-314c-48a8-8c37-6c0e8655e4a3 Sep 29 18:20:55 devstack sudo[90342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:20:56 devstack sudo[90342]: pam_unix(sudo:session): session closed for user root Sep 29 18:20:56 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-21296cdf-007e-451c-bb8a-8fac9dd165ba tempest-VolumesExtendTest-1968261416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0fc43c25-88a4-4037-a35d-474f1112f7eb.f64e8e20-314c-48a8-8c37-6c0e8655e4a3" returned: 0 in 0.398s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:20:56 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-21296cdf-007e-451c-bb8a-8fac9dd165ba tempest-VolumesExtendTest-1968261416 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0fc43c25-88a4-4037-a35d-474f1112f7eb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86512) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 18:20:56 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[787badb5-bafa-4dda-8839-87e894ef7408]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:20:56 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-21296cdf-007e-451c-bb8a-8fac9dd165ba tempest-VolumesExtendTest-1968261416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0fc43c25-88a4-4037-a35d-474f1112f7eb {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:20:56 devstack sudo[90347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0fc43c25-88a4-4037-a35d-474f1112f7eb Sep 29 18:20:56 devstack sudo[90347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:20:56 devstack sudo[90347]: pam_unix(sudo:session): session closed for user root Sep 29 18:20:56 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-21296cdf-007e-451c-bb8a-8fac9dd165ba tempest-VolumesExtendTest-1968261416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0fc43c25-88a4-4037-a35d-474f1112f7eb" returned: 0 in 0.545s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:20:56 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-21296cdf-007e-451c-bb8a-8fac9dd165ba tempest-VolumesExtendTest-1968261416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0fc43c25-88a4-4037-a35d-474f1112f7eb.f64e8e20-314c-48a8-8c37-6c0e8655e4a3 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:20:56 devstack sudo[90353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0fc43c25-88a4-4037-a35d-474f1112f7eb.f64e8e20-314c-48a8-8c37-6c0e8655e4a3 Sep 29 18:20:56 devstack sudo[90353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:20:57 devstack sudo[90353]: pam_unix(sudo:session): session closed for user root Sep 29 18:20:57 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-21296cdf-007e-451c-bb8a-8fac9dd165ba tempest-VolumesExtendTest-1968261416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0fc43c25-88a4-4037-a35d-474f1112f7eb.f64e8e20-314c-48a8-8c37-6c0e8655e4a3" returned: 0 in 0.400s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:20:57 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-21296cdf-007e-451c-bb8a-8fac9dd165ba tempest-VolumesExtendTest-1968261416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0fc43c25-88a4-4037-a35d-474f1112f7eb.f64e8e20-314c-48a8-8c37-6c0e8655e4a3 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:20:57 devstack sudo[90359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0fc43c25-88a4-4037-a35d-474f1112f7eb.f64e8e20-314c-48a8-8c37-6c0e8655e4a3 Sep 29 18:20:57 devstack sudo[90359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:20:57 devstack sudo[90359]: pam_unix(sudo:session): session closed for user root Sep 29 18:20:57 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-21296cdf-007e-451c-bb8a-8fac9dd165ba tempest-VolumesExtendTest-1968261416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0fc43c25-88a4-4037-a35d-474f1112f7eb.f64e8e20-314c-48a8-8c37-6c0e8655e4a3" returned: 0 in 0.260s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:20:57 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-21296cdf-007e-451c-bb8a-8fac9dd165ba tempest-VolumesExtendTest-1968261416 None] Lock "cinder-quobyte-f64e8e20-314c-48a8-8c37-6c0e8655e4a3" released by "_delete_snapshot" :: held 1.735s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:20:57 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-21296cdf-007e-451c-bb8a-8fac9dd165ba tempest-VolumesExtendTest-1968261416 None] Lock "cinder-quobyte-0fc43c25-88a4-4037-a35d-474f1112f7eb" released by "delete_snapshot" :: held 1.770s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:20:57 devstack cinder-volume[86512]: WARNING cinder.quota [None req-21296cdf-007e-451c-bb8a-8fac9dd165ba tempest-VolumesExtendTest-1968261416 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 29 18:20:57 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-21296cdf-007e-451c-bb8a-8fac9dd165ba tempest-VolumesExtendTest-1968261416 None] Created reservations ['ce2b6e45-b44c-40da-aa1e-d38c6f15e0fd', '2666f620-ffbe-4d34-86c1-2326b19a94b9', 'cc6cbfa1-aefb-49cc-b9ef-1c1e7a03164a', '3aad76b5-0566-4021-a65c-8608640abd9c'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:20:57 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-21296cdf-007e-451c-bb8a-8fac9dd165ba tempest-VolumesExtendTest-1968261416 None] Delete snapshot completed successfully. Sep 29 18:20:57 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-21296cdf-007e-451c-bb8a-8fac9dd165ba tempest-VolumesExtendTest-1968261416 None] Lock "cinder-f64e8e20-314c-48a8-8c37-6c0e8655e4a3-delete_snapshot" released by "delete_snapshot" :: held 1.995s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:20:57 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-b505e7f7-e988-43e0-bf6a-e4ccb75f69c0 tempest-VolumesExtendTest-1968261416 None] Acquiring lock "cinder-0fc43c25-88a4-4037-a35d-474f1112f7eb-delete_volume" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:20:57 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-b505e7f7-e988-43e0-bf6a-e4ccb75f69c0 tempest-VolumesExtendTest-1968261416 None] Lock "cinder-0fc43c25-88a4-4037-a35d-474f1112f7eb-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:20:57 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-b505e7f7-e988-43e0-bf6a-e4ccb75f69c0 tempest-VolumesExtendTest-1968261416 None] Acquiring lock "cinder-quobyte-0fc43c25-88a4-4037-a35d-474f1112f7eb" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:20:57 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-b505e7f7-e988-43e0-bf6a-e4ccb75f69c0 tempest-VolumesExtendTest-1968261416 None] Lock "cinder-quobyte-0fc43c25-88a4-4037-a35d-474f1112f7eb" acquired by "delete_volume" :: waited 0.018s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:20:58 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[000f5744-c6fd-4ba3-aecd-c868a663544d]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:20:58 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-b505e7f7-e988-43e0-bf6a-e4ccb75f69c0 tempest-VolumesExtendTest-1968261416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0fc43c25-88a4-4037-a35d-474f1112f7eb {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:20:58 devstack sudo[90363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0fc43c25-88a4-4037-a35d-474f1112f7eb Sep 29 18:20:58 devstack sudo[90363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:20:58 devstack sudo[90363]: pam_unix(sudo:session): session closed for user root Sep 29 18:20:58 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-b505e7f7-e988-43e0-bf6a-e4ccb75f69c0 tempest-VolumesExtendTest-1968261416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0fc43c25-88a4-4037-a35d-474f1112f7eb" returned: 0 in 0.409s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:20:58 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-b505e7f7-e988-43e0-bf6a-e4ccb75f69c0 tempest-VolumesExtendTest-1968261416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0fc43c25-88a4-4037-a35d-474f1112f7eb {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:20:58 devstack sudo[90379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0fc43c25-88a4-4037-a35d-474f1112f7eb Sep 29 18:20:58 devstack sudo[90379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:20:58 devstack sudo[90379]: pam_unix(sudo:session): session closed for user root Sep 29 18:20:58 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-b505e7f7-e988-43e0-bf6a-e4ccb75f69c0 tempest-VolumesExtendTest-1968261416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0fc43c25-88a4-4037-a35d-474f1112f7eb" returned: 0 in 0.392s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:20:58 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-b505e7f7-e988-43e0-bf6a-e4ccb75f69c0 tempest-VolumesExtendTest-1968261416 None] Lock "cinder-quobyte-0fc43c25-88a4-4037-a35d-474f1112f7eb" released by "delete_volume" :: held 0.876s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:20:58 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-b505e7f7-e988-43e0-bf6a-e4ccb75f69c0 tempest-VolumesExtendTest-1968261416 None] Created reservations ['8f98ae8d-c574-4a0f-9c2c-c570a3401aaa', '1ec2071f-1bc6-457f-8add-bfc19a5f2af2', '85fd3bbf-a19f-41fa-be58-18fb24573985', '3e758afa-80f0-4913-abc2-0e120d36aa1d'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:20:58 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-b505e7f7-e988-43e0-bf6a-e4ccb75f69c0 tempest-VolumesExtendTest-1968261416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:20:58 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-b505e7f7-e988-43e0-bf6a-e4ccb75f69c0 tempest-VolumesExtendTest-1968261416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:20:58 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-b505e7f7-e988-43e0-bf6a-e4ccb75f69c0 tempest-VolumesExtendTest-1968261416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:20:58 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-b505e7f7-e988-43e0-bf6a-e4ccb75f69c0 tempest-VolumesExtendTest-1968261416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:20:58 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-b505e7f7-e988-43e0-bf6a-e4ccb75f69c0 tempest-VolumesExtendTest-1968261416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:20:58 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-b505e7f7-e988-43e0-bf6a-e4ccb75f69c0 tempest-VolumesExtendTest-1968261416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:20:59 devstack sudo[90389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:20:59 devstack sudo[90389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:20:59 devstack sudo[90389]: pam_unix(sudo:session): session closed for user root Sep 29 18:20:59 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-b505e7f7-e988-43e0-bf6a-e4ccb75f69c0 tempest-VolumesExtendTest-1968261416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.304s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:20:59 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-b505e7f7-e988-43e0-bf6a-e4ccb75f69c0 tempest-VolumesExtendTest-1968261416 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:20:59 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-b505e7f7-e988-43e0-bf6a-e4ccb75f69c0 tempest-VolumesExtendTest-1968261416 None] Deleted volume successfully. Sep 29 18:20:59 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-b505e7f7-e988-43e0-bf6a-e4ccb75f69c0 tempest-VolumesExtendTest-1968261416 None] Lock "cinder-0fc43c25-88a4-4037-a35d-474f1112f7eb-delete_volume" released by "delete_volume" :: held 1.414s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:21:03 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a8b6b85-d917-4e3a-acb3-80a3e7c62495 tempest-VolumesNegativeTest-1308675989 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86512) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:21:03 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-6a8b6b85-d917-4e3a-acb3-80a3e7c62495 tempest-VolumesNegativeTest-1308675989 None] Flow 'volume_create_manager' (9e5883d9-3b5b-40c4-9ca7-255824e4b1f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:21:03 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-6a8b6b85-d917-4e3a-acb3-80a3e7c62495 tempest-VolumesNegativeTest-1308675989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d378dcf-b004-4d95-9028-d3c17734e02e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:21:03 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-6a8b6b85-d917-4e3a-acb3-80a3e7c62495 tempest-VolumesNegativeTest-1308675989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d378dcf-b004-4d95-9028-d3c17734e02e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:21:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1246026692',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e18ef05-543d-4714-89a5-85c4ec690d1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80fbcffa8b144b5b8ec65bfc5ed4ae58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:21:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:21:03Z,use_quota=True,user_id='91bebde6a9bc4411a5f77f738a04b8fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:21:03 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-6a8b6b85-d917-4e3a-acb3-80a3e7c62495 tempest-VolumesNegativeTest-1308675989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a2b00b6-381f-4eed-8458-9ac9b37677e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:21:03 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-6a8b6b85-d917-4e3a-acb3-80a3e7c62495 tempest-VolumesNegativeTest-1308675989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a2b00b6-381f-4eed-8458-9ac9b37677e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:21:03 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-6a8b6b85-d917-4e3a-acb3-80a3e7c62495 tempest-VolumesNegativeTest-1308675989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9424d386-4f6e-4993-b165-2b551ac95cb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:21:03 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-6a8b6b85-d917-4e3a-acb3-80a3e7c62495 tempest-VolumesNegativeTest-1308675989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9424d386-4f6e-4993-b165-2b551ac95cb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e18ef05-543d-4714-89a5-85c4ec690d1c', 'volume_name': 'volume-0e18ef05-543d-4714-89a5-85c4ec690d1c', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:21:03 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-6a8b6b85-d917-4e3a-acb3-80a3e7c62495 tempest-VolumesNegativeTest-1308675989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (caf1f882-aaea-48ba-ba08-b2cdcb4ce970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:21:03 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-6a8b6b85-d917-4e3a-acb3-80a3e7c62495 tempest-VolumesNegativeTest-1308675989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (caf1f882-aaea-48ba-ba08-b2cdcb4ce970) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:21:03 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-6a8b6b85-d917-4e3a-acb3-80a3e7c62495 tempest-VolumesNegativeTest-1308675989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ac1ad6f-7051-4a13-9fc7-857588653659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:21:03 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-6a8b6b85-d917-4e3a-acb3-80a3e7c62495 tempest-VolumesNegativeTest-1308675989 None] Volume 0e18ef05-543d-4714-89a5-85c4ec690d1c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e18ef05-543d-4714-89a5-85c4ec690d1c', 'volume_size': 1} Sep 29 18:21:03 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-6a8b6b85-d917-4e3a-acb3-80a3e7c62495 tempest-VolumesNegativeTest-1308675989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:21:03 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-6a8b6b85-d917-4e3a-acb3-80a3e7c62495 tempest-VolumesNegativeTest-1308675989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:21:03 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-6a8b6b85-d917-4e3a-acb3-80a3e7c62495 tempest-VolumesNegativeTest-1308675989 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:21:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1246026692',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e18ef05-543d-4714-89a5-85c4ec690d1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80fbcffa8b144b5b8ec65bfc5ed4ae58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:21:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:21:03Z,use_quota=True,user_id='91bebde6a9bc4411a5f77f738a04b8fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)}" {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:21:03 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-6a8b6b85-d917-4e3a-acb3-80a3e7c62495 tempest-VolumesNegativeTest-1308675989 None] Creating volume 0e18ef05-543d-4714-89a5-85c4ec690d1c {{(pid=86512) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:21:03 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-6a8b6b85-d917-4e3a-acb3-80a3e7c62495 tempest-VolumesNegativeTest-1308675989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:21:03 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-6a8b6b85-d917-4e3a-acb3-80a3e7c62495 tempest-VolumesNegativeTest-1308675989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:21:03 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-6a8b6b85-d917-4e3a-acb3-80a3e7c62495 tempest-VolumesNegativeTest-1308675989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:21:03 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-6a8b6b85-d917-4e3a-acb3-80a3e7c62495 tempest-VolumesNegativeTest-1308675989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:21:03 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-6a8b6b85-d917-4e3a-acb3-80a3e7c62495 tempest-VolumesNegativeTest-1308675989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:21:03 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-6a8b6b85-d917-4e3a-acb3-80a3e7c62495 tempest-VolumesNegativeTest-1308675989 None] Selected osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 as target Quobyte volume. {{(pid=86512) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:21:03 devstack cinder-volume[86512]: INFO cinder.volume.drivers.remotefs [None req-6a8b6b85-d917-4e3a-acb3-80a3e7c62495 tempest-VolumesNegativeTest-1308675989 None] casted to osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 Sep 29 18:21:03 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-6a8b6b85-d917-4e3a-acb3-80a3e7c62495 tempest-VolumesNegativeTest-1308675989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0e18ef05-543d-4714-89a5-85c4ec690d1c 1073741824 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:21:03 devstack sudo[90394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0e18ef05-543d-4714-89a5-85c4ec690d1c 1073741824 Sep 29 18:21:03 devstack sudo[90394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:21:03 devstack sudo[90394]: pam_unix(sudo:session): session closed for user root Sep 29 18:21:03 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-6a8b6b85-d917-4e3a-acb3-80a3e7c62495 tempest-VolumesNegativeTest-1308675989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0e18ef05-543d-4714-89a5-85c4ec690d1c 1073741824" returned: 0 in 0.466s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:21:03 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-6a8b6b85-d917-4e3a-acb3-80a3e7c62495 tempest-VolumesNegativeTest-1308675989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0e18ef05-543d-4714-89a5-85c4ec690d1c {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:21:03 devstack sudo[90400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0e18ef05-543d-4714-89a5-85c4ec690d1c Sep 29 18:21:03 devstack sudo[90400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:21:03 devstack sudo[90400]: pam_unix(sudo:session): session closed for user root Sep 29 18:21:03 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-6a8b6b85-d917-4e3a-acb3-80a3e7c62495 tempest-VolumesNegativeTest-1308675989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0e18ef05-543d-4714-89a5-85c4ec690d1c" returned: 0 in 0.241s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:21:03 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-6a8b6b85-d917-4e3a-acb3-80a3e7c62495 tempest-VolumesNegativeTest-1308675989 None] <== create_volume: return (748ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'} {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:21:03 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-6a8b6b85-d917-4e3a-acb3-80a3e7c62495 tempest-VolumesNegativeTest-1308675989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.751s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:21:03 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-6a8b6b85-d917-4e3a-acb3-80a3e7c62495 tempest-VolumesNegativeTest-1308675989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ac1ad6f-7051-4a13-9fc7-857588653659) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e18ef05-543d-4714-89a5-85c4ec690d1c', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:21:03 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-6a8b6b85-d917-4e3a-acb3-80a3e7c62495 tempest-VolumesNegativeTest-1308675989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0413edff-49e9-4938-bfca-02dad409ed12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:21:03 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-6a8b6b85-d917-4e3a-acb3-80a3e7c62495 tempest-VolumesNegativeTest-1308675989 None] Volume volume-0e18ef05-543d-4714-89a5-85c4ec690d1c (0e18ef05-543d-4714-89a5-85c4ec690d1c): created successfully Sep 29 18:21:03 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-6a8b6b85-d917-4e3a-acb3-80a3e7c62495 tempest-VolumesNegativeTest-1308675989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0413edff-49e9-4938-bfca-02dad409ed12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:21:03 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-6a8b6b85-d917-4e3a-acb3-80a3e7c62495 tempest-VolumesNegativeTest-1308675989 None] Flow 'volume_create_manager' (9e5883d9-3b5b-40c4-9ca7-255824e4b1f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:21:03 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-6a8b6b85-d917-4e3a-acb3-80a3e7c62495 tempest-VolumesNegativeTest-1308675989 None] Created volume successfully. Sep 29 18:21:13 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [req-8fa85525-4b60-49a7-b97d-a5658734d51f req-012fcedb-2478-4989-869e-08d3f34d986e tempest-ServerActionsTestOtherA-2039946361 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:21:13 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [req-8fa85525-4b60-49a7-b97d-a5658734d51f req-012fcedb-2478-4989-869e-08d3f34d986e tempest-ServerActionsTestOtherA-2039946361 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:21:13 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [req-8fa85525-4b60-49a7-b97d-a5658734d51f req-012fcedb-2478-4989-869e-08d3f34d986e tempest-ServerActionsTestOtherA-2039946361 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:21:13 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [req-8fa85525-4b60-49a7-b97d-a5658734d51f req-012fcedb-2478-4989-869e-08d3f34d986e tempest-ServerActionsTestOtherA-2039946361 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883', 'name': 'volume-ca107c68-21e2-4c3b-a3b6-98a640e627a0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6bfc0062-560f-458d-b15f-03884aab769c', 'enforce_multipath': True} {{(pid=86512) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 29 18:21:13 devstack cinder-volume[86512]: INFO cinder.volume.manager [req-8fa85525-4b60-49a7-b97d-a5658734d51f req-012fcedb-2478-4989-869e-08d3f34d986e tempest-ServerActionsTestOtherA-2039946361 None] attachment_update completed successfully. Sep 29 18:21:15 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-0c39e0bf-1759-43da-9869-cb46cfcc798a tempest-AttachVolumeShelveTestJSON-1381023116 None] Acquiring lock "cinder-80deef43-55f2-44fc-b1d0-8271a3e9fefd-delete_volume" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:21:15 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-0c39e0bf-1759-43da-9869-cb46cfcc798a tempest-AttachVolumeShelveTestJSON-1381023116 None] Lock "cinder-80deef43-55f2-44fc-b1d0-8271a3e9fefd-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:21:15 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-0c39e0bf-1759-43da-9869-cb46cfcc798a tempest-AttachVolumeShelveTestJSON-1381023116 None] Acquiring lock "cinder-quobyte-80deef43-55f2-44fc-b1d0-8271a3e9fefd" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:21:15 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-0c39e0bf-1759-43da-9869-cb46cfcc798a tempest-AttachVolumeShelveTestJSON-1381023116 None] Lock "cinder-quobyte-80deef43-55f2-44fc-b1d0-8271a3e9fefd" acquired by "delete_volume" :: waited 0.046s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:21:15 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[b25bc710-bd6f-4ad2-9846-c971e54835bb]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:21:15 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-0c39e0bf-1759-43da-9869-cb46cfcc798a tempest-AttachVolumeShelveTestJSON-1381023116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-80deef43-55f2-44fc-b1d0-8271a3e9fefd {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:21:15 devstack sudo[90974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-80deef43-55f2-44fc-b1d0-8271a3e9fefd Sep 29 18:21:15 devstack sudo[90974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:21:16 devstack sudo[90974]: pam_unix(sudo:session): session closed for user root Sep 29 18:21:16 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-0c39e0bf-1759-43da-9869-cb46cfcc798a tempest-AttachVolumeShelveTestJSON-1381023116 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-80deef43-55f2-44fc-b1d0-8271a3e9fefd" returned: 0 in 0.857s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:21:16 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-0c39e0bf-1759-43da-9869-cb46cfcc798a tempest-AttachVolumeShelveTestJSON-1381023116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-80deef43-55f2-44fc-b1d0-8271a3e9fefd {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:21:16 devstack sudo[90995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-80deef43-55f2-44fc-b1d0-8271a3e9fefd Sep 29 18:21:16 devstack sudo[90995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:21:16 devstack sudo[90995]: pam_unix(sudo:session): session closed for user root Sep 29 18:21:16 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-0c39e0bf-1759-43da-9869-cb46cfcc798a tempest-AttachVolumeShelveTestJSON-1381023116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-80deef43-55f2-44fc-b1d0-8271a3e9fefd" returned: 0 in 0.670s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:21:17 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-0c39e0bf-1759-43da-9869-cb46cfcc798a tempest-AttachVolumeShelveTestJSON-1381023116 None] Lock "cinder-quobyte-80deef43-55f2-44fc-b1d0-8271a3e9fefd" released by "delete_volume" :: held 1.632s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:21:17 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-0c39e0bf-1759-43da-9869-cb46cfcc798a tempest-AttachVolumeShelveTestJSON-1381023116 None] Created reservations ['04df33f9-a751-4128-a04d-fe08d109dd2d', '3dcea6c5-aca7-44b7-bab1-133f26ab73a5', '31d34455-06fb-4f59-be16-6978b7bec54f', '41b77f5e-cb8a-4be6-a765-090ef6032f38'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:21:17 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-0c39e0bf-1759-43da-9869-cb46cfcc798a tempest-AttachVolumeShelveTestJSON-1381023116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:21:17 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-0c39e0bf-1759-43da-9869-cb46cfcc798a tempest-AttachVolumeShelveTestJSON-1381023116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:21:17 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-0c39e0bf-1759-43da-9869-cb46cfcc798a tempest-AttachVolumeShelveTestJSON-1381023116 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:21:17 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-0c39e0bf-1759-43da-9869-cb46cfcc798a tempest-AttachVolumeShelveTestJSON-1381023116 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:21:17 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-0c39e0bf-1759-43da-9869-cb46cfcc798a tempest-AttachVolumeShelveTestJSON-1381023116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:21:17 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-0c39e0bf-1759-43da-9869-cb46cfcc798a tempest-AttachVolumeShelveTestJSON-1381023116 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:21:17 devstack sudo[91002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:21:17 devstack sudo[91002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:21:17 devstack sudo[91002]: pam_unix(sudo:session): session closed for user root Sep 29 18:21:17 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-0c39e0bf-1759-43da-9869-cb46cfcc798a tempest-AttachVolumeShelveTestJSON-1381023116 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.472s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:21:17 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-0c39e0bf-1759-43da-9869-cb46cfcc798a tempest-AttachVolumeShelveTestJSON-1381023116 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:21:17 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-0c39e0bf-1759-43da-9869-cb46cfcc798a tempest-AttachVolumeShelveTestJSON-1381023116 None] Deleted volume successfully. Sep 29 18:21:17 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-0c39e0bf-1759-43da-9869-cb46cfcc798a tempest-AttachVolumeShelveTestJSON-1381023116 None] Lock "cinder-80deef43-55f2-44fc-b1d0-8271a3e9fefd-delete_volume" released by "delete_volume" :: held 2.572s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:21:18 devstack cinder-volume[86512]: INFO cinder.volume.manager [req-03b1c607-a199-4101-b32e-02b923449cac req-4fa2e7ac-2e7e-4436-a00a-2c27e5bf37e4 tempest-ServerActionsTestOtherA-2039946361 None] Terminate volume connection completed successfully. Sep 29 18:21:18 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [req-03b1c607-a199-4101-b32e-02b923449cac req-4fa2e7ac-2e7e-4436-a00a-2c27e5bf37e4 tempest-ServerActionsTestOtherA-2039946361 None] Deleting attachment 6bfc0062-560f-458d-b15f-03884aab769c. {{(pid=86512) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 29 18:21:19 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [req-03b1c607-a199-4101-b32e-02b923449cac req-8d96f619-7e9f-48bd-907a-1e2ff950fb95 tempest-ServerActionsTestOtherA-2039946361 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:21:19 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [req-03b1c607-a199-4101-b32e-02b923449cac req-8d96f619-7e9f-48bd-907a-1e2ff950fb95 tempest-ServerActionsTestOtherA-2039946361 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:21:19 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [req-03b1c607-a199-4101-b32e-02b923449cac req-8d96f619-7e9f-48bd-907a-1e2ff950fb95 tempest-ServerActionsTestOtherA-2039946361 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:21:19 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [req-03b1c607-a199-4101-b32e-02b923449cac req-8d96f619-7e9f-48bd-907a-1e2ff950fb95 tempest-ServerActionsTestOtherA-2039946361 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883', 'name': 'volume-ca107c68-21e2-4c3b-a3b6-98a640e627a0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b42d3c08-2847-478a-8456-0e4fa16c5cc3', 'enforce_multipath': True} {{(pid=86512) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 29 18:21:20 devstack cinder-volume[86512]: INFO cinder.volume.manager [req-03b1c607-a199-4101-b32e-02b923449cac req-8d96f619-7e9f-48bd-907a-1e2ff950fb95 tempest-ServerActionsTestOtherA-2039946361 None] attachment_update completed successfully. Sep 29 18:21:30 devstack cinder-volume[86512]: DEBUG dbcounter [-] [86512] Writing DB stats cinder:SELECT=42,cinder:UPDATE=51,cinder:INSERT=11,cinder:DELETE=3 {{(pid=86512) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 18:21:30 devstack cinder-volume[86512]: DEBUG dbcounter [-] [86512] Writing DB stats cinder:UPDATE=50,cinder:SELECT=54,cinder:INSERT=12,cinder:DELETE=4 {{(pid=86512) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 18:21:32 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [req-f0062725-5876-4481-b442-23c14bdb911f req-9014de46-3487-4352-9ed1-a9b46c43a825 tempest-VolumesSnapshotsTestJSON-1375912852 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86512) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:21:32 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [req-f0062725-5876-4481-b442-23c14bdb911f req-9014de46-3487-4352-9ed1-a9b46c43a825 tempest-VolumesSnapshotsTestJSON-1375912852 None] Flow 'volume_create_manager' (5ec1fe4a-c9de-4a0f-ad83-4ce46d97ebe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:21:32 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [req-f0062725-5876-4481-b442-23c14bdb911f req-9014de46-3487-4352-9ed1-a9b46c43a825 tempest-VolumesSnapshotsTestJSON-1375912852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57ddefa9-b1c6-4992-b3d5-96ee0ab8fdeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:21:32 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [req-f0062725-5876-4481-b442-23c14bdb911f req-9014de46-3487-4352-9ed1-a9b46c43a825 tempest-VolumesSnapshotsTestJSON-1375912852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57ddefa9-b1c6-4992-b3d5-96ee0ab8fdeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:21:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-985426233',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09d93946-3e0f-4275-adff-0b130a1339da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2316a23c7bb14fecb6c46b1566e42370',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:21:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:21:32Z,use_quota=True,user_id='1b0e276bac494b87a199c405b38eb86e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:21:32 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [req-f0062725-5876-4481-b442-23c14bdb911f req-9014de46-3487-4352-9ed1-a9b46c43a825 tempest-VolumesSnapshotsTestJSON-1375912852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce705124-ca8f-440d-83e2-15d1e1e161d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:21:32 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [req-f0062725-5876-4481-b442-23c14bdb911f req-9014de46-3487-4352-9ed1-a9b46c43a825 tempest-VolumesSnapshotsTestJSON-1375912852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce705124-ca8f-440d-83e2-15d1e1e161d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:21:32 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [req-f0062725-5876-4481-b442-23c14bdb911f req-9014de46-3487-4352-9ed1-a9b46c43a825 tempest-VolumesSnapshotsTestJSON-1375912852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50464839-db22-46bd-bc33-3a232c808015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:21:32 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [req-f0062725-5876-4481-b442-23c14bdb911f req-9014de46-3487-4352-9ed1-a9b46c43a825 tempest-VolumesSnapshotsTestJSON-1375912852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50464839-db22-46bd-bc33-3a232c808015) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09d93946-3e0f-4275-adff-0b130a1339da', 'volume_name': 'volume-09d93946-3e0f-4275-adff-0b130a1339da', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:21:32 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [req-f0062725-5876-4481-b442-23c14bdb911f req-9014de46-3487-4352-9ed1-a9b46c43a825 tempest-VolumesSnapshotsTestJSON-1375912852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b193acb4-b208-4186-a1ae-57e84ae2d603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:21:32 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [req-f0062725-5876-4481-b442-23c14bdb911f req-9014de46-3487-4352-9ed1-a9b46c43a825 tempest-VolumesSnapshotsTestJSON-1375912852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b193acb4-b208-4186-a1ae-57e84ae2d603) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:21:32 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [req-f0062725-5876-4481-b442-23c14bdb911f req-9014de46-3487-4352-9ed1-a9b46c43a825 tempest-VolumesSnapshotsTestJSON-1375912852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e30f981-5288-4e16-9607-344a640ff047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:21:32 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [req-f0062725-5876-4481-b442-23c14bdb911f req-9014de46-3487-4352-9ed1-a9b46c43a825 tempest-VolumesSnapshotsTestJSON-1375912852 None] Volume 09d93946-3e0f-4275-adff-0b130a1339da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09d93946-3e0f-4275-adff-0b130a1339da', 'volume_size': 1} Sep 29 18:21:32 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [req-f0062725-5876-4481-b442-23c14bdb911f req-9014de46-3487-4352-9ed1-a9b46c43a825 tempest-VolumesSnapshotsTestJSON-1375912852 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:21:32 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [req-f0062725-5876-4481-b442-23c14bdb911f req-9014de46-3487-4352-9ed1-a9b46c43a825 tempest-VolumesSnapshotsTestJSON-1375912852 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:21:32 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [req-f0062725-5876-4481-b442-23c14bdb911f req-9014de46-3487-4352-9ed1-a9b46c43a825 tempest-VolumesSnapshotsTestJSON-1375912852 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:21:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-985426233',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09d93946-3e0f-4275-adff-0b130a1339da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2316a23c7bb14fecb6c46b1566e42370',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:21:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:21:32Z,use_quota=True,user_id='1b0e276bac494b87a199c405b38eb86e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)}" {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:21:32 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [req-f0062725-5876-4481-b442-23c14bdb911f req-9014de46-3487-4352-9ed1-a9b46c43a825 tempest-VolumesSnapshotsTestJSON-1375912852 None] Creating volume 09d93946-3e0f-4275-adff-0b130a1339da {{(pid=86512) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:21:32 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [req-f0062725-5876-4481-b442-23c14bdb911f req-9014de46-3487-4352-9ed1-a9b46c43a825 tempest-VolumesSnapshotsTestJSON-1375912852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:21:32 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [req-f0062725-5876-4481-b442-23c14bdb911f req-9014de46-3487-4352-9ed1-a9b46c43a825 tempest-VolumesSnapshotsTestJSON-1375912852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:21:32 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [req-f0062725-5876-4481-b442-23c14bdb911f req-9014de46-3487-4352-9ed1-a9b46c43a825 tempest-VolumesSnapshotsTestJSON-1375912852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:21:32 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [req-f0062725-5876-4481-b442-23c14bdb911f req-9014de46-3487-4352-9ed1-a9b46c43a825 tempest-VolumesSnapshotsTestJSON-1375912852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:21:32 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [req-f0062725-5876-4481-b442-23c14bdb911f req-9014de46-3487-4352-9ed1-a9b46c43a825 tempest-VolumesSnapshotsTestJSON-1375912852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:21:32 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [req-f0062725-5876-4481-b442-23c14bdb911f req-9014de46-3487-4352-9ed1-a9b46c43a825 tempest-VolumesSnapshotsTestJSON-1375912852 None] Selected osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 as target Quobyte volume. {{(pid=86512) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:21:32 devstack cinder-volume[86512]: INFO cinder.volume.drivers.remotefs [req-f0062725-5876-4481-b442-23c14bdb911f req-9014de46-3487-4352-9ed1-a9b46c43a825 tempest-VolumesSnapshotsTestJSON-1375912852 None] casted to osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 Sep 29 18:21:32 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [req-f0062725-5876-4481-b442-23c14bdb911f req-9014de46-3487-4352-9ed1-a9b46c43a825 tempest-VolumesSnapshotsTestJSON-1375912852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-09d93946-3e0f-4275-adff-0b130a1339da 1073741824 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:21:32 devstack sudo[91624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-09d93946-3e0f-4275-adff-0b130a1339da 1073741824 Sep 29 18:21:32 devstack sudo[91624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:21:32 devstack sudo[91624]: pam_unix(sudo:session): session closed for user root Sep 29 18:21:32 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [req-f0062725-5876-4481-b442-23c14bdb911f req-9014de46-3487-4352-9ed1-a9b46c43a825 tempest-VolumesSnapshotsTestJSON-1375912852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-09d93946-3e0f-4275-adff-0b130a1339da 1073741824" returned: 0 in 0.675s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:21:32 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [req-f0062725-5876-4481-b442-23c14bdb911f req-9014de46-3487-4352-9ed1-a9b46c43a825 tempest-VolumesSnapshotsTestJSON-1375912852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-09d93946-3e0f-4275-adff-0b130a1339da {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:21:32 devstack sudo[91631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-09d93946-3e0f-4275-adff-0b130a1339da Sep 29 18:21:32 devstack sudo[91631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:21:33 devstack sudo[91631]: pam_unix(sudo:session): session closed for user root Sep 29 18:21:33 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [req-f0062725-5876-4481-b442-23c14bdb911f req-9014de46-3487-4352-9ed1-a9b46c43a825 tempest-VolumesSnapshotsTestJSON-1375912852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-09d93946-3e0f-4275-adff-0b130a1339da" returned: 0 in 0.379s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:21:33 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [req-f0062725-5876-4481-b442-23c14bdb911f req-9014de46-3487-4352-9ed1-a9b46c43a825 tempest-VolumesSnapshotsTestJSON-1375912852 None] <== create_volume: return (1114ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'} {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:21:33 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [req-f0062725-5876-4481-b442-23c14bdb911f req-9014de46-3487-4352-9ed1-a9b46c43a825 tempest-VolumesSnapshotsTestJSON-1375912852 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.117s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:21:33 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [req-f0062725-5876-4481-b442-23c14bdb911f req-9014de46-3487-4352-9ed1-a9b46c43a825 tempest-VolumesSnapshotsTestJSON-1375912852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e30f981-5288-4e16-9607-344a640ff047) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09d93946-3e0f-4275-adff-0b130a1339da', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:21:33 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [req-f0062725-5876-4481-b442-23c14bdb911f req-9014de46-3487-4352-9ed1-a9b46c43a825 tempest-VolumesSnapshotsTestJSON-1375912852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5dae72b-3042-4eda-8cbd-f41b85fe2c89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:21:33 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [req-f0062725-5876-4481-b442-23c14bdb911f req-9014de46-3487-4352-9ed1-a9b46c43a825 tempest-VolumesSnapshotsTestJSON-1375912852 None] Volume volume-09d93946-3e0f-4275-adff-0b130a1339da (09d93946-3e0f-4275-adff-0b130a1339da): created successfully Sep 29 18:21:33 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [req-f0062725-5876-4481-b442-23c14bdb911f req-9014de46-3487-4352-9ed1-a9b46c43a825 tempest-VolumesSnapshotsTestJSON-1375912852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5dae72b-3042-4eda-8cbd-f41b85fe2c89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:21:33 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [req-f0062725-5876-4481-b442-23c14bdb911f req-9014de46-3487-4352-9ed1-a9b46c43a825 tempest-VolumesSnapshotsTestJSON-1375912852 None] Flow 'volume_create_manager' (5ec1fe4a-c9de-4a0f-ad83-4ce46d97ebe7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:21:33 devstack cinder-volume[86512]: INFO cinder.volume.manager [req-f0062725-5876-4481-b442-23c14bdb911f req-9014de46-3487-4352-9ed1-a9b46c43a825 tempest-VolumesSnapshotsTestJSON-1375912852 None] Created volume successfully. Sep 29 18:21:35 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-2f92e8b9-2e55-48d9-99b2-2c39bcce784a tempest-VolumesNegativeTest-1308675989 None] Acquiring lock "cinder-0e18ef05-543d-4714-89a5-85c4ec690d1c-delete_volume" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:21:35 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [req-0c0542f1-c55b-47a4-9d4d-b819faeaf15f req-c18515ab-38cb-4299-ae88-98720b2d355d tempest-VolumesSnapshotsTestJSON-1375912852 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:21:35 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [req-0c0542f1-c55b-47a4-9d4d-b819faeaf15f req-c18515ab-38cb-4299-ae88-98720b2d355d tempest-VolumesSnapshotsTestJSON-1375912852 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:21:35 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-2f92e8b9-2e55-48d9-99b2-2c39bcce784a tempest-VolumesNegativeTest-1308675989 None] Lock "cinder-0e18ef05-543d-4714-89a5-85c4ec690d1c-delete_volume" acquired by "delete_volume" :: waited 0.110s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:21:35 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [req-0c0542f1-c55b-47a4-9d4d-b819faeaf15f req-c18515ab-38cb-4299-ae88-98720b2d355d tempest-VolumesSnapshotsTestJSON-1375912852 None] Creating offline snapshot 502b4f59-418a-4053-90b4-dcc0932b6bb6 of volume 09d93946-3e0f-4275-adff-0b130a1339da {{(pid=86512) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 18:21:35 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6a79158-7942-417e-8110-28aa346e2d1a]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:21:35 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [req-0c0542f1-c55b-47a4-9d4d-b819faeaf15f req-c18515ab-38cb-4299-ae88-98720b2d355d tempest-VolumesSnapshotsTestJSON-1375912852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-09d93946-3e0f-4275-adff-0b130a1339da {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:21:35 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-2f92e8b9-2e55-48d9-99b2-2c39bcce784a tempest-VolumesNegativeTest-1308675989 None] Acquiring lock "cinder-quobyte-0e18ef05-543d-4714-89a5-85c4ec690d1c" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:21:35 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-2f92e8b9-2e55-48d9-99b2-2c39bcce784a tempest-VolumesNegativeTest-1308675989 None] Lock "cinder-quobyte-0e18ef05-543d-4714-89a5-85c4ec690d1c" acquired by "delete_volume" :: waited 0.032s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:21:35 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[01a77caf-0aaa-4c40-b6b6-5fa35c250320]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:21:35 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-2f92e8b9-2e55-48d9-99b2-2c39bcce784a tempest-VolumesNegativeTest-1308675989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0e18ef05-543d-4714-89a5-85c4ec690d1c {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:21:35 devstack sudo[91699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-09d93946-3e0f-4275-adff-0b130a1339da Sep 29 18:21:35 devstack sudo[91699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:21:35 devstack sudo[91702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0e18ef05-543d-4714-89a5-85c4ec690d1c Sep 29 18:21:35 devstack sudo[91702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:21:35 devstack sudo[91699]: pam_unix(sudo:session): session closed for user root Sep 29 18:21:35 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [req-0c0542f1-c55b-47a4-9d4d-b819faeaf15f req-c18515ab-38cb-4299-ae88-98720b2d355d tempest-VolumesSnapshotsTestJSON-1375912852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-09d93946-3e0f-4275-adff-0b130a1339da" returned: 0 in 0.574s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:21:35 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [req-0c0542f1-c55b-47a4-9d4d-b819faeaf15f req-c18515ab-38cb-4299-ae88-98720b2d355d tempest-VolumesSnapshotsTestJSON-1375912852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-09d93946-3e0f-4275-adff-0b130a1339da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-09d93946-3e0f-4275-adff-0b130a1339da.502b4f59-418a-4053-90b4-dcc0932b6bb6 1G {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:21:35 devstack sudo[91723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-09d93946-3e0f-4275-adff-0b130a1339da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-09d93946-3e0f-4275-adff-0b130a1339da.502b4f59-418a-4053-90b4-dcc0932b6bb6 1G Sep 29 18:21:35 devstack sudo[91723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:21:36 devstack sudo[91702]: pam_unix(sudo:session): session closed for user root Sep 29 18:21:36 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-2f92e8b9-2e55-48d9-99b2-2c39bcce784a tempest-VolumesNegativeTest-1308675989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0e18ef05-543d-4714-89a5-85c4ec690d1c" returned: 0 in 0.595s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:21:36 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-2f92e8b9-2e55-48d9-99b2-2c39bcce784a tempest-VolumesNegativeTest-1308675989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0e18ef05-543d-4714-89a5-85c4ec690d1c {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:21:36 devstack sudo[91729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0e18ef05-543d-4714-89a5-85c4ec690d1c Sep 29 18:21:36 devstack sudo[91729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:21:36 devstack sudo[91723]: pam_unix(sudo:session): session closed for user root Sep 29 18:21:36 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [req-0c0542f1-c55b-47a4-9d4d-b819faeaf15f req-c18515ab-38cb-4299-ae88-98720b2d355d tempest-VolumesSnapshotsTestJSON-1375912852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-09d93946-3e0f-4275-adff-0b130a1339da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-09d93946-3e0f-4275-adff-0b130a1339da.502b4f59-418a-4053-90b4-dcc0932b6bb6 1G" returned: 0 in 0.486s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:21:36 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [req-0c0542f1-c55b-47a4-9d4d-b819faeaf15f req-c18515ab-38cb-4299-ae88-98720b2d355d tempest-VolumesSnapshotsTestJSON-1375912852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-09d93946-3e0f-4275-adff-0b130a1339da -F qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-09d93946-3e0f-4275-adff-0b130a1339da.502b4f59-418a-4053-90b4-dcc0932b6bb6 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:21:36 devstack sudo[91729]: pam_unix(sudo:session): session closed for user root Sep 29 18:21:36 devstack sudo[91736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-09d93946-3e0f-4275-adff-0b130a1339da -F qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-09d93946-3e0f-4275-adff-0b130a1339da.502b4f59-418a-4053-90b4-dcc0932b6bb6 Sep 29 18:21:36 devstack sudo[91736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:21:36 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-2f92e8b9-2e55-48d9-99b2-2c39bcce784a tempest-VolumesNegativeTest-1308675989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0e18ef05-543d-4714-89a5-85c4ec690d1c" returned: 0 in 0.364s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:21:36 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-2f92e8b9-2e55-48d9-99b2-2c39bcce784a tempest-VolumesNegativeTest-1308675989 None] Lock "cinder-quobyte-0e18ef05-543d-4714-89a5-85c4ec690d1c" released by "delete_volume" :: held 1.071s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:21:36 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-2f92e8b9-2e55-48d9-99b2-2c39bcce784a tempest-VolumesNegativeTest-1308675989 None] Created reservations ['afeb415b-b555-4f98-b237-3da39a8e4c81', '25502d32-1c3c-4612-90e0-910bfbe9a434', '54c823b7-f75e-4a06-996e-92eb793def70', 'bdfedbbb-16eb-4062-adc2-07f3d25c01cc'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:21:36 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-2f92e8b9-2e55-48d9-99b2-2c39bcce784a tempest-VolumesNegativeTest-1308675989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:21:36 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-2f92e8b9-2e55-48d9-99b2-2c39bcce784a tempest-VolumesNegativeTest-1308675989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:21:36 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-2f92e8b9-2e55-48d9-99b2-2c39bcce784a tempest-VolumesNegativeTest-1308675989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:21:36 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-2f92e8b9-2e55-48d9-99b2-2c39bcce784a tempest-VolumesNegativeTest-1308675989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:21:36 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-2f92e8b9-2e55-48d9-99b2-2c39bcce784a tempest-VolumesNegativeTest-1308675989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:21:36 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-2f92e8b9-2e55-48d9-99b2-2c39bcce784a tempest-VolumesNegativeTest-1308675989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:21:36 devstack sudo[91738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:21:36 devstack sudo[91738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:21:36 devstack sudo[91736]: pam_unix(sudo:session): session closed for user root Sep 29 18:21:36 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [req-0c0542f1-c55b-47a4-9d4d-b819faeaf15f req-c18515ab-38cb-4299-ae88-98720b2d355d tempest-VolumesSnapshotsTestJSON-1375912852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-09d93946-3e0f-4275-adff-0b130a1339da -F qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-09d93946-3e0f-4275-adff-0b130a1339da.502b4f59-418a-4053-90b4-dcc0932b6bb6" returned: 0 in 0.483s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:21:36 devstack cinder-volume[86512]: WARNING cinder.volume.drivers.remotefs [req-0c0542f1-c55b-47a4-9d4d-b819faeaf15f req-c18515ab-38cb-4299-ae88-98720b2d355d tempest-VolumesSnapshotsTestJSON-1375912852 None] /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-09d93946-3e0f-4275-adff-0b130a1339da.502b4f59-418a-4053-90b4-dcc0932b6bb6 is being set with open permissions: ugo+rw Sep 29 18:21:36 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [req-0c0542f1-c55b-47a4-9d4d-b819faeaf15f req-c18515ab-38cb-4299-ae88-98720b2d355d tempest-VolumesSnapshotsTestJSON-1375912852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-09d93946-3e0f-4275-adff-0b130a1339da.502b4f59-418a-4053-90b4-dcc0932b6bb6 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:21:36 devstack sudo[91743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-09d93946-3e0f-4275-adff-0b130a1339da.502b4f59-418a-4053-90b4-dcc0932b6bb6 Sep 29 18:21:36 devstack sudo[91743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:21:37 devstack sudo[91738]: pam_unix(sudo:session): session closed for user root Sep 29 18:21:37 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-2f92e8b9-2e55-48d9-99b2-2c39bcce784a tempest-VolumesNegativeTest-1308675989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.405s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:21:37 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-2f92e8b9-2e55-48d9-99b2-2c39bcce784a tempest-VolumesNegativeTest-1308675989 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:21:37 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-2f92e8b9-2e55-48d9-99b2-2c39bcce784a tempest-VolumesNegativeTest-1308675989 None] Deleted volume successfully. Sep 29 18:21:37 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-2f92e8b9-2e55-48d9-99b2-2c39bcce784a tempest-VolumesNegativeTest-1308675989 None] Lock "cinder-0e18ef05-543d-4714-89a5-85c4ec690d1c-delete_volume" released by "delete_volume" :: held 1.964s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:21:37 devstack sudo[91743]: pam_unix(sudo:session): session closed for user root Sep 29 18:21:37 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [req-0c0542f1-c55b-47a4-9d4d-b819faeaf15f req-c18515ab-38cb-4299-ae88-98720b2d355d tempest-VolumesSnapshotsTestJSON-1375912852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-09d93946-3e0f-4275-adff-0b130a1339da.502b4f59-418a-4053-90b4-dcc0932b6bb6" returned: 0 in 0.566s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:21:37 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [req-0c0542f1-c55b-47a4-9d4d-b819faeaf15f req-c18515ab-38cb-4299-ae88-98720b2d355d tempest-VolumesSnapshotsTestJSON-1375912852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-09d93946-3e0f-4275-adff-0b130a1339da.info {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:21:37 devstack sudo[91785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-09d93946-3e0f-4275-adff-0b130a1339da.info Sep 29 18:21:37 devstack sudo[91785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:21:38 devstack sudo[91785]: pam_unix(sudo:session): session closed for user root Sep 29 18:21:38 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [req-0c0542f1-c55b-47a4-9d4d-b819faeaf15f req-c18515ab-38cb-4299-ae88-98720b2d355d tempest-VolumesSnapshotsTestJSON-1375912852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-09d93946-3e0f-4275-adff-0b130a1339da.info" returned: 0 in 0.707s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:21:38 devstack cinder-volume[86512]: WARNING cinder.volume.drivers.remotefs [req-0c0542f1-c55b-47a4-9d4d-b819faeaf15f req-c18515ab-38cb-4299-ae88-98720b2d355d tempest-VolumesSnapshotsTestJSON-1375912852 None] /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-09d93946-3e0f-4275-adff-0b130a1339da.info is being set with open permissions: ugo+rw Sep 29 18:21:38 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [req-0c0542f1-c55b-47a4-9d4d-b819faeaf15f req-c18515ab-38cb-4299-ae88-98720b2d355d tempest-VolumesSnapshotsTestJSON-1375912852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-09d93946-3e0f-4275-adff-0b130a1339da.info {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:21:38 devstack sudo[91836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-09d93946-3e0f-4275-adff-0b130a1339da.info Sep 29 18:21:38 devstack sudo[91836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:21:38 devstack sudo[91836]: pam_unix(sudo:session): session closed for user root Sep 29 18:21:38 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [req-0c0542f1-c55b-47a4-9d4d-b819faeaf15f req-c18515ab-38cb-4299-ae88-98720b2d355d tempest-VolumesSnapshotsTestJSON-1375912852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-09d93946-3e0f-4275-adff-0b130a1339da.info" returned: 0 in 0.488s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:21:38 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [req-0c0542f1-c55b-47a4-9d4d-b819faeaf15f req-c18515ab-38cb-4299-ae88-98720b2d355d tempest-VolumesSnapshotsTestJSON-1375912852 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.637s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:21:38 devstack cinder-volume[86512]: INFO cinder.volume.manager [req-0c0542f1-c55b-47a4-9d4d-b819faeaf15f req-c18515ab-38cb-4299-ae88-98720b2d355d tempest-VolumesSnapshotsTestJSON-1375912852 None] Create snapshot completed successfully Sep 29 18:21:39 devstack cinder-volume[86512]: DEBUG cinder.coordination [req-815cf9ca-ec61-4343-8fab-dda26e4e7ed2 req-01577ddd-2533-4528-8b7e-43771dbc97eb tempest-VolumesSnapshotsTestJSON-1375912852 None] Acquiring lock "cinder-502b4f59-418a-4053-90b4-dcc0932b6bb6-delete_snapshot" by "delete_snapshot" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:21:39 devstack cinder-volume[86512]: DEBUG cinder.coordination [req-815cf9ca-ec61-4343-8fab-dda26e4e7ed2 req-01577ddd-2533-4528-8b7e-43771dbc97eb tempest-VolumesSnapshotsTestJSON-1375912852 None] Lock "cinder-502b4f59-418a-4053-90b4-dcc0932b6bb6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:21:39 devstack cinder-volume[86512]: DEBUG cinder.coordination [req-815cf9ca-ec61-4343-8fab-dda26e4e7ed2 req-01577ddd-2533-4528-8b7e-43771dbc97eb tempest-VolumesSnapshotsTestJSON-1375912852 None] Acquiring lock "cinder-quobyte-09d93946-3e0f-4275-adff-0b130a1339da" by "delete_snapshot" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:21:39 devstack cinder-volume[86512]: DEBUG cinder.coordination [req-815cf9ca-ec61-4343-8fab-dda26e4e7ed2 req-01577ddd-2533-4528-8b7e-43771dbc97eb tempest-VolumesSnapshotsTestJSON-1375912852 None] Lock "cinder-quobyte-09d93946-3e0f-4275-adff-0b130a1339da" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:21:39 devstack cinder-volume[86512]: DEBUG cinder.coordination [req-815cf9ca-ec61-4343-8fab-dda26e4e7ed2 req-01577ddd-2533-4528-8b7e-43771dbc97eb tempest-VolumesSnapshotsTestJSON-1375912852 None] Acquiring lock "cinder-quobyte-502b4f59-418a-4053-90b4-dcc0932b6bb6" by "_delete_snapshot" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:21:39 devstack cinder-volume[86512]: DEBUG cinder.coordination [req-815cf9ca-ec61-4343-8fab-dda26e4e7ed2 req-01577ddd-2533-4528-8b7e-43771dbc97eb tempest-VolumesSnapshotsTestJSON-1375912852 None] Lock "cinder-quobyte-502b4f59-418a-4053-90b4-dcc0932b6bb6" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:21:39 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [req-815cf9ca-ec61-4343-8fab-dda26e4e7ed2 req-01577ddd-2533-4528-8b7e-43771dbc97eb tempest-VolumesSnapshotsTestJSON-1375912852 None] Deleting offline snapshot 502b4f59-418a-4053-90b4-dcc0932b6bb6 of volume 09d93946-3e0f-4275-adff-0b130a1339da {{(pid=86512) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 18:21:39 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [req-815cf9ca-ec61-4343-8fab-dda26e4e7ed2 req-01577ddd-2533-4528-8b7e-43771dbc97eb tempest-VolumesSnapshotsTestJSON-1375912852 None] snapshot_file for this snap is: volume-09d93946-3e0f-4275-adff-0b130a1339da.502b4f59-418a-4053-90b4-dcc0932b6bb6 {{(pid=86512) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 18:21:39 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad33fca4-ba30-4b11-869c-257feef5f305]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:21:39 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [req-815cf9ca-ec61-4343-8fab-dda26e4e7ed2 req-01577ddd-2533-4528-8b7e-43771dbc97eb tempest-VolumesSnapshotsTestJSON-1375912852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-09d93946-3e0f-4275-adff-0b130a1339da.502b4f59-418a-4053-90b4-dcc0932b6bb6 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:21:39 devstack sudo[91839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-09d93946-3e0f-4275-adff-0b130a1339da.502b4f59-418a-4053-90b4-dcc0932b6bb6 Sep 29 18:21:39 devstack sudo[91839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:21:39 devstack sudo[91839]: pam_unix(sudo:session): session closed for user root Sep 29 18:21:39 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [req-815cf9ca-ec61-4343-8fab-dda26e4e7ed2 req-01577ddd-2533-4528-8b7e-43771dbc97eb tempest-VolumesSnapshotsTestJSON-1375912852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-09d93946-3e0f-4275-adff-0b130a1339da.502b4f59-418a-4053-90b4-dcc0932b6bb6" returned: 0 in 0.615s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:21:39 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [req-815cf9ca-ec61-4343-8fab-dda26e4e7ed2 req-01577ddd-2533-4528-8b7e-43771dbc97eb tempest-VolumesSnapshotsTestJSON-1375912852 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-09d93946-3e0f-4275-adff-0b130a1339da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86512) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 18:21:39 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[90e7bb7f-6629-45f8-a905-1d4353c86984]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:21:39 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [req-815cf9ca-ec61-4343-8fab-dda26e4e7ed2 req-01577ddd-2533-4528-8b7e-43771dbc97eb tempest-VolumesSnapshotsTestJSON-1375912852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-09d93946-3e0f-4275-adff-0b130a1339da {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:21:40 devstack sudo[91845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-09d93946-3e0f-4275-adff-0b130a1339da Sep 29 18:21:40 devstack sudo[91845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:21:40 devstack sudo[91845]: pam_unix(sudo:session): session closed for user root Sep 29 18:21:40 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [req-815cf9ca-ec61-4343-8fab-dda26e4e7ed2 req-01577ddd-2533-4528-8b7e-43771dbc97eb tempest-VolumesSnapshotsTestJSON-1375912852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-09d93946-3e0f-4275-adff-0b130a1339da" returned: 0 in 0.558s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:21:40 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [req-815cf9ca-ec61-4343-8fab-dda26e4e7ed2 req-01577ddd-2533-4528-8b7e-43771dbc97eb tempest-VolumesSnapshotsTestJSON-1375912852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-09d93946-3e0f-4275-adff-0b130a1339da.502b4f59-418a-4053-90b4-dcc0932b6bb6 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:21:40 devstack sudo[91851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-09d93946-3e0f-4275-adff-0b130a1339da.502b4f59-418a-4053-90b4-dcc0932b6bb6 Sep 29 18:21:40 devstack sudo[91851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:21:40 devstack sudo[91851]: pam_unix(sudo:session): session closed for user root Sep 29 18:21:40 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [req-815cf9ca-ec61-4343-8fab-dda26e4e7ed2 req-01577ddd-2533-4528-8b7e-43771dbc97eb tempest-VolumesSnapshotsTestJSON-1375912852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-09d93946-3e0f-4275-adff-0b130a1339da.502b4f59-418a-4053-90b4-dcc0932b6bb6" returned: 0 in 0.457s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:21:40 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [req-815cf9ca-ec61-4343-8fab-dda26e4e7ed2 req-01577ddd-2533-4528-8b7e-43771dbc97eb tempest-VolumesSnapshotsTestJSON-1375912852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-09d93946-3e0f-4275-adff-0b130a1339da.502b4f59-418a-4053-90b4-dcc0932b6bb6 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:21:40 devstack sudo[91857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-09d93946-3e0f-4275-adff-0b130a1339da.502b4f59-418a-4053-90b4-dcc0932b6bb6 Sep 29 18:21:40 devstack sudo[91857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:21:41 devstack sudo[91857]: pam_unix(sudo:session): session closed for user root Sep 29 18:21:41 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [req-815cf9ca-ec61-4343-8fab-dda26e4e7ed2 req-01577ddd-2533-4528-8b7e-43771dbc97eb tempest-VolumesSnapshotsTestJSON-1375912852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-09d93946-3e0f-4275-adff-0b130a1339da.502b4f59-418a-4053-90b4-dcc0932b6bb6" returned: 0 in 0.302s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:21:41 devstack cinder-volume[86512]: DEBUG cinder.coordination [req-815cf9ca-ec61-4343-8fab-dda26e4e7ed2 req-01577ddd-2533-4528-8b7e-43771dbc97eb tempest-VolumesSnapshotsTestJSON-1375912852 None] Lock "cinder-quobyte-502b4f59-418a-4053-90b4-dcc0932b6bb6" released by "_delete_snapshot" :: held 2.102s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:21:41 devstack cinder-volume[86512]: DEBUG cinder.coordination [req-815cf9ca-ec61-4343-8fab-dda26e4e7ed2 req-01577ddd-2533-4528-8b7e-43771dbc97eb tempest-VolumesSnapshotsTestJSON-1375912852 None] Lock "cinder-quobyte-09d93946-3e0f-4275-adff-0b130a1339da" released by "delete_snapshot" :: held 2.144s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:21:41 devstack cinder-volume[86512]: DEBUG cinder.quota [req-815cf9ca-ec61-4343-8fab-dda26e4e7ed2 req-01577ddd-2533-4528-8b7e-43771dbc97eb tempest-VolumesSnapshotsTestJSON-1375912852 None] Created reservations ['0fcc9558-b383-466b-a246-e9fecb6d3dbb', '8101eedd-2c99-42a9-998d-5410a3a96138', 'e9a76803-b3f1-4594-912f-998adb47baf3', '274b1668-2640-4ceb-9fe2-266658e2b256'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:21:41 devstack cinder-volume[86512]: INFO cinder.volume.manager [req-815cf9ca-ec61-4343-8fab-dda26e4e7ed2 req-01577ddd-2533-4528-8b7e-43771dbc97eb tempest-VolumesSnapshotsTestJSON-1375912852 None] Delete snapshot completed successfully. Sep 29 18:21:41 devstack cinder-volume[86512]: DEBUG cinder.coordination [req-815cf9ca-ec61-4343-8fab-dda26e4e7ed2 req-01577ddd-2533-4528-8b7e-43771dbc97eb tempest-VolumesSnapshotsTestJSON-1375912852 None] Lock "cinder-502b4f59-418a-4053-90b4-dcc0932b6bb6-delete_snapshot" released by "delete_snapshot" :: held 2.443s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:21:42 devstack cinder-volume[86512]: DEBUG cinder.coordination [req-c9aa46cd-5659-493e-947d-b4e7c6460086 req-daf52795-a5d2-4ed3-856c-ad749544ec41 tempest-VolumesSnapshotsTestJSON-1375912852 None] Acquiring lock "cinder-09d93946-3e0f-4275-adff-0b130a1339da-delete_volume" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:21:42 devstack cinder-volume[86512]: DEBUG cinder.coordination [req-c9aa46cd-5659-493e-947d-b4e7c6460086 req-daf52795-a5d2-4ed3-856c-ad749544ec41 tempest-VolumesSnapshotsTestJSON-1375912852 None] Lock "cinder-09d93946-3e0f-4275-adff-0b130a1339da-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:21:42 devstack cinder-volume[86512]: DEBUG cinder.coordination [req-c9aa46cd-5659-493e-947d-b4e7c6460086 req-daf52795-a5d2-4ed3-856c-ad749544ec41 tempest-VolumesSnapshotsTestJSON-1375912852 None] Acquiring lock "cinder-quobyte-09d93946-3e0f-4275-adff-0b130a1339da" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:21:42 devstack cinder-volume[86512]: DEBUG cinder.coordination [req-c9aa46cd-5659-493e-947d-b4e7c6460086 req-daf52795-a5d2-4ed3-856c-ad749544ec41 tempest-VolumesSnapshotsTestJSON-1375912852 None] Lock "cinder-quobyte-09d93946-3e0f-4275-adff-0b130a1339da" acquired by "delete_volume" :: waited 0.026s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:21:42 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c8fa28b-1811-4bee-bc28-78efb3f21000]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:21:42 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [req-c9aa46cd-5659-493e-947d-b4e7c6460086 req-daf52795-a5d2-4ed3-856c-ad749544ec41 tempest-VolumesSnapshotsTestJSON-1375912852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-09d93946-3e0f-4275-adff-0b130a1339da {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:21:42 devstack sudo[91884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-09d93946-3e0f-4275-adff-0b130a1339da Sep 29 18:21:42 devstack sudo[91884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:21:43 devstack sudo[91884]: pam_unix(sudo:session): session closed for user root Sep 29 18:21:43 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [req-c9aa46cd-5659-493e-947d-b4e7c6460086 req-daf52795-a5d2-4ed3-856c-ad749544ec41 tempest-VolumesSnapshotsTestJSON-1375912852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-09d93946-3e0f-4275-adff-0b130a1339da" returned: 0 in 0.397s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:21:43 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [req-c9aa46cd-5659-493e-947d-b4e7c6460086 req-daf52795-a5d2-4ed3-856c-ad749544ec41 tempest-VolumesSnapshotsTestJSON-1375912852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-09d93946-3e0f-4275-adff-0b130a1339da {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:21:43 devstack sudo[91889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-09d93946-3e0f-4275-adff-0b130a1339da Sep 29 18:21:43 devstack sudo[91889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:21:43 devstack sudo[91889]: pam_unix(sudo:session): session closed for user root Sep 29 18:21:43 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [req-c9aa46cd-5659-493e-947d-b4e7c6460086 req-daf52795-a5d2-4ed3-856c-ad749544ec41 tempest-VolumesSnapshotsTestJSON-1375912852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-09d93946-3e0f-4275-adff-0b130a1339da" returned: 0 in 0.283s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:21:43 devstack cinder-volume[86512]: DEBUG cinder.coordination [req-c9aa46cd-5659-493e-947d-b4e7c6460086 req-daf52795-a5d2-4ed3-856c-ad749544ec41 tempest-VolumesSnapshotsTestJSON-1375912852 None] Lock "cinder-quobyte-09d93946-3e0f-4275-adff-0b130a1339da" released by "delete_volume" :: held 0.763s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:21:43 devstack cinder-volume[86512]: DEBUG cinder.quota [req-c9aa46cd-5659-493e-947d-b4e7c6460086 req-daf52795-a5d2-4ed3-856c-ad749544ec41 tempest-VolumesSnapshotsTestJSON-1375912852 None] Created reservations ['47ffbd71-7539-4402-bec9-872708aec45e', '7ca995ad-98f4-4c25-8fb4-f07395edf2d7', 'eb66d0ff-1442-4335-9434-233f9a06c053', '6eb4842b-5b6e-4d73-90ab-f109b8a301e5'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:21:43 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [req-c9aa46cd-5659-493e-947d-b4e7c6460086 req-daf52795-a5d2-4ed3-856c-ad749544ec41 tempest-VolumesSnapshotsTestJSON-1375912852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:21:43 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [req-c9aa46cd-5659-493e-947d-b4e7c6460086 req-daf52795-a5d2-4ed3-856c-ad749544ec41 tempest-VolumesSnapshotsTestJSON-1375912852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:21:43 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [req-c9aa46cd-5659-493e-947d-b4e7c6460086 req-daf52795-a5d2-4ed3-856c-ad749544ec41 tempest-VolumesSnapshotsTestJSON-1375912852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:21:43 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [req-c9aa46cd-5659-493e-947d-b4e7c6460086 req-daf52795-a5d2-4ed3-856c-ad749544ec41 tempest-VolumesSnapshotsTestJSON-1375912852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:21:43 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [req-c9aa46cd-5659-493e-947d-b4e7c6460086 req-daf52795-a5d2-4ed3-856c-ad749544ec41 tempest-VolumesSnapshotsTestJSON-1375912852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:21:43 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [req-c9aa46cd-5659-493e-947d-b4e7c6460086 req-daf52795-a5d2-4ed3-856c-ad749544ec41 tempest-VolumesSnapshotsTestJSON-1375912852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:21:43 devstack sudo[91893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:21:43 devstack sudo[91893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:21:43 devstack sudo[91893]: pam_unix(sudo:session): session closed for user root Sep 29 18:21:43 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [req-c9aa46cd-5659-493e-947d-b4e7c6460086 req-daf52795-a5d2-4ed3-856c-ad749544ec41 tempest-VolumesSnapshotsTestJSON-1375912852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.352s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:21:43 devstack cinder-volume[86512]: DEBUG cinder.manager [req-c9aa46cd-5659-493e-947d-b4e7c6460086 req-daf52795-a5d2-4ed3-856c-ad749544ec41 tempest-VolumesSnapshotsTestJSON-1375912852 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:21:43 devstack cinder-volume[86512]: INFO cinder.volume.manager [req-c9aa46cd-5659-493e-947d-b4e7c6460086 req-daf52795-a5d2-4ed3-856c-ad749544ec41 tempest-VolumesSnapshotsTestJSON-1375912852 None] Deleted volume successfully. Sep 29 18:21:43 devstack cinder-volume[86512]: DEBUG cinder.coordination [req-c9aa46cd-5659-493e-947d-b4e7c6460086 req-daf52795-a5d2-4ed3-856c-ad749544ec41 tempest-VolumesSnapshotsTestJSON-1375912852 None] Lock "cinder-09d93946-3e0f-4275-adff-0b130a1339da-delete_volume" released by "delete_volume" :: held 1.379s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:21:49 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-5934352c-a4c7-47e2-8975-7db05af02c64 tempest-VolumesTestJSON-533322040 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86512) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:21:49 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-5934352c-a4c7-47e2-8975-7db05af02c64 tempest-VolumesTestJSON-533322040 None] Flow 'volume_create_manager' (63a7ce9d-2805-4481-8969-82fbf085fbea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:21:49 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-5934352c-a4c7-47e2-8975-7db05af02c64 tempest-VolumesTestJSON-533322040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab1ec486-a713-4c6d-b7fc-a10cd8dadd45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:21:49 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-5934352c-a4c7-47e2-8975-7db05af02c64 tempest-VolumesTestJSON-533322040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab1ec486-a713-4c6d-b7fc-a10cd8dadd45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:21:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-115708859',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce8c62a0-2bed-4d43-bd34-4dd03680f10e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='98ff80f690744c1b905ef43a760fefb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:21:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:21:49Z,use_quota=True,user_id='2a906e025a02472399994f3adbe6df51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:21:49 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-5934352c-a4c7-47e2-8975-7db05af02c64 tempest-VolumesTestJSON-533322040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (202c2f34-0882-4f28-b97d-26e18bf950a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:21:49 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-5934352c-a4c7-47e2-8975-7db05af02c64 tempest-VolumesTestJSON-533322040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (202c2f34-0882-4f28-b97d-26e18bf950a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:21:49 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-5934352c-a4c7-47e2-8975-7db05af02c64 tempest-VolumesTestJSON-533322040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d55c5750-aaed-44f5-b0d2-782c0b2e3d7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:21:49 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-5934352c-a4c7-47e2-8975-7db05af02c64 tempest-VolumesTestJSON-533322040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d55c5750-aaed-44f5-b0d2-782c0b2e3d7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce8c62a0-2bed-4d43-bd34-4dd03680f10e', 'volume_name': 'volume-ce8c62a0-2bed-4d43-bd34-4dd03680f10e', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:21:49 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-5934352c-a4c7-47e2-8975-7db05af02c64 tempest-VolumesTestJSON-533322040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb4245c5-47a6-42f0-b755-457f3e8ba2ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:21:49 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-5934352c-a4c7-47e2-8975-7db05af02c64 tempest-VolumesTestJSON-533322040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb4245c5-47a6-42f0-b755-457f3e8ba2ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:21:49 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-5934352c-a4c7-47e2-8975-7db05af02c64 tempest-VolumesTestJSON-533322040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a75aa5f2-3bb6-4973-a301-859eaecee353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:21:49 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-5934352c-a4c7-47e2-8975-7db05af02c64 tempest-VolumesTestJSON-533322040 None] Volume ce8c62a0-2bed-4d43-bd34-4dd03680f10e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce8c62a0-2bed-4d43-bd34-4dd03680f10e', 'volume_size': 1} Sep 29 18:21:49 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-5934352c-a4c7-47e2-8975-7db05af02c64 tempest-VolumesTestJSON-533322040 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:21:49 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-5934352c-a4c7-47e2-8975-7db05af02c64 tempest-VolumesTestJSON-533322040 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.008s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:21:49 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-5934352c-a4c7-47e2-8975-7db05af02c64 tempest-VolumesTestJSON-533322040 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:21:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-115708859',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce8c62a0-2bed-4d43-bd34-4dd03680f10e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='98ff80f690744c1b905ef43a760fefb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:21:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:21:49Z,use_quota=True,user_id='2a906e025a02472399994f3adbe6df51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)}" {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:21:49 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-5934352c-a4c7-47e2-8975-7db05af02c64 tempest-VolumesTestJSON-533322040 None] Creating volume ce8c62a0-2bed-4d43-bd34-4dd03680f10e {{(pid=86512) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:21:49 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-5934352c-a4c7-47e2-8975-7db05af02c64 tempest-VolumesTestJSON-533322040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:21:49 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-5934352c-a4c7-47e2-8975-7db05af02c64 tempest-VolumesTestJSON-533322040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:21:49 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-5934352c-a4c7-47e2-8975-7db05af02c64 tempest-VolumesTestJSON-533322040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:21:49 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-5934352c-a4c7-47e2-8975-7db05af02c64 tempest-VolumesTestJSON-533322040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:21:49 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-5934352c-a4c7-47e2-8975-7db05af02c64 tempest-VolumesTestJSON-533322040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:21:49 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-5934352c-a4c7-47e2-8975-7db05af02c64 tempest-VolumesTestJSON-533322040 None] Selected osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 as target Quobyte volume. {{(pid=86512) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:21:49 devstack cinder-volume[86512]: INFO cinder.volume.drivers.remotefs [None req-5934352c-a4c7-47e2-8975-7db05af02c64 tempest-VolumesTestJSON-533322040 None] casted to osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 Sep 29 18:21:49 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-5934352c-a4c7-47e2-8975-7db05af02c64 tempest-VolumesTestJSON-533322040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ce8c62a0-2bed-4d43-bd34-4dd03680f10e 1073741824 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:21:49 devstack sudo[91898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ce8c62a0-2bed-4d43-bd34-4dd03680f10e 1073741824 Sep 29 18:21:49 devstack sudo[91898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:21:50 devstack sudo[91898]: pam_unix(sudo:session): session closed for user root Sep 29 18:21:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-5934352c-a4c7-47e2-8975-7db05af02c64 tempest-VolumesTestJSON-533322040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ce8c62a0-2bed-4d43-bd34-4dd03680f10e 1073741824" returned: 0 in 0.889s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:21:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-5934352c-a4c7-47e2-8975-7db05af02c64 tempest-VolumesTestJSON-533322040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ce8c62a0-2bed-4d43-bd34-4dd03680f10e {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:21:50 devstack sudo[91917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ce8c62a0-2bed-4d43-bd34-4dd03680f10e Sep 29 18:21:50 devstack sudo[91917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:21:50 devstack sudo[91917]: pam_unix(sudo:session): session closed for user root Sep 29 18:21:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-5934352c-a4c7-47e2-8975-7db05af02c64 tempest-VolumesTestJSON-533322040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ce8c62a0-2bed-4d43-bd34-4dd03680f10e" returned: 0 in 0.262s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:21:50 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-5934352c-a4c7-47e2-8975-7db05af02c64 tempest-VolumesTestJSON-533322040 None] <== create_volume: return (1219ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'} {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:21:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-5934352c-a4c7-47e2-8975-7db05af02c64 tempest-VolumesTestJSON-533322040 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.222s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:21:50 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-5934352c-a4c7-47e2-8975-7db05af02c64 tempest-VolumesTestJSON-533322040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a75aa5f2-3bb6-4973-a301-859eaecee353) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce8c62a0-2bed-4d43-bd34-4dd03680f10e', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:21:50 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-5934352c-a4c7-47e2-8975-7db05af02c64 tempest-VolumesTestJSON-533322040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dce1e53e-7671-4eca-8b27-86180d77a2fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:21:50 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-5934352c-a4c7-47e2-8975-7db05af02c64 tempest-VolumesTestJSON-533322040 None] Volume volume-ce8c62a0-2bed-4d43-bd34-4dd03680f10e (ce8c62a0-2bed-4d43-bd34-4dd03680f10e): created successfully Sep 29 18:21:50 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-5934352c-a4c7-47e2-8975-7db05af02c64 tempest-VolumesTestJSON-533322040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dce1e53e-7671-4eca-8b27-86180d77a2fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:21:50 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-5934352c-a4c7-47e2-8975-7db05af02c64 tempest-VolumesTestJSON-533322040 None] Flow 'volume_create_manager' (63a7ce9d-2805-4481-8969-82fbf085fbea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:21:50 devstack cinder-volume[86512]: DEBUG oslo_service.periodic_task [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86512) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 18:21:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:21:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:21:50 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:21:50 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:21:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:21:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:21:50 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-5934352c-a4c7-47e2-8975-7db05af02c64 tempest-VolumesTestJSON-533322040 None] Created volume successfully. Sep 29 18:21:50 devstack sudo[91925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:21:50 devstack sudo[91925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:21:50 devstack cinder-volume[86512]: INFO cinder.volume.manager [req-54ef9c3c-cdfe-44bf-8e40-ab5ffc09d708 req-96066d5f-a4d2-4d01-9c5d-1dc4b11c51d8 tempest-ServerActionsTestOtherA-2039946361 None] Terminate volume connection completed successfully. Sep 29 18:21:50 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [req-54ef9c3c-cdfe-44bf-8e40-ab5ffc09d708 req-96066d5f-a4d2-4d01-9c5d-1dc4b11c51d8 tempest-ServerActionsTestOtherA-2039946361 None] Deleting attachment b42d3c08-2847-478a-8456-0e4fa16c5cc3. {{(pid=86512) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 29 18:21:50 devstack sudo[91925]: pam_unix(sudo:session): session closed for user root Sep 29 18:21:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.303s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:21:50 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:21:50 devstack cinder-volume[86512]: DEBUG oslo_service.periodic_task [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Running periodic task VolumeManager._thread_info {{(pid=86512) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 18:21:50 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] thread count: 28 {{(pid=86512) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 29 18:21:50 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] thread info: [<_MainThread(MainThread, started 135593654804608)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86512) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 29 18:21:51 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-300f609c-337d-48b9-a316-3a7c2104cf7d tempest-VolumesTestJSON-533322040 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86512) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:21:51 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-300f609c-337d-48b9-a316-3a7c2104cf7d tempest-VolumesTestJSON-533322040 None] Flow 'volume_create_manager' (a801e130-26ea-4c0d-a7aa-e9e5b0f894e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:21:51 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-300f609c-337d-48b9-a316-3a7c2104cf7d tempest-VolumesTestJSON-533322040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (524763ba-e694-4e6e-9fc7-7e2b71131190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:21:51 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-300f609c-337d-48b9-a316-3a7c2104cf7d tempest-VolumesTestJSON-533322040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (524763ba-e694-4e6e-9fc7-7e2b71131190) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:21:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-155554187',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=684ba497-03f0-48b0-9af0-f2a85d0481d1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='98ff80f690744c1b905ef43a760fefb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:21:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:21:52Z,use_quota=True,user_id='2a906e025a02472399994f3adbe6df51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:21:51 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-300f609c-337d-48b9-a316-3a7c2104cf7d tempest-VolumesTestJSON-533322040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7aa84d01-f4d3-4ecd-9735-049d270b3f6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:21:51 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-300f609c-337d-48b9-a316-3a7c2104cf7d tempest-VolumesTestJSON-533322040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7aa84d01-f4d3-4ecd-9735-049d270b3f6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:21:51 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-300f609c-337d-48b9-a316-3a7c2104cf7d tempest-VolumesTestJSON-533322040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb82cdca-0db7-4f1c-bc5b-9c6e6742018b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:21:51 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-300f609c-337d-48b9-a316-3a7c2104cf7d tempest-VolumesTestJSON-533322040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb82cdca-0db7-4f1c-bc5b-9c6e6742018b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '684ba497-03f0-48b0-9af0-f2a85d0481d1', 'volume_name': 'volume-684ba497-03f0-48b0-9af0-f2a85d0481d1', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:21:51 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-300f609c-337d-48b9-a316-3a7c2104cf7d tempest-VolumesTestJSON-533322040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10955f24-bf7f-4dd3-aa7e-2ea927ec3c43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:21:51 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-300f609c-337d-48b9-a316-3a7c2104cf7d tempest-VolumesTestJSON-533322040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10955f24-bf7f-4dd3-aa7e-2ea927ec3c43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:21:51 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-300f609c-337d-48b9-a316-3a7c2104cf7d tempest-VolumesTestJSON-533322040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (193b8a1a-6fd4-491d-adc5-0d508e30a673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:21:51 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-300f609c-337d-48b9-a316-3a7c2104cf7d tempest-VolumesTestJSON-533322040 None] Volume 684ba497-03f0-48b0-9af0-f2a85d0481d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-684ba497-03f0-48b0-9af0-f2a85d0481d1', 'volume_size': 1} Sep 29 18:21:51 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-300f609c-337d-48b9-a316-3a7c2104cf7d tempest-VolumesTestJSON-533322040 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:21:51 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-300f609c-337d-48b9-a316-3a7c2104cf7d tempest-VolumesTestJSON-533322040 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:21:51 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-300f609c-337d-48b9-a316-3a7c2104cf7d tempest-VolumesTestJSON-533322040 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:21:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-155554187',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=684ba497-03f0-48b0-9af0-f2a85d0481d1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='98ff80f690744c1b905ef43a760fefb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:21:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:21:52Z,use_quota=True,user_id='2a906e025a02472399994f3adbe6df51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)}" {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:21:51 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-300f609c-337d-48b9-a316-3a7c2104cf7d tempest-VolumesTestJSON-533322040 None] Creating volume 684ba497-03f0-48b0-9af0-f2a85d0481d1 {{(pid=86512) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:21:51 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-300f609c-337d-48b9-a316-3a7c2104cf7d tempest-VolumesTestJSON-533322040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:21:51 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-300f609c-337d-48b9-a316-3a7c2104cf7d tempest-VolumesTestJSON-533322040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:21:51 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-300f609c-337d-48b9-a316-3a7c2104cf7d tempest-VolumesTestJSON-533322040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:21:51 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-300f609c-337d-48b9-a316-3a7c2104cf7d tempest-VolumesTestJSON-533322040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:21:51 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-300f609c-337d-48b9-a316-3a7c2104cf7d tempest-VolumesTestJSON-533322040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:21:51 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-300f609c-337d-48b9-a316-3a7c2104cf7d tempest-VolumesTestJSON-533322040 None] Selected osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 as target Quobyte volume. {{(pid=86512) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:21:51 devstack cinder-volume[86512]: INFO cinder.volume.drivers.remotefs [None req-300f609c-337d-48b9-a316-3a7c2104cf7d tempest-VolumesTestJSON-533322040 None] casted to osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 Sep 29 18:21:51 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-300f609c-337d-48b9-a316-3a7c2104cf7d tempest-VolumesTestJSON-533322040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-684ba497-03f0-48b0-9af0-f2a85d0481d1 1073741824 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:21:51 devstack sudo[91934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-684ba497-03f0-48b0-9af0-f2a85d0481d1 1073741824 Sep 29 18:21:51 devstack sudo[91934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:21:52 devstack sudo[91934]: pam_unix(sudo:session): session closed for user root Sep 29 18:21:52 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-300f609c-337d-48b9-a316-3a7c2104cf7d tempest-VolumesTestJSON-533322040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-684ba497-03f0-48b0-9af0-f2a85d0481d1 1073741824" returned: 0 in 0.666s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:21:52 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-300f609c-337d-48b9-a316-3a7c2104cf7d tempest-VolumesTestJSON-533322040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-684ba497-03f0-48b0-9af0-f2a85d0481d1 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:21:52 devstack sudo[91962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-684ba497-03f0-48b0-9af0-f2a85d0481d1 Sep 29 18:21:52 devstack sudo[91962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:21:52 devstack sudo[91962]: pam_unix(sudo:session): session closed for user root Sep 29 18:21:52 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-300f609c-337d-48b9-a316-3a7c2104cf7d tempest-VolumesTestJSON-533322040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-684ba497-03f0-48b0-9af0-f2a85d0481d1" returned: 0 in 0.315s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:21:52 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-300f609c-337d-48b9-a316-3a7c2104cf7d tempest-VolumesTestJSON-533322040 None] <== create_volume: return (1042ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'} {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:21:52 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-300f609c-337d-48b9-a316-3a7c2104cf7d tempest-VolumesTestJSON-533322040 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.045s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:21:52 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-300f609c-337d-48b9-a316-3a7c2104cf7d tempest-VolumesTestJSON-533322040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (193b8a1a-6fd4-491d-adc5-0d508e30a673) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-684ba497-03f0-48b0-9af0-f2a85d0481d1', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:21:52 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-300f609c-337d-48b9-a316-3a7c2104cf7d tempest-VolumesTestJSON-533322040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1126f3c-cb34-40b1-b3a1-5e01587d4458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:21:52 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-300f609c-337d-48b9-a316-3a7c2104cf7d tempest-VolumesTestJSON-533322040 None] Volume volume-684ba497-03f0-48b0-9af0-f2a85d0481d1 (684ba497-03f0-48b0-9af0-f2a85d0481d1): created successfully Sep 29 18:21:52 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-300f609c-337d-48b9-a316-3a7c2104cf7d tempest-VolumesTestJSON-533322040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1126f3c-cb34-40b1-b3a1-5e01587d4458) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:21:52 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-300f609c-337d-48b9-a316-3a7c2104cf7d tempest-VolumesTestJSON-533322040 None] Flow 'volume_create_manager' (a801e130-26ea-4c0d-a7aa-e9e5b0f894e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:21:52 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-300f609c-337d-48b9-a316-3a7c2104cf7d tempest-VolumesTestJSON-533322040 None] Created volume successfully. Sep 29 18:21:54 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-9377da1e-10f6-48d9-97ee-8d340806ae84 tempest-VolumesTestJSON-533322040 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86512) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:21:54 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-9377da1e-10f6-48d9-97ee-8d340806ae84 tempest-VolumesTestJSON-533322040 None] Flow 'volume_create_manager' (4477dd81-4dae-4f44-8bad-34289db779b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:21:54 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-9377da1e-10f6-48d9-97ee-8d340806ae84 tempest-VolumesTestJSON-533322040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5b11e18-f0e9-40c4-a02e-9cd33ca16e66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:21:54 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-9377da1e-10f6-48d9-97ee-8d340806ae84 tempest-VolumesTestJSON-533322040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5b11e18-f0e9-40c4-a02e-9cd33ca16e66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:21:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1471972814',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b863e73c-7ec3-4323-a437-36c8eed49be0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='98ff80f690744c1b905ef43a760fefb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:21:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:21:55Z,use_quota=True,user_id='2a906e025a02472399994f3adbe6df51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:21:54 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-9377da1e-10f6-48d9-97ee-8d340806ae84 tempest-VolumesTestJSON-533322040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bdb8e47-ca06-43f9-9ad6-32c0157a4ef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:21:54 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-9377da1e-10f6-48d9-97ee-8d340806ae84 tempest-VolumesTestJSON-533322040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bdb8e47-ca06-43f9-9ad6-32c0157a4ef8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:21:54 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-9377da1e-10f6-48d9-97ee-8d340806ae84 tempest-VolumesTestJSON-533322040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b328560-8de4-4f26-a0be-0eece76e6cf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:21:54 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-9377da1e-10f6-48d9-97ee-8d340806ae84 tempest-VolumesTestJSON-533322040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b328560-8de4-4f26-a0be-0eece76e6cf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b863e73c-7ec3-4323-a437-36c8eed49be0', 'volume_name': 'volume-b863e73c-7ec3-4323-a437-36c8eed49be0', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:21:54 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-9377da1e-10f6-48d9-97ee-8d340806ae84 tempest-VolumesTestJSON-533322040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (983a9635-1329-43c8-a314-c67d6f1ee55c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:21:54 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-9377da1e-10f6-48d9-97ee-8d340806ae84 tempest-VolumesTestJSON-533322040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (983a9635-1329-43c8-a314-c67d6f1ee55c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:21:54 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-9377da1e-10f6-48d9-97ee-8d340806ae84 tempest-VolumesTestJSON-533322040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca8cf6aa-a654-4cfa-8170-d9cb86e963dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:21:54 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-9377da1e-10f6-48d9-97ee-8d340806ae84 tempest-VolumesTestJSON-533322040 None] Volume b863e73c-7ec3-4323-a437-36c8eed49be0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b863e73c-7ec3-4323-a437-36c8eed49be0', 'volume_size': 1} Sep 29 18:21:54 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-9377da1e-10f6-48d9-97ee-8d340806ae84 tempest-VolumesTestJSON-533322040 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:21:54 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-9377da1e-10f6-48d9-97ee-8d340806ae84 tempest-VolumesTestJSON-533322040 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:21:54 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-9377da1e-10f6-48d9-97ee-8d340806ae84 tempest-VolumesTestJSON-533322040 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:21:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1471972814',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b863e73c-7ec3-4323-a437-36c8eed49be0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='98ff80f690744c1b905ef43a760fefb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:21:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:21:55Z,use_quota=True,user_id='2a906e025a02472399994f3adbe6df51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)}" {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:21:54 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-9377da1e-10f6-48d9-97ee-8d340806ae84 tempest-VolumesTestJSON-533322040 None] Creating volume b863e73c-7ec3-4323-a437-36c8eed49be0 {{(pid=86512) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:21:54 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-9377da1e-10f6-48d9-97ee-8d340806ae84 tempest-VolumesTestJSON-533322040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:21:54 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-9377da1e-10f6-48d9-97ee-8d340806ae84 tempest-VolumesTestJSON-533322040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:21:54 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-9377da1e-10f6-48d9-97ee-8d340806ae84 tempest-VolumesTestJSON-533322040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:21:54 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-9377da1e-10f6-48d9-97ee-8d340806ae84 tempest-VolumesTestJSON-533322040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:21:54 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-9377da1e-10f6-48d9-97ee-8d340806ae84 tempest-VolumesTestJSON-533322040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:21:54 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-9377da1e-10f6-48d9-97ee-8d340806ae84 tempest-VolumesTestJSON-533322040 None] Selected osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 as target Quobyte volume. {{(pid=86512) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:21:54 devstack cinder-volume[86512]: INFO cinder.volume.drivers.remotefs [None req-9377da1e-10f6-48d9-97ee-8d340806ae84 tempest-VolumesTestJSON-533322040 None] casted to osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 Sep 29 18:21:54 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-9377da1e-10f6-48d9-97ee-8d340806ae84 tempest-VolumesTestJSON-533322040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-b863e73c-7ec3-4323-a437-36c8eed49be0 1073741824 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:21:54 devstack sudo[91971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-b863e73c-7ec3-4323-a437-36c8eed49be0 1073741824 Sep 29 18:21:54 devstack sudo[91971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:21:55 devstack sudo[91971]: pam_unix(sudo:session): session closed for user root Sep 29 18:21:55 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-9377da1e-10f6-48d9-97ee-8d340806ae84 tempest-VolumesTestJSON-533322040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-b863e73c-7ec3-4323-a437-36c8eed49be0 1073741824" returned: 0 in 0.718s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:21:55 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-9377da1e-10f6-48d9-97ee-8d340806ae84 tempest-VolumesTestJSON-533322040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-b863e73c-7ec3-4323-a437-36c8eed49be0 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:21:55 devstack sudo[91983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-b863e73c-7ec3-4323-a437-36c8eed49be0 Sep 29 18:21:55 devstack sudo[91983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:21:55 devstack sudo[91983]: pam_unix(sudo:session): session closed for user root Sep 29 18:21:55 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-9377da1e-10f6-48d9-97ee-8d340806ae84 tempest-VolumesTestJSON-533322040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-b863e73c-7ec3-4323-a437-36c8eed49be0" returned: 0 in 0.310s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:21:55 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-9377da1e-10f6-48d9-97ee-8d340806ae84 tempest-VolumesTestJSON-533322040 None] <== create_volume: return (1091ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'} {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:21:55 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-9377da1e-10f6-48d9-97ee-8d340806ae84 tempest-VolumesTestJSON-533322040 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.094s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:21:55 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-9377da1e-10f6-48d9-97ee-8d340806ae84 tempest-VolumesTestJSON-533322040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca8cf6aa-a654-4cfa-8170-d9cb86e963dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b863e73c-7ec3-4323-a437-36c8eed49be0', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:21:55 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-9377da1e-10f6-48d9-97ee-8d340806ae84 tempest-VolumesTestJSON-533322040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1553fa1-76c5-47fb-909c-8e3e8c2957bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:21:55 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-9377da1e-10f6-48d9-97ee-8d340806ae84 tempest-VolumesTestJSON-533322040 None] Volume volume-b863e73c-7ec3-4323-a437-36c8eed49be0 (b863e73c-7ec3-4323-a437-36c8eed49be0): created successfully Sep 29 18:21:55 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-9377da1e-10f6-48d9-97ee-8d340806ae84 tempest-VolumesTestJSON-533322040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1553fa1-76c5-47fb-909c-8e3e8c2957bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:21:55 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-9377da1e-10f6-48d9-97ee-8d340806ae84 tempest-VolumesTestJSON-533322040 None] Flow 'volume_create_manager' (4477dd81-4dae-4f44-8bad-34289db779b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:21:55 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-9377da1e-10f6-48d9-97ee-8d340806ae84 tempest-VolumesTestJSON-533322040 None] Created volume successfully. Sep 29 18:21:58 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-763fbcc3-af9f-433a-b739-cdbc7b4d4f30 tempest-VolumesTestJSON-533322040 None] Acquiring lock "cinder-b863e73c-7ec3-4323-a437-36c8eed49be0-delete_volume" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:21:58 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-763fbcc3-af9f-433a-b739-cdbc7b4d4f30 tempest-VolumesTestJSON-533322040 None] Lock "cinder-b863e73c-7ec3-4323-a437-36c8eed49be0-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:21:58 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-763fbcc3-af9f-433a-b739-cdbc7b4d4f30 tempest-VolumesTestJSON-533322040 None] Acquiring lock "cinder-quobyte-b863e73c-7ec3-4323-a437-36c8eed49be0" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:21:58 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-763fbcc3-af9f-433a-b739-cdbc7b4d4f30 tempest-VolumesTestJSON-533322040 None] Lock "cinder-quobyte-b863e73c-7ec3-4323-a437-36c8eed49be0" acquired by "delete_volume" :: waited 0.030s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:21:58 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[13f9f954-43e5-4b73-ba5f-00af227c19e6]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:21:58 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-763fbcc3-af9f-433a-b739-cdbc7b4d4f30 tempest-VolumesTestJSON-533322040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-b863e73c-7ec3-4323-a437-36c8eed49be0 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:21:58 devstack sudo[91986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-b863e73c-7ec3-4323-a437-36c8eed49be0 Sep 29 18:21:58 devstack sudo[91986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:21:58 devstack sudo[91986]: pam_unix(sudo:session): session closed for user root Sep 29 18:21:58 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-763fbcc3-af9f-433a-b739-cdbc7b4d4f30 tempest-VolumesTestJSON-533322040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-b863e73c-7ec3-4323-a437-36c8eed49be0" returned: 0 in 0.473s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:21:58 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-763fbcc3-af9f-433a-b739-cdbc7b4d4f30 tempest-VolumesTestJSON-533322040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-b863e73c-7ec3-4323-a437-36c8eed49be0 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:21:58 devstack sudo[91991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-b863e73c-7ec3-4323-a437-36c8eed49be0 Sep 29 18:21:58 devstack sudo[91991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:21:58 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb9881d1-bd20-4dc6-bbf1-7bee7b4bee7c tempest-ServerActionsTestOtherA-2039946361 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86512) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:21:58 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-fb9881d1-bd20-4dc6-bbf1-7bee7b4bee7c tempest-ServerActionsTestOtherA-2039946361 None] Flow 'volume_create_manager' (83ebe290-3e18-40a3-abe9-69b30bdba82e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:21:58 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-fb9881d1-bd20-4dc6-bbf1-7bee7b4bee7c tempest-ServerActionsTestOtherA-2039946361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46e93f7a-0bde-4464-a5e8-fcf14b62e296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:21:58 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-fb9881d1-bd20-4dc6-bbf1-7bee7b4bee7c tempest-ServerActionsTestOtherA-2039946361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46e93f7a-0bde-4464-a5e8-fcf14b62e296) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:21:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1124379840',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36fb1940-32f1-4b9f-bdc4-546fcfa788b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f3d887fc4e845ef80c9bb8ffc45ec58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:21:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:21:59Z,use_quota=True,user_id='cfc3f4f30c5849dc955e4a322a35d496',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:21:58 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-fb9881d1-bd20-4dc6-bbf1-7bee7b4bee7c tempest-ServerActionsTestOtherA-2039946361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7f9055d-84bb-44b2-a6cd-bc089a124fbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:21:59 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-fb9881d1-bd20-4dc6-bbf1-7bee7b4bee7c tempest-ServerActionsTestOtherA-2039946361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7f9055d-84bb-44b2-a6cd-bc089a124fbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:21:59 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-fb9881d1-bd20-4dc6-bbf1-7bee7b4bee7c tempest-ServerActionsTestOtherA-2039946361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82d035f6-0477-4f23-8ebc-287cd8311c92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:21:59 devstack cinder-volume[86512]: DEBUG cinder.image.glance [None req-fb9881d1-bd20-4dc6-bbf1-7bee7b4bee7c tempest-ServerActionsTestOtherA-2039946361 None] Creating Keystone auth plugin from conf {{(pid=86512) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 29 18:21:59 devstack sudo[91991]: pam_unix(sudo:session): session closed for user root Sep 29 18:21:59 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-763fbcc3-af9f-433a-b739-cdbc7b4d4f30 tempest-VolumesTestJSON-533322040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-b863e73c-7ec3-4323-a437-36c8eed49be0" returned: 0 in 0.303s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:21:59 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-763fbcc3-af9f-433a-b739-cdbc7b4d4f30 tempest-VolumesTestJSON-533322040 None] Lock "cinder-quobyte-b863e73c-7ec3-4323-a437-36c8eed49be0" released by "delete_volume" :: held 0.844s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:21:59 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-763fbcc3-af9f-433a-b739-cdbc7b4d4f30 tempest-VolumesTestJSON-533322040 None] Created reservations ['4eb8ed6d-70a6-484a-a609-d324b380a13a', '01b22ff5-dba2-4d69-a995-67560b20cda6', '18a6b0e9-88cf-4cf3-b239-05c370936d5d', '517f2c5b-2c51-4fef-a786-2595883af58e'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:21:59 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-763fbcc3-af9f-433a-b739-cdbc7b4d4f30 tempest-VolumesTestJSON-533322040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:21:59 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-763fbcc3-af9f-433a-b739-cdbc7b4d4f30 tempest-VolumesTestJSON-533322040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:21:59 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-763fbcc3-af9f-433a-b739-cdbc7b4d4f30 tempest-VolumesTestJSON-533322040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:21:59 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-763fbcc3-af9f-433a-b739-cdbc7b4d4f30 tempest-VolumesTestJSON-533322040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:21:59 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-763fbcc3-af9f-433a-b739-cdbc7b4d4f30 tempest-VolumesTestJSON-533322040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:21:59 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-763fbcc3-af9f-433a-b739-cdbc7b4d4f30 tempest-VolumesTestJSON-533322040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:21:59 devstack sudo[91994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:21:59 devstack sudo[91994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:21:59 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-492d4454-82ca-4f0e-825d-2109d8cc0f30 tempest-VolumesTestJSON-533322040 None] Acquiring lock "cinder-684ba497-03f0-48b0-9af0-f2a85d0481d1-delete_volume" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:21:59 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-492d4454-82ca-4f0e-825d-2109d8cc0f30 tempest-VolumesTestJSON-533322040 None] Lock "cinder-684ba497-03f0-48b0-9af0-f2a85d0481d1-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:21:59 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-492d4454-82ca-4f0e-825d-2109d8cc0f30 tempest-VolumesTestJSON-533322040 None] Acquiring lock "cinder-quobyte-684ba497-03f0-48b0-9af0-f2a85d0481d1" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:21:59 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-492d4454-82ca-4f0e-825d-2109d8cc0f30 tempest-VolumesTestJSON-533322040 None] Lock "cinder-quobyte-684ba497-03f0-48b0-9af0-f2a85d0481d1" acquired by "delete_volume" :: waited 0.026s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:21:59 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-fb9881d1-bd20-4dc6-bbf1-7bee7b4bee7c tempest-ServerActionsTestOtherA-2039946361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82d035f6-0477-4f23-8ebc-287cd8311c92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '36fb1940-32f1-4b9f-bdc4-546fcfa788b8', 'volume_name': 'volume-36fb1940-32f1-4b9f-bdc4-546fcfa788b8', 'volume_size': 1, 'image_id': 'd8ebca63-1178-4b36-a1a2-e10949cbc87f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d8ebca63-1178-4b36-a1a2-e10949cbc87f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '987aeb00888a4b9bb9954392d91b8741', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd8ebca63-1178-4b36-a1a2-e10949cbc87f', 'created_at': datetime.datetime(2026, 9, 29, 16, 11, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 16, 11, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d8ebca63-1178-4b36-a1a2-e10949cbc87f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:21:59 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-fb9881d1-bd20-4dc6-bbf1-7bee7b4bee7c tempest-ServerActionsTestOtherA-2039946361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (573931d9-ca72-48e4-925b-7de5bc7eaeb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:21:59 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-fb9881d1-bd20-4dc6-bbf1-7bee7b4bee7c tempest-ServerActionsTestOtherA-2039946361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (573931d9-ca72-48e4-925b-7de5bc7eaeb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:21:59 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-fb9881d1-bd20-4dc6-bbf1-7bee7b4bee7c tempest-ServerActionsTestOtherA-2039946361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5cb3ff0-87c4-41f7-a915-b8619a2cef87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:21:59 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-fb9881d1-bd20-4dc6-bbf1-7bee7b4bee7c tempest-ServerActionsTestOtherA-2039946361 None] Volume 36fb1940-32f1-4b9f-bdc4-546fcfa788b8: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-36fb1940-32f1-4b9f-bdc4-546fcfa788b8', 'volume_size': 1, 'image_id': 'd8ebca63-1178-4b36-a1a2-e10949cbc87f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d8ebca63-1178-4b36-a1a2-e10949cbc87f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '987aeb00888a4b9bb9954392d91b8741', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd8ebca63-1178-4b36-a1a2-e10949cbc87f', 'created_at': datetime.datetime(2026, 9, 29, 16, 11, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 16, 11, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d8ebca63-1178-4b36-a1a2-e10949cbc87f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 29 18:21:59 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb9881d1-bd20-4dc6-bbf1-7bee7b4bee7c tempest-ServerActionsTestOtherA-2039946361 None] Trying to clone 36fb1940-32f1-4b9f-bdc4-546fcfa788b8 from image d8ebca63-1178-4b36-a1a2-e10949cbc87f at location (None, [{'url': 'file:///opt/stack/data/glance/images/d8ebca63-1178-4b36-a1a2-e10949cbc87f', 'metadata': {}}]). {{(pid=86512) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 29 18:21:59 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[9625bf6f-273f-4824-be81-78806f3f84dc]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:21:59 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-492d4454-82ca-4f0e-825d-2109d8cc0f30 tempest-VolumesTestJSON-533322040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-684ba497-03f0-48b0-9af0-f2a85d0481d1 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:21:59 devstack sudo[91994]: pam_unix(sudo:session): session closed for user root Sep 29 18:21:59 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-763fbcc3-af9f-433a-b739-cdbc7b4d4f30 tempest-VolumesTestJSON-533322040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.376s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:21:59 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-763fbcc3-af9f-433a-b739-cdbc7b4d4f30 tempest-VolumesTestJSON-533322040 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:21:59 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-763fbcc3-af9f-433a-b739-cdbc7b4d4f30 tempest-VolumesTestJSON-533322040 None] Deleted volume successfully. Sep 29 18:21:59 devstack sudo[91996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-684ba497-03f0-48b0-9af0-f2a85d0481d1 Sep 29 18:21:59 devstack sudo[91996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:21:59 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-763fbcc3-af9f-433a-b739-cdbc7b4d4f30 tempest-VolumesTestJSON-533322040 None] Lock "cinder-b863e73c-7ec3-4323-a437-36c8eed49be0-delete_volume" released by "delete_volume" :: held 1.534s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:22:00 devstack cinder-volume[86512]: DEBUG cinder.image.image_utils [None req-fb9881d1-bd20-4dc6-bbf1-7bee7b4bee7c tempest-ServerActionsTestOtherA-2039946361 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d8ebca63-1178-4b36-a1a2-e10949cbc87f_b5igos3fdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86512) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 29 18:22:00 devstack cinder-volume[86512]: INFO cinder.image.image_utils [None req-fb9881d1-bd20-4dc6-bbf1-7bee7b4bee7c tempest-ServerActionsTestOtherA-2039946361 None] Image download 20.69 MB at 20.69 MB/s Sep 29 18:22:00 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aa1f1f6-9c86-40be-a75d-3d431d843ac6]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:22:00 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-fb9881d1-bd20-4dc6-bbf1-7bee7b4bee7c tempest-ServerActionsTestOtherA-2039946361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d8ebca63-1178-4b36-a1a2-e10949cbc87f_b5igos3fdevstack@QuobyteHD {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:22:00 devstack sudo[91996]: pam_unix(sudo:session): session closed for user root Sep 29 18:22:00 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-492d4454-82ca-4f0e-825d-2109d8cc0f30 tempest-VolumesTestJSON-533322040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-684ba497-03f0-48b0-9af0-f2a85d0481d1" returned: 0 in 0.609s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:22:00 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-492d4454-82ca-4f0e-825d-2109d8cc0f30 tempest-VolumesTestJSON-533322040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-684ba497-03f0-48b0-9af0-f2a85d0481d1 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:22:00 devstack sudo[92004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d8ebca63-1178-4b36-a1a2-e10949cbc87f_b5igos3fdevstack@QuobyteHD Sep 29 18:22:00 devstack sudo[92004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:22:00 devstack sudo[92010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-684ba497-03f0-48b0-9af0-f2a85d0481d1 Sep 29 18:22:00 devstack sudo[92010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:22:00 devstack sudo[92004]: pam_unix(sudo:session): session closed for user root Sep 29 18:22:00 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-fb9881d1-bd20-4dc6-bbf1-7bee7b4bee7c tempest-ServerActionsTestOtherA-2039946361 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d8ebca63-1178-4b36-a1a2-e10949cbc87f_b5igos3fdevstack@QuobyteHD" returned: 0 in 0.432s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:22:00 devstack cinder-volume[86512]: DEBUG cinder.image.image_utils [None req-fb9881d1-bd20-4dc6-bbf1-7bee7b4bee7c tempest-ServerActionsTestOtherA-2039946361 None] Temporary image d8ebca63-1178-4b36-a1a2-e10949cbc87f is fetched for user cfc3f4f30c5849dc955e4a322a35d496. {{(pid=86512) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 29 18:22:00 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bfbc7ad-0217-484c-bfca-7d6076384ff6]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:22:00 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-fb9881d1-bd20-4dc6-bbf1-7bee7b4bee7c tempest-ServerActionsTestOtherA-2039946361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d8ebca63-1178-4b36-a1a2-e10949cbc87f_b5igos3fdevstack@QuobyteHD {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:22:00 devstack sudo[92010]: pam_unix(sudo:session): session closed for user root Sep 29 18:22:00 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-492d4454-82ca-4f0e-825d-2109d8cc0f30 tempest-VolumesTestJSON-533322040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-684ba497-03f0-48b0-9af0-f2a85d0481d1" returned: 0 in 0.587s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:22:00 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-492d4454-82ca-4f0e-825d-2109d8cc0f30 tempest-VolumesTestJSON-533322040 None] Lock "cinder-quobyte-684ba497-03f0-48b0-9af0-f2a85d0481d1" released by "delete_volume" :: held 1.279s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:22:00 devstack sudo[92018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d8ebca63-1178-4b36-a1a2-e10949cbc87f_b5igos3fdevstack@QuobyteHD Sep 29 18:22:00 devstack sudo[92018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:22:01 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-492d4454-82ca-4f0e-825d-2109d8cc0f30 tempest-VolumesTestJSON-533322040 None] Created reservations ['1c2188f6-f56f-450c-88c4-dc6787b14b82', '25f62c79-f0ca-4687-a7b8-649aa5cf2b0e', '849c08ef-9502-4d4f-8f0e-a1b4c9c941d3', 'cc89bae2-845b-4d2f-96b8-fadb0c2193d5'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:22:01 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-492d4454-82ca-4f0e-825d-2109d8cc0f30 tempest-VolumesTestJSON-533322040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:22:01 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-492d4454-82ca-4f0e-825d-2109d8cc0f30 tempest-VolumesTestJSON-533322040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:22:01 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-492d4454-82ca-4f0e-825d-2109d8cc0f30 tempest-VolumesTestJSON-533322040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:22:01 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-492d4454-82ca-4f0e-825d-2109d8cc0f30 tempest-VolumesTestJSON-533322040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:22:01 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-492d4454-82ca-4f0e-825d-2109d8cc0f30 tempest-VolumesTestJSON-533322040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:22:01 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-492d4454-82ca-4f0e-825d-2109d8cc0f30 tempest-VolumesTestJSON-533322040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:22:01 devstack sudo[92020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:22:01 devstack sudo[92020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:22:01 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0459b86-f77b-4d79-ba99-6176f90ffd94 tempest-AttachVolumeTestJSON-875799601 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86512) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:22:01 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-c0459b86-f77b-4d79-ba99-6176f90ffd94 tempest-AttachVolumeTestJSON-875799601 None] Flow 'volume_create_manager' (3e808770-48d4-439d-9a73-6f381adc99ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:22:01 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-c0459b86-f77b-4d79-ba99-6176f90ffd94 tempest-AttachVolumeTestJSON-875799601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51eb9633-0250-432d-8c01-619fdc2cdbd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:22:01 devstack sudo[92018]: pam_unix(sudo:session): session closed for user root Sep 29 18:22:01 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-fb9881d1-bd20-4dc6-bbf1-7bee7b4bee7c tempest-ServerActionsTestOtherA-2039946361 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d8ebca63-1178-4b36-a1a2-e10949cbc87f_b5igos3fdevstack@QuobyteHD" returned: 0 in 0.505s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:22:01 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-fb9881d1-bd20-4dc6-bbf1-7bee7b4bee7c tempest-ServerActionsTestOtherA-2039946361 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:22:01 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-fb9881d1-bd20-4dc6-bbf1-7bee7b4bee7c tempest-ServerActionsTestOtherA-2039946361 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:22:01 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-fb9881d1-bd20-4dc6-bbf1-7bee7b4bee7c tempest-ServerActionsTestOtherA-2039946361 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:21:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1124379840',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36fb1940-32f1-4b9f-bdc4-546fcfa788b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f3d887fc4e845ef80c9bb8ffc45ec58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:21:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:21:59Z,use_quota=True,user_id='cfc3f4f30c5849dc955e4a322a35d496',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)}" {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:22:01 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-fb9881d1-bd20-4dc6-bbf1-7bee7b4bee7c tempest-ServerActionsTestOtherA-2039946361 None] Creating volume 36fb1940-32f1-4b9f-bdc4-546fcfa788b8 {{(pid=86512) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:22:01 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-fb9881d1-bd20-4dc6-bbf1-7bee7b4bee7c tempest-ServerActionsTestOtherA-2039946361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:22:01 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-fb9881d1-bd20-4dc6-bbf1-7bee7b4bee7c tempest-ServerActionsTestOtherA-2039946361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:22:01 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-fb9881d1-bd20-4dc6-bbf1-7bee7b4bee7c tempest-ServerActionsTestOtherA-2039946361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:22:01 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-fb9881d1-bd20-4dc6-bbf1-7bee7b4bee7c tempest-ServerActionsTestOtherA-2039946361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:22:01 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-fb9881d1-bd20-4dc6-bbf1-7bee7b4bee7c tempest-ServerActionsTestOtherA-2039946361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:22:01 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-fb9881d1-bd20-4dc6-bbf1-7bee7b4bee7c tempest-ServerActionsTestOtherA-2039946361 None] Selected osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 as target Quobyte volume. {{(pid=86512) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:22:01 devstack cinder-volume[86512]: INFO cinder.volume.drivers.remotefs [None req-fb9881d1-bd20-4dc6-bbf1-7bee7b4bee7c tempest-ServerActionsTestOtherA-2039946361 None] casted to osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 Sep 29 18:22:01 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-fb9881d1-bd20-4dc6-bbf1-7bee7b4bee7c tempest-ServerActionsTestOtherA-2039946361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-36fb1940-32f1-4b9f-bdc4-546fcfa788b8 1073741824 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:22:01 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-c0459b86-f77b-4d79-ba99-6176f90ffd94 tempest-AttachVolumeTestJSON-875799601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51eb9633-0250-432d-8c01-619fdc2cdbd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:22:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1693922448',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=553aaf84-f9f1-46ef-a326-801fd69da8ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b263a1a0df4e482bba35f19d1bcae263',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:22:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:22:01Z,use_quota=True,user_id='32b44341b3334766ac9ff95448accea5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:22:01 devstack sudo[92026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-36fb1940-32f1-4b9f-bdc4-546fcfa788b8 1073741824 Sep 29 18:22:01 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-c0459b86-f77b-4d79-ba99-6176f90ffd94 tempest-AttachVolumeTestJSON-875799601 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e1bcdfe-2f7e-4739-af7c-c5f70bac729c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:22:01 devstack sudo[92026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:22:01 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-c0459b86-f77b-4d79-ba99-6176f90ffd94 tempest-AttachVolumeTestJSON-875799601 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e1bcdfe-2f7e-4739-af7c-c5f70bac729c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:22:01 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-c0459b86-f77b-4d79-ba99-6176f90ffd94 tempest-AttachVolumeTestJSON-875799601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e039cbb-cf8a-4319-b0ca-57ab82b0670e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:22:01 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-c0459b86-f77b-4d79-ba99-6176f90ffd94 tempest-AttachVolumeTestJSON-875799601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e039cbb-cf8a-4319-b0ca-57ab82b0670e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '553aaf84-f9f1-46ef-a326-801fd69da8ba', 'volume_name': 'volume-553aaf84-f9f1-46ef-a326-801fd69da8ba', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:22:01 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-c0459b86-f77b-4d79-ba99-6176f90ffd94 tempest-AttachVolumeTestJSON-875799601 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (579539ca-ac83-4033-b93b-4ac4227f6164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:22:01 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-c0459b86-f77b-4d79-ba99-6176f90ffd94 tempest-AttachVolumeTestJSON-875799601 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (579539ca-ac83-4033-b93b-4ac4227f6164) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:22:01 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-c0459b86-f77b-4d79-ba99-6176f90ffd94 tempest-AttachVolumeTestJSON-875799601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fcd3c8a-ee3b-4f6c-9c84-224cb014cb18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:22:01 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-c0459b86-f77b-4d79-ba99-6176f90ffd94 tempest-AttachVolumeTestJSON-875799601 None] Volume 553aaf84-f9f1-46ef-a326-801fd69da8ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-553aaf84-f9f1-46ef-a326-801fd69da8ba', 'volume_size': 1} Sep 29 18:22:01 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-c0459b86-f77b-4d79-ba99-6176f90ffd94 tempest-AttachVolumeTestJSON-875799601 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:22:01 devstack sudo[92020]: pam_unix(sudo:session): session closed for user root Sep 29 18:22:01 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-492d4454-82ca-4f0e-825d-2109d8cc0f30 tempest-VolumesTestJSON-533322040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.300s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:22:01 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-492d4454-82ca-4f0e-825d-2109d8cc0f30 tempest-VolumesTestJSON-533322040 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:22:01 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-492d4454-82ca-4f0e-825d-2109d8cc0f30 tempest-VolumesTestJSON-533322040 None] Deleted volume successfully. Sep 29 18:22:01 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-492d4454-82ca-4f0e-825d-2109d8cc0f30 tempest-VolumesTestJSON-533322040 None] Lock "cinder-684ba497-03f0-48b0-9af0-f2a85d0481d1-delete_volume" released by "delete_volume" :: held 2.064s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:22:01 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-0e65032f-16fe-438f-845b-b96ff9ae278b tempest-VolumesTestJSON-533322040 None] Acquiring lock "cinder-ce8c62a0-2bed-4d43-bd34-4dd03680f10e-delete_volume" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:22:01 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-0e65032f-16fe-438f-845b-b96ff9ae278b tempest-VolumesTestJSON-533322040 None] Lock "cinder-ce8c62a0-2bed-4d43-bd34-4dd03680f10e-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:22:01 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-0e65032f-16fe-438f-845b-b96ff9ae278b tempest-VolumesTestJSON-533322040 None] Acquiring lock "cinder-quobyte-ce8c62a0-2bed-4d43-bd34-4dd03680f10e" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:22:01 devstack sudo[92026]: pam_unix(sudo:session): session closed for user root Sep 29 18:22:01 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-fb9881d1-bd20-4dc6-bbf1-7bee7b4bee7c tempest-ServerActionsTestOtherA-2039946361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-36fb1940-32f1-4b9f-bdc4-546fcfa788b8 1073741824" returned: 0 in 0.571s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:22:01 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-0e65032f-16fe-438f-845b-b96ff9ae278b tempest-VolumesTestJSON-533322040 None] Lock "cinder-quobyte-ce8c62a0-2bed-4d43-bd34-4dd03680f10e" acquired by "delete_volume" :: waited 0.021s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:22:01 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[05890f7d-0c3a-4d56-a2b0-3deba5ed533e]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:22:01 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-0e65032f-16fe-438f-845b-b96ff9ae278b tempest-VolumesTestJSON-533322040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ce8c62a0-2bed-4d43-bd34-4dd03680f10e {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:22:01 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-fb9881d1-bd20-4dc6-bbf1-7bee7b4bee7c tempest-ServerActionsTestOtherA-2039946361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-36fb1940-32f1-4b9f-bdc4-546fcfa788b8 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:22:01 devstack sudo[92034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-36fb1940-32f1-4b9f-bdc4-546fcfa788b8 Sep 29 18:22:01 devstack sudo[92034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:22:02 devstack sudo[92033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ce8c62a0-2bed-4d43-bd34-4dd03680f10e Sep 29 18:22:02 devstack sudo[92033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:22:02 devstack sudo[92034]: pam_unix(sudo:session): session closed for user root Sep 29 18:22:02 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-fb9881d1-bd20-4dc6-bbf1-7bee7b4bee7c tempest-ServerActionsTestOtherA-2039946361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-36fb1940-32f1-4b9f-bdc4-546fcfa788b8" returned: 0 in 0.298s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:22:02 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-fb9881d1-bd20-4dc6-bbf1-7bee7b4bee7c tempest-ServerActionsTestOtherA-2039946361 None] <== create_volume: return (952ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'} {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:22:02 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-fb9881d1-bd20-4dc6-bbf1-7bee7b4bee7c tempest-ServerActionsTestOtherA-2039946361 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.957s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:22:02 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-c0459b86-f77b-4d79-ba99-6176f90ffd94 tempest-AttachVolumeTestJSON-875799601 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.888s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:22:02 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-c0459b86-f77b-4d79-ba99-6176f90ffd94 tempest-AttachVolumeTestJSON-875799601 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:22:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1693922448',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=553aaf84-f9f1-46ef-a326-801fd69da8ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b263a1a0df4e482bba35f19d1bcae263',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:22:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:22:01Z,use_quota=True,user_id='32b44341b3334766ac9ff95448accea5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)}" {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:22:02 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-c0459b86-f77b-4d79-ba99-6176f90ffd94 tempest-AttachVolumeTestJSON-875799601 None] Creating volume 553aaf84-f9f1-46ef-a326-801fd69da8ba {{(pid=86512) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:22:02 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-c0459b86-f77b-4d79-ba99-6176f90ffd94 tempest-AttachVolumeTestJSON-875799601 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:22:02 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-c0459b86-f77b-4d79-ba99-6176f90ffd94 tempest-AttachVolumeTestJSON-875799601 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:22:02 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-c0459b86-f77b-4d79-ba99-6176f90ffd94 tempest-AttachVolumeTestJSON-875799601 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:22:02 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-c0459b86-f77b-4d79-ba99-6176f90ffd94 tempest-AttachVolumeTestJSON-875799601 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:22:02 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-c0459b86-f77b-4d79-ba99-6176f90ffd94 tempest-AttachVolumeTestJSON-875799601 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:22:02 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-c0459b86-f77b-4d79-ba99-6176f90ffd94 tempest-AttachVolumeTestJSON-875799601 None] Selected osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 as target Quobyte volume. {{(pid=86512) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:22:02 devstack cinder-volume[86512]: INFO cinder.volume.drivers.remotefs [None req-c0459b86-f77b-4d79-ba99-6176f90ffd94 tempest-AttachVolumeTestJSON-875799601 None] casted to osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 Sep 29 18:22:02 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-c0459b86-f77b-4d79-ba99-6176f90ffd94 tempest-AttachVolumeTestJSON-875799601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-553aaf84-f9f1-46ef-a326-801fd69da8ba 1073741824 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:22:02 devstack sudo[92040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-553aaf84-f9f1-46ef-a326-801fd69da8ba 1073741824 Sep 29 18:22:02 devstack sudo[92040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:22:02 devstack cinder-volume[86512]: DEBUG cinder.volume.volume_utils [None req-fb9881d1-bd20-4dc6-bbf1-7bee7b4bee7c tempest-ServerActionsTestOtherA-2039946361 None] Attempting download of d8ebca63-1178-4b36-a1a2-e10949cbc87f ((None, [{'url': 'file:///opt/stack/data/glance/images/d8ebca63-1178-4b36-a1a2-e10949cbc87f', 'metadata': {}}])) to volume 36fb1940-32f1-4b9f-bdc4-546fcfa788b8. {{(pid=86512) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 29 18:22:02 devstack sudo[92033]: pam_unix(sudo:session): session closed for user root Sep 29 18:22:02 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-0e65032f-16fe-438f-845b-b96ff9ae278b tempest-VolumesTestJSON-533322040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ce8c62a0-2bed-4d43-bd34-4dd03680f10e" returned: 0 in 0.482s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:22:02 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-0e65032f-16fe-438f-845b-b96ff9ae278b tempest-VolumesTestJSON-533322040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ce8c62a0-2bed-4d43-bd34-4dd03680f10e {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:22:02 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[59efd586-1d3f-496c-ae0a-5ea5a1468718]: (4, 'raw') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:22:02 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-fb9881d1-bd20-4dc6-bbf1-7bee7b4bee7c tempest-ServerActionsTestOtherA-2039946361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d8ebca63-1178-4b36-a1a2-e10949cbc87f_c3rh4rqv {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:22:02 devstack sudo[92043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ce8c62a0-2bed-4d43-bd34-4dd03680f10e Sep 29 18:22:02 devstack sudo[92043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:22:02 devstack sudo[92044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d8ebca63-1178-4b36-a1a2-e10949cbc87f_c3rh4rqv Sep 29 18:22:02 devstack sudo[92044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:22:02 devstack sudo[92043]: pam_unix(sudo:session): session closed for user root Sep 29 18:22:02 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-0e65032f-16fe-438f-845b-b96ff9ae278b tempest-VolumesTestJSON-533322040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ce8c62a0-2bed-4d43-bd34-4dd03680f10e" returned: 0 in 0.330s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:22:02 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-0e65032f-16fe-438f-845b-b96ff9ae278b tempest-VolumesTestJSON-533322040 None] Lock "cinder-quobyte-ce8c62a0-2bed-4d43-bd34-4dd03680f10e" released by "delete_volume" :: held 0.866s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:22:02 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-0e65032f-16fe-438f-845b-b96ff9ae278b tempest-VolumesTestJSON-533322040 None] Created reservations ['2c819cbe-095f-4df3-a39c-d32271ce0041', '117396f1-aa34-4770-b74a-1be7b8f61c34', '131b2736-90cf-4ffd-a4fb-5e8579e60f38', '83ad16e9-7ccb-4237-8074-377635daf79b'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:22:02 devstack sudo[92040]: pam_unix(sudo:session): session closed for user root Sep 29 18:22:02 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-c0459b86-f77b-4d79-ba99-6176f90ffd94 tempest-AttachVolumeTestJSON-875799601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-553aaf84-f9f1-46ef-a326-801fd69da8ba 1073741824" returned: 0 in 0.592s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:22:02 devstack sudo[92044]: pam_unix(sudo:session): session closed for user root Sep 29 18:22:02 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-fb9881d1-bd20-4dc6-bbf1-7bee7b4bee7c tempest-ServerActionsTestOtherA-2039946361 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d8ebca63-1178-4b36-a1a2-e10949cbc87f_c3rh4rqv" returned: 0 in 0.470s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:22:02 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-fb9881d1-bd20-4dc6-bbf1-7bee7b4bee7c tempest-ServerActionsTestOtherA-2039946361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d8ebca63-1178-4b36-a1a2-e10949cbc87f_c3rh4rqv {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:22:02 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-c0459b86-f77b-4d79-ba99-6176f90ffd94 tempest-AttachVolumeTestJSON-875799601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-553aaf84-f9f1-46ef-a326-801fd69da8ba {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:22:02 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-0e65032f-16fe-438f-845b-b96ff9ae278b tempest-VolumesTestJSON-533322040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:22:02 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-0e65032f-16fe-438f-845b-b96ff9ae278b tempest-VolumesTestJSON-533322040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:22:02 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-0e65032f-16fe-438f-845b-b96ff9ae278b tempest-VolumesTestJSON-533322040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:22:02 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-0e65032f-16fe-438f-845b-b96ff9ae278b tempest-VolumesTestJSON-533322040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:22:02 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-0e65032f-16fe-438f-845b-b96ff9ae278b tempest-VolumesTestJSON-533322040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:22:02 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-0e65032f-16fe-438f-845b-b96ff9ae278b tempest-VolumesTestJSON-533322040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:22:02 devstack sudo[92055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-553aaf84-f9f1-46ef-a326-801fd69da8ba Sep 29 18:22:02 devstack sudo[92055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:22:02 devstack sudo[92057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:22:02 devstack sudo[92057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:22:02 devstack sudo[92054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d8ebca63-1178-4b36-a1a2-e10949cbc87f_c3rh4rqv Sep 29 18:22:02 devstack sudo[92054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:22:03 devstack sudo[92057]: pam_unix(sudo:session): session closed for user root Sep 29 18:22:03 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-0e65032f-16fe-438f-845b-b96ff9ae278b tempest-VolumesTestJSON-533322040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.367s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:22:03 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-0e65032f-16fe-438f-845b-b96ff9ae278b tempest-VolumesTestJSON-533322040 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:22:03 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-0e65032f-16fe-438f-845b-b96ff9ae278b tempest-VolumesTestJSON-533322040 None] Deleted volume successfully. Sep 29 18:22:03 devstack sudo[92055]: pam_unix(sudo:session): session closed for user root Sep 29 18:22:03 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-c0459b86-f77b-4d79-ba99-6176f90ffd94 tempest-AttachVolumeTestJSON-875799601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-553aaf84-f9f1-46ef-a326-801fd69da8ba" returned: 0 in 0.433s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:22:03 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-c0459b86-f77b-4d79-ba99-6176f90ffd94 tempest-AttachVolumeTestJSON-875799601 None] <== create_volume: return (1115ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'} {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:22:03 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-c0459b86-f77b-4d79-ba99-6176f90ffd94 tempest-AttachVolumeTestJSON-875799601 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.126s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:22:03 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-0e65032f-16fe-438f-845b-b96ff9ae278b tempest-VolumesTestJSON-533322040 None] Lock "cinder-ce8c62a0-2bed-4d43-bd34-4dd03680f10e-delete_volume" released by "delete_volume" :: held 1.596s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:22:03 devstack sudo[92054]: pam_unix(sudo:session): session closed for user root Sep 29 18:22:03 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-c0459b86-f77b-4d79-ba99-6176f90ffd94 tempest-AttachVolumeTestJSON-875799601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fcd3c8a-ee3b-4f6c-9c84-224cb014cb18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-553aaf84-f9f1-46ef-a326-801fd69da8ba', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:22:03 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-c0459b86-f77b-4d79-ba99-6176f90ffd94 tempest-AttachVolumeTestJSON-875799601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d06b01b0-931b-4324-8999-c0e8763f1ac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:22:03 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-fb9881d1-bd20-4dc6-bbf1-7bee7b4bee7c tempest-ServerActionsTestOtherA-2039946361 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d8ebca63-1178-4b36-a1a2-e10949cbc87f_c3rh4rqv" returned: 1 in 0.530s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:22:03 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-fb9881d1-bd20-4dc6-bbf1-7bee7b4bee7c tempest-ServerActionsTestOtherA-2039946361 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d8ebca63-1178-4b36-a1a2-e10949cbc87f_c3rh4rqv' failed. Not Retrying. {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 29 18:22:03 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[42f7b1d4-5a15-4762-8bf4-9c49710e9de7]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:22:03 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-fb9881d1-bd20-4dc6-bbf1-7bee7b4bee7c tempest-ServerActionsTestOtherA-2039946361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d8ebca63-1178-4b36-a1a2-e10949cbc87f_b5igos3fdevstack@QuobyteHD {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:22:03 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-c0459b86-f77b-4d79-ba99-6176f90ffd94 tempest-AttachVolumeTestJSON-875799601 None] Volume volume-553aaf84-f9f1-46ef-a326-801fd69da8ba (553aaf84-f9f1-46ef-a326-801fd69da8ba): created successfully Sep 29 18:22:03 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-c0459b86-f77b-4d79-ba99-6176f90ffd94 tempest-AttachVolumeTestJSON-875799601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d06b01b0-931b-4324-8999-c0e8763f1ac3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:22:03 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-c0459b86-f77b-4d79-ba99-6176f90ffd94 tempest-AttachVolumeTestJSON-875799601 None] Flow 'volume_create_manager' (3e808770-48d4-439d-9a73-6f381adc99ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:22:03 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-c0459b86-f77b-4d79-ba99-6176f90ffd94 tempest-AttachVolumeTestJSON-875799601 None] Created volume successfully. Sep 29 18:22:03 devstack sudo[92065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d8ebca63-1178-4b36-a1a2-e10949cbc87f_b5igos3fdevstack@QuobyteHD Sep 29 18:22:03 devstack sudo[92065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:22:03 devstack sudo[92065]: pam_unix(sudo:session): session closed for user root Sep 29 18:22:03 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-fb9881d1-bd20-4dc6-bbf1-7bee7b4bee7c tempest-ServerActionsTestOtherA-2039946361 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d8ebca63-1178-4b36-a1a2-e10949cbc87f_b5igos3fdevstack@QuobyteHD" returned: 0 in 0.462s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:22:03 devstack cinder-volume[86512]: DEBUG cinder.image.image_utils [None req-fb9881d1-bd20-4dc6-bbf1-7bee7b4bee7c tempest-ServerActionsTestOtherA-2039946361 None] d8ebca63-1178-4b36-a1a2-e10949cbc87f was qcow2, converting to qcow2 {{(pid=86512) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 29 18:22:03 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-fb9881d1-bd20-4dc6-bbf1-7bee7b4bee7c tempest-ServerActionsTestOtherA-2039946361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d8ebca63-1178-4b36-a1a2-e10949cbc87f_b5igos3fdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-36fb1940-32f1-4b9f-bdc4-546fcfa788b8 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:22:03 devstack sudo[92070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d8ebca63-1178-4b36-a1a2-e10949cbc87f_b5igos3fdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-36fb1940-32f1-4b9f-bdc4-546fcfa788b8 Sep 29 18:22:03 devstack sudo[92070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:22:05 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [req-8eda6eff-323a-426c-bb48-c86f2d51350a req-9207b7a8-a3ca-402e-b670-58b3b6ed7e8f tempest-AttachVolumeTestJSON-875799601 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:22:05 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [req-8eda6eff-323a-426c-bb48-c86f2d51350a req-9207b7a8-a3ca-402e-b670-58b3b6ed7e8f tempest-AttachVolumeTestJSON-875799601 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:22:05 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [req-8eda6eff-323a-426c-bb48-c86f2d51350a req-9207b7a8-a3ca-402e-b670-58b3b6ed7e8f tempest-AttachVolumeTestJSON-875799601 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:22:05 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [req-8eda6eff-323a-426c-bb48-c86f2d51350a req-9207b7a8-a3ca-402e-b670-58b3b6ed7e8f tempest-AttachVolumeTestJSON-875799601 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883', 'name': 'volume-553aaf84-f9f1-46ef-a326-801fd69da8ba', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '79da51bc-1d82-4857-bc57-e18291ceddc9', 'enforce_multipath': True} {{(pid=86512) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 29 18:22:05 devstack cinder-volume[86512]: INFO cinder.volume.manager [req-8eda6eff-323a-426c-bb48-c86f2d51350a req-9207b7a8-a3ca-402e-b670-58b3b6ed7e8f tempest-AttachVolumeTestJSON-875799601 None] attachment_update completed successfully. Sep 29 18:22:06 devstack sudo[92070]: pam_unix(sudo:session): session closed for user root Sep 29 18:22:06 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-fb9881d1-bd20-4dc6-bbf1-7bee7b4bee7c tempest-ServerActionsTestOtherA-2039946361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d8ebca63-1178-4b36-a1a2-e10949cbc87f_b5igos3fdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-36fb1940-32f1-4b9f-bdc4-546fcfa788b8" returned: 0 in 2.665s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:22:06 devstack cinder-volume[86512]: DEBUG cinder.image.image_utils [None req-fb9881d1-bd20-4dc6-bbf1-7bee7b4bee7c tempest-ServerActionsTestOtherA-2039946361 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d8ebca63-1178-4b36-a1a2-e10949cbc87f_b5igos3fdevstack@QuobyteHD, size 112.00 MB, duration 2.67 sec, destination /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-36fb1940-32f1-4b9f-bdc4-546fcfa788b8 {{(pid=86512) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 29 18:22:06 devstack cinder-volume[86512]: INFO cinder.image.image_utils [None req-fb9881d1-bd20-4dc6-bbf1-7bee7b4bee7c tempest-ServerActionsTestOtherA-2039946361 None] Converted 112.00 MB image at 42.02 MB/s Sep 29 18:22:06 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-fb9881d1-bd20-4dc6-bbf1-7bee7b4bee7c tempest-ServerActionsTestOtherA-2039946361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-36fb1940-32f1-4b9f-bdc4-546fcfa788b8 1G {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:22:06 devstack sudo[92509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-36fb1940-32f1-4b9f-bdc4-546fcfa788b8 1G Sep 29 18:22:06 devstack sudo[92509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:22:07 devstack sudo[92509]: pam_unix(sudo:session): session closed for user root Sep 29 18:22:07 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-fb9881d1-bd20-4dc6-bbf1-7bee7b4bee7c tempest-ServerActionsTestOtherA-2039946361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-36fb1940-32f1-4b9f-bdc4-546fcfa788b8 1G" returned: 0 in 0.533s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:22:07 devstack cinder-volume[86512]: DEBUG cinder.volume.volume_utils [None req-fb9881d1-bd20-4dc6-bbf1-7bee7b4bee7c tempest-ServerActionsTestOtherA-2039946361 None] Downloaded image d8ebca63-1178-4b36-a1a2-e10949cbc87f ((None, [{'url': 'file:///opt/stack/data/glance/images/d8ebca63-1178-4b36-a1a2-e10949cbc87f', 'metadata': {}}])) to volume 36fb1940-32f1-4b9f-bdc4-546fcfa788b8 successfully. {{(pid=86512) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 29 18:22:07 devstack cinder-volume[86512]: DEBUG cinder.image.image_utils [None req-fb9881d1-bd20-4dc6-bbf1-7bee7b4bee7c tempest-ServerActionsTestOtherA-2039946361 None] Temporary image d8ebca63-1178-4b36-a1a2-e10949cbc87f for user cfc3f4f30c5849dc955e4a322a35d496 is deleted. {{(pid=86512) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 29 18:22:07 devstack cinder-volume[86512]: DEBUG cinder.volume.volume_utils [None req-fb9881d1-bd20-4dc6-bbf1-7bee7b4bee7c tempest-ServerActionsTestOtherA-2039946361 None] Marking volume 36fb1940-32f1-4b9f-bdc4-546fcfa788b8 as bootable. {{(pid=86512) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 29 18:22:07 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb9881d1-bd20-4dc6-bbf1-7bee7b4bee7c tempest-ServerActionsTestOtherA-2039946361 None] Copying metadata from image d8ebca63-1178-4b36-a1a2-e10949cbc87f to 36fb1940-32f1-4b9f-bdc4-546fcfa788b8. {{(pid=86512) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 29 18:22:07 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb9881d1-bd20-4dc6-bbf1-7bee7b4bee7c tempest-ServerActionsTestOtherA-2039946361 None] Creating volume glance metadata for volume 36fb1940-32f1-4b9f-bdc4-546fcfa788b8 backed by image d8ebca63-1178-4b36-a1a2-e10949cbc87f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'd8ebca63-1178-4b36-a1a2-e10949cbc87f', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86512) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 29 18:22:07 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-fb9881d1-bd20-4dc6-bbf1-7bee7b4bee7c tempest-ServerActionsTestOtherA-2039946361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5cb3ff0-87c4-41f7-a915-b8619a2cef87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36fb1940-32f1-4b9f-bdc4-546fcfa788b8', 'volume_size': 1, 'image_id': 'd8ebca63-1178-4b36-a1a2-e10949cbc87f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d8ebca63-1178-4b36-a1a2-e10949cbc87f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '987aeb00888a4b9bb9954392d91b8741', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd8ebca63-1178-4b36-a1a2-e10949cbc87f', 'created_at': datetime.datetime(2026, 9, 29, 16, 11, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 16, 11, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d8ebca63-1178-4b36-a1a2-e10949cbc87f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:22:07 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-fb9881d1-bd20-4dc6-bbf1-7bee7b4bee7c tempest-ServerActionsTestOtherA-2039946361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (480c1735-62e8-4b6e-8d40-c77f406a4f1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:22:07 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-fb9881d1-bd20-4dc6-bbf1-7bee7b4bee7c tempest-ServerActionsTestOtherA-2039946361 None] Volume volume-36fb1940-32f1-4b9f-bdc4-546fcfa788b8 (36fb1940-32f1-4b9f-bdc4-546fcfa788b8): created successfully Sep 29 18:22:07 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-fb9881d1-bd20-4dc6-bbf1-7bee7b4bee7c tempest-ServerActionsTestOtherA-2039946361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (480c1735-62e8-4b6e-8d40-c77f406a4f1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:22:07 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-fb9881d1-bd20-4dc6-bbf1-7bee7b4bee7c tempest-ServerActionsTestOtherA-2039946361 None] Flow 'volume_create_manager' (83ebe290-3e18-40a3-abe9-69b30bdba82e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:22:07 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-fb9881d1-bd20-4dc6-bbf1-7bee7b4bee7c tempest-ServerActionsTestOtherA-2039946361 None] Created volume successfully. Sep 29 18:22:09 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e39fe8c-97b4-4a32-8761-3e46569021db tempest-TestImageHashVerification-201751849 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86512) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:22:09 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-6e39fe8c-97b4-4a32-8761-3e46569021db tempest-TestImageHashVerification-201751849 None] Flow 'volume_create_manager' (75b05b8f-44ac-4bef-8672-9adcb0e58e80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:22:09 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-6e39fe8c-97b4-4a32-8761-3e46569021db tempest-TestImageHashVerification-201751849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a89f9cf-76c3-41ce-8fd9-9e8638b92eef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:22:09 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-6e39fe8c-97b4-4a32-8761-3e46569021db tempest-TestImageHashVerification-201751849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a89f9cf-76c3-41ce-8fd9-9e8638b92eef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:22:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1797938078',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7100484e-b6a5-4aea-9334-dd6a4434a258,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1771eca05a6a432c961ed4aa6f5c1c83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:22:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:22:09Z,use_quota=True,user_id='5ead49d65cdc4ce6899098571c1506f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:22:09 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-6e39fe8c-97b4-4a32-8761-3e46569021db tempest-TestImageHashVerification-201751849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68f742dc-534b-4d6a-8085-077e1baa5ea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:22:09 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-6e39fe8c-97b4-4a32-8761-3e46569021db tempest-TestImageHashVerification-201751849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68f742dc-534b-4d6a-8085-077e1baa5ea0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:22:09 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-6e39fe8c-97b4-4a32-8761-3e46569021db tempest-TestImageHashVerification-201751849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96ee5c4f-d210-4b5f-a242-3f7c894cf5d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:22:09 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-6e39fe8c-97b4-4a32-8761-3e46569021db tempest-TestImageHashVerification-201751849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96ee5c4f-d210-4b5f-a242-3f7c894cf5d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7100484e-b6a5-4aea-9334-dd6a4434a258', 'volume_name': 'volume-7100484e-b6a5-4aea-9334-dd6a4434a258', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:22:09 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-6e39fe8c-97b4-4a32-8761-3e46569021db tempest-TestImageHashVerification-201751849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40284c73-e746-4d22-8cf4-f3238066087a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:22:09 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-6e39fe8c-97b4-4a32-8761-3e46569021db tempest-TestImageHashVerification-201751849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40284c73-e746-4d22-8cf4-f3238066087a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:22:09 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-6e39fe8c-97b4-4a32-8761-3e46569021db tempest-TestImageHashVerification-201751849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4af6bba6-d9ca-4258-8883-d9ce47c1cfda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:22:09 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-6e39fe8c-97b4-4a32-8761-3e46569021db tempest-TestImageHashVerification-201751849 None] Volume 7100484e-b6a5-4aea-9334-dd6a4434a258: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7100484e-b6a5-4aea-9334-dd6a4434a258', 'volume_size': 1} Sep 29 18:22:09 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-6e39fe8c-97b4-4a32-8761-3e46569021db tempest-TestImageHashVerification-201751849 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:22:09 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-6e39fe8c-97b4-4a32-8761-3e46569021db tempest-TestImageHashVerification-201751849 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:22:09 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-6e39fe8c-97b4-4a32-8761-3e46569021db tempest-TestImageHashVerification-201751849 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:22:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1797938078',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7100484e-b6a5-4aea-9334-dd6a4434a258,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1771eca05a6a432c961ed4aa6f5c1c83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:22:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:22:09Z,use_quota=True,user_id='5ead49d65cdc4ce6899098571c1506f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)}" {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:22:09 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-6e39fe8c-97b4-4a32-8761-3e46569021db tempest-TestImageHashVerification-201751849 None] Creating volume 7100484e-b6a5-4aea-9334-dd6a4434a258 {{(pid=86512) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:22:09 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-6e39fe8c-97b4-4a32-8761-3e46569021db tempest-TestImageHashVerification-201751849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:22:09 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-6e39fe8c-97b4-4a32-8761-3e46569021db tempest-TestImageHashVerification-201751849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:22:09 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-6e39fe8c-97b4-4a32-8761-3e46569021db tempest-TestImageHashVerification-201751849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:22:09 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-6e39fe8c-97b4-4a32-8761-3e46569021db tempest-TestImageHashVerification-201751849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:22:09 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-6e39fe8c-97b4-4a32-8761-3e46569021db tempest-TestImageHashVerification-201751849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:22:09 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-6e39fe8c-97b4-4a32-8761-3e46569021db tempest-TestImageHashVerification-201751849 None] Selected osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 as target Quobyte volume. {{(pid=86512) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:22:09 devstack cinder-volume[86512]: INFO cinder.volume.drivers.remotefs [None req-6e39fe8c-97b4-4a32-8761-3e46569021db tempest-TestImageHashVerification-201751849 None] casted to osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 Sep 29 18:22:09 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-6e39fe8c-97b4-4a32-8761-3e46569021db tempest-TestImageHashVerification-201751849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7100484e-b6a5-4aea-9334-dd6a4434a258 1073741824 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:22:09 devstack sudo[92528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7100484e-b6a5-4aea-9334-dd6a4434a258 1073741824 Sep 29 18:22:09 devstack sudo[92528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:22:09 devstack sudo[92528]: pam_unix(sudo:session): session closed for user root Sep 29 18:22:09 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-6e39fe8c-97b4-4a32-8761-3e46569021db tempest-TestImageHashVerification-201751849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7100484e-b6a5-4aea-9334-dd6a4434a258 1073741824" returned: 0 in 0.598s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:22:10 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-6e39fe8c-97b4-4a32-8761-3e46569021db tempest-TestImageHashVerification-201751849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7100484e-b6a5-4aea-9334-dd6a4434a258 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:22:10 devstack sudo[92535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7100484e-b6a5-4aea-9334-dd6a4434a258 Sep 29 18:22:10 devstack sudo[92535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:22:10 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-344ee187-4902-4d8f-bf0f-c81806a32c68 tempest-GroupSnapshotsTest-1642445393 None] Group tempest-GroupSnapshotsTest-Group-1980864728: creating Sep 29 18:22:10 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-344ee187-4902-4d8f-bf0f-c81806a32c68 tempest-GroupSnapshotsTest-1642445393 None] Group tempest-GroupSnapshotsTest-Group-1980864728: created successfully Sep 29 18:22:10 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-344ee187-4902-4d8f-bf0f-c81806a32c68 tempest-GroupSnapshotsTest-1642445393 None] Create group completed successfully. Sep 29 18:22:10 devstack sudo[92535]: pam_unix(sudo:session): session closed for user root Sep 29 18:22:10 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-6e39fe8c-97b4-4a32-8761-3e46569021db tempest-TestImageHashVerification-201751849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7100484e-b6a5-4aea-9334-dd6a4434a258" returned: 0 in 0.409s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:22:10 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-6e39fe8c-97b4-4a32-8761-3e46569021db tempest-TestImageHashVerification-201751849 None] <== create_volume: return (1070ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'} {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:22:10 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-6e39fe8c-97b4-4a32-8761-3e46569021db tempest-TestImageHashVerification-201751849 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.072s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:22:10 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-6e39fe8c-97b4-4a32-8761-3e46569021db tempest-TestImageHashVerification-201751849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4af6bba6-d9ca-4258-8883-d9ce47c1cfda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7100484e-b6a5-4aea-9334-dd6a4434a258', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:22:10 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-6e39fe8c-97b4-4a32-8761-3e46569021db tempest-TestImageHashVerification-201751849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6e39b26-fee4-42e7-a728-7856633f52c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:22:10 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-6e39fe8c-97b4-4a32-8761-3e46569021db tempest-TestImageHashVerification-201751849 None] Volume volume-7100484e-b6a5-4aea-9334-dd6a4434a258 (7100484e-b6a5-4aea-9334-dd6a4434a258): created successfully Sep 29 18:22:10 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-6e39fe8c-97b4-4a32-8761-3e46569021db tempest-TestImageHashVerification-201751849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6e39b26-fee4-42e7-a728-7856633f52c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:22:10 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-6e39fe8c-97b4-4a32-8761-3e46569021db tempest-TestImageHashVerification-201751849 None] Flow 'volume_create_manager' (75b05b8f-44ac-4bef-8672-9adcb0e58e80) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:22:10 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-6e39fe8c-97b4-4a32-8761-3e46569021db tempest-TestImageHashVerification-201751849 None] Created volume successfully. Sep 29 18:22:11 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [req-fd8d2423-0513-4d61-b3de-a6e6dd09c272 req-8773d103-9f60-4f88-8c76-db6f73fbffaa tempest-ServerActionsTestOtherA-2039946361 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:22:11 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [req-fd8d2423-0513-4d61-b3de-a6e6dd09c272 req-8773d103-9f60-4f88-8c76-db6f73fbffaa tempest-ServerActionsTestOtherA-2039946361 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:22:11 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [req-fd8d2423-0513-4d61-b3de-a6e6dd09c272 req-8773d103-9f60-4f88-8c76-db6f73fbffaa tempest-ServerActionsTestOtherA-2039946361 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:22:11 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [req-fd8d2423-0513-4d61-b3de-a6e6dd09c272 req-8773d103-9f60-4f88-8c76-db6f73fbffaa tempest-ServerActionsTestOtherA-2039946361 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883', 'name': 'volume-36fb1940-32f1-4b9f-bdc4-546fcfa788b8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0771cb0e-34bf-47b6-8881-7ccb79964e53', 'enforce_multipath': True} {{(pid=86512) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 29 18:22:11 devstack cinder-volume[86512]: INFO cinder.volume.manager [req-fd8d2423-0513-4d61-b3de-a6e6dd09c272 req-8773d103-9f60-4f88-8c76-db6f73fbffaa tempest-ServerActionsTestOtherA-2039946361 None] attachment_update completed successfully. Sep 29 18:22:12 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a5acbec-bc9d-4edb-809e-480130e2f902 tempest-GroupSnapshotsTest-1642445393 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86512) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:22:12 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-7a5acbec-bc9d-4edb-809e-480130e2f902 tempest-GroupSnapshotsTest-1642445393 None] Flow 'volume_create_manager' (3de27aa7-de47-4d13-aa6f-ef00a1e1973b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:22:12 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-7a5acbec-bc9d-4edb-809e-480130e2f902 tempest-GroupSnapshotsTest-1642445393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73da8010-33f7-463c-bec9-514cc985a79f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:22:12 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-7a5acbec-bc9d-4edb-809e-480130e2f902 tempest-GroupSnapshotsTest-1642445393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73da8010-33f7-463c-bec9-514cc985a79f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:22:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-255508580',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3e841045-158b-4d21-b7d2-121c881de045,host='devstack@QuobyteHD#QuobyteHD',id=a30ff8bd-c524-4c97-ad03-1659fe8ce11a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b72a6d98d3024636b98695226ae3244b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:22:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:22:13Z,use_quota=True,user_id='fea5c1a44e2e458e875b338a9ec7fbfd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5aece83-f38a-455c-ab3f-74ab08d65072),volume_type_id=c5aece83-f38a-455c-ab3f-74ab08d65072)' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:22:12 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-7a5acbec-bc9d-4edb-809e-480130e2f902 tempest-GroupSnapshotsTest-1642445393 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ff8da08-df22-452a-af28-5da9eaeac08a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:22:12 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-7a5acbec-bc9d-4edb-809e-480130e2f902 tempest-GroupSnapshotsTest-1642445393 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ff8da08-df22-452a-af28-5da9eaeac08a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:22:12 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-7a5acbec-bc9d-4edb-809e-480130e2f902 tempest-GroupSnapshotsTest-1642445393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3295632-d005-480f-b5f5-e9f293e1dacd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:22:12 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-7a5acbec-bc9d-4edb-809e-480130e2f902 tempest-GroupSnapshotsTest-1642445393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3295632-d005-480f-b5f5-e9f293e1dacd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a30ff8bd-c524-4c97-ad03-1659fe8ce11a', 'volume_name': 'volume-a30ff8bd-c524-4c97-ad03-1659fe8ce11a', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:22:12 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-7a5acbec-bc9d-4edb-809e-480130e2f902 tempest-GroupSnapshotsTest-1642445393 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac8c4459-9aae-48f1-99da-dafe2d70c4d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:22:12 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-7a5acbec-bc9d-4edb-809e-480130e2f902 tempest-GroupSnapshotsTest-1642445393 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac8c4459-9aae-48f1-99da-dafe2d70c4d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:22:12 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-7a5acbec-bc9d-4edb-809e-480130e2f902 tempest-GroupSnapshotsTest-1642445393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b292750b-31dd-4269-a41c-92ea0edaa73d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:22:12 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-7a5acbec-bc9d-4edb-809e-480130e2f902 tempest-GroupSnapshotsTest-1642445393 None] Volume a30ff8bd-c524-4c97-ad03-1659fe8ce11a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a30ff8bd-c524-4c97-ad03-1659fe8ce11a', 'volume_size': 1} Sep 29 18:22:12 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-7a5acbec-bc9d-4edb-809e-480130e2f902 tempest-GroupSnapshotsTest-1642445393 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:22:12 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-7a5acbec-bc9d-4edb-809e-480130e2f902 tempest-GroupSnapshotsTest-1642445393 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:22:12 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-7a5acbec-bc9d-4edb-809e-480130e2f902 tempest-GroupSnapshotsTest-1642445393 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3e841045-158b-4d21-b7d2-121c881de045,created_at=2026-09-29T16:22:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-255508580',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3e841045-158b-4d21-b7d2-121c881de045,host='devstack@QuobyteHD#QuobyteHD',id=a30ff8bd-c524-4c97-ad03-1659fe8ce11a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b72a6d98d3024636b98695226ae3244b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:22:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:22:13Z,use_quota=True,user_id='fea5c1a44e2e458e875b338a9ec7fbfd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5aece83-f38a-455c-ab3f-74ab08d65072),volume_type_id=c5aece83-f38a-455c-ab3f-74ab08d65072)}" {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:22:12 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-7a5acbec-bc9d-4edb-809e-480130e2f902 tempest-GroupSnapshotsTest-1642445393 None] Creating volume a30ff8bd-c524-4c97-ad03-1659fe8ce11a {{(pid=86512) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:22:12 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-7a5acbec-bc9d-4edb-809e-480130e2f902 tempest-GroupSnapshotsTest-1642445393 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:22:12 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-7a5acbec-bc9d-4edb-809e-480130e2f902 tempest-GroupSnapshotsTest-1642445393 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:22:12 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-7a5acbec-bc9d-4edb-809e-480130e2f902 tempest-GroupSnapshotsTest-1642445393 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:22:12 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-7a5acbec-bc9d-4edb-809e-480130e2f902 tempest-GroupSnapshotsTest-1642445393 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:22:12 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-7a5acbec-bc9d-4edb-809e-480130e2f902 tempest-GroupSnapshotsTest-1642445393 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:22:12 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-7a5acbec-bc9d-4edb-809e-480130e2f902 tempest-GroupSnapshotsTest-1642445393 None] Selected osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 as target Quobyte volume. {{(pid=86512) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:22:12 devstack cinder-volume[86512]: INFO cinder.volume.drivers.remotefs [None req-7a5acbec-bc9d-4edb-809e-480130e2f902 tempest-GroupSnapshotsTest-1642445393 None] casted to osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 Sep 29 18:22:12 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-7a5acbec-bc9d-4edb-809e-480130e2f902 tempest-GroupSnapshotsTest-1642445393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a30ff8bd-c524-4c97-ad03-1659fe8ce11a 1073741824 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:22:12 devstack sudo[92710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a30ff8bd-c524-4c97-ad03-1659fe8ce11a 1073741824 Sep 29 18:22:12 devstack sudo[92710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:22:13 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-042e084a-2e11-4744-8ba7-7f12a733055b tempest-TestImageHashVerification-201751849 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:22:13 devstack sudo[92710]: pam_unix(sudo:session): session closed for user root Sep 29 18:22:13 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-7a5acbec-bc9d-4edb-809e-480130e2f902 tempest-GroupSnapshotsTest-1642445393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a30ff8bd-c524-4c97-ad03-1659fe8ce11a 1073741824" returned: 0 in 0.957s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:22:13 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-7a5acbec-bc9d-4edb-809e-480130e2f902 tempest-GroupSnapshotsTest-1642445393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a30ff8bd-c524-4c97-ad03-1659fe8ce11a {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:22:13 devstack sudo[93075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a30ff8bd-c524-4c97-ad03-1659fe8ce11a Sep 29 18:22:13 devstack sudo[93075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:22:14 devstack sudo[93075]: pam_unix(sudo:session): session closed for user root Sep 29 18:22:14 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-7a5acbec-bc9d-4edb-809e-480130e2f902 tempest-GroupSnapshotsTest-1642445393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a30ff8bd-c524-4c97-ad03-1659fe8ce11a" returned: 0 in 0.368s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:22:14 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-7a5acbec-bc9d-4edb-809e-480130e2f902 tempest-GroupSnapshotsTest-1642445393 None] <== create_volume: return (1445ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'} {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:22:14 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-7a5acbec-bc9d-4edb-809e-480130e2f902 tempest-GroupSnapshotsTest-1642445393 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.449s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:22:14 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-042e084a-2e11-4744-8ba7-7f12a733055b tempest-TestImageHashVerification-201751849 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.728s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:22:14 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-7a5acbec-bc9d-4edb-809e-480130e2f902 tempest-GroupSnapshotsTest-1642445393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b292750b-31dd-4269-a41c-92ea0edaa73d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a30ff8bd-c524-4c97-ad03-1659fe8ce11a', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:22:14 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-7a5acbec-bc9d-4edb-809e-480130e2f902 tempest-GroupSnapshotsTest-1642445393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (883be491-e081-4948-aa4f-b3cd54a8f2df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:22:14 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-7a5acbec-bc9d-4edb-809e-480130e2f902 tempest-GroupSnapshotsTest-1642445393 None] Volume volume-a30ff8bd-c524-4c97-ad03-1659fe8ce11a (a30ff8bd-c524-4c97-ad03-1659fe8ce11a): created successfully Sep 29 18:22:14 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-7a5acbec-bc9d-4edb-809e-480130e2f902 tempest-GroupSnapshotsTest-1642445393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (883be491-e081-4948-aa4f-b3cd54a8f2df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:22:14 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-7a5acbec-bc9d-4edb-809e-480130e2f902 tempest-GroupSnapshotsTest-1642445393 None] Flow 'volume_create_manager' (3de27aa7-de47-4d13-aa6f-ef00a1e1973b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:22:14 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaf2af4c-adc4-4693-ba27-356ff41b05f5]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:22:14 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-042e084a-2e11-4744-8ba7-7f12a733055b tempest-TestImageHashVerification-201751849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7100484e-b6a5-4aea-9334-dd6a4434a258 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:22:14 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-7a5acbec-bc9d-4edb-809e-480130e2f902 tempest-GroupSnapshotsTest-1642445393 None] Created volume successfully. Sep 29 18:22:14 devstack sudo[93090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7100484e-b6a5-4aea-9334-dd6a4434a258 Sep 29 18:22:14 devstack sudo[93090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:22:15 devstack sudo[93090]: pam_unix(sudo:session): session closed for user root Sep 29 18:22:15 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-042e084a-2e11-4744-8ba7-7f12a733055b tempest-TestImageHashVerification-201751849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7100484e-b6a5-4aea-9334-dd6a4434a258" returned: 0 in 0.626s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:22:15 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[624aa2ff-fb8a-4328-b0ef-9667616c2bbf]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:22:15 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-042e084a-2e11-4744-8ba7-7f12a733055b tempest-TestImageHashVerification-201751849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7100484e-b6a5-4aea-9334-dd6a4434a258 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:22:15 devstack sudo[93112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7100484e-b6a5-4aea-9334-dd6a4434a258 Sep 29 18:22:15 devstack sudo[93112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:22:16 devstack sudo[93112]: pam_unix(sudo:session): session closed for user root Sep 29 18:22:16 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-042e084a-2e11-4744-8ba7-7f12a733055b tempest-TestImageHashVerification-201751849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7100484e-b6a5-4aea-9334-dd6a4434a258" returned: 0 in 0.973s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:22:16 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-042e084a-2e11-4744-8ba7-7f12a733055b tempest-TestImageHashVerification-201751849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7100484e-b6a5-4aea-9334-dd6a4434a258 /opt/stack/data/cinder/conversion/7100484e-b6a5-4aea-9334-dd6a4434a258.temp_image.59d3f2b2-3b20-490c-b421-6cf6f912f4ba0hdv669d.img {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:22:16 devstack sudo[93140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7100484e-b6a5-4aea-9334-dd6a4434a258 /opt/stack/data/cinder/conversion/7100484e-b6a5-4aea-9334-dd6a4434a258.temp_image.59d3f2b2-3b20-490c-b421-6cf6f912f4ba0hdv669d.img Sep 29 18:22:16 devstack sudo[93140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:22:16 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-55da30d6-b54a-4626-9593-b9538255c353 tempest-GroupSnapshotsTest-1642445393 None] GroupSnapshot d08ffeff-732d-4c44-9071-0e73e3236e13: creating. Sep 29 18:22:16 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-55da30d6-b54a-4626-9593-b9538255c353 tempest-GroupSnapshotsTest-1642445393 None] Group snapshot d08ffeff-732d-4c44-9071-0e73e3236e13: creating. {{(pid=86512) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 29 18:22:16 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-55da30d6-b54a-4626-9593-b9538255c353 tempest-GroupSnapshotsTest-1642445393 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:22:26 devstack cinder-volume[86512]: DEBUG dbcounter [-] [86512] Writing DB stats cinder:SELECT=76,cinder:UPDATE=74,cinder:DELETE=9,cinder:INSERT=25 {{(pid=86512) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 18:22:26 devstack cinder-volume[86512]: DEBUG dbcounter [-] [86512] Writing DB stats cinder:SELECT=74,cinder:INSERT=21,cinder:UPDATE=79,cinder:DELETE=5 {{(pid=86512) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 18:22:27 devstack sudo[93140]: pam_unix(sudo:session): session closed for user root Sep 29 18:22:27 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-042e084a-2e11-4744-8ba7-7f12a733055b tempest-TestImageHashVerification-201751849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7100484e-b6a5-4aea-9334-dd6a4434a258 /opt/stack/data/cinder/conversion/7100484e-b6a5-4aea-9334-dd6a4434a258.temp_image.59d3f2b2-3b20-490c-b421-6cf6f912f4ba0hdv669d.img" returned: 0 in 11.668s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:22:27 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf4e9dcc-fe4a-413f-9526-5876980d8e72]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:22:27 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-042e084a-2e11-4744-8ba7-7f12a733055b tempest-TestImageHashVerification-201751849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7100484e-b6a5-4aea-9334-dd6a4434a258 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:22:27 devstack sudo[93207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7100484e-b6a5-4aea-9334-dd6a4434a258 Sep 29 18:22:27 devstack sudo[93207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:22:28 devstack sudo[93207]: pam_unix(sudo:session): session closed for user root Sep 29 18:22:28 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-042e084a-2e11-4744-8ba7-7f12a733055b tempest-TestImageHashVerification-201751849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7100484e-b6a5-4aea-9334-dd6a4434a258" returned: 0 in 0.921s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:22:28 devstack cinder-volume[86512]: DEBUG cinder.image.image_utils [None req-042e084a-2e11-4744-8ba7-7f12a733055b tempest-TestImageHashVerification-201751849 None] Image conversion details: src /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7100484e-b6a5-4aea-9334-dd6a4434a258, size 1024.00 MB, duration 11.67 sec, destination /opt/stack/data/cinder/conversion/7100484e-b6a5-4aea-9334-dd6a4434a258.temp_image.59d3f2b2-3b20-490c-b421-6cf6f912f4ba0hdv669d.img {{(pid=86512) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 29 18:22:28 devstack cinder-volume[86512]: INFO cinder.image.image_utils [None req-042e084a-2e11-4744-8ba7-7f12a733055b tempest-TestImageHashVerification-201751849 None] Converted 1024.00 MB image at 87.74 MB/s Sep 29 18:22:28 devstack cinder-volume[86512]: DEBUG cinder.image.image_utils [None req-042e084a-2e11-4744-8ba7-7f12a733055b tempest-TestImageHashVerification-201751849 None] 59d3f2b2-3b20-490c-b421-6cf6f912f4ba was raw, no need to convert to raw {{(pid=86512) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Sep 29 18:22:35 devstack cinder-volume[86512]: INFO cinder.volume.manager [req-8a896a1f-0061-47ef-b030-34a25870e346 req-e1dd4625-8820-46f0-aebc-28cb31a8ed80 tempest-ServerActionsTestOtherA-2039946361 None] Terminate volume connection completed successfully. Sep 29 18:22:35 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [req-8a896a1f-0061-47ef-b030-34a25870e346 req-e1dd4625-8820-46f0-aebc-28cb31a8ed80 tempest-ServerActionsTestOtherA-2039946361 None] Deleting attachment 0771cb0e-34bf-47b6-8881-7ccb79964e53. {{(pid=86512) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 29 18:22:37 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [req-8a896a1f-0061-47ef-b030-34a25870e346 req-f7168e39-b272-4a69-bcbf-052ba03c8ccf tempest-ServerActionsTestOtherA-2039946361 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:22:41 devstack cinder-volume[86512]: INFO cinder.volume.manager [req-887bbe40-9b15-47f9-ba94-feee7df5bd53 req-633877e0-eb4b-4857-9b93-ae5374d1daa8 tempest-AttachVolumeTestJSON-875799601 None] Terminate volume connection completed successfully. Sep 29 18:22:41 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [req-887bbe40-9b15-47f9-ba94-feee7df5bd53 req-633877e0-eb4b-4857-9b93-ae5374d1daa8 tempest-AttachVolumeTestJSON-875799601 None] Deleting attachment 79da51bc-1d82-4857-bc57-e18291ceddc9. {{(pid=86512) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 29 18:22:50 devstack cinder-volume[86512]: DEBUG oslo_service.periodic_task [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86512) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 18:22:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:22:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:22:50 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:22:50 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:22:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:22:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:22:50 devstack sudo[93489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:22:50 devstack sudo[93489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:22:50 devstack sudo[93489]: pam_unix(sudo:session): session closed for user root Sep 29 18:22:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.344s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:22:50 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:22:50 devstack cinder-volume[86512]: DEBUG oslo_service.periodic_task [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Running periodic task VolumeManager._thread_info {{(pid=86512) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 18:22:50 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] thread count: 28 {{(pid=86512) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 29 18:22:50 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] thread info: [<_MainThread(MainThread, started 135593654804608)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86512) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 29 18:22:51 devstack cinder-volume[86512]: DEBUG dbcounter [-] [86512] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86512) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 18:22:51 devstack cinder-volume[86512]: DEBUG dbcounter [-] [86512] Writing DB stats cinder:SELECT=4 {{(pid=86512) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 18:22:53 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-042e084a-2e11-4744-8ba7-7f12a733055b tempest-TestImageHashVerification-201751849 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 39.176s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:22:53 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-042e084a-2e11-4744-8ba7-7f12a733055b tempest-TestImageHashVerification-201751849 None] Uploaded volume to glance image-id: 59d3f2b2-3b20-490c-b421-6cf6f912f4ba. {{(pid=86512) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 29 18:22:53 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-55da30d6-b54a-4626-9593-b9538255c353 tempest-GroupSnapshotsTest-1642445393 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 36.976s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:22:53 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-55da30d6-b54a-4626-9593-b9538255c353 tempest-GroupSnapshotsTest-1642445393 None] Creating offline snapshot bd60bfee-5b69-4092-a636-2c874818fdb5 of volume a30ff8bd-c524-4c97-ad03-1659fe8ce11a {{(pid=86512) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 18:22:53 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-042e084a-2e11-4744-8ba7-7f12a733055b tempest-TestImageHashVerification-201751849 None] Copy volume to image completed successfully. Sep 29 18:22:53 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf1319e2-c4d9-425e-a1fb-790b5db192f8]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:22:53 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-55da30d6-b54a-4626-9593-b9538255c353 tempest-GroupSnapshotsTest-1642445393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a30ff8bd-c524-4c97-ad03-1659fe8ce11a {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:22:53 devstack sudo[93493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a30ff8bd-c524-4c97-ad03-1659fe8ce11a Sep 29 18:22:53 devstack sudo[93493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:22:53 devstack sudo[93493]: pam_unix(sudo:session): session closed for user root Sep 29 18:22:53 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-55da30d6-b54a-4626-9593-b9538255c353 tempest-GroupSnapshotsTest-1642445393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a30ff8bd-c524-4c97-ad03-1659fe8ce11a" returned: 0 in 0.344s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:22:53 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-55da30d6-b54a-4626-9593-b9538255c353 tempest-GroupSnapshotsTest-1642445393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a30ff8bd-c524-4c97-ad03-1659fe8ce11a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a30ff8bd-c524-4c97-ad03-1659fe8ce11a.bd60bfee-5b69-4092-a636-2c874818fdb5 1G {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:22:53 devstack sudo[93498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a30ff8bd-c524-4c97-ad03-1659fe8ce11a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a30ff8bd-c524-4c97-ad03-1659fe8ce11a.bd60bfee-5b69-4092-a636-2c874818fdb5 1G Sep 29 18:22:53 devstack sudo[93498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:22:54 devstack sudo[93498]: pam_unix(sudo:session): session closed for user root Sep 29 18:22:54 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-55da30d6-b54a-4626-9593-b9538255c353 tempest-GroupSnapshotsTest-1642445393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a30ff8bd-c524-4c97-ad03-1659fe8ce11a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a30ff8bd-c524-4c97-ad03-1659fe8ce11a.bd60bfee-5b69-4092-a636-2c874818fdb5 1G" returned: 0 in 0.462s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:22:54 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-55da30d6-b54a-4626-9593-b9538255c353 tempest-GroupSnapshotsTest-1642445393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a30ff8bd-c524-4c97-ad03-1659fe8ce11a -F qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a30ff8bd-c524-4c97-ad03-1659fe8ce11a.bd60bfee-5b69-4092-a636-2c874818fdb5 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:22:54 devstack sudo[93504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a30ff8bd-c524-4c97-ad03-1659fe8ce11a -F qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a30ff8bd-c524-4c97-ad03-1659fe8ce11a.bd60bfee-5b69-4092-a636-2c874818fdb5 Sep 29 18:22:54 devstack sudo[93504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:22:54 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-e90c3d5d-5305-41f4-a7aa-95026b650aa8 tempest-TestImageHashVerification-201751849 None] Acquiring lock "cinder-7100484e-b6a5-4aea-9334-dd6a4434a258-delete_volume" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:22:54 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-e90c3d5d-5305-41f4-a7aa-95026b650aa8 tempest-TestImageHashVerification-201751849 None] Lock "cinder-7100484e-b6a5-4aea-9334-dd6a4434a258-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:22:54 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-e90c3d5d-5305-41f4-a7aa-95026b650aa8 tempest-TestImageHashVerification-201751849 None] Acquiring lock "cinder-quobyte-7100484e-b6a5-4aea-9334-dd6a4434a258" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:22:54 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-e90c3d5d-5305-41f4-a7aa-95026b650aa8 tempest-TestImageHashVerification-201751849 None] Lock "cinder-quobyte-7100484e-b6a5-4aea-9334-dd6a4434a258" acquired by "delete_volume" :: waited 0.016s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:22:54 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[85da84b6-e1fc-42b7-9da2-47f01560c076]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:22:54 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-e90c3d5d-5305-41f4-a7aa-95026b650aa8 tempest-TestImageHashVerification-201751849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7100484e-b6a5-4aea-9334-dd6a4434a258 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:22:54 devstack sudo[93504]: pam_unix(sudo:session): session closed for user root Sep 29 18:22:54 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-55da30d6-b54a-4626-9593-b9538255c353 tempest-GroupSnapshotsTest-1642445393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a30ff8bd-c524-4c97-ad03-1659fe8ce11a -F qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a30ff8bd-c524-4c97-ad03-1659fe8ce11a.bd60bfee-5b69-4092-a636-2c874818fdb5" returned: 0 in 0.445s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:22:54 devstack cinder-volume[86512]: WARNING cinder.volume.drivers.remotefs [None req-55da30d6-b54a-4626-9593-b9538255c353 tempest-GroupSnapshotsTest-1642445393 None] /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a30ff8bd-c524-4c97-ad03-1659fe8ce11a.bd60bfee-5b69-4092-a636-2c874818fdb5 is being set with open permissions: ugo+rw: NotImplementedError Sep 29 18:22:54 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-55da30d6-b54a-4626-9593-b9538255c353 tempest-GroupSnapshotsTest-1642445393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a30ff8bd-c524-4c97-ad03-1659fe8ce11a.bd60bfee-5b69-4092-a636-2c874818fdb5 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:22:54 devstack sudo[93512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a30ff8bd-c524-4c97-ad03-1659fe8ce11a.bd60bfee-5b69-4092-a636-2c874818fdb5 Sep 29 18:22:54 devstack sudo[93512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:22:54 devstack sudo[93511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7100484e-b6a5-4aea-9334-dd6a4434a258 Sep 29 18:22:54 devstack sudo[93511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:22:55 devstack sudo[93512]: pam_unix(sudo:session): session closed for user root Sep 29 18:22:55 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-55da30d6-b54a-4626-9593-b9538255c353 tempest-GroupSnapshotsTest-1642445393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a30ff8bd-c524-4c97-ad03-1659fe8ce11a.bd60bfee-5b69-4092-a636-2c874818fdb5" returned: 0 in 0.256s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:22:55 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-55da30d6-b54a-4626-9593-b9538255c353 tempest-GroupSnapshotsTest-1642445393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a30ff8bd-c524-4c97-ad03-1659fe8ce11a.info {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:22:55 devstack sudo[93516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a30ff8bd-c524-4c97-ad03-1659fe8ce11a.info Sep 29 18:22:55 devstack sudo[93516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:22:55 devstack sudo[93511]: pam_unix(sudo:session): session closed for user root Sep 29 18:22:55 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-e90c3d5d-5305-41f4-a7aa-95026b650aa8 tempest-TestImageHashVerification-201751849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7100484e-b6a5-4aea-9334-dd6a4434a258" returned: 0 in 0.431s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:22:55 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-e90c3d5d-5305-41f4-a7aa-95026b650aa8 tempest-TestImageHashVerification-201751849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7100484e-b6a5-4aea-9334-dd6a4434a258 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:22:55 devstack sudo[93521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7100484e-b6a5-4aea-9334-dd6a4434a258 Sep 29 18:22:55 devstack sudo[93521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:22:55 devstack sudo[93516]: pam_unix(sudo:session): session closed for user root Sep 29 18:22:55 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-55da30d6-b54a-4626-9593-b9538255c353 tempest-GroupSnapshotsTest-1642445393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a30ff8bd-c524-4c97-ad03-1659fe8ce11a.info" returned: 0 in 0.288s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:22:55 devstack cinder-volume[86512]: WARNING cinder.volume.drivers.remotefs [None req-55da30d6-b54a-4626-9593-b9538255c353 tempest-GroupSnapshotsTest-1642445393 None] /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a30ff8bd-c524-4c97-ad03-1659fe8ce11a.info is being set with open permissions: ugo+rw: NotImplementedError Sep 29 18:22:55 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-55da30d6-b54a-4626-9593-b9538255c353 tempest-GroupSnapshotsTest-1642445393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a30ff8bd-c524-4c97-ad03-1659fe8ce11a.info {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:22:55 devstack sudo[93530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a30ff8bd-c524-4c97-ad03-1659fe8ce11a.info Sep 29 18:22:55 devstack sudo[93530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:22:55 devstack sudo[93521]: pam_unix(sudo:session): session closed for user root Sep 29 18:22:55 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-e90c3d5d-5305-41f4-a7aa-95026b650aa8 tempest-TestImageHashVerification-201751849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7100484e-b6a5-4aea-9334-dd6a4434a258" returned: 0 in 0.278s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:22:55 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-e90c3d5d-5305-41f4-a7aa-95026b650aa8 tempest-TestImageHashVerification-201751849 None] Lock "cinder-quobyte-7100484e-b6a5-4aea-9334-dd6a4434a258" released by "delete_volume" :: held 0.767s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:22:55 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-e90c3d5d-5305-41f4-a7aa-95026b650aa8 tempest-TestImageHashVerification-201751849 None] Created reservations ['bb2ae176-5882-4143-a6a9-bba463e5160f', '9e2f92b6-19ce-423d-8d8c-7ea5b8206212', '20df684b-ae99-4cb2-aaf0-491766119fb5', 'f647d928-9358-4d26-8d9f-4b7ccf068542'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:22:55 devstack sudo[93530]: pam_unix(sudo:session): session closed for user root Sep 29 18:22:55 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-55da30d6-b54a-4626-9593-b9538255c353 tempest-GroupSnapshotsTest-1642445393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a30ff8bd-c524-4c97-ad03-1659fe8ce11a.info" returned: 0 in 0.259s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:22:55 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-55da30d6-b54a-4626-9593-b9538255c353 tempest-GroupSnapshotsTest-1642445393 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.149s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:22:55 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [req-8a896a1f-0061-47ef-b030-34a25870e346 req-f7168e39-b272-4a69-bcbf-052ba03c8ccf tempest-ServerActionsTestOtherA-2039946361 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 18.199s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:22:55 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-e90c3d5d-5305-41f4-a7aa-95026b650aa8 tempest-TestImageHashVerification-201751849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:22:55 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-e90c3d5d-5305-41f4-a7aa-95026b650aa8 tempest-TestImageHashVerification-201751849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:22:55 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-e90c3d5d-5305-41f4-a7aa-95026b650aa8 tempest-TestImageHashVerification-201751849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:22:55 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-e90c3d5d-5305-41f4-a7aa-95026b650aa8 tempest-TestImageHashVerification-201751849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:22:55 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-e90c3d5d-5305-41f4-a7aa-95026b650aa8 tempest-TestImageHashVerification-201751849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:22:55 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-e90c3d5d-5305-41f4-a7aa-95026b650aa8 tempest-TestImageHashVerification-201751849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:22:55 devstack sudo[93535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:22:55 devstack sudo[93535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:22:55 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [req-8a896a1f-0061-47ef-b030-34a25870e346 req-f7168e39-b272-4a69-bcbf-052ba03c8ccf tempest-ServerActionsTestOtherA-2039946361 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.165s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:22:55 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [req-8a896a1f-0061-47ef-b030-34a25870e346 req-f7168e39-b272-4a69-bcbf-052ba03c8ccf tempest-ServerActionsTestOtherA-2039946361 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883', 'name': 'volume-36fb1940-32f1-4b9f-bdc4-546fcfa788b8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '99b142c2-224e-4662-9f9b-80ae479a96d7', 'enforce_multipath': True} {{(pid=86512) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 29 18:22:55 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-55da30d6-b54a-4626-9593-b9538255c353 tempest-GroupSnapshotsTest-1642445393 None] group_snapshot d08ffeff-732d-4c44-9071-0e73e3236e13: created successfully Sep 29 18:22:55 devstack cinder-volume[86512]: INFO cinder.volume.manager [req-8a896a1f-0061-47ef-b030-34a25870e346 req-f7168e39-b272-4a69-bcbf-052ba03c8ccf tempest-ServerActionsTestOtherA-2039946361 None] attachment_update completed successfully. Sep 29 18:22:56 devstack sudo[93535]: pam_unix(sudo:session): session closed for user root Sep 29 18:22:56 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-e90c3d5d-5305-41f4-a7aa-95026b650aa8 tempest-TestImageHashVerification-201751849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.466s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:22:56 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-e90c3d5d-5305-41f4-a7aa-95026b650aa8 tempest-TestImageHashVerification-201751849 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:22:56 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-e90c3d5d-5305-41f4-a7aa-95026b650aa8 tempest-TestImageHashVerification-201751849 None] Deleted volume successfully. Sep 29 18:22:56 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-e90c3d5d-5305-41f4-a7aa-95026b650aa8 tempest-TestImageHashVerification-201751849 None] Lock "cinder-7100484e-b6a5-4aea-9334-dd6a4434a258-delete_volume" released by "delete_volume" :: held 1.593s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:22:57 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-0246fb81-6fd8-471f-8eea-a60efe2f02bb tempest-GroupSnapshotsTest-1642445393 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:22:57 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-0246fb81-6fd8-471f-8eea-a60efe2f02bb tempest-GroupSnapshotsTest-1642445393 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:22:57 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-0246fb81-6fd8-471f-8eea-a60efe2f02bb tempest-GroupSnapshotsTest-1642445393 None] Acquiring lock "cinder-quobyte-bd60bfee-5b69-4092-a636-2c874818fdb5-4ec303c2-ced8-4258-aa12-52565701c4aa" by "_create_volume_from_snapshot" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:22:57 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-0246fb81-6fd8-471f-8eea-a60efe2f02bb tempest-GroupSnapshotsTest-1642445393 None] Lock "cinder-quobyte-bd60bfee-5b69-4092-a636-2c874818fdb5-4ec303c2-ced8-4258-aa12-52565701c4aa" acquired by "_create_volume_from_snapshot" :: waited 0.034s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:22:57 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-0246fb81-6fd8-471f-8eea-a60efe2f02bb tempest-GroupSnapshotsTest-1642445393 None] Creating volume 4ec303c2-ced8-4258-aa12-52565701c4aa from snapshot bd60bfee-5b69-4092-a636-2c874818fdb5 {{(pid=86512) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 29 18:22:57 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-0246fb81-6fd8-471f-8eea-a60efe2f02bb tempest-GroupSnapshotsTest-1642445393 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:22:57 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-0246fb81-6fd8-471f-8eea-a60efe2f02bb tempest-GroupSnapshotsTest-1642445393 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:22:57 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-0246fb81-6fd8-471f-8eea-a60efe2f02bb tempest-GroupSnapshotsTest-1642445393 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:22:58 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-0246fb81-6fd8-471f-8eea-a60efe2f02bb tempest-GroupSnapshotsTest-1642445393 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:22:58 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-0246fb81-6fd8-471f-8eea-a60efe2f02bb tempest-GroupSnapshotsTest-1642445393 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:22:58 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-0246fb81-6fd8-471f-8eea-a60efe2f02bb tempest-GroupSnapshotsTest-1642445393 None] Selected osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 as target Quobyte volume. {{(pid=86512) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:22:58 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-0246fb81-6fd8-471f-8eea-a60efe2f02bb tempest-GroupSnapshotsTest-1642445393 None] Acquiring lock "cinder-quobyte-4ec303c2-ced8-4258-aa12-52565701c4aa" by "_copy_volume_from_snapshot" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:22:58 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-0246fb81-6fd8-471f-8eea-a60efe2f02bb tempest-GroupSnapshotsTest-1642445393 None] Lock "cinder-quobyte-4ec303c2-ced8-4258-aa12-52565701c4aa" acquired by "_copy_volume_from_snapshot" :: waited 0.031s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:22:58 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-0246fb81-6fd8-471f-8eea-a60efe2f02bb tempest-GroupSnapshotsTest-1642445393 None] snapshot: bd60bfee-5b69-4092-a636-2c874818fdb5, volume: 4ec303c2-ced8-4258-aa12-52565701c4aa, {{(pid=86512) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 29 18:22:58 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-0246fb81-6fd8-471f-8eea-a60efe2f02bb tempest-GroupSnapshotsTest-1642445393 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:22:58 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-0246fb81-6fd8-471f-8eea-a60efe2f02bb tempest-GroupSnapshotsTest-1642445393 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:22:58 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-0246fb81-6fd8-471f-8eea-a60efe2f02bb tempest-GroupSnapshotsTest-1642445393 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:22:58 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-0246fb81-6fd8-471f-8eea-a60efe2f02bb tempest-GroupSnapshotsTest-1642445393 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:22:58 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-0246fb81-6fd8-471f-8eea-a60efe2f02bb tempest-GroupSnapshotsTest-1642445393 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:22:58 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[529efcce-5f44-49c0-9513-bf2089b63457]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:22:58 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-0246fb81-6fd8-471f-8eea-a60efe2f02bb tempest-GroupSnapshotsTest-1642445393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a30ff8bd-c524-4c97-ad03-1659fe8ce11a.bd60bfee-5b69-4092-a636-2c874818fdb5 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:22:58 devstack sudo[93978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a30ff8bd-c524-4c97-ad03-1659fe8ce11a.bd60bfee-5b69-4092-a636-2c874818fdb5 Sep 29 18:22:58 devstack sudo[93978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:22:58 devstack sudo[93978]: pam_unix(sudo:session): session closed for user root Sep 29 18:22:58 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-0246fb81-6fd8-471f-8eea-a60efe2f02bb tempest-GroupSnapshotsTest-1642445393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a30ff8bd-c524-4c97-ad03-1659fe8ce11a.bd60bfee-5b69-4092-a636-2c874818fdb5" returned: 0 in 0.673s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:22:58 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-0246fb81-6fd8-471f-8eea-a60efe2f02bb tempest-GroupSnapshotsTest-1642445393 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a30ff8bd-c524-4c97-ad03-1659fe8ce11a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86512) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 18:22:58 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d6caeac-1d42-4fcc-a4cb-51ac0c4c4ab0]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:22:58 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-0246fb81-6fd8-471f-8eea-a60efe2f02bb tempest-GroupSnapshotsTest-1642445393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a30ff8bd-c524-4c97-ad03-1659fe8ce11a {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:22:59 devstack sudo[93995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a30ff8bd-c524-4c97-ad03-1659fe8ce11a Sep 29 18:22:59 devstack sudo[93995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:22:59 devstack sudo[93995]: pam_unix(sudo:session): session closed for user root Sep 29 18:22:59 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-0246fb81-6fd8-471f-8eea-a60efe2f02bb tempest-GroupSnapshotsTest-1642445393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a30ff8bd-c524-4c97-ad03-1659fe8ce11a" returned: 0 in 0.587s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:22:59 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-0246fb81-6fd8-471f-8eea-a60efe2f02bb tempest-GroupSnapshotsTest-1642445393 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a30ff8bd-c524-4c97-ad03-1659fe8ce11a {{(pid=86512) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 29 18:22:59 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-0246fb81-6fd8-471f-8eea-a60efe2f02bb tempest-GroupSnapshotsTest-1642445393 None] Creating direct copy from snapshot {{(pid=86512) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 29 18:22:59 devstack cinder-volume[86512]: DEBUG cinder.utils [None req-0246fb81-6fd8-471f-8eea-a60efe2f02bb tempest-GroupSnapshotsTest-1642445393 None] Path /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-4ec303c2-ced8-4258-aa12-52565701c4aa not found in is_blk_device check {{(pid=86512) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 29 18:22:59 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-0246fb81-6fd8-471f-8eea-a60efe2f02bb tempest-GroupSnapshotsTest-1642445393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a30ff8bd-c524-4c97-ad03-1659fe8ce11a /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-4ec303c2-ced8-4258-aa12-52565701c4aa {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:22:59 devstack sudo[94016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a30ff8bd-c524-4c97-ad03-1659fe8ce11a /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-4ec303c2-ced8-4258-aa12-52565701c4aa Sep 29 18:22:59 devstack sudo[94016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:23:07 devstack cinder-volume[86512]: DEBUG dbcounter [-] [86512] Writing DB stats cinder:SELECT=20,cinder:UPDATE=10,cinder:INSERT=4 {{(pid=86512) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 18:23:08 devstack cinder-volume[86512]: DEBUG dbcounter [-] [86512] Writing DB stats cinder:SELECT=16,cinder:UPDATE=14,cinder:INSERT=1,cinder:DELETE=1 {{(pid=86512) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 18:23:10 devstack sudo[94016]: pam_unix(sudo:session): session closed for user root Sep 29 18:23:10 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-0246fb81-6fd8-471f-8eea-a60efe2f02bb tempest-GroupSnapshotsTest-1642445393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a30ff8bd-c524-4c97-ad03-1659fe8ce11a /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-4ec303c2-ced8-4258-aa12-52565701c4aa" returned: 0 in 11.337s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:23:10 devstack cinder-volume[86512]: DEBUG cinder.image.image_utils [None req-0246fb81-6fd8-471f-8eea-a60efe2f02bb tempest-GroupSnapshotsTest-1642445393 None] Image conversion details: src /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a30ff8bd-c524-4c97-ad03-1659fe8ce11a, size 1024.00 MB, duration 11.34 sec, destination /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-4ec303c2-ced8-4258-aa12-52565701c4aa {{(pid=86512) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 29 18:23:10 devstack cinder-volume[86512]: INFO cinder.image.image_utils [None req-0246fb81-6fd8-471f-8eea-a60efe2f02bb tempest-GroupSnapshotsTest-1642445393 None] Converted 1024.00 MB image at 90.32 MB/s Sep 29 18:23:10 devstack cinder-volume[86512]: WARNING cinder.volume.drivers.remotefs [None req-0246fb81-6fd8-471f-8eea-a60efe2f02bb tempest-GroupSnapshotsTest-1642445393 None] /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-4ec303c2-ced8-4258-aa12-52565701c4aa is being set with open permissions: ugo+rw: NotImplementedError Sep 29 18:23:10 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-0246fb81-6fd8-471f-8eea-a60efe2f02bb tempest-GroupSnapshotsTest-1642445393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-4ec303c2-ced8-4258-aa12-52565701c4aa {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:23:10 devstack sudo[94041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-4ec303c2-ced8-4258-aa12-52565701c4aa Sep 29 18:23:10 devstack sudo[94041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:23:11 devstack sudo[94041]: pam_unix(sudo:session): session closed for user root Sep 29 18:23:11 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-0246fb81-6fd8-471f-8eea-a60efe2f02bb tempest-GroupSnapshotsTest-1642445393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-4ec303c2-ced8-4258-aa12-52565701c4aa" returned: 0 in 0.357s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:23:11 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-0246fb81-6fd8-471f-8eea-a60efe2f02bb tempest-GroupSnapshotsTest-1642445393 None] Lock "cinder-quobyte-4ec303c2-ced8-4258-aa12-52565701c4aa" released by "_copy_volume_from_snapshot" :: held 13.135s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:23:11 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-0246fb81-6fd8-471f-8eea-a60efe2f02bb tempest-GroupSnapshotsTest-1642445393 None] Lock "cinder-quobyte-bd60bfee-5b69-4092-a636-2c874818fdb5-4ec303c2-ced8-4258-aa12-52565701c4aa" released by "_create_volume_from_snapshot" :: held 13.256s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:23:11 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-0246fb81-6fd8-471f-8eea-a60efe2f02bb tempest-GroupSnapshotsTest-1642445393 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 13.293s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:23:11 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-0246fb81-6fd8-471f-8eea-a60efe2f02bb tempest-GroupSnapshotsTest-1642445393 None] Create group from source-snapshot-d08ffeff-732d-4c44-9071-0e73e3236e13 completed successfully. Sep 29 18:23:12 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-30d93069-ea7e-4a8b-b4e5-1835479ed350 tempest-GroupSnapshotsTest-1642445393 None] Acquiring lock "cinder-quobyte-4ec303c2-ced8-4258-aa12-52565701c4aa" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:23:12 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-30d93069-ea7e-4a8b-b4e5-1835479ed350 tempest-GroupSnapshotsTest-1642445393 None] Lock "cinder-quobyte-4ec303c2-ced8-4258-aa12-52565701c4aa" acquired by "delete_volume" :: waited 0.028s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:23:12 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a2b286a-2c25-43d9-93a7-4dfe847aa6b2]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:23:12 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-30d93069-ea7e-4a8b-b4e5-1835479ed350 tempest-GroupSnapshotsTest-1642445393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-4ec303c2-ced8-4258-aa12-52565701c4aa {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:23:12 devstack sudo[94044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-4ec303c2-ced8-4258-aa12-52565701c4aa Sep 29 18:23:12 devstack sudo[94044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:23:12 devstack sudo[94044]: pam_unix(sudo:session): session closed for user root Sep 29 18:23:12 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-30d93069-ea7e-4a8b-b4e5-1835479ed350 tempest-GroupSnapshotsTest-1642445393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-4ec303c2-ced8-4258-aa12-52565701c4aa" returned: 0 in 0.465s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:23:12 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-30d93069-ea7e-4a8b-b4e5-1835479ed350 tempest-GroupSnapshotsTest-1642445393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-4ec303c2-ced8-4258-aa12-52565701c4aa {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:23:12 devstack sudo[94052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-4ec303c2-ced8-4258-aa12-52565701c4aa Sep 29 18:23:12 devstack sudo[94052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:23:13 devstack sudo[94052]: pam_unix(sudo:session): session closed for user root Sep 29 18:23:13 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-30d93069-ea7e-4a8b-b4e5-1835479ed350 tempest-GroupSnapshotsTest-1642445393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-4ec303c2-ced8-4258-aa12-52565701c4aa" returned: 0 in 0.500s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:23:13 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-30d93069-ea7e-4a8b-b4e5-1835479ed350 tempest-GroupSnapshotsTest-1642445393 None] Lock "cinder-quobyte-4ec303c2-ced8-4258-aa12-52565701c4aa" released by "delete_volume" :: held 1.020s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:23:13 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-30d93069-ea7e-4a8b-b4e5-1835479ed350 tempest-GroupSnapshotsTest-1642445393 None] Created reservations ['5e032b9b-7124-407c-a8cf-0ed37f1e55d4'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:23:13 devstack cinder-volume[86512]: WARNING cinder.quota [None req-30d93069-ea7e-4a8b-b4e5-1835479ed350 tempest-GroupSnapshotsTest-1642445393 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-897270304 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-897270304, it is now deprecated. Please use the default quota class for default quota. Sep 29 18:23:13 devstack cinder-volume[86512]: WARNING cinder.quota [None req-30d93069-ea7e-4a8b-b4e5-1835479ed350 tempest-GroupSnapshotsTest-1642445393 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-897270304 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-897270304, it is now deprecated. Please use the default quota class for default quota. Sep 29 18:23:13 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-30d93069-ea7e-4a8b-b4e5-1835479ed350 tempest-GroupSnapshotsTest-1642445393 None] Created reservations ['fb61aa1f-244c-4c31-88f6-2714ad8a3444', '7663a72e-bd46-44e6-a4d6-50f661da92d4', '3c41a573-adfe-4fab-9d05-33e874e941a3', 'feb54803-47b2-4c5c-b3a2-95a58b141827'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:23:13 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-30d93069-ea7e-4a8b-b4e5-1835479ed350 tempest-GroupSnapshotsTest-1642445393 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:23:13 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-30d93069-ea7e-4a8b-b4e5-1835479ed350 tempest-GroupSnapshotsTest-1642445393 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:23:13 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-30d93069-ea7e-4a8b-b4e5-1835479ed350 tempest-GroupSnapshotsTest-1642445393 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:23:13 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-30d93069-ea7e-4a8b-b4e5-1835479ed350 tempest-GroupSnapshotsTest-1642445393 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:23:13 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-30d93069-ea7e-4a8b-b4e5-1835479ed350 tempest-GroupSnapshotsTest-1642445393 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:23:13 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-30d93069-ea7e-4a8b-b4e5-1835479ed350 tempest-GroupSnapshotsTest-1642445393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:23:13 devstack sudo[94061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:23:13 devstack sudo[94061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:23:13 devstack sudo[94061]: pam_unix(sudo:session): session closed for user root Sep 29 18:23:13 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-30d93069-ea7e-4a8b-b4e5-1835479ed350 tempest-GroupSnapshotsTest-1642445393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.436s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:23:13 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-30d93069-ea7e-4a8b-b4e5-1835479ed350 tempest-GroupSnapshotsTest-1642445393 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:23:13 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-30d93069-ea7e-4a8b-b4e5-1835479ed350 tempest-GroupSnapshotsTest-1642445393 None] Delete group completed successfully. Sep 29 18:23:14 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-4f452e7d-0d2c-44f5-8132-def6e9fb6504 tempest-GroupSnapshotsTest-1642445393 None] group_snapshot d08ffeff-732d-4c44-9071-0e73e3236e13: deleting Sep 29 18:23:14 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-4f452e7d-0d2c-44f5-8132-def6e9fb6504 tempest-GroupSnapshotsTest-1642445393 None] group_snapshot d08ffeff-732d-4c44-9071-0e73e3236e13: deleting {{(pid=86512) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 29 18:23:14 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-4f452e7d-0d2c-44f5-8132-def6e9fb6504 tempest-GroupSnapshotsTest-1642445393 None] Acquiring lock "cinder-quobyte-a30ff8bd-c524-4c97-ad03-1659fe8ce11a" by "delete_snapshot" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:23:14 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-4f452e7d-0d2c-44f5-8132-def6e9fb6504 tempest-GroupSnapshotsTest-1642445393 None] Lock "cinder-quobyte-a30ff8bd-c524-4c97-ad03-1659fe8ce11a" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:23:14 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-4f452e7d-0d2c-44f5-8132-def6e9fb6504 tempest-GroupSnapshotsTest-1642445393 None] Acquiring lock "cinder-quobyte-bd60bfee-5b69-4092-a636-2c874818fdb5" by "_delete_snapshot" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:23:14 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-4f452e7d-0d2c-44f5-8132-def6e9fb6504 tempest-GroupSnapshotsTest-1642445393 None] Lock "cinder-quobyte-bd60bfee-5b69-4092-a636-2c874818fdb5" acquired by "_delete_snapshot" :: waited 0.042s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:23:14 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-4f452e7d-0d2c-44f5-8132-def6e9fb6504 tempest-GroupSnapshotsTest-1642445393 None] Deleting offline snapshot bd60bfee-5b69-4092-a636-2c874818fdb5 of volume a30ff8bd-c524-4c97-ad03-1659fe8ce11a {{(pid=86512) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 18:23:14 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-4f452e7d-0d2c-44f5-8132-def6e9fb6504 tempest-GroupSnapshotsTest-1642445393 None] snapshot_file for this snap is: volume-a30ff8bd-c524-4c97-ad03-1659fe8ce11a.bd60bfee-5b69-4092-a636-2c874818fdb5 {{(pid=86512) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 18:23:15 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[aac29e5b-5d97-47db-b487-677045d03e43]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:23:15 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-4f452e7d-0d2c-44f5-8132-def6e9fb6504 tempest-GroupSnapshotsTest-1642445393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a30ff8bd-c524-4c97-ad03-1659fe8ce11a.bd60bfee-5b69-4092-a636-2c874818fdb5 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:23:15 devstack sudo[94086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a30ff8bd-c524-4c97-ad03-1659fe8ce11a.bd60bfee-5b69-4092-a636-2c874818fdb5 Sep 29 18:23:15 devstack sudo[94086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:23:15 devstack sudo[94086]: pam_unix(sudo:session): session closed for user root Sep 29 18:23:15 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-4f452e7d-0d2c-44f5-8132-def6e9fb6504 tempest-GroupSnapshotsTest-1642445393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a30ff8bd-c524-4c97-ad03-1659fe8ce11a.bd60bfee-5b69-4092-a636-2c874818fdb5" returned: 0 in 0.601s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:23:15 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-4f452e7d-0d2c-44f5-8132-def6e9fb6504 tempest-GroupSnapshotsTest-1642445393 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a30ff8bd-c524-4c97-ad03-1659fe8ce11a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86512) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 18:23:15 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[06391c4c-a069-497c-abc2-1821769f0287]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:23:15 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-4f452e7d-0d2c-44f5-8132-def6e9fb6504 tempest-GroupSnapshotsTest-1642445393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a30ff8bd-c524-4c97-ad03-1659fe8ce11a {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:23:15 devstack sudo[94093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a30ff8bd-c524-4c97-ad03-1659fe8ce11a Sep 29 18:23:15 devstack sudo[94093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:23:16 devstack sudo[94093]: pam_unix(sudo:session): session closed for user root Sep 29 18:23:16 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-4f452e7d-0d2c-44f5-8132-def6e9fb6504 tempest-GroupSnapshotsTest-1642445393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a30ff8bd-c524-4c97-ad03-1659fe8ce11a" returned: 0 in 0.671s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:23:16 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-4f452e7d-0d2c-44f5-8132-def6e9fb6504 tempest-GroupSnapshotsTest-1642445393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a30ff8bd-c524-4c97-ad03-1659fe8ce11a.bd60bfee-5b69-4092-a636-2c874818fdb5 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:23:16 devstack sudo[94098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a30ff8bd-c524-4c97-ad03-1659fe8ce11a.bd60bfee-5b69-4092-a636-2c874818fdb5 Sep 29 18:23:16 devstack sudo[94098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:23:16 devstack sudo[94098]: pam_unix(sudo:session): session closed for user root Sep 29 18:23:16 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-4f452e7d-0d2c-44f5-8132-def6e9fb6504 tempest-GroupSnapshotsTest-1642445393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a30ff8bd-c524-4c97-ad03-1659fe8ce11a.bd60bfee-5b69-4092-a636-2c874818fdb5" returned: 0 in 0.581s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:23:16 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-4f452e7d-0d2c-44f5-8132-def6e9fb6504 tempest-GroupSnapshotsTest-1642445393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a30ff8bd-c524-4c97-ad03-1659fe8ce11a.bd60bfee-5b69-4092-a636-2c874818fdb5 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:23:16 devstack sudo[94127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a30ff8bd-c524-4c97-ad03-1659fe8ce11a.bd60bfee-5b69-4092-a636-2c874818fdb5 Sep 29 18:23:16 devstack sudo[94127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:23:17 devstack sudo[94127]: pam_unix(sudo:session): session closed for user root Sep 29 18:23:17 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-4f452e7d-0d2c-44f5-8132-def6e9fb6504 tempest-GroupSnapshotsTest-1642445393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a30ff8bd-c524-4c97-ad03-1659fe8ce11a.bd60bfee-5b69-4092-a636-2c874818fdb5" returned: 0 in 0.372s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:23:17 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-4f452e7d-0d2c-44f5-8132-def6e9fb6504 tempest-GroupSnapshotsTest-1642445393 None] Lock "cinder-quobyte-bd60bfee-5b69-4092-a636-2c874818fdb5" released by "_delete_snapshot" :: held 2.438s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:23:17 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-4f452e7d-0d2c-44f5-8132-def6e9fb6504 tempest-GroupSnapshotsTest-1642445393 None] Lock "cinder-quobyte-a30ff8bd-c524-4c97-ad03-1659fe8ce11a" released by "delete_snapshot" :: held 2.491s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:23:17 devstack cinder-volume[86512]: WARNING cinder.quota [None req-4f452e7d-0d2c-44f5-8132-def6e9fb6504 tempest-GroupSnapshotsTest-1642445393 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-897270304 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-897270304, it is now deprecated. Please use the default quota class for default quota. Sep 29 18:23:17 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-4f452e7d-0d2c-44f5-8132-def6e9fb6504 tempest-GroupSnapshotsTest-1642445393 None] Created reservations ['4c9493d0-8eb4-4601-86a0-b36ee11cc6a1', '35cfbbe6-1d85-4ffb-9001-0615ec577533', '9c40c651-695b-483d-ad2f-e961f3f73d83', '0156cf45-1485-4335-9218-3ca695f339d6'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:23:17 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-4f452e7d-0d2c-44f5-8132-def6e9fb6504 tempest-GroupSnapshotsTest-1642445393 None] group_snapshot d08ffeff-732d-4c44-9071-0e73e3236e13: deleted successfully Sep 29 18:23:18 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-20686a6a-6c98-4305-9df3-06801fde6d28 tempest-GroupSnapshotsTest-1642445393 None] Acquiring lock "cinder-quobyte-a30ff8bd-c524-4c97-ad03-1659fe8ce11a" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:23:18 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-20686a6a-6c98-4305-9df3-06801fde6d28 tempest-GroupSnapshotsTest-1642445393 None] Lock "cinder-quobyte-a30ff8bd-c524-4c97-ad03-1659fe8ce11a" acquired by "delete_volume" :: waited 0.025s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:23:18 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[6333cb29-5b49-4ac8-8870-e4e4c09dd2e3]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:23:18 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-20686a6a-6c98-4305-9df3-06801fde6d28 tempest-GroupSnapshotsTest-1642445393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a30ff8bd-c524-4c97-ad03-1659fe8ce11a {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:23:19 devstack sudo[94133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a30ff8bd-c524-4c97-ad03-1659fe8ce11a Sep 29 18:23:19 devstack sudo[94133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:23:19 devstack sudo[94133]: pam_unix(sudo:session): session closed for user root Sep 29 18:23:19 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-20686a6a-6c98-4305-9df3-06801fde6d28 tempest-GroupSnapshotsTest-1642445393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a30ff8bd-c524-4c97-ad03-1659fe8ce11a" returned: 0 in 0.576s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:23:19 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-20686a6a-6c98-4305-9df3-06801fde6d28 tempest-GroupSnapshotsTest-1642445393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a30ff8bd-c524-4c97-ad03-1659fe8ce11a {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:23:19 devstack sudo[94139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a30ff8bd-c524-4c97-ad03-1659fe8ce11a Sep 29 18:23:19 devstack sudo[94139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:23:19 devstack sudo[94139]: pam_unix(sudo:session): session closed for user root Sep 29 18:23:19 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-20686a6a-6c98-4305-9df3-06801fde6d28 tempest-GroupSnapshotsTest-1642445393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a30ff8bd-c524-4c97-ad03-1659fe8ce11a" returned: 0 in 0.433s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:23:19 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-20686a6a-6c98-4305-9df3-06801fde6d28 tempest-GroupSnapshotsTest-1642445393 None] Lock "cinder-quobyte-a30ff8bd-c524-4c97-ad03-1659fe8ce11a" released by "delete_volume" :: held 1.146s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:23:20 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-20686a6a-6c98-4305-9df3-06801fde6d28 tempest-GroupSnapshotsTest-1642445393 None] Created reservations ['d2109688-35c5-4756-b553-5cac40a1b615'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:23:20 devstack cinder-volume[86512]: WARNING cinder.db.api [None req-20686a6a-6c98-4305-9df3-06801fde6d28 tempest-GroupSnapshotsTest-1642445393 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-897270304'] Sep 29 18:23:20 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-20686a6a-6c98-4305-9df3-06801fde6d28 tempest-GroupSnapshotsTest-1642445393 None] Created reservations ['b1e56481-621f-44d2-9041-28cd031158dc', 'ab900ecd-53a0-4f0b-8626-a4bc82f2ce7a', 'd31f39b0-9d20-4528-ab9b-4f7784040203', '87f4ec4e-4090-44c8-bc90-e0e0136ff2a7'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:23:20 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-20686a6a-6c98-4305-9df3-06801fde6d28 tempest-GroupSnapshotsTest-1642445393 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:23:20 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-20686a6a-6c98-4305-9df3-06801fde6d28 tempest-GroupSnapshotsTest-1642445393 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:23:20 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-20686a6a-6c98-4305-9df3-06801fde6d28 tempest-GroupSnapshotsTest-1642445393 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:23:20 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-20686a6a-6c98-4305-9df3-06801fde6d28 tempest-GroupSnapshotsTest-1642445393 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:23:20 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-20686a6a-6c98-4305-9df3-06801fde6d28 tempest-GroupSnapshotsTest-1642445393 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:23:20 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-20686a6a-6c98-4305-9df3-06801fde6d28 tempest-GroupSnapshotsTest-1642445393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:23:20 devstack sudo[94142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:23:20 devstack sudo[94142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:23:20 devstack sudo[94142]: pam_unix(sudo:session): session closed for user root Sep 29 18:23:20 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-20686a6a-6c98-4305-9df3-06801fde6d28 tempest-GroupSnapshotsTest-1642445393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.390s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:23:20 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-20686a6a-6c98-4305-9df3-06801fde6d28 tempest-GroupSnapshotsTest-1642445393 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:23:20 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-20686a6a-6c98-4305-9df3-06801fde6d28 tempest-GroupSnapshotsTest-1642445393 None] Delete group completed successfully. Sep 29 18:23:21 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-edceb8c2-45c9-465a-a8c5-93a5b4bf3b3d tempest-GroupSnapshotsTest-1642445393 None] Group tempest-GroupSnapshotsTest-Group-1803267892: creating Sep 29 18:23:21 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-edceb8c2-45c9-465a-a8c5-93a5b4bf3b3d tempest-GroupSnapshotsTest-1642445393 None] Group tempest-GroupSnapshotsTest-Group-1803267892: created successfully Sep 29 18:23:21 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-edceb8c2-45c9-465a-a8c5-93a5b4bf3b3d tempest-GroupSnapshotsTest-1642445393 None] Create group completed successfully. Sep 29 18:23:23 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce7b817a-1968-43a1-8422-756309622d33 tempest-GroupSnapshotsTest-1642445393 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86512) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:23:23 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-ce7b817a-1968-43a1-8422-756309622d33 tempest-GroupSnapshotsTest-1642445393 None] Flow 'volume_create_manager' (a573f1ce-b8d6-4151-93b1-7d9a4ae989a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:23:23 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-ce7b817a-1968-43a1-8422-756309622d33 tempest-GroupSnapshotsTest-1642445393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed93914f-8dec-4fa3-821d-fa9e3e4dd605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:23:23 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-ce7b817a-1968-43a1-8422-756309622d33 tempest-GroupSnapshotsTest-1642445393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed93914f-8dec-4fa3-821d-fa9e3e4dd605) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:23:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1994548758',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2d619e93-5950-4d64-a5a2-678d27151ee8,host='devstack@QuobyteHD#QuobyteHD',id=abe8b53b-c13f-4b59-84e1-890e2c92a58e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b72a6d98d3024636b98695226ae3244b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:23:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:23:24Z,use_quota=True,user_id='fea5c1a44e2e458e875b338a9ec7fbfd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(af7b8169-b5b1-4909-8bba-512370c911d2),volume_type_id=af7b8169-b5b1-4909-8bba-512370c911d2)' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:23:23 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-ce7b817a-1968-43a1-8422-756309622d33 tempest-GroupSnapshotsTest-1642445393 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b857e81-314f-4337-91a2-db3e0202db35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:23:23 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-ce7b817a-1968-43a1-8422-756309622d33 tempest-GroupSnapshotsTest-1642445393 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b857e81-314f-4337-91a2-db3e0202db35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:23:23 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-ce7b817a-1968-43a1-8422-756309622d33 tempest-GroupSnapshotsTest-1642445393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f95b2f1-08f3-4e6e-ac8c-3cacf6a049d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:23:23 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-ce7b817a-1968-43a1-8422-756309622d33 tempest-GroupSnapshotsTest-1642445393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f95b2f1-08f3-4e6e-ac8c-3cacf6a049d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'abe8b53b-c13f-4b59-84e1-890e2c92a58e', 'volume_name': 'volume-abe8b53b-c13f-4b59-84e1-890e2c92a58e', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:23:23 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-ce7b817a-1968-43a1-8422-756309622d33 tempest-GroupSnapshotsTest-1642445393 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fe3cb67-b1ae-417f-a8fc-bd930145d72b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:23:23 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-ce7b817a-1968-43a1-8422-756309622d33 tempest-GroupSnapshotsTest-1642445393 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fe3cb67-b1ae-417f-a8fc-bd930145d72b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:23:23 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-ce7b817a-1968-43a1-8422-756309622d33 tempest-GroupSnapshotsTest-1642445393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ff672ae-11a6-4241-a177-dc0ea865ea35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:23:23 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-ce7b817a-1968-43a1-8422-756309622d33 tempest-GroupSnapshotsTest-1642445393 None] Volume abe8b53b-c13f-4b59-84e1-890e2c92a58e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-abe8b53b-c13f-4b59-84e1-890e2c92a58e', 'volume_size': 1} Sep 29 18:23:23 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-ce7b817a-1968-43a1-8422-756309622d33 tempest-GroupSnapshotsTest-1642445393 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:23:23 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-ce7b817a-1968-43a1-8422-756309622d33 tempest-GroupSnapshotsTest-1642445393 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:23:23 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-ce7b817a-1968-43a1-8422-756309622d33 tempest-GroupSnapshotsTest-1642445393 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=2d619e93-5950-4d64-a5a2-678d27151ee8,created_at=2026-09-29T16:23:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1994548758',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2d619e93-5950-4d64-a5a2-678d27151ee8,host='devstack@QuobyteHD#QuobyteHD',id=abe8b53b-c13f-4b59-84e1-890e2c92a58e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b72a6d98d3024636b98695226ae3244b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:23:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:23:24Z,use_quota=True,user_id='fea5c1a44e2e458e875b338a9ec7fbfd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(af7b8169-b5b1-4909-8bba-512370c911d2),volume_type_id=af7b8169-b5b1-4909-8bba-512370c911d2)}" {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:23:23 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-ce7b817a-1968-43a1-8422-756309622d33 tempest-GroupSnapshotsTest-1642445393 None] Creating volume abe8b53b-c13f-4b59-84e1-890e2c92a58e {{(pid=86512) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:23:23 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-ce7b817a-1968-43a1-8422-756309622d33 tempest-GroupSnapshotsTest-1642445393 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:23:23 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-ce7b817a-1968-43a1-8422-756309622d33 tempest-GroupSnapshotsTest-1642445393 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:23:23 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-ce7b817a-1968-43a1-8422-756309622d33 tempest-GroupSnapshotsTest-1642445393 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:23:23 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-ce7b817a-1968-43a1-8422-756309622d33 tempest-GroupSnapshotsTest-1642445393 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:23:23 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-ce7b817a-1968-43a1-8422-756309622d33 tempest-GroupSnapshotsTest-1642445393 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:23:23 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-ce7b817a-1968-43a1-8422-756309622d33 tempest-GroupSnapshotsTest-1642445393 None] Selected osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 as target Quobyte volume. {{(pid=86512) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:23:23 devstack cinder-volume[86512]: INFO cinder.volume.drivers.remotefs [None req-ce7b817a-1968-43a1-8422-756309622d33 tempest-GroupSnapshotsTest-1642445393 None] casted to osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 Sep 29 18:23:23 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-ce7b817a-1968-43a1-8422-756309622d33 tempest-GroupSnapshotsTest-1642445393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-abe8b53b-c13f-4b59-84e1-890e2c92a58e 1073741824 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:23:23 devstack sudo[94160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-abe8b53b-c13f-4b59-84e1-890e2c92a58e 1073741824 Sep 29 18:23:23 devstack sudo[94160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:23:24 devstack sudo[94160]: pam_unix(sudo:session): session closed for user root Sep 29 18:23:24 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-ce7b817a-1968-43a1-8422-756309622d33 tempest-GroupSnapshotsTest-1642445393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-abe8b53b-c13f-4b59-84e1-890e2c92a58e 1073741824" returned: 0 in 0.641s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:23:24 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-ce7b817a-1968-43a1-8422-756309622d33 tempest-GroupSnapshotsTest-1642445393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-abe8b53b-c13f-4b59-84e1-890e2c92a58e {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:23:24 devstack sudo[94169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-abe8b53b-c13f-4b59-84e1-890e2c92a58e Sep 29 18:23:24 devstack sudo[94169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:23:24 devstack sudo[94169]: pam_unix(sudo:session): session closed for user root Sep 29 18:23:24 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-ce7b817a-1968-43a1-8422-756309622d33 tempest-GroupSnapshotsTest-1642445393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-abe8b53b-c13f-4b59-84e1-890e2c92a58e" returned: 0 in 0.337s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:23:24 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-ce7b817a-1968-43a1-8422-756309622d33 tempest-GroupSnapshotsTest-1642445393 None] <== create_volume: return (1043ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'} {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:23:24 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-ce7b817a-1968-43a1-8422-756309622d33 tempest-GroupSnapshotsTest-1642445393 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.048s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:23:24 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-ce7b817a-1968-43a1-8422-756309622d33 tempest-GroupSnapshotsTest-1642445393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ff672ae-11a6-4241-a177-dc0ea865ea35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-abe8b53b-c13f-4b59-84e1-890e2c92a58e', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:23:24 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-ce7b817a-1968-43a1-8422-756309622d33 tempest-GroupSnapshotsTest-1642445393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (242c24d2-f1c0-409a-b4ec-3ff75fa4d1b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:23:24 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-ce7b817a-1968-43a1-8422-756309622d33 tempest-GroupSnapshotsTest-1642445393 None] Volume volume-abe8b53b-c13f-4b59-84e1-890e2c92a58e (abe8b53b-c13f-4b59-84e1-890e2c92a58e): created successfully Sep 29 18:23:24 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-ce7b817a-1968-43a1-8422-756309622d33 tempest-GroupSnapshotsTest-1642445393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (242c24d2-f1c0-409a-b4ec-3ff75fa4d1b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:23:24 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-ce7b817a-1968-43a1-8422-756309622d33 tempest-GroupSnapshotsTest-1642445393 None] Flow 'volume_create_manager' (a573f1ce-b8d6-4151-93b1-7d9a4ae989a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:23:24 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-ce7b817a-1968-43a1-8422-756309622d33 tempest-GroupSnapshotsTest-1642445393 None] Created volume successfully. Sep 29 18:23:26 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9e1d1e7-bc22-4f42-aaa2-86807cd32f91 tempest-GroupSnapshotsTest-1642445393 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86512) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:23:26 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-f9e1d1e7-bc22-4f42-aaa2-86807cd32f91 tempest-GroupSnapshotsTest-1642445393 None] Flow 'volume_create_manager' (06b8ace8-4c67-469e-8244-cfda747c7ba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:23:26 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-f9e1d1e7-bc22-4f42-aaa2-86807cd32f91 tempest-GroupSnapshotsTest-1642445393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (689df692-19fd-44fb-affb-61153d589ef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:23:26 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-f9e1d1e7-bc22-4f42-aaa2-86807cd32f91 tempest-GroupSnapshotsTest-1642445393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (689df692-19fd-44fb-affb-61153d589ef7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:23:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1530369701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2d619e93-5950-4d64-a5a2-678d27151ee8,host='devstack@QuobyteHD#QuobyteHD',id=988b379c-95b7-4890-adf0-08ef1bcc9cc0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b72a6d98d3024636b98695226ae3244b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:23:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:23:27Z,use_quota=True,user_id='fea5c1a44e2e458e875b338a9ec7fbfd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(af7b8169-b5b1-4909-8bba-512370c911d2),volume_type_id=af7b8169-b5b1-4909-8bba-512370c911d2)' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:23:26 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-f9e1d1e7-bc22-4f42-aaa2-86807cd32f91 tempest-GroupSnapshotsTest-1642445393 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e36c000-42dd-4982-bec0-e820fa0b5b56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:23:26 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-f9e1d1e7-bc22-4f42-aaa2-86807cd32f91 tempest-GroupSnapshotsTest-1642445393 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e36c000-42dd-4982-bec0-e820fa0b5b56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:23:26 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-f9e1d1e7-bc22-4f42-aaa2-86807cd32f91 tempest-GroupSnapshotsTest-1642445393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aea9cba7-b2f1-4020-8a5e-c26e55610697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:23:26 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-f9e1d1e7-bc22-4f42-aaa2-86807cd32f91 tempest-GroupSnapshotsTest-1642445393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aea9cba7-b2f1-4020-8a5e-c26e55610697) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '988b379c-95b7-4890-adf0-08ef1bcc9cc0', 'volume_name': 'volume-988b379c-95b7-4890-adf0-08ef1bcc9cc0', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:23:26 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-f9e1d1e7-bc22-4f42-aaa2-86807cd32f91 tempest-GroupSnapshotsTest-1642445393 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67740fa4-1546-48d8-95e3-107e08036608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:23:26 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-f9e1d1e7-bc22-4f42-aaa2-86807cd32f91 tempest-GroupSnapshotsTest-1642445393 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67740fa4-1546-48d8-95e3-107e08036608) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:23:27 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-f9e1d1e7-bc22-4f42-aaa2-86807cd32f91 tempest-GroupSnapshotsTest-1642445393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56bb955c-7ee3-4910-ac51-66484561d7c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:23:27 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-f9e1d1e7-bc22-4f42-aaa2-86807cd32f91 tempest-GroupSnapshotsTest-1642445393 None] Volume 988b379c-95b7-4890-adf0-08ef1bcc9cc0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-988b379c-95b7-4890-adf0-08ef1bcc9cc0', 'volume_size': 1} Sep 29 18:23:27 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-f9e1d1e7-bc22-4f42-aaa2-86807cd32f91 tempest-GroupSnapshotsTest-1642445393 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:23:27 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-f9e1d1e7-bc22-4f42-aaa2-86807cd32f91 tempest-GroupSnapshotsTest-1642445393 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:23:27 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-f9e1d1e7-bc22-4f42-aaa2-86807cd32f91 tempest-GroupSnapshotsTest-1642445393 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=2d619e93-5950-4d64-a5a2-678d27151ee8,created_at=2026-09-29T16:23:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1530369701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2d619e93-5950-4d64-a5a2-678d27151ee8,host='devstack@QuobyteHD#QuobyteHD',id=988b379c-95b7-4890-adf0-08ef1bcc9cc0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b72a6d98d3024636b98695226ae3244b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:23:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:23:27Z,use_quota=True,user_id='fea5c1a44e2e458e875b338a9ec7fbfd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(af7b8169-b5b1-4909-8bba-512370c911d2),volume_type_id=af7b8169-b5b1-4909-8bba-512370c911d2)}" {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:23:27 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-f9e1d1e7-bc22-4f42-aaa2-86807cd32f91 tempest-GroupSnapshotsTest-1642445393 None] Creating volume 988b379c-95b7-4890-adf0-08ef1bcc9cc0 {{(pid=86512) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:23:27 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-f9e1d1e7-bc22-4f42-aaa2-86807cd32f91 tempest-GroupSnapshotsTest-1642445393 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:23:27 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-f9e1d1e7-bc22-4f42-aaa2-86807cd32f91 tempest-GroupSnapshotsTest-1642445393 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:23:27 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-f9e1d1e7-bc22-4f42-aaa2-86807cd32f91 tempest-GroupSnapshotsTest-1642445393 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:23:27 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-f9e1d1e7-bc22-4f42-aaa2-86807cd32f91 tempest-GroupSnapshotsTest-1642445393 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:23:27 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-f9e1d1e7-bc22-4f42-aaa2-86807cd32f91 tempest-GroupSnapshotsTest-1642445393 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:23:27 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-f9e1d1e7-bc22-4f42-aaa2-86807cd32f91 tempest-GroupSnapshotsTest-1642445393 None] Selected osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 as target Quobyte volume. {{(pid=86512) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:23:27 devstack cinder-volume[86512]: INFO cinder.volume.drivers.remotefs [None req-f9e1d1e7-bc22-4f42-aaa2-86807cd32f91 tempest-GroupSnapshotsTest-1642445393 None] casted to osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 Sep 29 18:23:27 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-f9e1d1e7-bc22-4f42-aaa2-86807cd32f91 tempest-GroupSnapshotsTest-1642445393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-988b379c-95b7-4890-adf0-08ef1bcc9cc0 1073741824 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:23:27 devstack sudo[94188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-988b379c-95b7-4890-adf0-08ef1bcc9cc0 1073741824 Sep 29 18:23:27 devstack sudo[94188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:23:27 devstack sudo[94188]: pam_unix(sudo:session): session closed for user root Sep 29 18:23:27 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-f9e1d1e7-bc22-4f42-aaa2-86807cd32f91 tempest-GroupSnapshotsTest-1642445393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-988b379c-95b7-4890-adf0-08ef1bcc9cc0 1073741824" returned: 0 in 0.540s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:23:27 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-f9e1d1e7-bc22-4f42-aaa2-86807cd32f91 tempest-GroupSnapshotsTest-1642445393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-988b379c-95b7-4890-adf0-08ef1bcc9cc0 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:23:27 devstack sudo[94195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-988b379c-95b7-4890-adf0-08ef1bcc9cc0 Sep 29 18:23:27 devstack sudo[94195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:23:28 devstack sudo[94195]: pam_unix(sudo:session): session closed for user root Sep 29 18:23:28 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-f9e1d1e7-bc22-4f42-aaa2-86807cd32f91 tempest-GroupSnapshotsTest-1642445393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-988b379c-95b7-4890-adf0-08ef1bcc9cc0" returned: 0 in 0.415s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:23:28 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-f9e1d1e7-bc22-4f42-aaa2-86807cd32f91 tempest-GroupSnapshotsTest-1642445393 None] <== create_volume: return (1008ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'} {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:23:28 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-f9e1d1e7-bc22-4f42-aaa2-86807cd32f91 tempest-GroupSnapshotsTest-1642445393 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.011s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:23:28 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-f9e1d1e7-bc22-4f42-aaa2-86807cd32f91 tempest-GroupSnapshotsTest-1642445393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56bb955c-7ee3-4910-ac51-66484561d7c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-988b379c-95b7-4890-adf0-08ef1bcc9cc0', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:23:28 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-f9e1d1e7-bc22-4f42-aaa2-86807cd32f91 tempest-GroupSnapshotsTest-1642445393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e01cfa7-ed4e-4410-8f92-cf5bbe68184f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:23:28 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-f9e1d1e7-bc22-4f42-aaa2-86807cd32f91 tempest-GroupSnapshotsTest-1642445393 None] Volume volume-988b379c-95b7-4890-adf0-08ef1bcc9cc0 (988b379c-95b7-4890-adf0-08ef1bcc9cc0): created successfully Sep 29 18:23:28 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-f9e1d1e7-bc22-4f42-aaa2-86807cd32f91 tempest-GroupSnapshotsTest-1642445393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e01cfa7-ed4e-4410-8f92-cf5bbe68184f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:23:28 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-f9e1d1e7-bc22-4f42-aaa2-86807cd32f91 tempest-GroupSnapshotsTest-1642445393 None] Flow 'volume_create_manager' (06b8ace8-4c67-469e-8244-cfda747c7ba6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:23:28 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-f9e1d1e7-bc22-4f42-aaa2-86807cd32f91 tempest-GroupSnapshotsTest-1642445393 None] Created volume successfully. Sep 29 18:23:29 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-bfecd665-841e-4822-95cf-e61741ff1920 tempest-GroupSnapshotsTest-1642445393 None] Update group completed successfully. Sep 29 18:23:31 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-4e5e8134-5de6-4b99-8e5b-08d8af8ca882 tempest-GroupSnapshotsTest-1642445393 None] Update group completed successfully. Sep 29 18:23:32 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-1acd5ace-4feb-4027-b9d8-6206953beba9 tempest-GroupSnapshotsTest-1642445393 None] Update group completed successfully. Sep 29 18:23:33 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-5b472b2c-502f-4433-8b3a-0dc091a05f0e tempest-GroupSnapshotsTest-1642445393 None] Update group completed successfully. Sep 29 18:23:36 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-772546aa-c1b8-49cf-a35d-16d6165dac94 tempest-GroupSnapshotsTest-1642445393 None] GroupSnapshot 515aa875-f443-4e79-9cd2-1b90622031cb: creating. Sep 29 18:23:36 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-772546aa-c1b8-49cf-a35d-16d6165dac94 tempest-GroupSnapshotsTest-1642445393 None] Group snapshot 515aa875-f443-4e79-9cd2-1b90622031cb: creating. {{(pid=86512) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 29 18:23:36 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-772546aa-c1b8-49cf-a35d-16d6165dac94 tempest-GroupSnapshotsTest-1642445393 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:23:36 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-772546aa-c1b8-49cf-a35d-16d6165dac94 tempest-GroupSnapshotsTest-1642445393 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:23:36 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-772546aa-c1b8-49cf-a35d-16d6165dac94 tempest-GroupSnapshotsTest-1642445393 None] Creating offline snapshot 3b5a4cd1-5b3f-4562-ac15-9595c552c6d4 of volume 988b379c-95b7-4890-adf0-08ef1bcc9cc0 {{(pid=86512) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 18:23:36 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0844de5-ff26-49e3-a8da-329994aa228d]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:23:36 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-772546aa-c1b8-49cf-a35d-16d6165dac94 tempest-GroupSnapshotsTest-1642445393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-988b379c-95b7-4890-adf0-08ef1bcc9cc0 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:23:36 devstack sudo[94335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-988b379c-95b7-4890-adf0-08ef1bcc9cc0 Sep 29 18:23:36 devstack sudo[94335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:23:36 devstack sudo[94335]: pam_unix(sudo:session): session closed for user root Sep 29 18:23:36 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-772546aa-c1b8-49cf-a35d-16d6165dac94 tempest-GroupSnapshotsTest-1642445393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-988b379c-95b7-4890-adf0-08ef1bcc9cc0" returned: 0 in 0.626s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:23:36 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-772546aa-c1b8-49cf-a35d-16d6165dac94 tempest-GroupSnapshotsTest-1642445393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-988b379c-95b7-4890-adf0-08ef1bcc9cc0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-988b379c-95b7-4890-adf0-08ef1bcc9cc0.3b5a4cd1-5b3f-4562-ac15-9595c552c6d4 1G {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:23:36 devstack sudo[94345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-988b379c-95b7-4890-adf0-08ef1bcc9cc0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-988b379c-95b7-4890-adf0-08ef1bcc9cc0.3b5a4cd1-5b3f-4562-ac15-9595c552c6d4 1G Sep 29 18:23:36 devstack sudo[94345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:23:37 devstack sudo[94345]: pam_unix(sudo:session): session closed for user root Sep 29 18:23:37 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-772546aa-c1b8-49cf-a35d-16d6165dac94 tempest-GroupSnapshotsTest-1642445393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-988b379c-95b7-4890-adf0-08ef1bcc9cc0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-988b379c-95b7-4890-adf0-08ef1bcc9cc0.3b5a4cd1-5b3f-4562-ac15-9595c552c6d4 1G" returned: 0 in 0.568s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:23:37 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-772546aa-c1b8-49cf-a35d-16d6165dac94 tempest-GroupSnapshotsTest-1642445393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-988b379c-95b7-4890-adf0-08ef1bcc9cc0 -F qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-988b379c-95b7-4890-adf0-08ef1bcc9cc0.3b5a4cd1-5b3f-4562-ac15-9595c552c6d4 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:23:37 devstack sudo[94352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-988b379c-95b7-4890-adf0-08ef1bcc9cc0 -F qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-988b379c-95b7-4890-adf0-08ef1bcc9cc0.3b5a4cd1-5b3f-4562-ac15-9595c552c6d4 Sep 29 18:23:37 devstack sudo[94352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:23:37 devstack sudo[94352]: pam_unix(sudo:session): session closed for user root Sep 29 18:23:37 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-772546aa-c1b8-49cf-a35d-16d6165dac94 tempest-GroupSnapshotsTest-1642445393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-988b379c-95b7-4890-adf0-08ef1bcc9cc0 -F qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-988b379c-95b7-4890-adf0-08ef1bcc9cc0.3b5a4cd1-5b3f-4562-ac15-9595c552c6d4" returned: 0 in 0.465s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:23:37 devstack cinder-volume[86512]: WARNING cinder.volume.drivers.remotefs [None req-772546aa-c1b8-49cf-a35d-16d6165dac94 tempest-GroupSnapshotsTest-1642445393 None] /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-988b379c-95b7-4890-adf0-08ef1bcc9cc0.3b5a4cd1-5b3f-4562-ac15-9595c552c6d4 is being set with open permissions: ugo+rw: NotImplementedError Sep 29 18:23:37 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-772546aa-c1b8-49cf-a35d-16d6165dac94 tempest-GroupSnapshotsTest-1642445393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-988b379c-95b7-4890-adf0-08ef1bcc9cc0.3b5a4cd1-5b3f-4562-ac15-9595c552c6d4 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:23:37 devstack sudo[94358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-988b379c-95b7-4890-adf0-08ef1bcc9cc0.3b5a4cd1-5b3f-4562-ac15-9595c552c6d4 Sep 29 18:23:37 devstack sudo[94358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:23:38 devstack sudo[94358]: pam_unix(sudo:session): session closed for user root Sep 29 18:23:38 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-772546aa-c1b8-49cf-a35d-16d6165dac94 tempest-GroupSnapshotsTest-1642445393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-988b379c-95b7-4890-adf0-08ef1bcc9cc0.3b5a4cd1-5b3f-4562-ac15-9595c552c6d4" returned: 0 in 0.509s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:23:38 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-772546aa-c1b8-49cf-a35d-16d6165dac94 tempest-GroupSnapshotsTest-1642445393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-988b379c-95b7-4890-adf0-08ef1bcc9cc0.info {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:23:38 devstack sudo[94361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-988b379c-95b7-4890-adf0-08ef1bcc9cc0.info Sep 29 18:23:38 devstack sudo[94361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:23:38 devstack sudo[94361]: pam_unix(sudo:session): session closed for user root Sep 29 18:23:38 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-772546aa-c1b8-49cf-a35d-16d6165dac94 tempest-GroupSnapshotsTest-1642445393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-988b379c-95b7-4890-adf0-08ef1bcc9cc0.info" returned: 0 in 0.413s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:23:38 devstack cinder-volume[86512]: WARNING cinder.volume.drivers.remotefs [None req-772546aa-c1b8-49cf-a35d-16d6165dac94 tempest-GroupSnapshotsTest-1642445393 None] /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-988b379c-95b7-4890-adf0-08ef1bcc9cc0.info is being set with open permissions: ugo+rw: NotImplementedError Sep 29 18:23:38 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-772546aa-c1b8-49cf-a35d-16d6165dac94 tempest-GroupSnapshotsTest-1642445393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-988b379c-95b7-4890-adf0-08ef1bcc9cc0.info {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:23:38 devstack sudo[94390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-988b379c-95b7-4890-adf0-08ef1bcc9cc0.info Sep 29 18:23:38 devstack sudo[94390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:23:39 devstack sudo[94390]: pam_unix(sudo:session): session closed for user root Sep 29 18:23:39 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-772546aa-c1b8-49cf-a35d-16d6165dac94 tempest-GroupSnapshotsTest-1642445393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-988b379c-95b7-4890-adf0-08ef1bcc9cc0.info" returned: 0 in 0.307s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:23:39 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-772546aa-c1b8-49cf-a35d-16d6165dac94 tempest-GroupSnapshotsTest-1642445393 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.055s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:23:39 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-772546aa-c1b8-49cf-a35d-16d6165dac94 tempest-GroupSnapshotsTest-1642445393 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:23:39 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-772546aa-c1b8-49cf-a35d-16d6165dac94 tempest-GroupSnapshotsTest-1642445393 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:23:39 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-772546aa-c1b8-49cf-a35d-16d6165dac94 tempest-GroupSnapshotsTest-1642445393 None] Creating offline snapshot 7d9551b7-0734-4831-b0b7-ac909d177758 of volume abe8b53b-c13f-4b59-84e1-890e2c92a58e {{(pid=86512) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 18:23:39 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[b18135e4-1cb8-43cf-be1a-3429f6e574e2]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:23:39 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-772546aa-c1b8-49cf-a35d-16d6165dac94 tempest-GroupSnapshotsTest-1642445393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-abe8b53b-c13f-4b59-84e1-890e2c92a58e {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:23:39 devstack sudo[94401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-abe8b53b-c13f-4b59-84e1-890e2c92a58e Sep 29 18:23:39 devstack sudo[94401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:23:39 devstack cinder-volume[86512]: INFO cinder.volume.manager [req-3d9af0a0-e3be-4434-9d54-3a56195d1425 req-071b2a24-e81d-49c3-b618-0130798ea758 tempest-ServerActionsTestOtherA-2039946361 None] Terminate volume connection completed successfully. Sep 29 18:23:39 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [req-3d9af0a0-e3be-4434-9d54-3a56195d1425 req-071b2a24-e81d-49c3-b618-0130798ea758 tempest-ServerActionsTestOtherA-2039946361 None] Deleting attachment 99b142c2-224e-4662-9f9b-80ae479a96d7. {{(pid=86512) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 29 18:23:39 devstack sudo[94401]: pam_unix(sudo:session): session closed for user root Sep 29 18:23:39 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-772546aa-c1b8-49cf-a35d-16d6165dac94 tempest-GroupSnapshotsTest-1642445393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-abe8b53b-c13f-4b59-84e1-890e2c92a58e" returned: 0 in 0.682s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:23:39 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-772546aa-c1b8-49cf-a35d-16d6165dac94 tempest-GroupSnapshotsTest-1642445393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-abe8b53b-c13f-4b59-84e1-890e2c92a58e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-abe8b53b-c13f-4b59-84e1-890e2c92a58e.7d9551b7-0734-4831-b0b7-ac909d177758 1G {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:23:39 devstack sudo[94408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-abe8b53b-c13f-4b59-84e1-890e2c92a58e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-abe8b53b-c13f-4b59-84e1-890e2c92a58e.7d9551b7-0734-4831-b0b7-ac909d177758 1G Sep 29 18:23:39 devstack sudo[94408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:23:40 devstack cinder-volume[86512]: DEBUG cinder.coordination [req-3d9af0a0-e3be-4434-9d54-3a56195d1425 req-f5fd5ad0-a3a4-4e1e-a4d8-48ede9244a50 tempest-ServerActionsTestOtherA-2039946361 None] Acquiring lock "cinder-36fb1940-32f1-4b9f-bdc4-546fcfa788b8-delete_volume" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:23:40 devstack cinder-volume[86512]: DEBUG cinder.coordination [req-3d9af0a0-e3be-4434-9d54-3a56195d1425 req-f5fd5ad0-a3a4-4e1e-a4d8-48ede9244a50 tempest-ServerActionsTestOtherA-2039946361 None] Lock "cinder-36fb1940-32f1-4b9f-bdc4-546fcfa788b8-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:23:40 devstack cinder-volume[86512]: DEBUG cinder.coordination [req-3d9af0a0-e3be-4434-9d54-3a56195d1425 req-f5fd5ad0-a3a4-4e1e-a4d8-48ede9244a50 tempest-ServerActionsTestOtherA-2039946361 None] Acquiring lock "cinder-quobyte-36fb1940-32f1-4b9f-bdc4-546fcfa788b8" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:23:40 devstack cinder-volume[86512]: DEBUG cinder.coordination [req-3d9af0a0-e3be-4434-9d54-3a56195d1425 req-f5fd5ad0-a3a4-4e1e-a4d8-48ede9244a50 tempest-ServerActionsTestOtherA-2039946361 None] Lock "cinder-quobyte-36fb1940-32f1-4b9f-bdc4-546fcfa788b8" acquired by "delete_volume" :: waited 0.018s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:23:40 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d647475-6af1-42ca-8721-8a14efd83126]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:23:40 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [req-3d9af0a0-e3be-4434-9d54-3a56195d1425 req-f5fd5ad0-a3a4-4e1e-a4d8-48ede9244a50 tempest-ServerActionsTestOtherA-2039946361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-36fb1940-32f1-4b9f-bdc4-546fcfa788b8 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:23:40 devstack sudo[94412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-36fb1940-32f1-4b9f-bdc4-546fcfa788b8 Sep 29 18:23:40 devstack sudo[94412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:23:40 devstack sudo[94408]: pam_unix(sudo:session): session closed for user root Sep 29 18:23:40 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-772546aa-c1b8-49cf-a35d-16d6165dac94 tempest-GroupSnapshotsTest-1642445393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-abe8b53b-c13f-4b59-84e1-890e2c92a58e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-abe8b53b-c13f-4b59-84e1-890e2c92a58e.7d9551b7-0734-4831-b0b7-ac909d177758 1G" returned: 0 in 0.756s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:23:40 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-772546aa-c1b8-49cf-a35d-16d6165dac94 tempest-GroupSnapshotsTest-1642445393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-abe8b53b-c13f-4b59-84e1-890e2c92a58e -F qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-abe8b53b-c13f-4b59-84e1-890e2c92a58e.7d9551b7-0734-4831-b0b7-ac909d177758 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:23:40 devstack sudo[94412]: pam_unix(sudo:session): session closed for user root Sep 29 18:23:40 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [req-3d9af0a0-e3be-4434-9d54-3a56195d1425 req-f5fd5ad0-a3a4-4e1e-a4d8-48ede9244a50 tempest-ServerActionsTestOtherA-2039946361 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-36fb1940-32f1-4b9f-bdc4-546fcfa788b8" returned: 0 in 0.581s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:23:40 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [req-3d9af0a0-e3be-4434-9d54-3a56195d1425 req-f5fd5ad0-a3a4-4e1e-a4d8-48ede9244a50 tempest-ServerActionsTestOtherA-2039946361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-36fb1940-32f1-4b9f-bdc4-546fcfa788b8 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:23:40 devstack sudo[94421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-abe8b53b-c13f-4b59-84e1-890e2c92a58e -F qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-abe8b53b-c13f-4b59-84e1-890e2c92a58e.7d9551b7-0734-4831-b0b7-ac909d177758 Sep 29 18:23:40 devstack sudo[94421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:23:40 devstack sudo[94422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-36fb1940-32f1-4b9f-bdc4-546fcfa788b8 Sep 29 18:23:40 devstack sudo[94422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:23:41 devstack sudo[94422]: pam_unix(sudo:session): session closed for user root Sep 29 18:23:41 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [req-3d9af0a0-e3be-4434-9d54-3a56195d1425 req-f5fd5ad0-a3a4-4e1e-a4d8-48ede9244a50 tempest-ServerActionsTestOtherA-2039946361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-36fb1940-32f1-4b9f-bdc4-546fcfa788b8" returned: 0 in 0.567s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:23:41 devstack cinder-volume[86512]: DEBUG cinder.coordination [req-3d9af0a0-e3be-4434-9d54-3a56195d1425 req-f5fd5ad0-a3a4-4e1e-a4d8-48ede9244a50 tempest-ServerActionsTestOtherA-2039946361 None] Lock "cinder-quobyte-36fb1940-32f1-4b9f-bdc4-546fcfa788b8" released by "delete_volume" :: held 1.203s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:23:41 devstack sudo[94421]: pam_unix(sudo:session): session closed for user root Sep 29 18:23:41 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-772546aa-c1b8-49cf-a35d-16d6165dac94 tempest-GroupSnapshotsTest-1642445393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-abe8b53b-c13f-4b59-84e1-890e2c92a58e -F qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-abe8b53b-c13f-4b59-84e1-890e2c92a58e.7d9551b7-0734-4831-b0b7-ac909d177758" returned: 0 in 0.722s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:23:41 devstack cinder-volume[86512]: WARNING cinder.volume.drivers.remotefs [None req-772546aa-c1b8-49cf-a35d-16d6165dac94 tempest-GroupSnapshotsTest-1642445393 None] /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-abe8b53b-c13f-4b59-84e1-890e2c92a58e.7d9551b7-0734-4831-b0b7-ac909d177758 is being set with open permissions: ugo+rw: NotImplementedError Sep 29 18:23:41 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-772546aa-c1b8-49cf-a35d-16d6165dac94 tempest-GroupSnapshotsTest-1642445393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-abe8b53b-c13f-4b59-84e1-890e2c92a58e.7d9551b7-0734-4831-b0b7-ac909d177758 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:23:41 devstack cinder-volume[86512]: DEBUG cinder.quota [req-3d9af0a0-e3be-4434-9d54-3a56195d1425 req-f5fd5ad0-a3a4-4e1e-a4d8-48ede9244a50 tempest-ServerActionsTestOtherA-2039946361 None] Created reservations ['0ac9daf8-1577-46d4-8c1b-6efc9a9381c6', '7a0d97cb-3c9a-4409-8748-66f18deff6ba', 'b41bf06e-7a63-4758-b607-987bc43b8594', 'd274a743-91da-48f5-9bbf-d9e0af4a84a0'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:23:41 devstack sudo[94429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-abe8b53b-c13f-4b59-84e1-890e2c92a58e.7d9551b7-0734-4831-b0b7-ac909d177758 Sep 29 18:23:41 devstack sudo[94429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:23:41 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [req-3d9af0a0-e3be-4434-9d54-3a56195d1425 req-f5fd5ad0-a3a4-4e1e-a4d8-48ede9244a50 tempest-ServerActionsTestOtherA-2039946361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:23:41 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [req-3d9af0a0-e3be-4434-9d54-3a56195d1425 req-f5fd5ad0-a3a4-4e1e-a4d8-48ede9244a50 tempest-ServerActionsTestOtherA-2039946361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:23:41 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [req-3d9af0a0-e3be-4434-9d54-3a56195d1425 req-f5fd5ad0-a3a4-4e1e-a4d8-48ede9244a50 tempest-ServerActionsTestOtherA-2039946361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:23:41 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [req-3d9af0a0-e3be-4434-9d54-3a56195d1425 req-f5fd5ad0-a3a4-4e1e-a4d8-48ede9244a50 tempest-ServerActionsTestOtherA-2039946361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:23:41 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [req-3d9af0a0-e3be-4434-9d54-3a56195d1425 req-f5fd5ad0-a3a4-4e1e-a4d8-48ede9244a50 tempest-ServerActionsTestOtherA-2039946361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:23:41 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [req-3d9af0a0-e3be-4434-9d54-3a56195d1425 req-f5fd5ad0-a3a4-4e1e-a4d8-48ede9244a50 tempest-ServerActionsTestOtherA-2039946361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:23:41 devstack sudo[94431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:23:41 devstack sudo[94431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:23:41 devstack sudo[94429]: pam_unix(sudo:session): session closed for user root Sep 29 18:23:41 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-772546aa-c1b8-49cf-a35d-16d6165dac94 tempest-GroupSnapshotsTest-1642445393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-abe8b53b-c13f-4b59-84e1-890e2c92a58e.7d9551b7-0734-4831-b0b7-ac909d177758" returned: 0 in 0.350s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:23:41 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-772546aa-c1b8-49cf-a35d-16d6165dac94 tempest-GroupSnapshotsTest-1642445393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-abe8b53b-c13f-4b59-84e1-890e2c92a58e.info {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:23:41 devstack sudo[94434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-abe8b53b-c13f-4b59-84e1-890e2c92a58e.info Sep 29 18:23:41 devstack sudo[94434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:23:41 devstack sudo[94431]: pam_unix(sudo:session): session closed for user root Sep 29 18:23:41 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [req-3d9af0a0-e3be-4434-9d54-3a56195d1425 req-f5fd5ad0-a3a4-4e1e-a4d8-48ede9244a50 tempest-ServerActionsTestOtherA-2039946361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.307s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:23:41 devstack cinder-volume[86512]: DEBUG cinder.manager [req-3d9af0a0-e3be-4434-9d54-3a56195d1425 req-f5fd5ad0-a3a4-4e1e-a4d8-48ede9244a50 tempest-ServerActionsTestOtherA-2039946361 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:23:41 devstack cinder-volume[86512]: INFO cinder.volume.manager [req-3d9af0a0-e3be-4434-9d54-3a56195d1425 req-f5fd5ad0-a3a4-4e1e-a4d8-48ede9244a50 tempest-ServerActionsTestOtherA-2039946361 None] Deleted volume successfully. Sep 29 18:23:41 devstack cinder-volume[86512]: DEBUG cinder.coordination [req-3d9af0a0-e3be-4434-9d54-3a56195d1425 req-f5fd5ad0-a3a4-4e1e-a4d8-48ede9244a50 tempest-ServerActionsTestOtherA-2039946361 None] Lock "cinder-36fb1940-32f1-4b9f-bdc4-546fcfa788b8-delete_volume" released by "delete_volume" :: held 1.902s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:23:42 devstack sudo[94434]: pam_unix(sudo:session): session closed for user root Sep 29 18:23:42 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-772546aa-c1b8-49cf-a35d-16d6165dac94 tempest-GroupSnapshotsTest-1642445393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-abe8b53b-c13f-4b59-84e1-890e2c92a58e.info" returned: 0 in 0.307s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:23:42 devstack cinder-volume[86512]: WARNING cinder.volume.drivers.remotefs [None req-772546aa-c1b8-49cf-a35d-16d6165dac94 tempest-GroupSnapshotsTest-1642445393 None] /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-abe8b53b-c13f-4b59-84e1-890e2c92a58e.info is being set with open permissions: ugo+rw: NotImplementedError Sep 29 18:23:42 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-772546aa-c1b8-49cf-a35d-16d6165dac94 tempest-GroupSnapshotsTest-1642445393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-abe8b53b-c13f-4b59-84e1-890e2c92a58e.info {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:23:42 devstack sudo[94438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-abe8b53b-c13f-4b59-84e1-890e2c92a58e.info Sep 29 18:23:42 devstack sudo[94438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:23:42 devstack sudo[94438]: pam_unix(sudo:session): session closed for user root Sep 29 18:23:42 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-772546aa-c1b8-49cf-a35d-16d6165dac94 tempest-GroupSnapshotsTest-1642445393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-abe8b53b-c13f-4b59-84e1-890e2c92a58e.info" returned: 0 in 0.385s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:23:42 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-772546aa-c1b8-49cf-a35d-16d6165dac94 tempest-GroupSnapshotsTest-1642445393 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.348s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:23:42 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-1b5b8ec2-d6e6-40b5-ae23-774a104b1436 tempest-ServerActionsTestOtherA-2039946361 None] Acquiring lock "cinder-ca107c68-21e2-4c3b-a3b6-98a640e627a0-delete_volume" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:23:42 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-1b5b8ec2-d6e6-40b5-ae23-774a104b1436 tempest-ServerActionsTestOtherA-2039946361 None] Lock "cinder-ca107c68-21e2-4c3b-a3b6-98a640e627a0-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:23:42 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-772546aa-c1b8-49cf-a35d-16d6165dac94 tempest-GroupSnapshotsTest-1642445393 None] group_snapshot 515aa875-f443-4e79-9cd2-1b90622031cb: created successfully Sep 29 18:23:42 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-1b5b8ec2-d6e6-40b5-ae23-774a104b1436 tempest-ServerActionsTestOtherA-2039946361 None] Acquiring lock "cinder-quobyte-ca107c68-21e2-4c3b-a3b6-98a640e627a0" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:23:42 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-1b5b8ec2-d6e6-40b5-ae23-774a104b1436 tempest-ServerActionsTestOtherA-2039946361 None] Lock "cinder-quobyte-ca107c68-21e2-4c3b-a3b6-98a640e627a0" acquired by "delete_volume" :: waited 0.028s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:23:42 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b242233-80d5-4cd1-82b6-670313de4258]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:23:42 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-1b5b8ec2-d6e6-40b5-ae23-774a104b1436 tempest-ServerActionsTestOtherA-2039946361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ca107c68-21e2-4c3b-a3b6-98a640e627a0 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:23:42 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-71a88e68-f275-4cc4-bfab-bf34a2c30512 tempest-GroupSnapshotsTest-1642445393 None] group_snapshot 515aa875-f443-4e79-9cd2-1b90622031cb: deleting Sep 29 18:23:43 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-71a88e68-f275-4cc4-bfab-bf34a2c30512 tempest-GroupSnapshotsTest-1642445393 None] group_snapshot 515aa875-f443-4e79-9cd2-1b90622031cb: deleting {{(pid=86512) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 29 18:23:43 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-71a88e68-f275-4cc4-bfab-bf34a2c30512 tempest-GroupSnapshotsTest-1642445393 None] Acquiring lock "cinder-quobyte-988b379c-95b7-4890-adf0-08ef1bcc9cc0" by "delete_snapshot" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:23:43 devstack sudo[94441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ca107c68-21e2-4c3b-a3b6-98a640e627a0 Sep 29 18:23:43 devstack sudo[94441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:23:43 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-71a88e68-f275-4cc4-bfab-bf34a2c30512 tempest-GroupSnapshotsTest-1642445393 None] Lock "cinder-quobyte-988b379c-95b7-4890-adf0-08ef1bcc9cc0" acquired by "delete_snapshot" :: waited 0.040s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:23:43 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-71a88e68-f275-4cc4-bfab-bf34a2c30512 tempest-GroupSnapshotsTest-1642445393 None] Acquiring lock "cinder-quobyte-3b5a4cd1-5b3f-4562-ac15-9595c552c6d4" by "_delete_snapshot" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:23:43 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-71a88e68-f275-4cc4-bfab-bf34a2c30512 tempest-GroupSnapshotsTest-1642445393 None] Lock "cinder-quobyte-3b5a4cd1-5b3f-4562-ac15-9595c552c6d4" acquired by "_delete_snapshot" :: waited 0.048s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:23:43 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-71a88e68-f275-4cc4-bfab-bf34a2c30512 tempest-GroupSnapshotsTest-1642445393 None] Deleting offline snapshot 3b5a4cd1-5b3f-4562-ac15-9595c552c6d4 of volume 988b379c-95b7-4890-adf0-08ef1bcc9cc0 {{(pid=86512) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 18:23:43 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-71a88e68-f275-4cc4-bfab-bf34a2c30512 tempest-GroupSnapshotsTest-1642445393 None] snapshot_file for this snap is: volume-988b379c-95b7-4890-adf0-08ef1bcc9cc0.3b5a4cd1-5b3f-4562-ac15-9595c552c6d4 {{(pid=86512) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 18:23:43 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[04abfc2a-6547-407e-8f77-676b7e39938b]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:23:43 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-71a88e68-f275-4cc4-bfab-bf34a2c30512 tempest-GroupSnapshotsTest-1642445393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-988b379c-95b7-4890-adf0-08ef1bcc9cc0.3b5a4cd1-5b3f-4562-ac15-9595c552c6d4 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:23:43 devstack sudo[94444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-988b379c-95b7-4890-adf0-08ef1bcc9cc0.3b5a4cd1-5b3f-4562-ac15-9595c552c6d4 Sep 29 18:23:43 devstack sudo[94444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:23:43 devstack sudo[94441]: pam_unix(sudo:session): session closed for user root Sep 29 18:23:43 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-1b5b8ec2-d6e6-40b5-ae23-774a104b1436 tempest-ServerActionsTestOtherA-2039946361 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ca107c68-21e2-4c3b-a3b6-98a640e627a0" returned: 0 in 0.718s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:23:43 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-1b5b8ec2-d6e6-40b5-ae23-774a104b1436 tempest-ServerActionsTestOtherA-2039946361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ca107c68-21e2-4c3b-a3b6-98a640e627a0 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:23:43 devstack sudo[94450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ca107c68-21e2-4c3b-a3b6-98a640e627a0 Sep 29 18:23:43 devstack sudo[94450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:23:43 devstack sudo[94450]: pam_unix(sudo:session): session closed for user root Sep 29 18:23:43 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-1b5b8ec2-d6e6-40b5-ae23-774a104b1436 tempest-ServerActionsTestOtherA-2039946361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ca107c68-21e2-4c3b-a3b6-98a640e627a0" returned: 0 in 0.334s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:23:43 devstack sudo[94444]: pam_unix(sudo:session): session closed for user root Sep 29 18:23:43 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-71a88e68-f275-4cc4-bfab-bf34a2c30512 tempest-GroupSnapshotsTest-1642445393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-988b379c-95b7-4890-adf0-08ef1bcc9cc0.3b5a4cd1-5b3f-4562-ac15-9595c552c6d4" returned: 0 in 0.650s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:23:43 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-71a88e68-f275-4cc4-bfab-bf34a2c30512 tempest-GroupSnapshotsTest-1642445393 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-988b379c-95b7-4890-adf0-08ef1bcc9cc0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86512) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 18:23:43 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-1b5b8ec2-d6e6-40b5-ae23-774a104b1436 tempest-ServerActionsTestOtherA-2039946361 None] Lock "cinder-quobyte-ca107c68-21e2-4c3b-a3b6-98a640e627a0" released by "delete_volume" :: held 1.148s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:23:43 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[52c1d3a7-11bd-4962-b634-503e26dc06fb]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:23:43 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-71a88e68-f275-4cc4-bfab-bf34a2c30512 tempest-GroupSnapshotsTest-1642445393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-988b379c-95b7-4890-adf0-08ef1bcc9cc0 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:23:44 devstack sudo[94456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-988b379c-95b7-4890-adf0-08ef1bcc9cc0 Sep 29 18:23:44 devstack sudo[94456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:23:44 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-1b5b8ec2-d6e6-40b5-ae23-774a104b1436 tempest-ServerActionsTestOtherA-2039946361 None] Created reservations ['949ae884-820c-4a22-aaee-d83b139ccd8c', '80684221-923c-4fbd-b9dd-20ad10dab702', '971046c0-f9c8-4e5f-b08a-95d96bcdb3d5', '9bacfc3f-5ea4-402d-b228-206613d6b225'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:23:44 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-1b5b8ec2-d6e6-40b5-ae23-774a104b1436 tempest-ServerActionsTestOtherA-2039946361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:23:44 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-1b5b8ec2-d6e6-40b5-ae23-774a104b1436 tempest-ServerActionsTestOtherA-2039946361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:23:44 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-1b5b8ec2-d6e6-40b5-ae23-774a104b1436 tempest-ServerActionsTestOtherA-2039946361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:23:44 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-1b5b8ec2-d6e6-40b5-ae23-774a104b1436 tempest-ServerActionsTestOtherA-2039946361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:23:44 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-1b5b8ec2-d6e6-40b5-ae23-774a104b1436 tempest-ServerActionsTestOtherA-2039946361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:23:44 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-1b5b8ec2-d6e6-40b5-ae23-774a104b1436 tempest-ServerActionsTestOtherA-2039946361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:23:44 devstack sudo[94458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:23:44 devstack sudo[94458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:23:44 devstack sudo[94456]: pam_unix(sudo:session): session closed for user root Sep 29 18:23:44 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-71a88e68-f275-4cc4-bfab-bf34a2c30512 tempest-GroupSnapshotsTest-1642445393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-988b379c-95b7-4890-adf0-08ef1bcc9cc0" returned: 0 in 0.542s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:23:44 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-71a88e68-f275-4cc4-bfab-bf34a2c30512 tempest-GroupSnapshotsTest-1642445393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-988b379c-95b7-4890-adf0-08ef1bcc9cc0.3b5a4cd1-5b3f-4562-ac15-9595c552c6d4 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:23:44 devstack sudo[94463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-988b379c-95b7-4890-adf0-08ef1bcc9cc0.3b5a4cd1-5b3f-4562-ac15-9595c552c6d4 Sep 29 18:23:44 devstack sudo[94463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:23:44 devstack sudo[94458]: pam_unix(sudo:session): session closed for user root Sep 29 18:23:44 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-1b5b8ec2-d6e6-40b5-ae23-774a104b1436 tempest-ServerActionsTestOtherA-2039946361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.393s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:23:44 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-1b5b8ec2-d6e6-40b5-ae23-774a104b1436 tempest-ServerActionsTestOtherA-2039946361 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:23:44 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-1b5b8ec2-d6e6-40b5-ae23-774a104b1436 tempest-ServerActionsTestOtherA-2039946361 None] Deleted volume successfully. Sep 29 18:23:44 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-1b5b8ec2-d6e6-40b5-ae23-774a104b1436 tempest-ServerActionsTestOtherA-2039946361 None] Lock "cinder-ca107c68-21e2-4c3b-a3b6-98a640e627a0-delete_volume" released by "delete_volume" :: held 2.033s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:23:45 devstack sudo[94463]: pam_unix(sudo:session): session closed for user root Sep 29 18:23:45 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-71a88e68-f275-4cc4-bfab-bf34a2c30512 tempest-GroupSnapshotsTest-1642445393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-988b379c-95b7-4890-adf0-08ef1bcc9cc0.3b5a4cd1-5b3f-4562-ac15-9595c552c6d4" returned: 0 in 0.503s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:23:45 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-71a88e68-f275-4cc4-bfab-bf34a2c30512 tempest-GroupSnapshotsTest-1642445393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-988b379c-95b7-4890-adf0-08ef1bcc9cc0.3b5a4cd1-5b3f-4562-ac15-9595c552c6d4 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:23:45 devstack sudo[94470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-988b379c-95b7-4890-adf0-08ef1bcc9cc0.3b5a4cd1-5b3f-4562-ac15-9595c552c6d4 Sep 29 18:23:45 devstack sudo[94470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:23:45 devstack sudo[94470]: pam_unix(sudo:session): session closed for user root Sep 29 18:23:45 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-71a88e68-f275-4cc4-bfab-bf34a2c30512 tempest-GroupSnapshotsTest-1642445393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-988b379c-95b7-4890-adf0-08ef1bcc9cc0.3b5a4cd1-5b3f-4562-ac15-9595c552c6d4" returned: 0 in 0.382s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:23:45 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-71a88e68-f275-4cc4-bfab-bf34a2c30512 tempest-GroupSnapshotsTest-1642445393 None] Lock "cinder-quobyte-3b5a4cd1-5b3f-4562-ac15-9595c552c6d4" released by "_delete_snapshot" :: held 2.283s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:23:45 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-71a88e68-f275-4cc4-bfab-bf34a2c30512 tempest-GroupSnapshotsTest-1642445393 None] Lock "cinder-quobyte-988b379c-95b7-4890-adf0-08ef1bcc9cc0" released by "delete_snapshot" :: held 2.355s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:23:45 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-71a88e68-f275-4cc4-bfab-bf34a2c30512 tempest-GroupSnapshotsTest-1642445393 None] Acquiring lock "cinder-quobyte-abe8b53b-c13f-4b59-84e1-890e2c92a58e" by "delete_snapshot" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:23:45 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-71a88e68-f275-4cc4-bfab-bf34a2c30512 tempest-GroupSnapshotsTest-1642445393 None] Lock "cinder-quobyte-abe8b53b-c13f-4b59-84e1-890e2c92a58e" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:23:45 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-71a88e68-f275-4cc4-bfab-bf34a2c30512 tempest-GroupSnapshotsTest-1642445393 None] Acquiring lock "cinder-quobyte-7d9551b7-0734-4831-b0b7-ac909d177758" by "_delete_snapshot" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:23:45 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-71a88e68-f275-4cc4-bfab-bf34a2c30512 tempest-GroupSnapshotsTest-1642445393 None] Lock "cinder-quobyte-7d9551b7-0734-4831-b0b7-ac909d177758" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:23:45 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-71a88e68-f275-4cc4-bfab-bf34a2c30512 tempest-GroupSnapshotsTest-1642445393 None] Deleting offline snapshot 7d9551b7-0734-4831-b0b7-ac909d177758 of volume abe8b53b-c13f-4b59-84e1-890e2c92a58e {{(pid=86512) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 18:23:45 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-71a88e68-f275-4cc4-bfab-bf34a2c30512 tempest-GroupSnapshotsTest-1642445393 None] snapshot_file for this snap is: volume-abe8b53b-c13f-4b59-84e1-890e2c92a58e.7d9551b7-0734-4831-b0b7-ac909d177758 {{(pid=86512) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 18:23:45 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d122e49-45b5-4fd4-b77f-c1f185496da3]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:23:45 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-71a88e68-f275-4cc4-bfab-bf34a2c30512 tempest-GroupSnapshotsTest-1642445393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-abe8b53b-c13f-4b59-84e1-890e2c92a58e.7d9551b7-0734-4831-b0b7-ac909d177758 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:23:45 devstack sudo[94479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-abe8b53b-c13f-4b59-84e1-890e2c92a58e.7d9551b7-0734-4831-b0b7-ac909d177758 Sep 29 18:23:45 devstack sudo[94479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:23:46 devstack sudo[94479]: pam_unix(sudo:session): session closed for user root Sep 29 18:23:46 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-71a88e68-f275-4cc4-bfab-bf34a2c30512 tempest-GroupSnapshotsTest-1642445393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-abe8b53b-c13f-4b59-84e1-890e2c92a58e.7d9551b7-0734-4831-b0b7-ac909d177758" returned: 0 in 0.734s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:23:46 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-71a88e68-f275-4cc4-bfab-bf34a2c30512 tempest-GroupSnapshotsTest-1642445393 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-abe8b53b-c13f-4b59-84e1-890e2c92a58e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86512) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 18:23:46 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[5560590f-039b-4d4a-8f33-6bb08ef78190]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:23:46 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-71a88e68-f275-4cc4-bfab-bf34a2c30512 tempest-GroupSnapshotsTest-1642445393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-abe8b53b-c13f-4b59-84e1-890e2c92a58e {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:23:46 devstack sudo[94526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-abe8b53b-c13f-4b59-84e1-890e2c92a58e Sep 29 18:23:46 devstack sudo[94526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:23:46 devstack sudo[94526]: pam_unix(sudo:session): session closed for user root Sep 29 18:23:46 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-71a88e68-f275-4cc4-bfab-bf34a2c30512 tempest-GroupSnapshotsTest-1642445393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-abe8b53b-c13f-4b59-84e1-890e2c92a58e" returned: 0 in 0.424s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:23:46 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-71a88e68-f275-4cc4-bfab-bf34a2c30512 tempest-GroupSnapshotsTest-1642445393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-abe8b53b-c13f-4b59-84e1-890e2c92a58e.7d9551b7-0734-4831-b0b7-ac909d177758 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:23:46 devstack sudo[94533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-abe8b53b-c13f-4b59-84e1-890e2c92a58e.7d9551b7-0734-4831-b0b7-ac909d177758 Sep 29 18:23:46 devstack sudo[94533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:23:47 devstack sudo[94533]: pam_unix(sudo:session): session closed for user root Sep 29 18:23:47 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-71a88e68-f275-4cc4-bfab-bf34a2c30512 tempest-GroupSnapshotsTest-1642445393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-abe8b53b-c13f-4b59-84e1-890e2c92a58e.7d9551b7-0734-4831-b0b7-ac909d177758" returned: 0 in 0.418s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:23:47 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-71a88e68-f275-4cc4-bfab-bf34a2c30512 tempest-GroupSnapshotsTest-1642445393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-abe8b53b-c13f-4b59-84e1-890e2c92a58e.7d9551b7-0734-4831-b0b7-ac909d177758 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:23:47 devstack sudo[94538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-abe8b53b-c13f-4b59-84e1-890e2c92a58e.7d9551b7-0734-4831-b0b7-ac909d177758 Sep 29 18:23:47 devstack sudo[94538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:23:47 devstack sudo[94538]: pam_unix(sudo:session): session closed for user root Sep 29 18:23:47 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-71a88e68-f275-4cc4-bfab-bf34a2c30512 tempest-GroupSnapshotsTest-1642445393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-abe8b53b-c13f-4b59-84e1-890e2c92a58e.7d9551b7-0734-4831-b0b7-ac909d177758" returned: 0 in 0.307s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:23:47 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-71a88e68-f275-4cc4-bfab-bf34a2c30512 tempest-GroupSnapshotsTest-1642445393 None] Lock "cinder-quobyte-7d9551b7-0734-4831-b0b7-ac909d177758" released by "_delete_snapshot" :: held 2.038s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:23:47 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-71a88e68-f275-4cc4-bfab-bf34a2c30512 tempest-GroupSnapshotsTest-1642445393 None] Lock "cinder-quobyte-abe8b53b-c13f-4b59-84e1-890e2c92a58e" released by "delete_snapshot" :: held 2.075s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:23:47 devstack cinder-volume[86512]: WARNING cinder.quota [None req-71a88e68-f275-4cc4-bfab-bf34a2c30512 tempest-GroupSnapshotsTest-1642445393 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-849987999 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-849987999, it is now deprecated. Please use the default quota class for default quota. Sep 29 18:23:47 devstack cinder-volume[86512]: WARNING cinder.quota [None req-71a88e68-f275-4cc4-bfab-bf34a2c30512 tempest-GroupSnapshotsTest-1642445393 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-849987999 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-849987999, it is now deprecated. Please use the default quota class for default quota. Sep 29 18:23:47 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-71a88e68-f275-4cc4-bfab-bf34a2c30512 tempest-GroupSnapshotsTest-1642445393 None] Created reservations ['c1366f21-f8c7-4f89-b676-f652c916c2e0', '03430195-00bc-414c-8fd1-edc900ef4d60', '540fe838-8548-4fbd-a35c-168156822605', '4b10c00e-ee06-41d3-a33b-13b1658ef432'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:23:47 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-71a88e68-f275-4cc4-bfab-bf34a2c30512 tempest-GroupSnapshotsTest-1642445393 None] Created reservations ['d6984191-f37e-4248-bc69-85b858c20d70', 'a781d421-173b-4170-a566-20f27a3f3f69', 'd6473e78-cdeb-4f5f-86c2-ecf461f55eba', 'ff5be6c1-46ff-4e23-852e-f390a0206faf'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:23:47 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-71a88e68-f275-4cc4-bfab-bf34a2c30512 tempest-GroupSnapshotsTest-1642445393 None] group_snapshot 515aa875-f443-4e79-9cd2-1b90622031cb: deleted successfully Sep 29 18:23:49 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-7835d0a2-6ccc-4194-b746-89b4dcd6a339 tempest-GroupSnapshotsTest-1642445393 None] Acquiring lock "cinder-quobyte-988b379c-95b7-4890-adf0-08ef1bcc9cc0" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:23:49 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-7835d0a2-6ccc-4194-b746-89b4dcd6a339 tempest-GroupSnapshotsTest-1642445393 None] Lock "cinder-quobyte-988b379c-95b7-4890-adf0-08ef1bcc9cc0" acquired by "delete_volume" :: waited 0.019s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:23:49 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ee8fcf3-7ec1-4af7-a9af-35d1bc23f189]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:23:49 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-7835d0a2-6ccc-4194-b746-89b4dcd6a339 tempest-GroupSnapshotsTest-1642445393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-988b379c-95b7-4890-adf0-08ef1bcc9cc0 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:23:49 devstack sudo[94543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-988b379c-95b7-4890-adf0-08ef1bcc9cc0 Sep 29 18:23:49 devstack sudo[94543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:23:49 devstack sudo[94543]: pam_unix(sudo:session): session closed for user root Sep 29 18:23:49 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-7835d0a2-6ccc-4194-b746-89b4dcd6a339 tempest-GroupSnapshotsTest-1642445393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-988b379c-95b7-4890-adf0-08ef1bcc9cc0" returned: 0 in 0.453s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:23:49 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-7835d0a2-6ccc-4194-b746-89b4dcd6a339 tempest-GroupSnapshotsTest-1642445393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-988b379c-95b7-4890-adf0-08ef1bcc9cc0 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:23:49 devstack sudo[94548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-988b379c-95b7-4890-adf0-08ef1bcc9cc0 Sep 29 18:23:49 devstack sudo[94548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:23:50 devstack sudo[94548]: pam_unix(sudo:session): session closed for user root Sep 29 18:23:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-7835d0a2-6ccc-4194-b746-89b4dcd6a339 tempest-GroupSnapshotsTest-1642445393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-988b379c-95b7-4890-adf0-08ef1bcc9cc0" returned: 0 in 0.295s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:23:50 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-7835d0a2-6ccc-4194-b746-89b4dcd6a339 tempest-GroupSnapshotsTest-1642445393 None] Lock "cinder-quobyte-988b379c-95b7-4890-adf0-08ef1bcc9cc0" released by "delete_volume" :: held 0.857s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:23:50 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-7835d0a2-6ccc-4194-b746-89b4dcd6a339 tempest-GroupSnapshotsTest-1642445393 None] Acquiring lock "cinder-quobyte-abe8b53b-c13f-4b59-84e1-890e2c92a58e" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:23:50 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-7835d0a2-6ccc-4194-b746-89b4dcd6a339 tempest-GroupSnapshotsTest-1642445393 None] Lock "cinder-quobyte-abe8b53b-c13f-4b59-84e1-890e2c92a58e" acquired by "delete_volume" :: waited 0.016s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:23:50 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ab74e89-48fc-4c96-b69d-7d7c03bb075e]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:23:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-7835d0a2-6ccc-4194-b746-89b4dcd6a339 tempest-GroupSnapshotsTest-1642445393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-abe8b53b-c13f-4b59-84e1-890e2c92a58e {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:23:50 devstack sudo[94551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-abe8b53b-c13f-4b59-84e1-890e2c92a58e Sep 29 18:23:50 devstack sudo[94551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:23:50 devstack cinder-volume[86512]: DEBUG oslo_service.periodic_task [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86512) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 18:23:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:23:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:23:50 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:23:50 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:23:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:23:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:23:50 devstack sudo[94556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:23:50 devstack sudo[94556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:23:50 devstack sudo[94551]: pam_unix(sudo:session): session closed for user root Sep 29 18:23:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-7835d0a2-6ccc-4194-b746-89b4dcd6a339 tempest-GroupSnapshotsTest-1642445393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-abe8b53b-c13f-4b59-84e1-890e2c92a58e" returned: 0 in 0.478s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:23:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-7835d0a2-6ccc-4194-b746-89b4dcd6a339 tempest-GroupSnapshotsTest-1642445393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-abe8b53b-c13f-4b59-84e1-890e2c92a58e {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:23:50 devstack sudo[94558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-abe8b53b-c13f-4b59-84e1-890e2c92a58e Sep 29 18:23:50 devstack sudo[94558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:23:50 devstack sudo[94556]: pam_unix(sudo:session): session closed for user root Sep 29 18:23:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.345s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:23:50 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:23:50 devstack cinder-volume[86512]: DEBUG oslo_service.periodic_task [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Running periodic task VolumeManager._thread_info {{(pid=86512) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 18:23:50 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] thread count: 28 {{(pid=86512) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 29 18:23:50 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] thread info: [<_MainThread(MainThread, started 135593654804608)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86512) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 29 18:23:50 devstack sudo[94558]: pam_unix(sudo:session): session closed for user root Sep 29 18:23:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-7835d0a2-6ccc-4194-b746-89b4dcd6a339 tempest-GroupSnapshotsTest-1642445393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-abe8b53b-c13f-4b59-84e1-890e2c92a58e" returned: 0 in 0.337s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:23:51 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-7835d0a2-6ccc-4194-b746-89b4dcd6a339 tempest-GroupSnapshotsTest-1642445393 None] Lock "cinder-quobyte-abe8b53b-c13f-4b59-84e1-890e2c92a58e" released by "delete_volume" :: held 0.884s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:23:51 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-7835d0a2-6ccc-4194-b746-89b4dcd6a339 tempest-GroupSnapshotsTest-1642445393 None] Created reservations ['6d60747b-b997-4fce-b2cf-b57cac5480a1'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:23:51 devstack cinder-volume[86512]: WARNING cinder.quota [None req-7835d0a2-6ccc-4194-b746-89b4dcd6a339 tempest-GroupSnapshotsTest-1642445393 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-849987999 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-849987999, it is now deprecated. Please use the default quota class for default quota. Sep 29 18:23:51 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-7835d0a2-6ccc-4194-b746-89b4dcd6a339 tempest-GroupSnapshotsTest-1642445393 None] Created reservations ['de126b65-1ece-4d8d-b2f6-05066fe87da7', 'ed411973-ad8b-4c74-9308-24ead464ac97', 'bee6778b-4a2d-41ab-95f4-19f632168974', 'a6fcc248-c048-462a-89ac-8e1317361194'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:23:51 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-7835d0a2-6ccc-4194-b746-89b4dcd6a339 tempest-GroupSnapshotsTest-1642445393 None] Created reservations ['dfef77c5-8b65-407b-b654-c58c642abadb', 'e2e8b225-98ab-438d-8d12-70ce75aea046', '7c29bfd9-0836-4dbb-b412-b1a3fa3dc9bc', 'd9be80a7-0ac3-4469-8833-d7e7a9c57bf4'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:23:51 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-7835d0a2-6ccc-4194-b746-89b4dcd6a339 tempest-GroupSnapshotsTest-1642445393 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:23:51 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-7835d0a2-6ccc-4194-b746-89b4dcd6a339 tempest-GroupSnapshotsTest-1642445393 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:23:51 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-7835d0a2-6ccc-4194-b746-89b4dcd6a339 tempest-GroupSnapshotsTest-1642445393 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:23:51 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-7835d0a2-6ccc-4194-b746-89b4dcd6a339 tempest-GroupSnapshotsTest-1642445393 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:23:51 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-7835d0a2-6ccc-4194-b746-89b4dcd6a339 tempest-GroupSnapshotsTest-1642445393 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:23:51 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-7835d0a2-6ccc-4194-b746-89b4dcd6a339 tempest-GroupSnapshotsTest-1642445393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:23:51 devstack sudo[94562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:23:51 devstack sudo[94562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:23:51 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a2f7302-5983-47e6-aeef-32e61c30b3ed tempest-TestStampPattern-1947170058 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86512) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:23:51 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-7a2f7302-5983-47e6-aeef-32e61c30b3ed tempest-TestStampPattern-1947170058 None] Flow 'volume_create_manager' (999e40fc-9a40-4f04-8901-2e0b06e15a39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:23:51 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-7a2f7302-5983-47e6-aeef-32e61c30b3ed tempest-TestStampPattern-1947170058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ee7f673-1a25-46df-b6be-a084c8636af8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:23:51 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-7a2f7302-5983-47e6-aeef-32e61c30b3ed tempest-TestStampPattern-1947170058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ee7f673-1a25-46df-b6be-a084c8636af8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:23:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-825156614',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fc95db1-8a95-4cd2-9802-eecd7eb24f64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='573e731cd34c4c8eb5153858812df122',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:23:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:23:51Z,use_quota=True,user_id='2fab4143c23a4deb8178d0113156f1e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:23:51 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-7a2f7302-5983-47e6-aeef-32e61c30b3ed tempest-TestStampPattern-1947170058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1bbc92d-214b-4bd4-bb6e-32afb517427d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:23:51 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-7a2f7302-5983-47e6-aeef-32e61c30b3ed tempest-TestStampPattern-1947170058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1bbc92d-214b-4bd4-bb6e-32afb517427d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:23:51 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-7a2f7302-5983-47e6-aeef-32e61c30b3ed tempest-TestStampPattern-1947170058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b028271f-1ccd-43bf-9f93-2ab9337c81c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:23:51 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-7a2f7302-5983-47e6-aeef-32e61c30b3ed tempest-TestStampPattern-1947170058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b028271f-1ccd-43bf-9f93-2ab9337c81c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7fc95db1-8a95-4cd2-9802-eecd7eb24f64', 'volume_name': 'volume-7fc95db1-8a95-4cd2-9802-eecd7eb24f64', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:23:51 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-7a2f7302-5983-47e6-aeef-32e61c30b3ed tempest-TestStampPattern-1947170058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (466e086b-062d-41f9-81dc-ce907b6fa4ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:23:51 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-7a2f7302-5983-47e6-aeef-32e61c30b3ed tempest-TestStampPattern-1947170058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (466e086b-062d-41f9-81dc-ce907b6fa4ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:23:51 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-7a2f7302-5983-47e6-aeef-32e61c30b3ed tempest-TestStampPattern-1947170058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (365f7c0b-fba4-44f9-b0a6-bec9b4402e83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:23:51 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-7a2f7302-5983-47e6-aeef-32e61c30b3ed tempest-TestStampPattern-1947170058 None] Volume 7fc95db1-8a95-4cd2-9802-eecd7eb24f64: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7fc95db1-8a95-4cd2-9802-eecd7eb24f64', 'volume_size': 1} Sep 29 18:23:51 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-7a2f7302-5983-47e6-aeef-32e61c30b3ed tempest-TestStampPattern-1947170058 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:23:51 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-7a2f7302-5983-47e6-aeef-32e61c30b3ed tempest-TestStampPattern-1947170058 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:23:51 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-7a2f7302-5983-47e6-aeef-32e61c30b3ed tempest-TestStampPattern-1947170058 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:23:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-825156614',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fc95db1-8a95-4cd2-9802-eecd7eb24f64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='573e731cd34c4c8eb5153858812df122',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:23:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:23:51Z,use_quota=True,user_id='2fab4143c23a4deb8178d0113156f1e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)}" {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:23:51 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-7a2f7302-5983-47e6-aeef-32e61c30b3ed tempest-TestStampPattern-1947170058 None] Creating volume 7fc95db1-8a95-4cd2-9802-eecd7eb24f64 {{(pid=86512) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:23:51 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-7a2f7302-5983-47e6-aeef-32e61c30b3ed tempest-TestStampPattern-1947170058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:23:51 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-7a2f7302-5983-47e6-aeef-32e61c30b3ed tempest-TestStampPattern-1947170058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:23:51 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-7a2f7302-5983-47e6-aeef-32e61c30b3ed tempest-TestStampPattern-1947170058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:23:51 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-7a2f7302-5983-47e6-aeef-32e61c30b3ed tempest-TestStampPattern-1947170058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:23:51 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-7a2f7302-5983-47e6-aeef-32e61c30b3ed tempest-TestStampPattern-1947170058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:23:51 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-7a2f7302-5983-47e6-aeef-32e61c30b3ed tempest-TestStampPattern-1947170058 None] Selected osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 as target Quobyte volume. {{(pid=86512) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:23:51 devstack cinder-volume[86512]: INFO cinder.volume.drivers.remotefs [None req-7a2f7302-5983-47e6-aeef-32e61c30b3ed tempest-TestStampPattern-1947170058 None] casted to osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 Sep 29 18:23:51 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-7a2f7302-5983-47e6-aeef-32e61c30b3ed tempest-TestStampPattern-1947170058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7fc95db1-8a95-4cd2-9802-eecd7eb24f64 1073741824 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:23:51 devstack sudo[94564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7fc95db1-8a95-4cd2-9802-eecd7eb24f64 1073741824 Sep 29 18:23:51 devstack sudo[94564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:23:51 devstack sudo[94562]: pam_unix(sudo:session): session closed for user root Sep 29 18:23:51 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-7835d0a2-6ccc-4194-b746-89b4dcd6a339 tempest-GroupSnapshotsTest-1642445393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.427s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:23:51 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-7835d0a2-6ccc-4194-b746-89b4dcd6a339 tempest-GroupSnapshotsTest-1642445393 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:23:51 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-7835d0a2-6ccc-4194-b746-89b4dcd6a339 tempest-GroupSnapshotsTest-1642445393 None] Delete group completed successfully. Sep 29 18:23:52 devstack sudo[94564]: pam_unix(sudo:session): session closed for user root Sep 29 18:23:52 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-7a2f7302-5983-47e6-aeef-32e61c30b3ed tempest-TestStampPattern-1947170058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7fc95db1-8a95-4cd2-9802-eecd7eb24f64 1073741824" returned: 0 in 0.586s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:23:52 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-7a2f7302-5983-47e6-aeef-32e61c30b3ed tempest-TestStampPattern-1947170058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7fc95db1-8a95-4cd2-9802-eecd7eb24f64 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:23:52 devstack sudo[94574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7fc95db1-8a95-4cd2-9802-eecd7eb24f64 Sep 29 18:23:52 devstack sudo[94574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:23:52 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-70dbfe0e-ea82-43c3-b2c3-bc283d3a2611 tempest-GroupSnapshotsTest-1642445393 None] Group tempest-GroupSnapshotsTest-Group-934180924: creating Sep 29 18:23:52 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-70dbfe0e-ea82-43c3-b2c3-bc283d3a2611 tempest-GroupSnapshotsTest-1642445393 None] Group tempest-GroupSnapshotsTest-Group-934180924: created successfully Sep 29 18:23:52 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-70dbfe0e-ea82-43c3-b2c3-bc283d3a2611 tempest-GroupSnapshotsTest-1642445393 None] Create group completed successfully. Sep 29 18:23:52 devstack sudo[94574]: pam_unix(sudo:session): session closed for user root Sep 29 18:23:52 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-7a2f7302-5983-47e6-aeef-32e61c30b3ed tempest-TestStampPattern-1947170058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7fc95db1-8a95-4cd2-9802-eecd7eb24f64" returned: 0 in 0.423s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:23:52 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-7a2f7302-5983-47e6-aeef-32e61c30b3ed tempest-TestStampPattern-1947170058 None] <== create_volume: return (1075ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'} {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:23:52 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-7a2f7302-5983-47e6-aeef-32e61c30b3ed tempest-TestStampPattern-1947170058 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.082s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:23:52 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-7a2f7302-5983-47e6-aeef-32e61c30b3ed tempest-TestStampPattern-1947170058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (365f7c0b-fba4-44f9-b0a6-bec9b4402e83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7fc95db1-8a95-4cd2-9802-eecd7eb24f64', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:23:52 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-7a2f7302-5983-47e6-aeef-32e61c30b3ed tempest-TestStampPattern-1947170058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be63614a-0878-4e8e-9cae-4aacf9e97472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:23:52 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-7a2f7302-5983-47e6-aeef-32e61c30b3ed tempest-TestStampPattern-1947170058 None] Volume volume-7fc95db1-8a95-4cd2-9802-eecd7eb24f64 (7fc95db1-8a95-4cd2-9802-eecd7eb24f64): created successfully Sep 29 18:23:52 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-7a2f7302-5983-47e6-aeef-32e61c30b3ed tempest-TestStampPattern-1947170058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be63614a-0878-4e8e-9cae-4aacf9e97472) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:23:52 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-7a2f7302-5983-47e6-aeef-32e61c30b3ed tempest-TestStampPattern-1947170058 None] Flow 'volume_create_manager' (999e40fc-9a40-4f04-8901-2e0b06e15a39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:23:52 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-7a2f7302-5983-47e6-aeef-32e61c30b3ed tempest-TestStampPattern-1947170058 None] Created volume successfully. Sep 29 18:23:54 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a63e57e-0241-41ff-95fc-b868fcf35566 tempest-GroupSnapshotsTest-1642445393 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86512) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:23:54 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-5a63e57e-0241-41ff-95fc-b868fcf35566 tempest-GroupSnapshotsTest-1642445393 None] Flow 'volume_create_manager' (974c63ab-bdb2-4f79-85a9-525fc81b057a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:23:54 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-5a63e57e-0241-41ff-95fc-b868fcf35566 tempest-GroupSnapshotsTest-1642445393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11c9a807-8865-4982-93cc-7f51e71c89db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:23:54 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-5a63e57e-0241-41ff-95fc-b868fcf35566 tempest-GroupSnapshotsTest-1642445393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11c9a807-8865-4982-93cc-7f51e71c89db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:23:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1268013050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7c1ba2d1-834f-4cec-acba-baf2e3e441cf,host='devstack@QuobyteHD#QuobyteHD',id=b96c9232-1ded-4494-adad-ffc097d8224c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b72a6d98d3024636b98695226ae3244b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:23:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:23:55Z,use_quota=True,user_id='fea5c1a44e2e458e875b338a9ec7fbfd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(25bd5d90-3f21-4964-adcd-d3ae6d700c77),volume_type_id=25bd5d90-3f21-4964-adcd-d3ae6d700c77)' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:23:54 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-5a63e57e-0241-41ff-95fc-b868fcf35566 tempest-GroupSnapshotsTest-1642445393 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73710960-55e7-48a5-a16f-79dde9ebacb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:23:54 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-5a63e57e-0241-41ff-95fc-b868fcf35566 tempest-GroupSnapshotsTest-1642445393 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73710960-55e7-48a5-a16f-79dde9ebacb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:23:54 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-5a63e57e-0241-41ff-95fc-b868fcf35566 tempest-GroupSnapshotsTest-1642445393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f19f409-b614-438a-9cff-6eb6fd8e1f4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:23:54 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-5a63e57e-0241-41ff-95fc-b868fcf35566 tempest-GroupSnapshotsTest-1642445393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f19f409-b614-438a-9cff-6eb6fd8e1f4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b96c9232-1ded-4494-adad-ffc097d8224c', 'volume_name': 'volume-b96c9232-1ded-4494-adad-ffc097d8224c', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:23:54 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-5a63e57e-0241-41ff-95fc-b868fcf35566 tempest-GroupSnapshotsTest-1642445393 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (004ba639-1dff-4d20-ab00-2f82f4f85655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:23:54 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-5a63e57e-0241-41ff-95fc-b868fcf35566 tempest-GroupSnapshotsTest-1642445393 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (004ba639-1dff-4d20-ab00-2f82f4f85655) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:23:54 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-5a63e57e-0241-41ff-95fc-b868fcf35566 tempest-GroupSnapshotsTest-1642445393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9d34b15-1ad6-4750-89bd-11f790341aeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:23:54 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-5a63e57e-0241-41ff-95fc-b868fcf35566 tempest-GroupSnapshotsTest-1642445393 None] Volume b96c9232-1ded-4494-adad-ffc097d8224c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b96c9232-1ded-4494-adad-ffc097d8224c', 'volume_size': 1} Sep 29 18:23:54 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-5a63e57e-0241-41ff-95fc-b868fcf35566 tempest-GroupSnapshotsTest-1642445393 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:23:54 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-5a63e57e-0241-41ff-95fc-b868fcf35566 tempest-GroupSnapshotsTest-1642445393 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:23:54 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-5a63e57e-0241-41ff-95fc-b868fcf35566 tempest-GroupSnapshotsTest-1642445393 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=7c1ba2d1-834f-4cec-acba-baf2e3e441cf,created_at=2026-09-29T16:23:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1268013050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7c1ba2d1-834f-4cec-acba-baf2e3e441cf,host='devstack@QuobyteHD#QuobyteHD',id=b96c9232-1ded-4494-adad-ffc097d8224c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b72a6d98d3024636b98695226ae3244b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:23:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:23:55Z,use_quota=True,user_id='fea5c1a44e2e458e875b338a9ec7fbfd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(25bd5d90-3f21-4964-adcd-d3ae6d700c77),volume_type_id=25bd5d90-3f21-4964-adcd-d3ae6d700c77)}" {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:23:54 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-5a63e57e-0241-41ff-95fc-b868fcf35566 tempest-GroupSnapshotsTest-1642445393 None] Creating volume b96c9232-1ded-4494-adad-ffc097d8224c {{(pid=86512) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:23:54 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-5a63e57e-0241-41ff-95fc-b868fcf35566 tempest-GroupSnapshotsTest-1642445393 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:23:54 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-5a63e57e-0241-41ff-95fc-b868fcf35566 tempest-GroupSnapshotsTest-1642445393 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:23:54 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-5a63e57e-0241-41ff-95fc-b868fcf35566 tempest-GroupSnapshotsTest-1642445393 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:23:54 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-5a63e57e-0241-41ff-95fc-b868fcf35566 tempest-GroupSnapshotsTest-1642445393 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:23:54 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-5a63e57e-0241-41ff-95fc-b868fcf35566 tempest-GroupSnapshotsTest-1642445393 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:23:54 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-5a63e57e-0241-41ff-95fc-b868fcf35566 tempest-GroupSnapshotsTest-1642445393 None] Selected osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 as target Quobyte volume. {{(pid=86512) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:23:54 devstack cinder-volume[86512]: INFO cinder.volume.drivers.remotefs [None req-5a63e57e-0241-41ff-95fc-b868fcf35566 tempest-GroupSnapshotsTest-1642445393 None] casted to osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 Sep 29 18:23:54 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-5a63e57e-0241-41ff-95fc-b868fcf35566 tempest-GroupSnapshotsTest-1642445393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-b96c9232-1ded-4494-adad-ffc097d8224c 1073741824 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:23:54 devstack sudo[94587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-b96c9232-1ded-4494-adad-ffc097d8224c 1073741824 Sep 29 18:23:54 devstack sudo[94587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:23:55 devstack sudo[94587]: pam_unix(sudo:session): session closed for user root Sep 29 18:23:55 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-5a63e57e-0241-41ff-95fc-b868fcf35566 tempest-GroupSnapshotsTest-1642445393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-b96c9232-1ded-4494-adad-ffc097d8224c 1073741824" returned: 0 in 0.708s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:23:55 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-5a63e57e-0241-41ff-95fc-b868fcf35566 tempest-GroupSnapshotsTest-1642445393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-b96c9232-1ded-4494-adad-ffc097d8224c {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:23:55 devstack sudo[94611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-b96c9232-1ded-4494-adad-ffc097d8224c Sep 29 18:23:55 devstack sudo[94611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:23:55 devstack sudo[94611]: pam_unix(sudo:session): session closed for user root Sep 29 18:23:55 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-5a63e57e-0241-41ff-95fc-b868fcf35566 tempest-GroupSnapshotsTest-1642445393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-b96c9232-1ded-4494-adad-ffc097d8224c" returned: 0 in 0.377s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:23:55 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-5a63e57e-0241-41ff-95fc-b868fcf35566 tempest-GroupSnapshotsTest-1642445393 None] <== create_volume: return (1155ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'} {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:23:55 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-5a63e57e-0241-41ff-95fc-b868fcf35566 tempest-GroupSnapshotsTest-1642445393 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.160s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:23:55 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-5a63e57e-0241-41ff-95fc-b868fcf35566 tempest-GroupSnapshotsTest-1642445393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9d34b15-1ad6-4750-89bd-11f790341aeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b96c9232-1ded-4494-adad-ffc097d8224c', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:23:55 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-5a63e57e-0241-41ff-95fc-b868fcf35566 tempest-GroupSnapshotsTest-1642445393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7992ecf-87da-469b-9dc1-b16b83b387ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:23:55 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-5a63e57e-0241-41ff-95fc-b868fcf35566 tempest-GroupSnapshotsTest-1642445393 None] Volume volume-b96c9232-1ded-4494-adad-ffc097d8224c (b96c9232-1ded-4494-adad-ffc097d8224c): created successfully Sep 29 18:23:55 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-5a63e57e-0241-41ff-95fc-b868fcf35566 tempest-GroupSnapshotsTest-1642445393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7992ecf-87da-469b-9dc1-b16b83b387ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:23:55 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-5a63e57e-0241-41ff-95fc-b868fcf35566 tempest-GroupSnapshotsTest-1642445393 None] Flow 'volume_create_manager' (974c63ab-bdb2-4f79-85a9-525fc81b057a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:23:55 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-5a63e57e-0241-41ff-95fc-b868fcf35566 tempest-GroupSnapshotsTest-1642445393 None] Created volume successfully. Sep 29 18:23:57 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-16988497-6258-459a-9939-0ca27f50b6a4 tempest-GroupSnapshotsTest-1642445393 None] GroupSnapshot e5764c95-2628-4854-9be8-1d52034b9f79: creating. Sep 29 18:23:57 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-16988497-6258-459a-9939-0ca27f50b6a4 tempest-GroupSnapshotsTest-1642445393 None] Group snapshot e5764c95-2628-4854-9be8-1d52034b9f79: creating. {{(pid=86512) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 29 18:23:57 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-16988497-6258-459a-9939-0ca27f50b6a4 tempest-GroupSnapshotsTest-1642445393 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:23:57 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-16988497-6258-459a-9939-0ca27f50b6a4 tempest-GroupSnapshotsTest-1642445393 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:23:57 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-16988497-6258-459a-9939-0ca27f50b6a4 tempest-GroupSnapshotsTest-1642445393 None] Creating offline snapshot e85ba23e-f928-46dd-9cec-e2fb8b04ca0a of volume b96c9232-1ded-4494-adad-ffc097d8224c {{(pid=86512) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 18:23:57 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8ee0cfb-cd5f-4d09-9fb9-3b01bc741877]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:23:57 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-16988497-6258-459a-9939-0ca27f50b6a4 tempest-GroupSnapshotsTest-1642445393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-b96c9232-1ded-4494-adad-ffc097d8224c {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:23:57 devstack sudo[94618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-b96c9232-1ded-4494-adad-ffc097d8224c Sep 29 18:23:57 devstack sudo[94618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:23:57 devstack sudo[94618]: pam_unix(sudo:session): session closed for user root Sep 29 18:23:57 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-16988497-6258-459a-9939-0ca27f50b6a4 tempest-GroupSnapshotsTest-1642445393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-b96c9232-1ded-4494-adad-ffc097d8224c" returned: 0 in 0.690s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:23:57 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-16988497-6258-459a-9939-0ca27f50b6a4 tempest-GroupSnapshotsTest-1642445393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-b96c9232-1ded-4494-adad-ffc097d8224c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-b96c9232-1ded-4494-adad-ffc097d8224c.e85ba23e-f928-46dd-9cec-e2fb8b04ca0a 1G {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:23:58 devstack sudo[94656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-b96c9232-1ded-4494-adad-ffc097d8224c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-b96c9232-1ded-4494-adad-ffc097d8224c.e85ba23e-f928-46dd-9cec-e2fb8b04ca0a 1G Sep 29 18:23:58 devstack sudo[94656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:23:58 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-4282e3e2-e44b-4cf0-bf44-393724e30e50 tempest-AttachVolumeTestJSON-875799601 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86512) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:23:58 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-4282e3e2-e44b-4cf0-bf44-393724e30e50 tempest-AttachVolumeTestJSON-875799601 None] Flow 'volume_create_manager' (b155222d-68ec-4ec8-b78c-04a75ba008be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:23:58 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-4282e3e2-e44b-4cf0-bf44-393724e30e50 tempest-AttachVolumeTestJSON-875799601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d536ee0e-9709-47af-bb2e-e6d05dea08ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:23:58 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-4282e3e2-e44b-4cf0-bf44-393724e30e50 tempest-AttachVolumeTestJSON-875799601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d536ee0e-9709-47af-bb2e-e6d05dea08ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:23:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1133641930',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52dcbae9-a4bd-47d5-88ec-6e8087eaa43e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b263a1a0df4e482bba35f19d1bcae263',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:23:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:23:59Z,use_quota=True,user_id='32b44341b3334766ac9ff95448accea5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:23:58 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-4282e3e2-e44b-4cf0-bf44-393724e30e50 tempest-AttachVolumeTestJSON-875799601 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (758026a6-19b5-476b-b00f-0c7bb1a10648) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:23:58 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-4282e3e2-e44b-4cf0-bf44-393724e30e50 tempest-AttachVolumeTestJSON-875799601 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (758026a6-19b5-476b-b00f-0c7bb1a10648) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:23:58 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-4282e3e2-e44b-4cf0-bf44-393724e30e50 tempest-AttachVolumeTestJSON-875799601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b68150d-24db-459e-aafa-eef56142dd50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:23:59 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-4282e3e2-e44b-4cf0-bf44-393724e30e50 tempest-AttachVolumeTestJSON-875799601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b68150d-24db-459e-aafa-eef56142dd50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52dcbae9-a4bd-47d5-88ec-6e8087eaa43e', 'volume_name': 'volume-52dcbae9-a4bd-47d5-88ec-6e8087eaa43e', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:23:59 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-4282e3e2-e44b-4cf0-bf44-393724e30e50 tempest-AttachVolumeTestJSON-875799601 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0eeccfdc-a640-4127-8854-62ddfb4e4fd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:23:59 devstack sudo[94656]: pam_unix(sudo:session): session closed for user root Sep 29 18:23:59 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-4282e3e2-e44b-4cf0-bf44-393724e30e50 tempest-AttachVolumeTestJSON-875799601 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0eeccfdc-a640-4127-8854-62ddfb4e4fd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:23:59 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-4282e3e2-e44b-4cf0-bf44-393724e30e50 tempest-AttachVolumeTestJSON-875799601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (251271ca-886c-4dbe-9bc6-c7d4bc0036ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:23:59 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-4282e3e2-e44b-4cf0-bf44-393724e30e50 tempest-AttachVolumeTestJSON-875799601 None] Volume 52dcbae9-a4bd-47d5-88ec-6e8087eaa43e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52dcbae9-a4bd-47d5-88ec-6e8087eaa43e', 'volume_size': 1} Sep 29 18:23:59 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-4282e3e2-e44b-4cf0-bf44-393724e30e50 tempest-AttachVolumeTestJSON-875799601 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:23:59 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-16988497-6258-459a-9939-0ca27f50b6a4 tempest-GroupSnapshotsTest-1642445393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-b96c9232-1ded-4494-adad-ffc097d8224c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-b96c9232-1ded-4494-adad-ffc097d8224c.e85ba23e-f928-46dd-9cec-e2fb8b04ca0a 1G" returned: 0 in 1.074s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:23:59 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-16988497-6258-459a-9939-0ca27f50b6a4 tempest-GroupSnapshotsTest-1642445393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b96c9232-1ded-4494-adad-ffc097d8224c -F qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-b96c9232-1ded-4494-adad-ffc097d8224c.e85ba23e-f928-46dd-9cec-e2fb8b04ca0a {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:23:59 devstack sudo[94697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b96c9232-1ded-4494-adad-ffc097d8224c -F qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-b96c9232-1ded-4494-adad-ffc097d8224c.e85ba23e-f928-46dd-9cec-e2fb8b04ca0a Sep 29 18:23:59 devstack sudo[94697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:23:59 devstack sudo[94697]: pam_unix(sudo:session): session closed for user root Sep 29 18:23:59 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-16988497-6258-459a-9939-0ca27f50b6a4 tempest-GroupSnapshotsTest-1642445393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b96c9232-1ded-4494-adad-ffc097d8224c -F qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-b96c9232-1ded-4494-adad-ffc097d8224c.e85ba23e-f928-46dd-9cec-e2fb8b04ca0a" returned: 0 in 0.367s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:23:59 devstack cinder-volume[86512]: WARNING cinder.volume.drivers.remotefs [None req-16988497-6258-459a-9939-0ca27f50b6a4 tempest-GroupSnapshotsTest-1642445393 None] /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-b96c9232-1ded-4494-adad-ffc097d8224c.e85ba23e-f928-46dd-9cec-e2fb8b04ca0a is being set with open permissions: ugo+rw: NotImplementedError Sep 29 18:23:59 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-16988497-6258-459a-9939-0ca27f50b6a4 tempest-GroupSnapshotsTest-1642445393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-b96c9232-1ded-4494-adad-ffc097d8224c.e85ba23e-f928-46dd-9cec-e2fb8b04ca0a {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:23:59 devstack sudo[94717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-b96c9232-1ded-4494-adad-ffc097d8224c.e85ba23e-f928-46dd-9cec-e2fb8b04ca0a Sep 29 18:23:59 devstack sudo[94717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:23:59 devstack sudo[94717]: pam_unix(sudo:session): session closed for user root Sep 29 18:23:59 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-16988497-6258-459a-9939-0ca27f50b6a4 tempest-GroupSnapshotsTest-1642445393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-b96c9232-1ded-4494-adad-ffc097d8224c.e85ba23e-f928-46dd-9cec-e2fb8b04ca0a" returned: 0 in 0.299s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:23:59 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-16988497-6258-459a-9939-0ca27f50b6a4 tempest-GroupSnapshotsTest-1642445393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-b96c9232-1ded-4494-adad-ffc097d8224c.info {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:23:59 devstack sudo[94720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-b96c9232-1ded-4494-adad-ffc097d8224c.info Sep 29 18:23:59 devstack sudo[94720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:24:00 devstack sudo[94720]: pam_unix(sudo:session): session closed for user root Sep 29 18:24:00 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-16988497-6258-459a-9939-0ca27f50b6a4 tempest-GroupSnapshotsTest-1642445393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-b96c9232-1ded-4494-adad-ffc097d8224c.info" returned: 0 in 0.296s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:24:00 devstack cinder-volume[86512]: WARNING cinder.volume.drivers.remotefs [None req-16988497-6258-459a-9939-0ca27f50b6a4 tempest-GroupSnapshotsTest-1642445393 None] /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-b96c9232-1ded-4494-adad-ffc097d8224c.info is being set with open permissions: ugo+rw: NotImplementedError Sep 29 18:24:00 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-16988497-6258-459a-9939-0ca27f50b6a4 tempest-GroupSnapshotsTest-1642445393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-b96c9232-1ded-4494-adad-ffc097d8224c.info {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:24:00 devstack sudo[94723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-b96c9232-1ded-4494-adad-ffc097d8224c.info Sep 29 18:24:00 devstack sudo[94723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:24:00 devstack sudo[94723]: pam_unix(sudo:session): session closed for user root Sep 29 18:24:00 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-16988497-6258-459a-9939-0ca27f50b6a4 tempest-GroupSnapshotsTest-1642445393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-b96c9232-1ded-4494-adad-ffc097d8224c.info" returned: 0 in 0.389s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:24:00 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-16988497-6258-459a-9939-0ca27f50b6a4 tempest-GroupSnapshotsTest-1642445393 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.321s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:24:00 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-4282e3e2-e44b-4cf0-bf44-393724e30e50 tempest-AttachVolumeTestJSON-875799601 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.448s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:24:00 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-4282e3e2-e44b-4cf0-bf44-393724e30e50 tempest-AttachVolumeTestJSON-875799601 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:23:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1133641930',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52dcbae9-a4bd-47d5-88ec-6e8087eaa43e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b263a1a0df4e482bba35f19d1bcae263',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:23:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:23:59Z,use_quota=True,user_id='32b44341b3334766ac9ff95448accea5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)}" {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:24:00 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-4282e3e2-e44b-4cf0-bf44-393724e30e50 tempest-AttachVolumeTestJSON-875799601 None] Creating volume 52dcbae9-a4bd-47d5-88ec-6e8087eaa43e {{(pid=86512) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:24:00 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-4282e3e2-e44b-4cf0-bf44-393724e30e50 tempest-AttachVolumeTestJSON-875799601 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:24:00 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-4282e3e2-e44b-4cf0-bf44-393724e30e50 tempest-AttachVolumeTestJSON-875799601 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:24:00 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-4282e3e2-e44b-4cf0-bf44-393724e30e50 tempest-AttachVolumeTestJSON-875799601 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:24:00 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-4282e3e2-e44b-4cf0-bf44-393724e30e50 tempest-AttachVolumeTestJSON-875799601 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:24:00 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-4282e3e2-e44b-4cf0-bf44-393724e30e50 tempest-AttachVolumeTestJSON-875799601 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:24:00 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-4282e3e2-e44b-4cf0-bf44-393724e30e50 tempest-AttachVolumeTestJSON-875799601 None] Selected osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 as target Quobyte volume. {{(pid=86512) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:24:00 devstack cinder-volume[86512]: INFO cinder.volume.drivers.remotefs [None req-4282e3e2-e44b-4cf0-bf44-393724e30e50 tempest-AttachVolumeTestJSON-875799601 None] casted to osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 Sep 29 18:24:00 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-4282e3e2-e44b-4cf0-bf44-393724e30e50 tempest-AttachVolumeTestJSON-875799601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-52dcbae9-a4bd-47d5-88ec-6e8087eaa43e 1073741824 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:24:00 devstack sudo[94728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-52dcbae9-a4bd-47d5-88ec-6e8087eaa43e 1073741824 Sep 29 18:24:00 devstack sudo[94728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:24:00 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-16988497-6258-459a-9939-0ca27f50b6a4 tempest-GroupSnapshotsTest-1642445393 None] group_snapshot e5764c95-2628-4854-9be8-1d52034b9f79: created successfully Sep 29 18:24:01 devstack sudo[94728]: pam_unix(sudo:session): session closed for user root Sep 29 18:24:01 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-4282e3e2-e44b-4cf0-bf44-393724e30e50 tempest-AttachVolumeTestJSON-875799601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-52dcbae9-a4bd-47d5-88ec-6e8087eaa43e 1073741824" returned: 0 in 0.752s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:24:01 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-4282e3e2-e44b-4cf0-bf44-393724e30e50 tempest-AttachVolumeTestJSON-875799601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-52dcbae9-a4bd-47d5-88ec-6e8087eaa43e {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:24:01 devstack sudo[94734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-52dcbae9-a4bd-47d5-88ec-6e8087eaa43e Sep 29 18:24:01 devstack sudo[94734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:24:01 devstack sudo[94734]: pam_unix(sudo:session): session closed for user root Sep 29 18:24:01 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-4282e3e2-e44b-4cf0-bf44-393724e30e50 tempest-AttachVolumeTestJSON-875799601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-52dcbae9-a4bd-47d5-88ec-6e8087eaa43e" returned: 0 in 0.349s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:24:01 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-4282e3e2-e44b-4cf0-bf44-393724e30e50 tempest-AttachVolumeTestJSON-875799601 None] <== create_volume: return (1167ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'} {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:24:01 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-4282e3e2-e44b-4cf0-bf44-393724e30e50 tempest-AttachVolumeTestJSON-875799601 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.174s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:24:01 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-4282e3e2-e44b-4cf0-bf44-393724e30e50 tempest-AttachVolumeTestJSON-875799601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (251271ca-886c-4dbe-9bc6-c7d4bc0036ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52dcbae9-a4bd-47d5-88ec-6e8087eaa43e', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:24:01 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-4282e3e2-e44b-4cf0-bf44-393724e30e50 tempest-AttachVolumeTestJSON-875799601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (251b86ea-5c34-4de1-8263-7b68f1d9660e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:24:01 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-4282e3e2-e44b-4cf0-bf44-393724e30e50 tempest-AttachVolumeTestJSON-875799601 None] Volume volume-52dcbae9-a4bd-47d5-88ec-6e8087eaa43e (52dcbae9-a4bd-47d5-88ec-6e8087eaa43e): created successfully Sep 29 18:24:01 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-4282e3e2-e44b-4cf0-bf44-393724e30e50 tempest-AttachVolumeTestJSON-875799601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (251b86ea-5c34-4de1-8263-7b68f1d9660e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:24:01 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-4282e3e2-e44b-4cf0-bf44-393724e30e50 tempest-AttachVolumeTestJSON-875799601 None] Flow 'volume_create_manager' (b155222d-68ec-4ec8-b78c-04a75ba008be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:24:01 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-4f4c8781-a198-42e8-b219-044369333f16 tempest-GroupSnapshotsTest-1642445393 None] group_snapshot e5764c95-2628-4854-9be8-1d52034b9f79: deleting Sep 29 18:24:01 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-4282e3e2-e44b-4cf0-bf44-393724e30e50 tempest-AttachVolumeTestJSON-875799601 None] Created volume successfully. Sep 29 18:24:01 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-4f4c8781-a198-42e8-b219-044369333f16 tempest-GroupSnapshotsTest-1642445393 None] group_snapshot e5764c95-2628-4854-9be8-1d52034b9f79: deleting {{(pid=86512) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 29 18:24:01 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-4f4c8781-a198-42e8-b219-044369333f16 tempest-GroupSnapshotsTest-1642445393 None] Acquiring lock "cinder-quobyte-b96c9232-1ded-4494-adad-ffc097d8224c" by "delete_snapshot" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:24:01 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-4f4c8781-a198-42e8-b219-044369333f16 tempest-GroupSnapshotsTest-1642445393 None] Lock "cinder-quobyte-b96c9232-1ded-4494-adad-ffc097d8224c" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:24:01 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-4f4c8781-a198-42e8-b219-044369333f16 tempest-GroupSnapshotsTest-1642445393 None] Acquiring lock "cinder-quobyte-e85ba23e-f928-46dd-9cec-e2fb8b04ca0a" by "_delete_snapshot" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:24:01 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-4f4c8781-a198-42e8-b219-044369333f16 tempest-GroupSnapshotsTest-1642445393 None] Lock "cinder-quobyte-e85ba23e-f928-46dd-9cec-e2fb8b04ca0a" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:24:01 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-4f4c8781-a198-42e8-b219-044369333f16 tempest-GroupSnapshotsTest-1642445393 None] Deleting offline snapshot e85ba23e-f928-46dd-9cec-e2fb8b04ca0a of volume b96c9232-1ded-4494-adad-ffc097d8224c {{(pid=86512) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 18:24:01 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-4f4c8781-a198-42e8-b219-044369333f16 tempest-GroupSnapshotsTest-1642445393 None] snapshot_file for this snap is: volume-b96c9232-1ded-4494-adad-ffc097d8224c.e85ba23e-f928-46dd-9cec-e2fb8b04ca0a {{(pid=86512) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 18:24:01 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c741441-b3c3-4173-aeef-e45c272c858b]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:24:01 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-4f4c8781-a198-42e8-b219-044369333f16 tempest-GroupSnapshotsTest-1642445393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-b96c9232-1ded-4494-adad-ffc097d8224c.e85ba23e-f928-46dd-9cec-e2fb8b04ca0a {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:24:02 devstack sudo[94737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-b96c9232-1ded-4494-adad-ffc097d8224c.e85ba23e-f928-46dd-9cec-e2fb8b04ca0a Sep 29 18:24:02 devstack sudo[94737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:24:02 devstack sudo[94737]: pam_unix(sudo:session): session closed for user root Sep 29 18:24:02 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-4f4c8781-a198-42e8-b219-044369333f16 tempest-GroupSnapshotsTest-1642445393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-b96c9232-1ded-4494-adad-ffc097d8224c.e85ba23e-f928-46dd-9cec-e2fb8b04ca0a" returned: 0 in 0.634s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:24:02 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-4f4c8781-a198-42e8-b219-044369333f16 tempest-GroupSnapshotsTest-1642445393 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b96c9232-1ded-4494-adad-ffc097d8224c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86512) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 18:24:02 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[424d287b-df68-4813-821a-d2889a926959]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:24:02 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-4f4c8781-a198-42e8-b219-044369333f16 tempest-GroupSnapshotsTest-1642445393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-b96c9232-1ded-4494-adad-ffc097d8224c {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:24:02 devstack sudo[94747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-b96c9232-1ded-4494-adad-ffc097d8224c Sep 29 18:24:02 devstack sudo[94747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:24:03 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [req-2257c2d5-3d50-4185-861d-9a5a88d8ac2a req-78bdf3f3-3dbc-45e0-be41-de1d549cedfa tempest-AttachVolumeTestJSON-875799601 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:24:03 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [req-2257c2d5-3d50-4185-861d-9a5a88d8ac2a req-78bdf3f3-3dbc-45e0-be41-de1d549cedfa tempest-AttachVolumeTestJSON-875799601 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.005s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:24:03 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [req-2257c2d5-3d50-4185-861d-9a5a88d8ac2a req-78bdf3f3-3dbc-45e0-be41-de1d549cedfa tempest-AttachVolumeTestJSON-875799601 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:24:03 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [req-2257c2d5-3d50-4185-861d-9a5a88d8ac2a req-78bdf3f3-3dbc-45e0-be41-de1d549cedfa tempest-AttachVolumeTestJSON-875799601 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883', 'name': 'volume-52dcbae9-a4bd-47d5-88ec-6e8087eaa43e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cc34454a-484e-4dcc-9b1f-4b303fdd465f', 'enforce_multipath': True} {{(pid=86512) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 29 18:24:03 devstack sudo[94747]: pam_unix(sudo:session): session closed for user root Sep 29 18:24:03 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-4f4c8781-a198-42e8-b219-044369333f16 tempest-GroupSnapshotsTest-1642445393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-b96c9232-1ded-4494-adad-ffc097d8224c" returned: 0 in 0.651s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:24:03 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-4f4c8781-a198-42e8-b219-044369333f16 tempest-GroupSnapshotsTest-1642445393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-b96c9232-1ded-4494-adad-ffc097d8224c.e85ba23e-f928-46dd-9cec-e2fb8b04ca0a {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:24:03 devstack sudo[94761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-b96c9232-1ded-4494-adad-ffc097d8224c.e85ba23e-f928-46dd-9cec-e2fb8b04ca0a Sep 29 18:24:03 devstack sudo[94761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:24:03 devstack cinder-volume[86512]: INFO cinder.volume.manager [req-2257c2d5-3d50-4185-861d-9a5a88d8ac2a req-78bdf3f3-3dbc-45e0-be41-de1d549cedfa tempest-AttachVolumeTestJSON-875799601 None] attachment_update completed successfully. Sep 29 18:24:04 devstack sudo[94761]: pam_unix(sudo:session): session closed for user root Sep 29 18:24:04 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-4f4c8781-a198-42e8-b219-044369333f16 tempest-GroupSnapshotsTest-1642445393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-b96c9232-1ded-4494-adad-ffc097d8224c.e85ba23e-f928-46dd-9cec-e2fb8b04ca0a" returned: 0 in 0.818s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:24:04 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-4f4c8781-a198-42e8-b219-044369333f16 tempest-GroupSnapshotsTest-1642445393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-b96c9232-1ded-4494-adad-ffc097d8224c.e85ba23e-f928-46dd-9cec-e2fb8b04ca0a {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:24:04 devstack sudo[95184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-b96c9232-1ded-4494-adad-ffc097d8224c.e85ba23e-f928-46dd-9cec-e2fb8b04ca0a Sep 29 18:24:04 devstack sudo[95184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:24:04 devstack sudo[95184]: pam_unix(sudo:session): session closed for user root Sep 29 18:24:04 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-4f4c8781-a198-42e8-b219-044369333f16 tempest-GroupSnapshotsTest-1642445393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-b96c9232-1ded-4494-adad-ffc097d8224c.e85ba23e-f928-46dd-9cec-e2fb8b04ca0a" returned: 0 in 0.551s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:24:04 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-4f4c8781-a198-42e8-b219-044369333f16 tempest-GroupSnapshotsTest-1642445393 None] Lock "cinder-quobyte-e85ba23e-f928-46dd-9cec-e2fb8b04ca0a" released by "_delete_snapshot" :: held 2.912s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:24:04 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-4f4c8781-a198-42e8-b219-044369333f16 tempest-GroupSnapshotsTest-1642445393 None] Lock "cinder-quobyte-b96c9232-1ded-4494-adad-ffc097d8224c" released by "delete_snapshot" :: held 2.952s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:24:04 devstack cinder-volume[86512]: WARNING cinder.quota [None req-4f4c8781-a198-42e8-b219-044369333f16 tempest-GroupSnapshotsTest-1642445393 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-606036385 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-606036385, it is now deprecated. Please use the default quota class for default quota. Sep 29 18:24:04 devstack cinder-volume[86512]: WARNING cinder.quota [None req-4f4c8781-a198-42e8-b219-044369333f16 tempest-GroupSnapshotsTest-1642445393 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-606036385 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-606036385, it is now deprecated. Please use the default quota class for default quota. Sep 29 18:24:04 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-4f4c8781-a198-42e8-b219-044369333f16 tempest-GroupSnapshotsTest-1642445393 None] Created reservations ['f827a85e-6a01-4cc5-9f75-593e4ca97ac8', '0d667ff4-3a2e-43a4-ad02-e21a7244d8fe', '2201a35c-572d-49f0-8499-19ca9b5f5bde', '539a7bf5-da7a-4068-85d1-0a7ddef05cbb'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:24:05 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-4f4c8781-a198-42e8-b219-044369333f16 tempest-GroupSnapshotsTest-1642445393 None] group_snapshot e5764c95-2628-4854-9be8-1d52034b9f79: deleted successfully Sep 29 18:24:05 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-388a3636-510d-413d-bf80-7465b19d3e06 tempest-GroupSnapshotsTest-1642445393 None] Acquiring lock "cinder-quobyte-b96c9232-1ded-4494-adad-ffc097d8224c" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:24:05 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-388a3636-510d-413d-bf80-7465b19d3e06 tempest-GroupSnapshotsTest-1642445393 None] Lock "cinder-quobyte-b96c9232-1ded-4494-adad-ffc097d8224c" acquired by "delete_volume" :: waited 0.031s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:24:05 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8ea6b3d-c7ae-4a6e-8612-2dc71243b7ad]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:24:05 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-388a3636-510d-413d-bf80-7465b19d3e06 tempest-GroupSnapshotsTest-1642445393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-b96c9232-1ded-4494-adad-ffc097d8224c {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:24:06 devstack sudo[95188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-b96c9232-1ded-4494-adad-ffc097d8224c Sep 29 18:24:06 devstack sudo[95188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:24:06 devstack sudo[95188]: pam_unix(sudo:session): session closed for user root Sep 29 18:24:06 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-388a3636-510d-413d-bf80-7465b19d3e06 tempest-GroupSnapshotsTest-1642445393 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-b96c9232-1ded-4494-adad-ffc097d8224c" returned: 0 in 0.595s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:24:06 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-388a3636-510d-413d-bf80-7465b19d3e06 tempest-GroupSnapshotsTest-1642445393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-b96c9232-1ded-4494-adad-ffc097d8224c {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:24:06 devstack sudo[95194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-b96c9232-1ded-4494-adad-ffc097d8224c Sep 29 18:24:06 devstack sudo[95194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:24:07 devstack sudo[95194]: pam_unix(sudo:session): session closed for user root Sep 29 18:24:07 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-388a3636-510d-413d-bf80-7465b19d3e06 tempest-GroupSnapshotsTest-1642445393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-b96c9232-1ded-4494-adad-ffc097d8224c" returned: 0 in 0.750s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:24:07 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-388a3636-510d-413d-bf80-7465b19d3e06 tempest-GroupSnapshotsTest-1642445393 None] Lock "cinder-quobyte-b96c9232-1ded-4494-adad-ffc097d8224c" released by "delete_volume" :: held 1.469s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:24:07 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a3e878a-4231-46dc-ab3f-fdf2d7cf9ea7 tempest-AttachVolumeTestJSON-875799601 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86512) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:24:07 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-9a3e878a-4231-46dc-ab3f-fdf2d7cf9ea7 tempest-AttachVolumeTestJSON-875799601 None] Flow 'volume_create_manager' (36ee43fd-c438-4ab2-ad72-aa691f1248fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:24:07 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-9a3e878a-4231-46dc-ab3f-fdf2d7cf9ea7 tempest-AttachVolumeTestJSON-875799601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70fc73bb-daac-4718-9c44-7b049ea4b06a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:24:07 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-9a3e878a-4231-46dc-ab3f-fdf2d7cf9ea7 tempest-AttachVolumeTestJSON-875799601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70fc73bb-daac-4718-9c44-7b049ea4b06a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:24:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-947343560',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef8b40bf-a133-4126-bc59-95809e46922d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b263a1a0df4e482bba35f19d1bcae263',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:24:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:24:07Z,use_quota=True,user_id='32b44341b3334766ac9ff95448accea5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:24:07 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-9a3e878a-4231-46dc-ab3f-fdf2d7cf9ea7 tempest-AttachVolumeTestJSON-875799601 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7d34f4a-b399-42ba-bf1f-a0e83c818d4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:24:07 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-9a3e878a-4231-46dc-ab3f-fdf2d7cf9ea7 tempest-AttachVolumeTestJSON-875799601 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7d34f4a-b399-42ba-bf1f-a0e83c818d4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:24:07 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-9a3e878a-4231-46dc-ab3f-fdf2d7cf9ea7 tempest-AttachVolumeTestJSON-875799601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfd96674-8ab1-48ec-b37e-6285c4818f43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:24:07 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-9a3e878a-4231-46dc-ab3f-fdf2d7cf9ea7 tempest-AttachVolumeTestJSON-875799601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfd96674-8ab1-48ec-b37e-6285c4818f43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef8b40bf-a133-4126-bc59-95809e46922d', 'volume_name': 'volume-ef8b40bf-a133-4126-bc59-95809e46922d', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:24:07 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-9a3e878a-4231-46dc-ab3f-fdf2d7cf9ea7 tempest-AttachVolumeTestJSON-875799601 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49e8b88e-a07f-45af-857f-17cabba18a4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:24:07 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-9a3e878a-4231-46dc-ab3f-fdf2d7cf9ea7 tempest-AttachVolumeTestJSON-875799601 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49e8b88e-a07f-45af-857f-17cabba18a4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:24:07 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-9a3e878a-4231-46dc-ab3f-fdf2d7cf9ea7 tempest-AttachVolumeTestJSON-875799601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18acac19-670b-4d6b-9470-719de3985f31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:24:07 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-9a3e878a-4231-46dc-ab3f-fdf2d7cf9ea7 tempest-AttachVolumeTestJSON-875799601 None] Volume ef8b40bf-a133-4126-bc59-95809e46922d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef8b40bf-a133-4126-bc59-95809e46922d', 'volume_size': 1} Sep 29 18:24:07 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-9a3e878a-4231-46dc-ab3f-fdf2d7cf9ea7 tempest-AttachVolumeTestJSON-875799601 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:24:07 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-9a3e878a-4231-46dc-ab3f-fdf2d7cf9ea7 tempest-AttachVolumeTestJSON-875799601 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:24:07 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-9a3e878a-4231-46dc-ab3f-fdf2d7cf9ea7 tempest-AttachVolumeTestJSON-875799601 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:24:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-947343560',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef8b40bf-a133-4126-bc59-95809e46922d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b263a1a0df4e482bba35f19d1bcae263',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:24:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:24:07Z,use_quota=True,user_id='32b44341b3334766ac9ff95448accea5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)}" {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:24:07 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-9a3e878a-4231-46dc-ab3f-fdf2d7cf9ea7 tempest-AttachVolumeTestJSON-875799601 None] Creating volume ef8b40bf-a133-4126-bc59-95809e46922d {{(pid=86512) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:24:07 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-9a3e878a-4231-46dc-ab3f-fdf2d7cf9ea7 tempest-AttachVolumeTestJSON-875799601 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:24:07 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-9a3e878a-4231-46dc-ab3f-fdf2d7cf9ea7 tempest-AttachVolumeTestJSON-875799601 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:24:07 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-9a3e878a-4231-46dc-ab3f-fdf2d7cf9ea7 tempest-AttachVolumeTestJSON-875799601 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:24:07 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-9a3e878a-4231-46dc-ab3f-fdf2d7cf9ea7 tempest-AttachVolumeTestJSON-875799601 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:24:07 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-9a3e878a-4231-46dc-ab3f-fdf2d7cf9ea7 tempest-AttachVolumeTestJSON-875799601 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:24:07 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-9a3e878a-4231-46dc-ab3f-fdf2d7cf9ea7 tempest-AttachVolumeTestJSON-875799601 None] Selected osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 as target Quobyte volume. {{(pid=86512) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:24:07 devstack cinder-volume[86512]: INFO cinder.volume.drivers.remotefs [None req-9a3e878a-4231-46dc-ab3f-fdf2d7cf9ea7 tempest-AttachVolumeTestJSON-875799601 None] casted to osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 Sep 29 18:24:07 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-9a3e878a-4231-46dc-ab3f-fdf2d7cf9ea7 tempest-AttachVolumeTestJSON-875799601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ef8b40bf-a133-4126-bc59-95809e46922d 1073741824 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:24:07 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-388a3636-510d-413d-bf80-7465b19d3e06 tempest-GroupSnapshotsTest-1642445393 None] Created reservations ['56c8b08b-634e-4cba-b063-21a33e393436'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:24:07 devstack sudo[95198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ef8b40bf-a133-4126-bc59-95809e46922d 1073741824 Sep 29 18:24:07 devstack sudo[95198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:24:07 devstack cinder-volume[86512]: WARNING cinder.quota [None req-388a3636-510d-413d-bf80-7465b19d3e06 tempest-GroupSnapshotsTest-1642445393 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-606036385 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-606036385, it is now deprecated. Please use the default quota class for default quota. Sep 29 18:24:07 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-388a3636-510d-413d-bf80-7465b19d3e06 tempest-GroupSnapshotsTest-1642445393 None] Created reservations ['b109a80d-6c79-4fbb-a217-d03c31ef9387', '5c58578b-dcb0-401a-b855-4565cadb28b4', '23064664-e0ba-48d6-bc16-1af66f224e4c', '4aa829c8-24f1-4db0-9ec7-c7cee5851831'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:24:07 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-388a3636-510d-413d-bf80-7465b19d3e06 tempest-GroupSnapshotsTest-1642445393 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:24:07 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-388a3636-510d-413d-bf80-7465b19d3e06 tempest-GroupSnapshotsTest-1642445393 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:24:07 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-388a3636-510d-413d-bf80-7465b19d3e06 tempest-GroupSnapshotsTest-1642445393 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:24:07 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-388a3636-510d-413d-bf80-7465b19d3e06 tempest-GroupSnapshotsTest-1642445393 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:24:07 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-388a3636-510d-413d-bf80-7465b19d3e06 tempest-GroupSnapshotsTest-1642445393 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:24:07 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-388a3636-510d-413d-bf80-7465b19d3e06 tempest-GroupSnapshotsTest-1642445393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:24:08 devstack sudo[95200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:24:08 devstack sudo[95200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:24:08 devstack sudo[95198]: pam_unix(sudo:session): session closed for user root Sep 29 18:24:08 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-9a3e878a-4231-46dc-ab3f-fdf2d7cf9ea7 tempest-AttachVolumeTestJSON-875799601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ef8b40bf-a133-4126-bc59-95809e46922d 1073741824" returned: 0 in 0.662s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:24:08 devstack cinder-volume[86512]: DEBUG dbcounter [-] [86512] Writing DB stats cinder:SELECT=117,cinder:INSERT=31,cinder:UPDATE=117,cinder:DELETE=5 {{(pid=86512) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 18:24:08 devstack cinder-volume[86512]: DEBUG dbcounter [-] [86512] Writing DB stats cinder:SELECT=124,cinder:UPDATE=128,cinder:INSERT=26,cinder:DELETE=2 {{(pid=86512) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 18:24:08 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-9a3e878a-4231-46dc-ab3f-fdf2d7cf9ea7 tempest-AttachVolumeTestJSON-875799601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ef8b40bf-a133-4126-bc59-95809e46922d {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:24:08 devstack sudo[95200]: pam_unix(sudo:session): session closed for user root Sep 29 18:24:08 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-388a3636-510d-413d-bf80-7465b19d3e06 tempest-GroupSnapshotsTest-1642445393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.400s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:24:08 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-388a3636-510d-413d-bf80-7465b19d3e06 tempest-GroupSnapshotsTest-1642445393 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:24:08 devstack sudo[95207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ef8b40bf-a133-4126-bc59-95809e46922d Sep 29 18:24:08 devstack sudo[95207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:24:08 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-388a3636-510d-413d-bf80-7465b19d3e06 tempest-GroupSnapshotsTest-1642445393 None] Delete group completed successfully. Sep 29 18:24:08 devstack sudo[95207]: pam_unix(sudo:session): session closed for user root Sep 29 18:24:08 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-9a3e878a-4231-46dc-ab3f-fdf2d7cf9ea7 tempest-AttachVolumeTestJSON-875799601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ef8b40bf-a133-4126-bc59-95809e46922d" returned: 0 in 0.315s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:24:08 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-9a3e878a-4231-46dc-ab3f-fdf2d7cf9ea7 tempest-AttachVolumeTestJSON-875799601 None] <== create_volume: return (1054ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'} {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:24:08 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-9a3e878a-4231-46dc-ab3f-fdf2d7cf9ea7 tempest-AttachVolumeTestJSON-875799601 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.058s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:24:08 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-9a3e878a-4231-46dc-ab3f-fdf2d7cf9ea7 tempest-AttachVolumeTestJSON-875799601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18acac19-670b-4d6b-9470-719de3985f31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef8b40bf-a133-4126-bc59-95809e46922d', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:24:08 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-9a3e878a-4231-46dc-ab3f-fdf2d7cf9ea7 tempest-AttachVolumeTestJSON-875799601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b51edc3-a422-4772-a125-acbd65a195b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:24:08 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-9a3e878a-4231-46dc-ab3f-fdf2d7cf9ea7 tempest-AttachVolumeTestJSON-875799601 None] Volume volume-ef8b40bf-a133-4126-bc59-95809e46922d (ef8b40bf-a133-4126-bc59-95809e46922d): created successfully Sep 29 18:24:08 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-9a3e878a-4231-46dc-ab3f-fdf2d7cf9ea7 tempest-AttachVolumeTestJSON-875799601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b51edc3-a422-4772-a125-acbd65a195b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:24:08 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-9a3e878a-4231-46dc-ab3f-fdf2d7cf9ea7 tempest-AttachVolumeTestJSON-875799601 None] Flow 'volume_create_manager' (36ee43fd-c438-4ab2-ad72-aa691f1248fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:24:08 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-9a3e878a-4231-46dc-ab3f-fdf2d7cf9ea7 tempest-AttachVolumeTestJSON-875799601 None] Created volume successfully. Sep 29 18:24:11 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [req-15801dc2-abca-48a9-89da-00ff19fed0b8 req-ee55f5cd-4e9d-47e0-b800-493e671ba419 tempest-AttachVolumeTestJSON-875799601 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:24:11 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [req-15801dc2-abca-48a9-89da-00ff19fed0b8 req-ee55f5cd-4e9d-47e0-b800-493e671ba419 tempest-AttachVolumeTestJSON-875799601 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:24:11 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [req-15801dc2-abca-48a9-89da-00ff19fed0b8 req-ee55f5cd-4e9d-47e0-b800-493e671ba419 tempest-AttachVolumeTestJSON-875799601 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:24:11 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [req-15801dc2-abca-48a9-89da-00ff19fed0b8 req-ee55f5cd-4e9d-47e0-b800-493e671ba419 tempest-AttachVolumeTestJSON-875799601 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883', 'name': 'volume-ef8b40bf-a133-4126-bc59-95809e46922d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c198331b-a030-4fb5-a744-17c05cfad914', 'enforce_multipath': True} {{(pid=86512) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 29 18:24:11 devstack cinder-volume[86512]: INFO cinder.volume.manager [req-15801dc2-abca-48a9-89da-00ff19fed0b8 req-ee55f5cd-4e9d-47e0-b800-493e671ba419 tempest-AttachVolumeTestJSON-875799601 None] attachment_update completed successfully. Sep 29 18:24:14 devstack cinder-volume[86512]: INFO cinder.volume.manager [req-1aec5844-e478-4f36-b35b-4853220388d9 req-2663c08d-23a6-48ad-b604-b4f7504b6b08 tempest-AttachVolumeTestJSON-875799601 None] Terminate volume connection completed successfully. Sep 29 18:24:14 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [req-1aec5844-e478-4f36-b35b-4853220388d9 req-2663c08d-23a6-48ad-b604-b4f7504b6b08 tempest-AttachVolumeTestJSON-875799601 None] Deleting attachment cc34454a-484e-4dcc-9b1f-4b303fdd465f. {{(pid=86512) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 29 18:24:16 devstack cinder-volume[86512]: INFO cinder.volume.manager [req-98d25d56-845e-46a1-8351-20672bc774d9 req-3b85486f-f5f3-4b49-aa4e-10023638a2e4 tempest-AttachVolumeTestJSON-875799601 None] Terminate volume connection completed successfully. Sep 29 18:24:16 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [req-98d25d56-845e-46a1-8351-20672bc774d9 req-3b85486f-f5f3-4b49-aa4e-10023638a2e4 tempest-AttachVolumeTestJSON-875799601 None] Deleting attachment c198331b-a030-4fb5-a744-17c05cfad914. {{(pid=86512) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 29 18:24:17 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-d1da9b7c-6364-4d68-8b46-23f5af094819 tempest-GroupSnapshotsV319Test-1820805182 None] Group tempest-GroupSnapshotsV319Test-Group-2052947853: creating Sep 29 18:24:17 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-d1da9b7c-6364-4d68-8b46-23f5af094819 tempest-GroupSnapshotsV319Test-1820805182 None] Group tempest-GroupSnapshotsV319Test-Group-2052947853: created successfully Sep 29 18:24:17 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-d1da9b7c-6364-4d68-8b46-23f5af094819 tempest-GroupSnapshotsV319Test-1820805182 None] Create group completed successfully. Sep 29 18:24:19 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-d72f5250-2e40-4db3-aff4-e03909c09448 tempest-GroupSnapshotsV319Test-1820805182 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86512) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:24:19 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d72f5250-2e40-4db3-aff4-e03909c09448 tempest-GroupSnapshotsV319Test-1820805182 None] Flow 'volume_create_manager' (9617609a-0ae9-4ec0-ac58-a290f4a246a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:24:19 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d72f5250-2e40-4db3-aff4-e03909c09448 tempest-GroupSnapshotsV319Test-1820805182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd6f0e15-f305-4ab6-b0f9-b21655d78a37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:24:19 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d72f5250-2e40-4db3-aff4-e03909c09448 tempest-GroupSnapshotsV319Test-1820805182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd6f0e15-f305-4ab6-b0f9-b21655d78a37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:24:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1552753509',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=600de023-2316-4761-8514-7742c1d60172,host='devstack@QuobyteHD#QuobyteHD',id=aa9562cc-e80d-4bf1-bfda-7fc4124cbbf9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='443a7faeabea41cf8ad18e9be560f69a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:24:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:24:19Z,use_quota=True,user_id='58e42433cdef47bfa62cafed9b41db79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d906a475-855a-4fdd-aa57-e067f38334e4),volume_type_id=d906a475-855a-4fdd-aa57-e067f38334e4)' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:24:19 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d72f5250-2e40-4db3-aff4-e03909c09448 tempest-GroupSnapshotsV319Test-1820805182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3421c63b-2fe5-457f-bd18-9c25641bf3ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:24:19 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d72f5250-2e40-4db3-aff4-e03909c09448 tempest-GroupSnapshotsV319Test-1820805182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3421c63b-2fe5-457f-bd18-9c25641bf3ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:24:19 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d72f5250-2e40-4db3-aff4-e03909c09448 tempest-GroupSnapshotsV319Test-1820805182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f43dbdfd-d9ee-4182-b962-fc8cccdf903a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:24:19 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d72f5250-2e40-4db3-aff4-e03909c09448 tempest-GroupSnapshotsV319Test-1820805182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f43dbdfd-d9ee-4182-b962-fc8cccdf903a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa9562cc-e80d-4bf1-bfda-7fc4124cbbf9', 'volume_name': 'volume-aa9562cc-e80d-4bf1-bfda-7fc4124cbbf9', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:24:19 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d72f5250-2e40-4db3-aff4-e03909c09448 tempest-GroupSnapshotsV319Test-1820805182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f80d7a0-0039-465f-a37b-adf617d4fefc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:24:19 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d72f5250-2e40-4db3-aff4-e03909c09448 tempest-GroupSnapshotsV319Test-1820805182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f80d7a0-0039-465f-a37b-adf617d4fefc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:24:19 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d72f5250-2e40-4db3-aff4-e03909c09448 tempest-GroupSnapshotsV319Test-1820805182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a332a91-7d21-4571-8ee0-d98c84a742d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:24:19 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-d72f5250-2e40-4db3-aff4-e03909c09448 tempest-GroupSnapshotsV319Test-1820805182 None] Volume aa9562cc-e80d-4bf1-bfda-7fc4124cbbf9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa9562cc-e80d-4bf1-bfda-7fc4124cbbf9', 'volume_size': 1} Sep 29 18:24:19 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-d72f5250-2e40-4db3-aff4-e03909c09448 tempest-GroupSnapshotsV319Test-1820805182 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:24:19 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-d72f5250-2e40-4db3-aff4-e03909c09448 tempest-GroupSnapshotsV319Test-1820805182 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:24:19 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-d72f5250-2e40-4db3-aff4-e03909c09448 tempest-GroupSnapshotsV319Test-1820805182 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=600de023-2316-4761-8514-7742c1d60172,created_at=2026-09-29T16:24:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1552753509',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=600de023-2316-4761-8514-7742c1d60172,host='devstack@QuobyteHD#QuobyteHD',id=aa9562cc-e80d-4bf1-bfda-7fc4124cbbf9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='443a7faeabea41cf8ad18e9be560f69a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:24:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:24:19Z,use_quota=True,user_id='58e42433cdef47bfa62cafed9b41db79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d906a475-855a-4fdd-aa57-e067f38334e4),volume_type_id=d906a475-855a-4fdd-aa57-e067f38334e4)}" {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:24:19 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-d72f5250-2e40-4db3-aff4-e03909c09448 tempest-GroupSnapshotsV319Test-1820805182 None] Creating volume aa9562cc-e80d-4bf1-bfda-7fc4124cbbf9 {{(pid=86512) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:24:19 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-d72f5250-2e40-4db3-aff4-e03909c09448 tempest-GroupSnapshotsV319Test-1820805182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:24:19 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-d72f5250-2e40-4db3-aff4-e03909c09448 tempest-GroupSnapshotsV319Test-1820805182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:24:19 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-d72f5250-2e40-4db3-aff4-e03909c09448 tempest-GroupSnapshotsV319Test-1820805182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:24:19 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-d72f5250-2e40-4db3-aff4-e03909c09448 tempest-GroupSnapshotsV319Test-1820805182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:24:19 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-d72f5250-2e40-4db3-aff4-e03909c09448 tempest-GroupSnapshotsV319Test-1820805182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:24:19 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-d72f5250-2e40-4db3-aff4-e03909c09448 tempest-GroupSnapshotsV319Test-1820805182 None] Selected osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 as target Quobyte volume. {{(pid=86512) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:24:19 devstack cinder-volume[86512]: INFO cinder.volume.drivers.remotefs [None req-d72f5250-2e40-4db3-aff4-e03909c09448 tempest-GroupSnapshotsV319Test-1820805182 None] casted to osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 Sep 29 18:24:19 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-d72f5250-2e40-4db3-aff4-e03909c09448 tempest-GroupSnapshotsV319Test-1820805182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-aa9562cc-e80d-4bf1-bfda-7fc4124cbbf9 1073741824 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:24:19 devstack sudo[95310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-aa9562cc-e80d-4bf1-bfda-7fc4124cbbf9 1073741824 Sep 29 18:24:19 devstack sudo[95310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:24:20 devstack sudo[95310]: pam_unix(sudo:session): session closed for user root Sep 29 18:24:20 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-d72f5250-2e40-4db3-aff4-e03909c09448 tempest-GroupSnapshotsV319Test-1820805182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-aa9562cc-e80d-4bf1-bfda-7fc4124cbbf9 1073741824" returned: 0 in 0.775s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:24:20 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-d72f5250-2e40-4db3-aff4-e03909c09448 tempest-GroupSnapshotsV319Test-1820805182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-aa9562cc-e80d-4bf1-bfda-7fc4124cbbf9 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:24:20 devstack sudo[95317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-aa9562cc-e80d-4bf1-bfda-7fc4124cbbf9 Sep 29 18:24:20 devstack sudo[95317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:24:20 devstack sudo[95317]: pam_unix(sudo:session): session closed for user root Sep 29 18:24:20 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-d72f5250-2e40-4db3-aff4-e03909c09448 tempest-GroupSnapshotsV319Test-1820805182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-aa9562cc-e80d-4bf1-bfda-7fc4124cbbf9" returned: 0 in 0.455s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:24:20 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-d72f5250-2e40-4db3-aff4-e03909c09448 tempest-GroupSnapshotsV319Test-1820805182 None] <== create_volume: return (1311ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'} {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:24:20 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-d72f5250-2e40-4db3-aff4-e03909c09448 tempest-GroupSnapshotsV319Test-1820805182 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.315s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:24:20 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d72f5250-2e40-4db3-aff4-e03909c09448 tempest-GroupSnapshotsV319Test-1820805182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a332a91-7d21-4571-8ee0-d98c84a742d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa9562cc-e80d-4bf1-bfda-7fc4124cbbf9', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:24:20 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d72f5250-2e40-4db3-aff4-e03909c09448 tempest-GroupSnapshotsV319Test-1820805182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdd11c28-9ada-4cd7-a2b9-77902cf16e54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:24:20 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-d72f5250-2e40-4db3-aff4-e03909c09448 tempest-GroupSnapshotsV319Test-1820805182 None] Volume volume-aa9562cc-e80d-4bf1-bfda-7fc4124cbbf9 (aa9562cc-e80d-4bf1-bfda-7fc4124cbbf9): created successfully Sep 29 18:24:20 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d72f5250-2e40-4db3-aff4-e03909c09448 tempest-GroupSnapshotsV319Test-1820805182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdd11c28-9ada-4cd7-a2b9-77902cf16e54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:24:20 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d72f5250-2e40-4db3-aff4-e03909c09448 tempest-GroupSnapshotsV319Test-1820805182 None] Flow 'volume_create_manager' (9617609a-0ae9-4ec0-ac58-a290f4a246a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:24:20 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-d72f5250-2e40-4db3-aff4-e03909c09448 tempest-GroupSnapshotsV319Test-1820805182 None] Created volume successfully. Sep 29 18:24:21 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-a84dc016-2045-443c-b97a-9f5ca9a34fbd tempest-AttachVolumeTestJSON-875799601 None] Acquiring lock "cinder-ef8b40bf-a133-4126-bc59-95809e46922d-delete_volume" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:24:21 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-a84dc016-2045-443c-b97a-9f5ca9a34fbd tempest-AttachVolumeTestJSON-875799601 None] Lock "cinder-ef8b40bf-a133-4126-bc59-95809e46922d-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:24:21 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-a84dc016-2045-443c-b97a-9f5ca9a34fbd tempest-AttachVolumeTestJSON-875799601 None] Acquiring lock "cinder-quobyte-ef8b40bf-a133-4126-bc59-95809e46922d" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:24:21 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-a84dc016-2045-443c-b97a-9f5ca9a34fbd tempest-AttachVolumeTestJSON-875799601 None] Lock "cinder-quobyte-ef8b40bf-a133-4126-bc59-95809e46922d" acquired by "delete_volume" :: waited 0.041s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:24:21 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c0b568b-1055-4914-a89b-a10f27fe7585]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:24:21 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a84dc016-2045-443c-b97a-9f5ca9a34fbd tempest-AttachVolumeTestJSON-875799601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ef8b40bf-a133-4126-bc59-95809e46922d {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:24:22 devstack sudo[95325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ef8b40bf-a133-4126-bc59-95809e46922d Sep 29 18:24:22 devstack sudo[95325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:24:22 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-a05223cf-3e2e-4442-826c-c9a5009d4a9d tempest-GroupSnapshotsV319Test-1820805182 None] GroupSnapshot bdb49c5a-eb8f-4d0b-822b-56f594a657d2: creating. Sep 29 18:24:22 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-a05223cf-3e2e-4442-826c-c9a5009d4a9d tempest-GroupSnapshotsV319Test-1820805182 None] Group snapshot bdb49c5a-eb8f-4d0b-822b-56f594a657d2: creating. {{(pid=86512) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 29 18:24:22 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-a05223cf-3e2e-4442-826c-c9a5009d4a9d tempest-GroupSnapshotsV319Test-1820805182 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:24:22 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-a05223cf-3e2e-4442-826c-c9a5009d4a9d tempest-GroupSnapshotsV319Test-1820805182 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:24:22 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-a05223cf-3e2e-4442-826c-c9a5009d4a9d tempest-GroupSnapshotsV319Test-1820805182 None] Creating offline snapshot add5ad85-dcf2-4c98-9b61-0487c0ab5e4a of volume aa9562cc-e80d-4bf1-bfda-7fc4124cbbf9 {{(pid=86512) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 18:24:22 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[fef6b1fe-5b59-4a00-aa2b-64676b27b1fd]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:24:22 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a05223cf-3e2e-4442-826c-c9a5009d4a9d tempest-GroupSnapshotsV319Test-1820805182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-aa9562cc-e80d-4bf1-bfda-7fc4124cbbf9 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:24:22 devstack sudo[95327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-aa9562cc-e80d-4bf1-bfda-7fc4124cbbf9 Sep 29 18:24:22 devstack sudo[95327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:24:22 devstack sudo[95325]: pam_unix(sudo:session): session closed for user root Sep 29 18:24:22 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a84dc016-2045-443c-b97a-9f5ca9a34fbd tempest-AttachVolumeTestJSON-875799601 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ef8b40bf-a133-4126-bc59-95809e46922d" returned: 0 in 0.545s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:24:22 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a84dc016-2045-443c-b97a-9f5ca9a34fbd tempest-AttachVolumeTestJSON-875799601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ef8b40bf-a133-4126-bc59-95809e46922d {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:24:22 devstack sudo[95336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ef8b40bf-a133-4126-bc59-95809e46922d Sep 29 18:24:22 devstack sudo[95336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:24:22 devstack sudo[95327]: pam_unix(sudo:session): session closed for user root Sep 29 18:24:22 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a05223cf-3e2e-4442-826c-c9a5009d4a9d tempest-GroupSnapshotsV319Test-1820805182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-aa9562cc-e80d-4bf1-bfda-7fc4124cbbf9" returned: 0 in 0.487s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:24:22 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a05223cf-3e2e-4442-826c-c9a5009d4a9d tempest-GroupSnapshotsV319Test-1820805182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-aa9562cc-e80d-4bf1-bfda-7fc4124cbbf9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-aa9562cc-e80d-4bf1-bfda-7fc4124cbbf9.add5ad85-dcf2-4c98-9b61-0487c0ab5e4a 1G {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:24:22 devstack sudo[95345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-aa9562cc-e80d-4bf1-bfda-7fc4124cbbf9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-aa9562cc-e80d-4bf1-bfda-7fc4124cbbf9.add5ad85-dcf2-4c98-9b61-0487c0ab5e4a 1G Sep 29 18:24:22 devstack sudo[95345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:24:22 devstack sudo[95336]: pam_unix(sudo:session): session closed for user root Sep 29 18:24:22 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a84dc016-2045-443c-b97a-9f5ca9a34fbd tempest-AttachVolumeTestJSON-875799601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ef8b40bf-a133-4126-bc59-95809e46922d" returned: 0 in 0.322s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:24:22 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-a84dc016-2045-443c-b97a-9f5ca9a34fbd tempest-AttachVolumeTestJSON-875799601 None] Lock "cinder-quobyte-ef8b40bf-a133-4126-bc59-95809e46922d" released by "delete_volume" :: held 0.951s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:24:22 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-a84dc016-2045-443c-b97a-9f5ca9a34fbd tempest-AttachVolumeTestJSON-875799601 None] Created reservations ['72619f1d-a17d-47aa-b4e3-c615b7b0c6ee', '68af785d-0378-4fe0-a62d-d173cc2c1f3f', 'c2ce5598-ae29-473d-9355-7228da38ed2c', '3d313497-60dd-4d20-9d0b-30872b5b3e09'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:24:22 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-a84dc016-2045-443c-b97a-9f5ca9a34fbd tempest-AttachVolumeTestJSON-875799601 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:24:22 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-a84dc016-2045-443c-b97a-9f5ca9a34fbd tempest-AttachVolumeTestJSON-875799601 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:24:22 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-a84dc016-2045-443c-b97a-9f5ca9a34fbd tempest-AttachVolumeTestJSON-875799601 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:24:22 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-a84dc016-2045-443c-b97a-9f5ca9a34fbd tempest-AttachVolumeTestJSON-875799601 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:24:22 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-a84dc016-2045-443c-b97a-9f5ca9a34fbd tempest-AttachVolumeTestJSON-875799601 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.038s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:24:23 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a84dc016-2045-443c-b97a-9f5ca9a34fbd tempest-AttachVolumeTestJSON-875799601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:24:23 devstack sudo[95355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:24:23 devstack sudo[95355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:24:23 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-bd0f9617-5292-479c-99a8-14ac83248dd9 tempest-AttachVolumeTestJSON-875799601 None] Acquiring lock "cinder-52dcbae9-a4bd-47d5-88ec-6e8087eaa43e-delete_volume" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:24:23 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-bd0f9617-5292-479c-99a8-14ac83248dd9 tempest-AttachVolumeTestJSON-875799601 None] Lock "cinder-52dcbae9-a4bd-47d5-88ec-6e8087eaa43e-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:24:23 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-bd0f9617-5292-479c-99a8-14ac83248dd9 tempest-AttachVolumeTestJSON-875799601 None] Acquiring lock "cinder-quobyte-52dcbae9-a4bd-47d5-88ec-6e8087eaa43e" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:24:23 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-bd0f9617-5292-479c-99a8-14ac83248dd9 tempest-AttachVolumeTestJSON-875799601 None] Lock "cinder-quobyte-52dcbae9-a4bd-47d5-88ec-6e8087eaa43e" acquired by "delete_volume" :: waited 0.018s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:24:23 devstack sudo[95345]: pam_unix(sudo:session): session closed for user root Sep 29 18:24:23 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1894c90-3351-42c9-9b7b-84d0faefe13a]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:24:23 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-bd0f9617-5292-479c-99a8-14ac83248dd9 tempest-AttachVolumeTestJSON-875799601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-52dcbae9-a4bd-47d5-88ec-6e8087eaa43e {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:24:23 devstack sudo[95355]: pam_unix(sudo:session): session closed for user root Sep 29 18:24:23 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a05223cf-3e2e-4442-826c-c9a5009d4a9d tempest-GroupSnapshotsV319Test-1820805182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-aa9562cc-e80d-4bf1-bfda-7fc4124cbbf9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-aa9562cc-e80d-4bf1-bfda-7fc4124cbbf9.add5ad85-dcf2-4c98-9b61-0487c0ab5e4a 1G" returned: 0 in 0.730s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:24:23 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a84dc016-2045-443c-b97a-9f5ca9a34fbd tempest-AttachVolumeTestJSON-875799601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.428s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:24:23 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a05223cf-3e2e-4442-826c-c9a5009d4a9d tempest-GroupSnapshotsV319Test-1820805182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa9562cc-e80d-4bf1-bfda-7fc4124cbbf9 -F qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-aa9562cc-e80d-4bf1-bfda-7fc4124cbbf9.add5ad85-dcf2-4c98-9b61-0487c0ab5e4a {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:24:23 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-a84dc016-2045-443c-b97a-9f5ca9a34fbd tempest-AttachVolumeTestJSON-875799601 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:24:23 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-a84dc016-2045-443c-b97a-9f5ca9a34fbd tempest-AttachVolumeTestJSON-875799601 None] Deleted volume successfully. Sep 29 18:24:23 devstack sudo[95368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa9562cc-e80d-4bf1-bfda-7fc4124cbbf9 -F qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-aa9562cc-e80d-4bf1-bfda-7fc4124cbbf9.add5ad85-dcf2-4c98-9b61-0487c0ab5e4a Sep 29 18:24:23 devstack sudo[95368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:24:23 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-a84dc016-2045-443c-b97a-9f5ca9a34fbd tempest-AttachVolumeTestJSON-875799601 None] Lock "cinder-ef8b40bf-a133-4126-bc59-95809e46922d-delete_volume" released by "delete_volume" :: held 1.725s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:24:23 devstack sudo[95367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-52dcbae9-a4bd-47d5-88ec-6e8087eaa43e Sep 29 18:24:23 devstack sudo[95367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:24:23 devstack sudo[95368]: pam_unix(sudo:session): session closed for user root Sep 29 18:24:23 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a05223cf-3e2e-4442-826c-c9a5009d4a9d tempest-GroupSnapshotsV319Test-1820805182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa9562cc-e80d-4bf1-bfda-7fc4124cbbf9 -F qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-aa9562cc-e80d-4bf1-bfda-7fc4124cbbf9.add5ad85-dcf2-4c98-9b61-0487c0ab5e4a" returned: 0 in 0.367s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:24:23 devstack cinder-volume[86512]: WARNING cinder.volume.drivers.remotefs [None req-a05223cf-3e2e-4442-826c-c9a5009d4a9d tempest-GroupSnapshotsV319Test-1820805182 None] /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-aa9562cc-e80d-4bf1-bfda-7fc4124cbbf9.add5ad85-dcf2-4c98-9b61-0487c0ab5e4a is being set with open permissions: ugo+rw: NotImplementedError Sep 29 18:24:23 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a05223cf-3e2e-4442-826c-c9a5009d4a9d tempest-GroupSnapshotsV319Test-1820805182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-aa9562cc-e80d-4bf1-bfda-7fc4124cbbf9.add5ad85-dcf2-4c98-9b61-0487c0ab5e4a {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:24:23 devstack sudo[95379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-aa9562cc-e80d-4bf1-bfda-7fc4124cbbf9.add5ad85-dcf2-4c98-9b61-0487c0ab5e4a Sep 29 18:24:23 devstack sudo[95379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:24:23 devstack sudo[95367]: pam_unix(sudo:session): session closed for user root Sep 29 18:24:23 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-bd0f9617-5292-479c-99a8-14ac83248dd9 tempest-AttachVolumeTestJSON-875799601 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-52dcbae9-a4bd-47d5-88ec-6e8087eaa43e" returned: 0 in 0.425s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:24:23 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-bd0f9617-5292-479c-99a8-14ac83248dd9 tempest-AttachVolumeTestJSON-875799601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-52dcbae9-a4bd-47d5-88ec-6e8087eaa43e {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:24:23 devstack sudo[95381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-52dcbae9-a4bd-47d5-88ec-6e8087eaa43e Sep 29 18:24:23 devstack sudo[95381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:24:24 devstack sudo[95379]: pam_unix(sudo:session): session closed for user root Sep 29 18:24:24 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a05223cf-3e2e-4442-826c-c9a5009d4a9d tempest-GroupSnapshotsV319Test-1820805182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-aa9562cc-e80d-4bf1-bfda-7fc4124cbbf9.add5ad85-dcf2-4c98-9b61-0487c0ab5e4a" returned: 0 in 0.260s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:24:24 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a05223cf-3e2e-4442-826c-c9a5009d4a9d tempest-GroupSnapshotsV319Test-1820805182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-aa9562cc-e80d-4bf1-bfda-7fc4124cbbf9.info {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:24:24 devstack sudo[95387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-aa9562cc-e80d-4bf1-bfda-7fc4124cbbf9.info Sep 29 18:24:24 devstack sudo[95387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:24:24 devstack sudo[95381]: pam_unix(sudo:session): session closed for user root Sep 29 18:24:24 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-bd0f9617-5292-479c-99a8-14ac83248dd9 tempest-AttachVolumeTestJSON-875799601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-52dcbae9-a4bd-47d5-88ec-6e8087eaa43e" returned: 0 in 0.290s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:24:24 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-bd0f9617-5292-479c-99a8-14ac83248dd9 tempest-AttachVolumeTestJSON-875799601 None] Lock "cinder-quobyte-52dcbae9-a4bd-47d5-88ec-6e8087eaa43e" released by "delete_volume" :: held 0.789s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:24:24 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-bd0f9617-5292-479c-99a8-14ac83248dd9 tempest-AttachVolumeTestJSON-875799601 None] Created reservations ['397b0b0e-a28c-454e-a241-815a74478b0b', 'c0691c82-b89b-4ce8-9fa7-a8a563265ccc', 'e5b0997d-e4b3-46cf-891e-e516a0ea48e1', 'a92b0953-7b31-464d-82d2-bb05271e1967'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:24:24 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-bd0f9617-5292-479c-99a8-14ac83248dd9 tempest-AttachVolumeTestJSON-875799601 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:24:24 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-bd0f9617-5292-479c-99a8-14ac83248dd9 tempest-AttachVolumeTestJSON-875799601 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:24:24 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-bd0f9617-5292-479c-99a8-14ac83248dd9 tempest-AttachVolumeTestJSON-875799601 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:24:24 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-bd0f9617-5292-479c-99a8-14ac83248dd9 tempest-AttachVolumeTestJSON-875799601 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:24:24 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-bd0f9617-5292-479c-99a8-14ac83248dd9 tempest-AttachVolumeTestJSON-875799601 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:24:24 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-bd0f9617-5292-479c-99a8-14ac83248dd9 tempest-AttachVolumeTestJSON-875799601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:24:24 devstack sudo[95390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:24:24 devstack sudo[95390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:24:24 devstack sudo[95387]: pam_unix(sudo:session): session closed for user root Sep 29 18:24:24 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a05223cf-3e2e-4442-826c-c9a5009d4a9d tempest-GroupSnapshotsV319Test-1820805182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-aa9562cc-e80d-4bf1-bfda-7fc4124cbbf9.info" returned: 0 in 0.285s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:24:24 devstack cinder-volume[86512]: WARNING cinder.volume.drivers.remotefs [None req-a05223cf-3e2e-4442-826c-c9a5009d4a9d tempest-GroupSnapshotsV319Test-1820805182 None] /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-aa9562cc-e80d-4bf1-bfda-7fc4124cbbf9.info is being set with open permissions: ugo+rw: NotImplementedError Sep 29 18:24:24 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a05223cf-3e2e-4442-826c-c9a5009d4a9d tempest-GroupSnapshotsV319Test-1820805182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-aa9562cc-e80d-4bf1-bfda-7fc4124cbbf9.info {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:24:24 devstack sudo[95392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-aa9562cc-e80d-4bf1-bfda-7fc4124cbbf9.info Sep 29 18:24:24 devstack sudo[95392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:24:24 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-60a47e56-2715-401d-a98f-5ecfc44eef6c tempest-AttachVolumeTestJSON-875799601 None] Acquiring lock "cinder-553aaf84-f9f1-46ef-a326-801fd69da8ba-delete_volume" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:24:24 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-60a47e56-2715-401d-a98f-5ecfc44eef6c tempest-AttachVolumeTestJSON-875799601 None] Lock "cinder-553aaf84-f9f1-46ef-a326-801fd69da8ba-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:24:24 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-60a47e56-2715-401d-a98f-5ecfc44eef6c tempest-AttachVolumeTestJSON-875799601 None] Acquiring lock "cinder-quobyte-553aaf84-f9f1-46ef-a326-801fd69da8ba" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:24:24 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-60a47e56-2715-401d-a98f-5ecfc44eef6c tempest-AttachVolumeTestJSON-875799601 None] Lock "cinder-quobyte-553aaf84-f9f1-46ef-a326-801fd69da8ba" acquired by "delete_volume" :: waited 0.032s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:24:24 devstack sudo[95390]: pam_unix(sudo:session): session closed for user root Sep 29 18:24:24 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-bd0f9617-5292-479c-99a8-14ac83248dd9 tempest-AttachVolumeTestJSON-875799601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.414s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:24:24 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-bd0f9617-5292-479c-99a8-14ac83248dd9 tempest-AttachVolumeTestJSON-875799601 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:24:24 devstack sudo[95392]: pam_unix(sudo:session): session closed for user root Sep 29 18:24:24 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-bd0f9617-5292-479c-99a8-14ac83248dd9 tempest-AttachVolumeTestJSON-875799601 None] Deleted volume successfully. Sep 29 18:24:24 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a05223cf-3e2e-4442-826c-c9a5009d4a9d tempest-GroupSnapshotsV319Test-1820805182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-aa9562cc-e80d-4bf1-bfda-7fc4124cbbf9.info" returned: 0 in 0.358s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:24:24 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-a05223cf-3e2e-4442-826c-c9a5009d4a9d tempest-GroupSnapshotsV319Test-1820805182 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.600s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:24:24 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[54c46a23-954a-493e-94af-9409e10aeac6]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:24:24 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-60a47e56-2715-401d-a98f-5ecfc44eef6c tempest-AttachVolumeTestJSON-875799601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-553aaf84-f9f1-46ef-a326-801fd69da8ba {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:24:24 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-bd0f9617-5292-479c-99a8-14ac83248dd9 tempest-AttachVolumeTestJSON-875799601 None] Lock "cinder-52dcbae9-a4bd-47d5-88ec-6e8087eaa43e-delete_volume" released by "delete_volume" :: held 1.611s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:24:24 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-a05223cf-3e2e-4442-826c-c9a5009d4a9d tempest-GroupSnapshotsV319Test-1820805182 None] group_snapshot bdb49c5a-eb8f-4d0b-822b-56f594a657d2: created successfully Sep 29 18:24:24 devstack sudo[95397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-553aaf84-f9f1-46ef-a326-801fd69da8ba Sep 29 18:24:24 devstack sudo[95397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:24:25 devstack sudo[95397]: pam_unix(sudo:session): session closed for user root Sep 29 18:24:25 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-60a47e56-2715-401d-a98f-5ecfc44eef6c tempest-AttachVolumeTestJSON-875799601 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-553aaf84-f9f1-46ef-a326-801fd69da8ba" returned: 0 in 0.435s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:24:25 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-60a47e56-2715-401d-a98f-5ecfc44eef6c tempest-AttachVolumeTestJSON-875799601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-553aaf84-f9f1-46ef-a326-801fd69da8ba {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:24:25 devstack sudo[95402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-553aaf84-f9f1-46ef-a326-801fd69da8ba Sep 29 18:24:25 devstack sudo[95402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:24:25 devstack sudo[95402]: pam_unix(sudo:session): session closed for user root Sep 29 18:24:25 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-60a47e56-2715-401d-a98f-5ecfc44eef6c tempest-AttachVolumeTestJSON-875799601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-553aaf84-f9f1-46ef-a326-801fd69da8ba" returned: 0 in 0.408s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:24:25 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-60a47e56-2715-401d-a98f-5ecfc44eef6c tempest-AttachVolumeTestJSON-875799601 None] Lock "cinder-quobyte-553aaf84-f9f1-46ef-a326-801fd69da8ba" released by "delete_volume" :: held 0.952s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:24:25 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-60a47e56-2715-401d-a98f-5ecfc44eef6c tempest-AttachVolumeTestJSON-875799601 None] Created reservations ['41a8886e-7d6d-42e9-837e-6f107eda1745', '21873045-7648-424f-9508-b92559fd96a2', 'ebe39412-3d5c-4b4e-8f28-54e2f40ce3fd', 'e1ec2968-88a4-48d3-af25-550b9767bc31'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:24:26 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-60a47e56-2715-401d-a98f-5ecfc44eef6c tempest-AttachVolumeTestJSON-875799601 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:24:26 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-60a47e56-2715-401d-a98f-5ecfc44eef6c tempest-AttachVolumeTestJSON-875799601 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:24:26 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-60a47e56-2715-401d-a98f-5ecfc44eef6c tempest-AttachVolumeTestJSON-875799601 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:24:26 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-60a47e56-2715-401d-a98f-5ecfc44eef6c tempest-AttachVolumeTestJSON-875799601 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:24:26 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-60a47e56-2715-401d-a98f-5ecfc44eef6c tempest-AttachVolumeTestJSON-875799601 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:24:26 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-60a47e56-2715-401d-a98f-5ecfc44eef6c tempest-AttachVolumeTestJSON-875799601 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:24:26 devstack sudo[95450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:24:26 devstack sudo[95450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:24:26 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-e9565732-6713-4d15-8406-2760cd395ffe tempest-GroupSnapshotsV319Test-1820805182 None] group_snapshot bdb49c5a-eb8f-4d0b-822b-56f594a657d2: deleting Sep 29 18:24:26 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-e9565732-6713-4d15-8406-2760cd395ffe tempest-GroupSnapshotsV319Test-1820805182 None] group_snapshot bdb49c5a-eb8f-4d0b-822b-56f594a657d2: deleting {{(pid=86512) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 29 18:24:26 devstack sudo[95450]: pam_unix(sudo:session): session closed for user root Sep 29 18:24:26 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-60a47e56-2715-401d-a98f-5ecfc44eef6c tempest-AttachVolumeTestJSON-875799601 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.460s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:24:26 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-60a47e56-2715-401d-a98f-5ecfc44eef6c tempest-AttachVolumeTestJSON-875799601 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:24:26 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-e9565732-6713-4d15-8406-2760cd395ffe tempest-GroupSnapshotsV319Test-1820805182 None] Acquiring lock "cinder-quobyte-aa9562cc-e80d-4bf1-bfda-7fc4124cbbf9" by "delete_snapshot" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:24:26 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-60a47e56-2715-401d-a98f-5ecfc44eef6c tempest-AttachVolumeTestJSON-875799601 None] Deleted volume successfully. Sep 29 18:24:26 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-e9565732-6713-4d15-8406-2760cd395ffe tempest-GroupSnapshotsV319Test-1820805182 None] Lock "cinder-quobyte-aa9562cc-e80d-4bf1-bfda-7fc4124cbbf9" acquired by "delete_snapshot" :: waited 0.060s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:24:26 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-e9565732-6713-4d15-8406-2760cd395ffe tempest-GroupSnapshotsV319Test-1820805182 None] Acquiring lock "cinder-quobyte-add5ad85-dcf2-4c98-9b61-0487c0ab5e4a" by "_delete_snapshot" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:24:26 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-60a47e56-2715-401d-a98f-5ecfc44eef6c tempest-AttachVolumeTestJSON-875799601 None] Lock "cinder-553aaf84-f9f1-46ef-a326-801fd69da8ba-delete_volume" released by "delete_volume" :: held 2.005s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:24:26 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-e9565732-6713-4d15-8406-2760cd395ffe tempest-GroupSnapshotsV319Test-1820805182 None] Lock "cinder-quobyte-add5ad85-dcf2-4c98-9b61-0487c0ab5e4a" acquired by "_delete_snapshot" :: waited 0.051s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:24:26 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-e9565732-6713-4d15-8406-2760cd395ffe tempest-GroupSnapshotsV319Test-1820805182 None] Deleting offline snapshot add5ad85-dcf2-4c98-9b61-0487c0ab5e4a of volume aa9562cc-e80d-4bf1-bfda-7fc4124cbbf9 {{(pid=86512) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 18:24:26 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-e9565732-6713-4d15-8406-2760cd395ffe tempest-GroupSnapshotsV319Test-1820805182 None] snapshot_file for this snap is: volume-aa9562cc-e80d-4bf1-bfda-7fc4124cbbf9.add5ad85-dcf2-4c98-9b61-0487c0ab5e4a {{(pid=86512) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 18:24:26 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[a201dc93-7dcb-486f-bd18-23edb0de97bf]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:24:26 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-e9565732-6713-4d15-8406-2760cd395ffe tempest-GroupSnapshotsV319Test-1820805182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-aa9562cc-e80d-4bf1-bfda-7fc4124cbbf9.add5ad85-dcf2-4c98-9b61-0487c0ab5e4a {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:24:26 devstack sudo[95478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-aa9562cc-e80d-4bf1-bfda-7fc4124cbbf9.add5ad85-dcf2-4c98-9b61-0487c0ab5e4a Sep 29 18:24:26 devstack sudo[95478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:24:27 devstack sudo[95478]: pam_unix(sudo:session): session closed for user root Sep 29 18:24:27 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-e9565732-6713-4d15-8406-2760cd395ffe tempest-GroupSnapshotsV319Test-1820805182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-aa9562cc-e80d-4bf1-bfda-7fc4124cbbf9.add5ad85-dcf2-4c98-9b61-0487c0ab5e4a" returned: 0 in 0.519s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:24:27 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-e9565732-6713-4d15-8406-2760cd395ffe tempest-GroupSnapshotsV319Test-1820805182 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aa9562cc-e80d-4bf1-bfda-7fc4124cbbf9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86512) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 18:24:27 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[58891488-8d31-40eb-80ea-eeb17f75a9c4]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:24:27 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-e9565732-6713-4d15-8406-2760cd395ffe tempest-GroupSnapshotsV319Test-1820805182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-aa9562cc-e80d-4bf1-bfda-7fc4124cbbf9 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:24:27 devstack sudo[95503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-aa9562cc-e80d-4bf1-bfda-7fc4124cbbf9 Sep 29 18:24:27 devstack sudo[95503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:24:27 devstack sudo[95503]: pam_unix(sudo:session): session closed for user root Sep 29 18:24:27 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-e9565732-6713-4d15-8406-2760cd395ffe tempest-GroupSnapshotsV319Test-1820805182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-aa9562cc-e80d-4bf1-bfda-7fc4124cbbf9" returned: 0 in 0.583s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:24:27 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-e9565732-6713-4d15-8406-2760cd395ffe tempest-GroupSnapshotsV319Test-1820805182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-aa9562cc-e80d-4bf1-bfda-7fc4124cbbf9.add5ad85-dcf2-4c98-9b61-0487c0ab5e4a {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:24:27 devstack sudo[95517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-aa9562cc-e80d-4bf1-bfda-7fc4124cbbf9.add5ad85-dcf2-4c98-9b61-0487c0ab5e4a Sep 29 18:24:27 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [req-db36e1e6-de6e-4bea-a590-94a37d76e345 req-ffc5989b-09a6-4841-9d0f-504f67f21602 tempest-TestStampPattern-1947170058 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:24:27 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [req-db36e1e6-de6e-4bea-a590-94a37d76e345 req-ffc5989b-09a6-4841-9d0f-504f67f21602 tempest-TestStampPattern-1947170058 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:24:27 devstack sudo[95517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:24:27 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [req-db36e1e6-de6e-4bea-a590-94a37d76e345 req-ffc5989b-09a6-4841-9d0f-504f67f21602 tempest-TestStampPattern-1947170058 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:24:27 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [req-db36e1e6-de6e-4bea-a590-94a37d76e345 req-ffc5989b-09a6-4841-9d0f-504f67f21602 tempest-TestStampPattern-1947170058 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883', 'name': 'volume-7fc95db1-8a95-4cd2-9802-eecd7eb24f64', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cafdcbec-5ca9-48bb-ac5b-e34546b82990', 'enforce_multipath': True} {{(pid=86512) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 29 18:24:28 devstack cinder-volume[86512]: INFO cinder.volume.manager [req-db36e1e6-de6e-4bea-a590-94a37d76e345 req-ffc5989b-09a6-4841-9d0f-504f67f21602 tempest-TestStampPattern-1947170058 None] attachment_update completed successfully. Sep 29 18:24:28 devstack sudo[95517]: pam_unix(sudo:session): session closed for user root Sep 29 18:24:28 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-e9565732-6713-4d15-8406-2760cd395ffe tempest-GroupSnapshotsV319Test-1820805182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-aa9562cc-e80d-4bf1-bfda-7fc4124cbbf9.add5ad85-dcf2-4c98-9b61-0487c0ab5e4a" returned: 0 in 0.624s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:24:28 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-e9565732-6713-4d15-8406-2760cd395ffe tempest-GroupSnapshotsV319Test-1820805182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-aa9562cc-e80d-4bf1-bfda-7fc4124cbbf9.add5ad85-dcf2-4c98-9b61-0487c0ab5e4a {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:24:28 devstack sudo[95621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-aa9562cc-e80d-4bf1-bfda-7fc4124cbbf9.add5ad85-dcf2-4c98-9b61-0487c0ab5e4a Sep 29 18:24:28 devstack sudo[95621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:24:28 devstack sudo[95621]: pam_unix(sudo:session): session closed for user root Sep 29 18:24:28 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-e9565732-6713-4d15-8406-2760cd395ffe tempest-GroupSnapshotsV319Test-1820805182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-aa9562cc-e80d-4bf1-bfda-7fc4124cbbf9.add5ad85-dcf2-4c98-9b61-0487c0ab5e4a" returned: 0 in 0.370s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:24:28 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-e9565732-6713-4d15-8406-2760cd395ffe tempest-GroupSnapshotsV319Test-1820805182 None] Lock "cinder-quobyte-add5ad85-dcf2-4c98-9b61-0487c0ab5e4a" released by "_delete_snapshot" :: held 2.287s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:24:28 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-e9565732-6713-4d15-8406-2760cd395ffe tempest-GroupSnapshotsV319Test-1820805182 None] Lock "cinder-quobyte-aa9562cc-e80d-4bf1-bfda-7fc4124cbbf9" released by "delete_snapshot" :: held 2.348s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:24:29 devstack cinder-volume[86512]: WARNING cinder.quota [None req-e9565732-6713-4d15-8406-2760cd395ffe tempest-GroupSnapshotsV319Test-1820805182 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-853730412 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-853730412, it is now deprecated. Please use the default quota class for default quota. Sep 29 18:24:29 devstack cinder-volume[86512]: WARNING cinder.quota [None req-e9565732-6713-4d15-8406-2760cd395ffe tempest-GroupSnapshotsV319Test-1820805182 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-853730412 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-853730412, it is now deprecated. Please use the default quota class for default quota. Sep 29 18:24:29 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-e9565732-6713-4d15-8406-2760cd395ffe tempest-GroupSnapshotsV319Test-1820805182 None] Created reservations ['bd7ed73e-ffb8-4d78-9691-b93fe81c84fc', '4634c1a6-1230-4bd7-8300-c36967b30034', '46a0f536-2426-4d93-9cfe-0cdc2f82a216', 'd3cd8013-4450-439d-ab09-afd062d00f97'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:24:29 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-e9565732-6713-4d15-8406-2760cd395ffe tempest-GroupSnapshotsV319Test-1820805182 None] group_snapshot bdb49c5a-eb8f-4d0b-822b-56f594a657d2: deleted successfully Sep 29 18:24:30 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-75c6782b-4c73-436e-9803-f3e9369c3e5a tempest-GroupSnapshotsV319Test-1820805182 None] Acquiring lock "cinder-quobyte-aa9562cc-e80d-4bf1-bfda-7fc4124cbbf9" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:24:30 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-75c6782b-4c73-436e-9803-f3e9369c3e5a tempest-GroupSnapshotsV319Test-1820805182 None] Lock "cinder-quobyte-aa9562cc-e80d-4bf1-bfda-7fc4124cbbf9" acquired by "delete_volume" :: waited 0.033s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:24:30 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[075fc0d3-344a-4580-9963-5d5feb2ebd10]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:24:30 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-75c6782b-4c73-436e-9803-f3e9369c3e5a tempest-GroupSnapshotsV319Test-1820805182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-aa9562cc-e80d-4bf1-bfda-7fc4124cbbf9 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:24:30 devstack sudo[95956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-aa9562cc-e80d-4bf1-bfda-7fc4124cbbf9 Sep 29 18:24:30 devstack sudo[95956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:24:31 devstack sudo[95956]: pam_unix(sudo:session): session closed for user root Sep 29 18:24:31 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-75c6782b-4c73-436e-9803-f3e9369c3e5a tempest-GroupSnapshotsV319Test-1820805182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-aa9562cc-e80d-4bf1-bfda-7fc4124cbbf9" returned: 0 in 0.632s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:24:31 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-75c6782b-4c73-436e-9803-f3e9369c3e5a tempest-GroupSnapshotsV319Test-1820805182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-aa9562cc-e80d-4bf1-bfda-7fc4124cbbf9 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:24:31 devstack sudo[95963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-aa9562cc-e80d-4bf1-bfda-7fc4124cbbf9 Sep 29 18:24:31 devstack sudo[95963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:24:31 devstack sudo[95963]: pam_unix(sudo:session): session closed for user root Sep 29 18:24:31 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-75c6782b-4c73-436e-9803-f3e9369c3e5a tempest-GroupSnapshotsV319Test-1820805182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-aa9562cc-e80d-4bf1-bfda-7fc4124cbbf9" returned: 0 in 0.362s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:24:31 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-75c6782b-4c73-436e-9803-f3e9369c3e5a tempest-GroupSnapshotsV319Test-1820805182 None] Lock "cinder-quobyte-aa9562cc-e80d-4bf1-bfda-7fc4124cbbf9" released by "delete_volume" :: held 1.132s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:24:31 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-75c6782b-4c73-436e-9803-f3e9369c3e5a tempest-GroupSnapshotsV319Test-1820805182 None] Created reservations ['f65a311a-efad-4d11-b94d-88b461bdc61d'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:24:31 devstack cinder-volume[86512]: WARNING cinder.quota [None req-75c6782b-4c73-436e-9803-f3e9369c3e5a tempest-GroupSnapshotsV319Test-1820805182 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-853730412 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-853730412, it is now deprecated. Please use the default quota class for default quota. Sep 29 18:24:31 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-75c6782b-4c73-436e-9803-f3e9369c3e5a tempest-GroupSnapshotsV319Test-1820805182 None] Created reservations ['8f798765-e16e-452a-80fb-bd7b023900dd', '0ce07a9a-efef-4877-9cb4-9d320c782ad8', '126542d4-31a9-44a6-b614-46d1dce672fd', 'ae21abf3-d34f-4d1f-9c0a-9a12c6c125ad'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:24:31 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-75c6782b-4c73-436e-9803-f3e9369c3e5a tempest-GroupSnapshotsV319Test-1820805182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:24:31 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-75c6782b-4c73-436e-9803-f3e9369c3e5a tempest-GroupSnapshotsV319Test-1820805182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:24:31 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-75c6782b-4c73-436e-9803-f3e9369c3e5a tempest-GroupSnapshotsV319Test-1820805182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:24:31 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-75c6782b-4c73-436e-9803-f3e9369c3e5a tempest-GroupSnapshotsV319Test-1820805182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:24:31 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-75c6782b-4c73-436e-9803-f3e9369c3e5a tempest-GroupSnapshotsV319Test-1820805182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:24:31 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-75c6782b-4c73-436e-9803-f3e9369c3e5a tempest-GroupSnapshotsV319Test-1820805182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:24:32 devstack sudo[95967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:24:32 devstack sudo[95967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:24:32 devstack sudo[95967]: pam_unix(sudo:session): session closed for user root Sep 29 18:24:32 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-75c6782b-4c73-436e-9803-f3e9369c3e5a tempest-GroupSnapshotsV319Test-1820805182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.423s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:24:32 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-75c6782b-4c73-436e-9803-f3e9369c3e5a tempest-GroupSnapshotsV319Test-1820805182 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:24:32 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-75c6782b-4c73-436e-9803-f3e9369c3e5a tempest-GroupSnapshotsV319Test-1820805182 None] Delete group completed successfully. Sep 29 18:24:35 devstack cinder-volume[86512]: INFO cinder.volume.manager [req-f0c95a06-8c7a-405b-81bb-a1272fe06cbf req-fccf9a49-282c-44a5-92d2-a4c3f4726ab8 tempest-TestStampPattern-1947170058 None] Terminate volume connection completed successfully. Sep 29 18:24:35 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [req-f0c95a06-8c7a-405b-81bb-a1272fe06cbf req-fccf9a49-282c-44a5-92d2-a4c3f4726ab8 tempest-TestStampPattern-1947170058 None] Deleting attachment cafdcbec-5ca9-48bb-ac5b-e34546b82990. {{(pid=86512) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 29 18:24:36 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-26c5b21e-d8ca-4784-99ea-5c996799accc tempest-TestStampPattern-1947170058 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:24:36 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-26c5b21e-d8ca-4784-99ea-5c996799accc tempest-TestStampPattern-1947170058 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:24:36 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-26c5b21e-d8ca-4784-99ea-5c996799accc tempest-TestStampPattern-1947170058 None] Creating offline snapshot c2ab48ef-ed57-4ae4-b2c8-36f363ca9948 of volume 7fc95db1-8a95-4cd2-9802-eecd7eb24f64 {{(pid=86512) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 18:24:36 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[2590994a-2e10-4f71-8445-5fb9a0613041]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:24:36 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-26c5b21e-d8ca-4784-99ea-5c996799accc tempest-TestStampPattern-1947170058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7fc95db1-8a95-4cd2-9802-eecd7eb24f64 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:24:36 devstack sudo[96029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7fc95db1-8a95-4cd2-9802-eecd7eb24f64 Sep 29 18:24:36 devstack sudo[96029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:24:37 devstack sudo[96029]: pam_unix(sudo:session): session closed for user root Sep 29 18:24:37 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-26c5b21e-d8ca-4784-99ea-5c996799accc tempest-TestStampPattern-1947170058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7fc95db1-8a95-4cd2-9802-eecd7eb24f64" returned: 0 in 0.579s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:24:37 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-26c5b21e-d8ca-4784-99ea-5c996799accc tempest-TestStampPattern-1947170058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7fc95db1-8a95-4cd2-9802-eecd7eb24f64,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7fc95db1-8a95-4cd2-9802-eecd7eb24f64.c2ab48ef-ed57-4ae4-b2c8-36f363ca9948 1G {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:24:37 devstack sudo[96035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7fc95db1-8a95-4cd2-9802-eecd7eb24f64,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7fc95db1-8a95-4cd2-9802-eecd7eb24f64.c2ab48ef-ed57-4ae4-b2c8-36f363ca9948 1G Sep 29 18:24:37 devstack sudo[96035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:24:37 devstack sudo[96035]: pam_unix(sudo:session): session closed for user root Sep 29 18:24:37 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-26c5b21e-d8ca-4784-99ea-5c996799accc tempest-TestStampPattern-1947170058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7fc95db1-8a95-4cd2-9802-eecd7eb24f64,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7fc95db1-8a95-4cd2-9802-eecd7eb24f64.c2ab48ef-ed57-4ae4-b2c8-36f363ca9948 1G" returned: 0 in 0.643s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:24:37 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-26c5b21e-d8ca-4784-99ea-5c996799accc tempest-TestStampPattern-1947170058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7fc95db1-8a95-4cd2-9802-eecd7eb24f64 -F qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7fc95db1-8a95-4cd2-9802-eecd7eb24f64.c2ab48ef-ed57-4ae4-b2c8-36f363ca9948 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:24:37 devstack sudo[96041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7fc95db1-8a95-4cd2-9802-eecd7eb24f64 -F qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7fc95db1-8a95-4cd2-9802-eecd7eb24f64.c2ab48ef-ed57-4ae4-b2c8-36f363ca9948 Sep 29 18:24:37 devstack sudo[96041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:24:38 devstack sudo[96041]: pam_unix(sudo:session): session closed for user root Sep 29 18:24:38 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-26c5b21e-d8ca-4784-99ea-5c996799accc tempest-TestStampPattern-1947170058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7fc95db1-8a95-4cd2-9802-eecd7eb24f64 -F qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7fc95db1-8a95-4cd2-9802-eecd7eb24f64.c2ab48ef-ed57-4ae4-b2c8-36f363ca9948" returned: 0 in 0.401s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:24:38 devstack cinder-volume[86512]: WARNING cinder.volume.drivers.remotefs [None req-26c5b21e-d8ca-4784-99ea-5c996799accc tempest-TestStampPattern-1947170058 None] /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7fc95db1-8a95-4cd2-9802-eecd7eb24f64.c2ab48ef-ed57-4ae4-b2c8-36f363ca9948 is being set with open permissions: ugo+rw Sep 29 18:24:38 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-26c5b21e-d8ca-4784-99ea-5c996799accc tempest-TestStampPattern-1947170058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7fc95db1-8a95-4cd2-9802-eecd7eb24f64.c2ab48ef-ed57-4ae4-b2c8-36f363ca9948 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:24:38 devstack sudo[96046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7fc95db1-8a95-4cd2-9802-eecd7eb24f64.c2ab48ef-ed57-4ae4-b2c8-36f363ca9948 Sep 29 18:24:38 devstack sudo[96046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:24:38 devstack sudo[96046]: pam_unix(sudo:session): session closed for user root Sep 29 18:24:38 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-26c5b21e-d8ca-4784-99ea-5c996799accc tempest-TestStampPattern-1947170058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7fc95db1-8a95-4cd2-9802-eecd7eb24f64.c2ab48ef-ed57-4ae4-b2c8-36f363ca9948" returned: 0 in 0.334s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:24:38 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-26c5b21e-d8ca-4784-99ea-5c996799accc tempest-TestStampPattern-1947170058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7fc95db1-8a95-4cd2-9802-eecd7eb24f64.info {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:24:38 devstack sudo[96049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7fc95db1-8a95-4cd2-9802-eecd7eb24f64.info Sep 29 18:24:38 devstack sudo[96049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:24:38 devstack sudo[96049]: pam_unix(sudo:session): session closed for user root Sep 29 18:24:38 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-26c5b21e-d8ca-4784-99ea-5c996799accc tempest-TestStampPattern-1947170058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7fc95db1-8a95-4cd2-9802-eecd7eb24f64.info" returned: 0 in 0.325s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:24:38 devstack cinder-volume[86512]: WARNING cinder.volume.drivers.remotefs [None req-26c5b21e-d8ca-4784-99ea-5c996799accc tempest-TestStampPattern-1947170058 None] /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7fc95db1-8a95-4cd2-9802-eecd7eb24f64.info is being set with open permissions: ugo+rw Sep 29 18:24:38 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-26c5b21e-d8ca-4784-99ea-5c996799accc tempest-TestStampPattern-1947170058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7fc95db1-8a95-4cd2-9802-eecd7eb24f64.info {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:24:38 devstack sudo[96052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7fc95db1-8a95-4cd2-9802-eecd7eb24f64.info Sep 29 18:24:38 devstack sudo[96052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:24:39 devstack sudo[96052]: pam_unix(sudo:session): session closed for user root Sep 29 18:24:39 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-26c5b21e-d8ca-4784-99ea-5c996799accc tempest-TestStampPattern-1947170058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7fc95db1-8a95-4cd2-9802-eecd7eb24f64.info" returned: 0 in 0.320s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:24:39 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-26c5b21e-d8ca-4784-99ea-5c996799accc tempest-TestStampPattern-1947170058 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.742s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:24:39 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-26c5b21e-d8ca-4784-99ea-5c996799accc tempest-TestStampPattern-1947170058 None] Create snapshot completed successfully Sep 29 18:24:40 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [req-252c129d-2064-405e-a3e8-dca652d609de req-e517a964-dd8d-434a-bd3a-143d2bb555d5 tempest-VolumesGetTestJSON-642935293 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86512) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:24:40 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [req-252c129d-2064-405e-a3e8-dca652d609de req-e517a964-dd8d-434a-bd3a-143d2bb555d5 tempest-VolumesGetTestJSON-642935293 None] Flow 'volume_create_manager' (1fb04e74-8439-492e-9fa7-b0429445bf0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:24:40 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [req-252c129d-2064-405e-a3e8-dca652d609de req-e517a964-dd8d-434a-bd3a-143d2bb555d5 tempest-VolumesGetTestJSON-642935293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51efa95f-64fd-493d-bb77-1145aeee6ac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:24:40 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [req-252c129d-2064-405e-a3e8-dca652d609de req-e517a964-dd8d-434a-bd3a-143d2bb555d5 tempest-VolumesGetTestJSON-642935293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51efa95f-64fd-493d-bb77-1145aeee6ac7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:24:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1303565212',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73710cbd-c2eb-4b09-aeec-74c311fb98b6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e87aca70bb0c42918c1ee42a0a0ec4e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:24:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:24:40Z,use_quota=True,user_id='8b86a287a59c4d7d9895b2441a1b3086',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:24:40 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [req-252c129d-2064-405e-a3e8-dca652d609de req-e517a964-dd8d-434a-bd3a-143d2bb555d5 tempest-VolumesGetTestJSON-642935293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (158fece0-beb6-4506-97e5-2041c14c1d75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:24:40 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [req-252c129d-2064-405e-a3e8-dca652d609de req-e517a964-dd8d-434a-bd3a-143d2bb555d5 tempest-VolumesGetTestJSON-642935293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (158fece0-beb6-4506-97e5-2041c14c1d75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:24:40 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [req-252c129d-2064-405e-a3e8-dca652d609de req-e517a964-dd8d-434a-bd3a-143d2bb555d5 tempest-VolumesGetTestJSON-642935293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6590fa6b-6b67-445e-b9e9-03838a39a8f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:24:40 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [req-252c129d-2064-405e-a3e8-dca652d609de req-e517a964-dd8d-434a-bd3a-143d2bb555d5 tempest-VolumesGetTestJSON-642935293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6590fa6b-6b67-445e-b9e9-03838a39a8f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73710cbd-c2eb-4b09-aeec-74c311fb98b6', 'volume_name': 'volume-73710cbd-c2eb-4b09-aeec-74c311fb98b6', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:24:40 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [req-252c129d-2064-405e-a3e8-dca652d609de req-e517a964-dd8d-434a-bd3a-143d2bb555d5 tempest-VolumesGetTestJSON-642935293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9182e15-fe61-4143-97b8-7e701a9d879d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:24:40 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [req-252c129d-2064-405e-a3e8-dca652d609de req-e517a964-dd8d-434a-bd3a-143d2bb555d5 tempest-VolumesGetTestJSON-642935293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9182e15-fe61-4143-97b8-7e701a9d879d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:24:40 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [req-252c129d-2064-405e-a3e8-dca652d609de req-e517a964-dd8d-434a-bd3a-143d2bb555d5 tempest-VolumesGetTestJSON-642935293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ef5d44f-5ee9-44a8-a2ec-40b7c87653d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:24:40 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [req-252c129d-2064-405e-a3e8-dca652d609de req-e517a964-dd8d-434a-bd3a-143d2bb555d5 tempest-VolumesGetTestJSON-642935293 None] Volume 73710cbd-c2eb-4b09-aeec-74c311fb98b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73710cbd-c2eb-4b09-aeec-74c311fb98b6', 'volume_size': 1} Sep 29 18:24:40 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [req-252c129d-2064-405e-a3e8-dca652d609de req-e517a964-dd8d-434a-bd3a-143d2bb555d5 tempest-VolumesGetTestJSON-642935293 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:24:40 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [req-252c129d-2064-405e-a3e8-dca652d609de req-e517a964-dd8d-434a-bd3a-143d2bb555d5 tempest-VolumesGetTestJSON-642935293 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:24:40 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [req-252c129d-2064-405e-a3e8-dca652d609de req-e517a964-dd8d-434a-bd3a-143d2bb555d5 tempest-VolumesGetTestJSON-642935293 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:24:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1303565212',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73710cbd-c2eb-4b09-aeec-74c311fb98b6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e87aca70bb0c42918c1ee42a0a0ec4e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:24:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:24:40Z,use_quota=True,user_id='8b86a287a59c4d7d9895b2441a1b3086',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)}" {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:24:40 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [req-252c129d-2064-405e-a3e8-dca652d609de req-e517a964-dd8d-434a-bd3a-143d2bb555d5 tempest-VolumesGetTestJSON-642935293 None] Creating volume 73710cbd-c2eb-4b09-aeec-74c311fb98b6 {{(pid=86512) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:24:40 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [req-252c129d-2064-405e-a3e8-dca652d609de req-e517a964-dd8d-434a-bd3a-143d2bb555d5 tempest-VolumesGetTestJSON-642935293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:24:40 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [req-252c129d-2064-405e-a3e8-dca652d609de req-e517a964-dd8d-434a-bd3a-143d2bb555d5 tempest-VolumesGetTestJSON-642935293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:24:40 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [req-252c129d-2064-405e-a3e8-dca652d609de req-e517a964-dd8d-434a-bd3a-143d2bb555d5 tempest-VolumesGetTestJSON-642935293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:24:40 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [req-252c129d-2064-405e-a3e8-dca652d609de req-e517a964-dd8d-434a-bd3a-143d2bb555d5 tempest-VolumesGetTestJSON-642935293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:24:40 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [req-252c129d-2064-405e-a3e8-dca652d609de req-e517a964-dd8d-434a-bd3a-143d2bb555d5 tempest-VolumesGetTestJSON-642935293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:24:40 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [req-252c129d-2064-405e-a3e8-dca652d609de req-e517a964-dd8d-434a-bd3a-143d2bb555d5 tempest-VolumesGetTestJSON-642935293 None] Selected osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 as target Quobyte volume. {{(pid=86512) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:24:40 devstack cinder-volume[86512]: INFO cinder.volume.drivers.remotefs [req-252c129d-2064-405e-a3e8-dca652d609de req-e517a964-dd8d-434a-bd3a-143d2bb555d5 tempest-VolumesGetTestJSON-642935293 None] casted to osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 Sep 29 18:24:40 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [req-252c129d-2064-405e-a3e8-dca652d609de req-e517a964-dd8d-434a-bd3a-143d2bb555d5 tempest-VolumesGetTestJSON-642935293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-73710cbd-c2eb-4b09-aeec-74c311fb98b6 1073741824 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:24:40 devstack sudo[96055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-73710cbd-c2eb-4b09-aeec-74c311fb98b6 1073741824 Sep 29 18:24:40 devstack sudo[96055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:24:41 devstack sudo[96055]: pam_unix(sudo:session): session closed for user root Sep 29 18:24:41 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [req-252c129d-2064-405e-a3e8-dca652d609de req-e517a964-dd8d-434a-bd3a-143d2bb555d5 tempest-VolumesGetTestJSON-642935293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-73710cbd-c2eb-4b09-aeec-74c311fb98b6 1073741824" returned: 0 in 0.705s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:24:41 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [req-252c129d-2064-405e-a3e8-dca652d609de req-e517a964-dd8d-434a-bd3a-143d2bb555d5 tempest-VolumesGetTestJSON-642935293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-73710cbd-c2eb-4b09-aeec-74c311fb98b6 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:24:41 devstack sudo[96118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-73710cbd-c2eb-4b09-aeec-74c311fb98b6 Sep 29 18:24:41 devstack sudo[96118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:24:41 devstack sudo[96118]: pam_unix(sudo:session): session closed for user root Sep 29 18:24:41 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [req-252c129d-2064-405e-a3e8-dca652d609de req-e517a964-dd8d-434a-bd3a-143d2bb555d5 tempest-VolumesGetTestJSON-642935293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-73710cbd-c2eb-4b09-aeec-74c311fb98b6" returned: 0 in 0.451s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:24:41 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [req-252c129d-2064-405e-a3e8-dca652d609de req-e517a964-dd8d-434a-bd3a-143d2bb555d5 tempest-VolumesGetTestJSON-642935293 None] <== create_volume: return (1237ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'} {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:24:41 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [req-252c129d-2064-405e-a3e8-dca652d609de req-e517a964-dd8d-434a-bd3a-143d2bb555d5 tempest-VolumesGetTestJSON-642935293 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.240s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:24:41 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [req-252c129d-2064-405e-a3e8-dca652d609de req-e517a964-dd8d-434a-bd3a-143d2bb555d5 tempest-VolumesGetTestJSON-642935293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ef5d44f-5ee9-44a8-a2ec-40b7c87653d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73710cbd-c2eb-4b09-aeec-74c311fb98b6', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:24:41 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [req-252c129d-2064-405e-a3e8-dca652d609de req-e517a964-dd8d-434a-bd3a-143d2bb555d5 tempest-VolumesGetTestJSON-642935293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e52fd87c-f85c-4778-9191-370dfb2a083a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:24:41 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [req-252c129d-2064-405e-a3e8-dca652d609de req-e517a964-dd8d-434a-bd3a-143d2bb555d5 tempest-VolumesGetTestJSON-642935293 None] Volume volume-73710cbd-c2eb-4b09-aeec-74c311fb98b6 (73710cbd-c2eb-4b09-aeec-74c311fb98b6): created successfully Sep 29 18:24:41 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [req-252c129d-2064-405e-a3e8-dca652d609de req-e517a964-dd8d-434a-bd3a-143d2bb555d5 tempest-VolumesGetTestJSON-642935293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e52fd87c-f85c-4778-9191-370dfb2a083a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:24:41 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [req-252c129d-2064-405e-a3e8-dca652d609de req-e517a964-dd8d-434a-bd3a-143d2bb555d5 tempest-VolumesGetTestJSON-642935293 None] Flow 'volume_create_manager' (1fb04e74-8439-492e-9fa7-b0429445bf0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:24:41 devstack cinder-volume[86512]: INFO cinder.volume.manager [req-252c129d-2064-405e-a3e8-dca652d609de req-e517a964-dd8d-434a-bd3a-143d2bb555d5 tempest-VolumesGetTestJSON-642935293 None] Created volume successfully. Sep 29 18:24:42 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-71566690-870f-4c36-a8b3-456e6802c50d tempest-GroupsTest-1343710170 None] Group tempest-Group1-576949324: creating Sep 29 18:24:42 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-71566690-870f-4c36-a8b3-456e6802c50d tempest-GroupsTest-1343710170 None] Group tempest-Group1-576949324: created successfully Sep 29 18:24:42 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-71566690-870f-4c36-a8b3-456e6802c50d tempest-GroupsTest-1343710170 None] Create group completed successfully. Sep 29 18:24:42 devstack cinder-volume[86512]: DEBUG cinder.coordination [req-68f4309b-6c4e-4bf1-866d-1afefe90178f req-836e1444-8651-4439-8db6-ce846785b815 tempest-VolumesGetTestJSON-642935293 None] Acquiring lock "cinder-73710cbd-c2eb-4b09-aeec-74c311fb98b6-delete_volume" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:24:42 devstack cinder-volume[86512]: DEBUG cinder.coordination [req-68f4309b-6c4e-4bf1-866d-1afefe90178f req-836e1444-8651-4439-8db6-ce846785b815 tempest-VolumesGetTestJSON-642935293 None] Lock "cinder-73710cbd-c2eb-4b09-aeec-74c311fb98b6-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:24:42 devstack cinder-volume[86512]: DEBUG cinder.coordination [req-68f4309b-6c4e-4bf1-866d-1afefe90178f req-836e1444-8651-4439-8db6-ce846785b815 tempest-VolumesGetTestJSON-642935293 None] Acquiring lock "cinder-quobyte-73710cbd-c2eb-4b09-aeec-74c311fb98b6" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:24:42 devstack cinder-volume[86512]: DEBUG cinder.coordination [req-68f4309b-6c4e-4bf1-866d-1afefe90178f req-836e1444-8651-4439-8db6-ce846785b815 tempest-VolumesGetTestJSON-642935293 None] Lock "cinder-quobyte-73710cbd-c2eb-4b09-aeec-74c311fb98b6" acquired by "delete_volume" :: waited 0.015s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:24:42 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[d10d0a85-1e86-4499-b95a-4c6353f0d801]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:24:42 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [req-68f4309b-6c4e-4bf1-866d-1afefe90178f req-836e1444-8651-4439-8db6-ce846785b815 tempest-VolumesGetTestJSON-642935293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-73710cbd-c2eb-4b09-aeec-74c311fb98b6 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:24:42 devstack sudo[96146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-73710cbd-c2eb-4b09-aeec-74c311fb98b6 Sep 29 18:24:42 devstack sudo[96146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:24:43 devstack sudo[96146]: pam_unix(sudo:session): session closed for user root Sep 29 18:24:43 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [req-68f4309b-6c4e-4bf1-866d-1afefe90178f req-836e1444-8651-4439-8db6-ce846785b815 tempest-VolumesGetTestJSON-642935293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-73710cbd-c2eb-4b09-aeec-74c311fb98b6" returned: 0 in 0.389s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:24:43 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [req-68f4309b-6c4e-4bf1-866d-1afefe90178f req-836e1444-8651-4439-8db6-ce846785b815 tempest-VolumesGetTestJSON-642935293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-73710cbd-c2eb-4b09-aeec-74c311fb98b6 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:24:43 devstack sudo[96160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-73710cbd-c2eb-4b09-aeec-74c311fb98b6 Sep 29 18:24:43 devstack sudo[96160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:24:43 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-8de4f104-abf8-4e70-a2a3-167642c2127b tempest-GroupsTest-1343710170 None] Group tempest-Group2-547985618: creating Sep 29 18:24:43 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-8de4f104-abf8-4e70-a2a3-167642c2127b tempest-GroupsTest-1343710170 None] Group tempest-Group2-547985618: created successfully Sep 29 18:24:43 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-8de4f104-abf8-4e70-a2a3-167642c2127b tempest-GroupsTest-1343710170 None] Create group completed successfully. Sep 29 18:24:43 devstack sudo[96160]: pam_unix(sudo:session): session closed for user root Sep 29 18:24:43 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [req-68f4309b-6c4e-4bf1-866d-1afefe90178f req-836e1444-8651-4439-8db6-ce846785b815 tempest-VolumesGetTestJSON-642935293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-73710cbd-c2eb-4b09-aeec-74c311fb98b6" returned: 0 in 0.327s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:24:43 devstack cinder-volume[86512]: DEBUG cinder.coordination [req-68f4309b-6c4e-4bf1-866d-1afefe90178f req-836e1444-8651-4439-8db6-ce846785b815 tempest-VolumesGetTestJSON-642935293 None] Lock "cinder-quobyte-73710cbd-c2eb-4b09-aeec-74c311fb98b6" released by "delete_volume" :: held 0.759s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:24:43 devstack cinder-volume[86512]: DEBUG cinder.quota [req-68f4309b-6c4e-4bf1-866d-1afefe90178f req-836e1444-8651-4439-8db6-ce846785b815 tempest-VolumesGetTestJSON-642935293 None] Created reservations ['1642ec51-749e-41b5-8afd-68eded386e56', '97b061c5-d0a0-49cf-800c-6898e0372ed4', 'a8ba7637-16d5-4d03-8065-73b06a8595bd', 'b1ddec9c-493e-4721-83e4-057fbedcceb4'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:24:43 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [req-68f4309b-6c4e-4bf1-866d-1afefe90178f req-836e1444-8651-4439-8db6-ce846785b815 tempest-VolumesGetTestJSON-642935293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:24:43 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [req-68f4309b-6c4e-4bf1-866d-1afefe90178f req-836e1444-8651-4439-8db6-ce846785b815 tempest-VolumesGetTestJSON-642935293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:24:43 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [req-68f4309b-6c4e-4bf1-866d-1afefe90178f req-836e1444-8651-4439-8db6-ce846785b815 tempest-VolumesGetTestJSON-642935293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:24:43 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [req-68f4309b-6c4e-4bf1-866d-1afefe90178f req-836e1444-8651-4439-8db6-ce846785b815 tempest-VolumesGetTestJSON-642935293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:24:43 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [req-68f4309b-6c4e-4bf1-866d-1afefe90178f req-836e1444-8651-4439-8db6-ce846785b815 tempest-VolumesGetTestJSON-642935293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:24:43 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [req-68f4309b-6c4e-4bf1-866d-1afefe90178f req-836e1444-8651-4439-8db6-ce846785b815 tempest-VolumesGetTestJSON-642935293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:24:43 devstack sudo[96164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:24:43 devstack sudo[96164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:24:43 devstack sudo[96164]: pam_unix(sudo:session): session closed for user root Sep 29 18:24:43 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [req-68f4309b-6c4e-4bf1-866d-1afefe90178f req-836e1444-8651-4439-8db6-ce846785b815 tempest-VolumesGetTestJSON-642935293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.271s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:24:43 devstack cinder-volume[86512]: DEBUG cinder.manager [req-68f4309b-6c4e-4bf1-866d-1afefe90178f req-836e1444-8651-4439-8db6-ce846785b815 tempest-VolumesGetTestJSON-642935293 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:24:43 devstack cinder-volume[86512]: INFO cinder.volume.manager [req-68f4309b-6c4e-4bf1-866d-1afefe90178f req-836e1444-8651-4439-8db6-ce846785b815 tempest-VolumesGetTestJSON-642935293 None] Deleted volume successfully. Sep 29 18:24:43 devstack cinder-volume[86512]: DEBUG cinder.coordination [req-68f4309b-6c4e-4bf1-866d-1afefe90178f req-836e1444-8651-4439-8db6-ce846785b815 tempest-VolumesGetTestJSON-642935293 None] Lock "cinder-73710cbd-c2eb-4b09-aeec-74c311fb98b6-delete_volume" released by "delete_volume" :: held 1.231s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:24:45 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb85cc49-3381-4efc-8a55-22a204d4ab8a tempest-GroupsTest-1343710170 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86512) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:24:45 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-cb85cc49-3381-4efc-8a55-22a204d4ab8a tempest-GroupsTest-1343710170 None] Flow 'volume_create_manager' (86234bd4-4f3f-4d2f-971a-5f776d9370f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:24:45 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-cb85cc49-3381-4efc-8a55-22a204d4ab8a tempest-GroupsTest-1343710170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00cc3973-4608-4d72-8a79-e9b9b6873ad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:24:45 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-cb85cc49-3381-4efc-8a55-22a204d4ab8a tempest-GroupsTest-1343710170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00cc3973-4608-4d72-8a79-e9b9b6873ad1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:24:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1550496491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0955529b-51f1-44d8-b934-a26133282e41,host='devstack@QuobyteHD#QuobyteHD',id=1b01366e-d9c2-4864-ad85-e3ed1d17f182,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ef29abf54704f9189c2b14b7b0687fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:24:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:24:45Z,use_quota=True,user_id='a3f1a665aa40490aa415471eda187c04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e0aec2a-2b77-43e9-8592-b5f8e09f86ae),volume_type_id=8e0aec2a-2b77-43e9-8592-b5f8e09f86ae)' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:24:45 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-cb85cc49-3381-4efc-8a55-22a204d4ab8a tempest-GroupsTest-1343710170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5eca258-05ae-4f1d-b3a6-e567a3232140) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:24:45 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-cb85cc49-3381-4efc-8a55-22a204d4ab8a tempest-GroupsTest-1343710170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5eca258-05ae-4f1d-b3a6-e567a3232140) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:24:45 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-cb85cc49-3381-4efc-8a55-22a204d4ab8a tempest-GroupsTest-1343710170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b81eef5c-e6f3-40df-9ef7-77d718287150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:24:45 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-cb85cc49-3381-4efc-8a55-22a204d4ab8a tempest-GroupsTest-1343710170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b81eef5c-e6f3-40df-9ef7-77d718287150) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b01366e-d9c2-4864-ad85-e3ed1d17f182', 'volume_name': 'volume-1b01366e-d9c2-4864-ad85-e3ed1d17f182', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:24:45 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-cb85cc49-3381-4efc-8a55-22a204d4ab8a tempest-GroupsTest-1343710170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6f45662-537f-4d07-9b8f-fc3b37ef15e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:24:45 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-cb85cc49-3381-4efc-8a55-22a204d4ab8a tempest-GroupsTest-1343710170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6f45662-537f-4d07-9b8f-fc3b37ef15e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:24:45 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-cb85cc49-3381-4efc-8a55-22a204d4ab8a tempest-GroupsTest-1343710170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66d8bb7c-5228-4924-8b5e-3eccf0914675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:24:45 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-cb85cc49-3381-4efc-8a55-22a204d4ab8a tempest-GroupsTest-1343710170 None] Volume 1b01366e-d9c2-4864-ad85-e3ed1d17f182: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b01366e-d9c2-4864-ad85-e3ed1d17f182', 'volume_size': 1} Sep 29 18:24:45 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-cb85cc49-3381-4efc-8a55-22a204d4ab8a tempest-GroupsTest-1343710170 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:24:45 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-cb85cc49-3381-4efc-8a55-22a204d4ab8a tempest-GroupsTest-1343710170 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:24:45 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-cb85cc49-3381-4efc-8a55-22a204d4ab8a tempest-GroupsTest-1343710170 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=0955529b-51f1-44d8-b934-a26133282e41,created_at=2026-09-29T16:24:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1550496491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0955529b-51f1-44d8-b934-a26133282e41,host='devstack@QuobyteHD#QuobyteHD',id=1b01366e-d9c2-4864-ad85-e3ed1d17f182,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ef29abf54704f9189c2b14b7b0687fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:24:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:24:45Z,use_quota=True,user_id='a3f1a665aa40490aa415471eda187c04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8e0aec2a-2b77-43e9-8592-b5f8e09f86ae),volume_type_id=8e0aec2a-2b77-43e9-8592-b5f8e09f86ae)}" {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:24:45 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-cb85cc49-3381-4efc-8a55-22a204d4ab8a tempest-GroupsTest-1343710170 None] Creating volume 1b01366e-d9c2-4864-ad85-e3ed1d17f182 {{(pid=86512) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:24:45 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-cb85cc49-3381-4efc-8a55-22a204d4ab8a tempest-GroupsTest-1343710170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:24:45 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-cb85cc49-3381-4efc-8a55-22a204d4ab8a tempest-GroupsTest-1343710170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:24:45 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-cb85cc49-3381-4efc-8a55-22a204d4ab8a tempest-GroupsTest-1343710170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:24:45 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-cb85cc49-3381-4efc-8a55-22a204d4ab8a tempest-GroupsTest-1343710170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:24:45 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-cb85cc49-3381-4efc-8a55-22a204d4ab8a tempest-GroupsTest-1343710170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:24:45 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-cb85cc49-3381-4efc-8a55-22a204d4ab8a tempest-GroupsTest-1343710170 None] Selected osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 as target Quobyte volume. {{(pid=86512) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:24:45 devstack cinder-volume[86512]: INFO cinder.volume.drivers.remotefs [None req-cb85cc49-3381-4efc-8a55-22a204d4ab8a tempest-GroupsTest-1343710170 None] casted to osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 Sep 29 18:24:45 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-cb85cc49-3381-4efc-8a55-22a204d4ab8a tempest-GroupsTest-1343710170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-1b01366e-d9c2-4864-ad85-e3ed1d17f182 1073741824 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:24:45 devstack sudo[96167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-1b01366e-d9c2-4864-ad85-e3ed1d17f182 1073741824 Sep 29 18:24:45 devstack sudo[96167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:24:45 devstack sudo[96167]: pam_unix(sudo:session): session closed for user root Sep 29 18:24:45 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-cb85cc49-3381-4efc-8a55-22a204d4ab8a tempest-GroupsTest-1343710170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-1b01366e-d9c2-4864-ad85-e3ed1d17f182 1073741824" returned: 0 in 0.539s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:24:45 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-cb85cc49-3381-4efc-8a55-22a204d4ab8a tempest-GroupsTest-1343710170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-1b01366e-d9c2-4864-ad85-e3ed1d17f182 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:24:45 devstack sudo[96173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-1b01366e-d9c2-4864-ad85-e3ed1d17f182 Sep 29 18:24:45 devstack sudo[96173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:24:46 devstack sudo[96173]: pam_unix(sudo:session): session closed for user root Sep 29 18:24:46 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-cb85cc49-3381-4efc-8a55-22a204d4ab8a tempest-GroupsTest-1343710170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-1b01366e-d9c2-4864-ad85-e3ed1d17f182" returned: 0 in 0.298s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:24:46 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-cb85cc49-3381-4efc-8a55-22a204d4ab8a tempest-GroupsTest-1343710170 None] <== create_volume: return (886ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'} {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:24:46 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-cb85cc49-3381-4efc-8a55-22a204d4ab8a tempest-GroupsTest-1343710170 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.889s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:24:46 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-cb85cc49-3381-4efc-8a55-22a204d4ab8a tempest-GroupsTest-1343710170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66d8bb7c-5228-4924-8b5e-3eccf0914675) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b01366e-d9c2-4864-ad85-e3ed1d17f182', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:24:46 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-cb85cc49-3381-4efc-8a55-22a204d4ab8a tempest-GroupsTest-1343710170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d32be37-570b-4577-844e-9d5ee9d32b12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:24:46 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-cb85cc49-3381-4efc-8a55-22a204d4ab8a tempest-GroupsTest-1343710170 None] Volume volume-1b01366e-d9c2-4864-ad85-e3ed1d17f182 (1b01366e-d9c2-4864-ad85-e3ed1d17f182): created successfully Sep 29 18:24:46 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-cb85cc49-3381-4efc-8a55-22a204d4ab8a tempest-GroupsTest-1343710170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d32be37-570b-4577-844e-9d5ee9d32b12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:24:46 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-cb85cc49-3381-4efc-8a55-22a204d4ab8a tempest-GroupsTest-1343710170 None] Flow 'volume_create_manager' (86234bd4-4f3f-4d2f-971a-5f776d9370f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:24:46 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-cb85cc49-3381-4efc-8a55-22a204d4ab8a tempest-GroupsTest-1343710170 None] Created volume successfully. Sep 29 18:24:47 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-70e15341-003e-45ba-90cd-7b19df36d045 tempest-GroupsTest-1343710170 None] Acquiring lock "cinder-quobyte-1b01366e-d9c2-4864-ad85-e3ed1d17f182" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:24:47 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-70e15341-003e-45ba-90cd-7b19df36d045 tempest-GroupsTest-1343710170 None] Lock "cinder-quobyte-1b01366e-d9c2-4864-ad85-e3ed1d17f182" acquired by "delete_volume" :: waited 0.019s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:24:47 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[27526169-2445-4201-acfa-b200a907518b]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:24:47 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-70e15341-003e-45ba-90cd-7b19df36d045 tempest-GroupsTest-1343710170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-1b01366e-d9c2-4864-ad85-e3ed1d17f182 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:24:47 devstack sudo[96176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-1b01366e-d9c2-4864-ad85-e3ed1d17f182 Sep 29 18:24:47 devstack sudo[96176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:24:47 devstack sudo[96176]: pam_unix(sudo:session): session closed for user root Sep 29 18:24:47 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-70e15341-003e-45ba-90cd-7b19df36d045 tempest-GroupsTest-1343710170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-1b01366e-d9c2-4864-ad85-e3ed1d17f182" returned: 0 in 0.395s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:24:47 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-70e15341-003e-45ba-90cd-7b19df36d045 tempest-GroupsTest-1343710170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-1b01366e-d9c2-4864-ad85-e3ed1d17f182 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:24:47 devstack sudo[96181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-1b01366e-d9c2-4864-ad85-e3ed1d17f182 Sep 29 18:24:47 devstack sudo[96181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:24:47 devstack sudo[96181]: pam_unix(sudo:session): session closed for user root Sep 29 18:24:47 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-70e15341-003e-45ba-90cd-7b19df36d045 tempest-GroupsTest-1343710170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-1b01366e-d9c2-4864-ad85-e3ed1d17f182" returned: 0 in 0.299s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:24:47 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-70e15341-003e-45ba-90cd-7b19df36d045 tempest-GroupsTest-1343710170 None] Lock "cinder-quobyte-1b01366e-d9c2-4864-ad85-e3ed1d17f182" released by "delete_volume" :: held 0.757s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:24:47 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-70e15341-003e-45ba-90cd-7b19df36d045 tempest-GroupsTest-1343710170 None] Created reservations ['2b3d95b5-c8c9-4660-83ea-58cf3bbc6c85'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:24:47 devstack cinder-volume[86512]: WARNING cinder.quota [None req-70e15341-003e-45ba-90cd-7b19df36d045 tempest-GroupsTest-1343710170 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-2124138410 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-2124138410, it is now deprecated. Please use the default quota class for default quota. Sep 29 18:24:47 devstack cinder-volume[86512]: WARNING cinder.quota [None req-70e15341-003e-45ba-90cd-7b19df36d045 tempest-GroupsTest-1343710170 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-2124138410 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-2124138410, it is now deprecated. Please use the default quota class for default quota. Sep 29 18:24:47 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-70e15341-003e-45ba-90cd-7b19df36d045 tempest-GroupsTest-1343710170 None] Created reservations ['e549fabc-2623-4c57-b520-27b0f1c0ce20', '44de686a-c125-457e-b4a7-037e3277f7d3', '6d74187b-7ad4-4635-9b21-1f738930eeb2', '8d317abd-ecc9-445c-b7df-21bed25266db'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:24:48 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-f90fde46-6121-4344-b521-2196c854d8e2 tempest-TestStampPattern-1947170058 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86512) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:24:48 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-f90fde46-6121-4344-b521-2196c854d8e2 tempest-TestStampPattern-1947170058 None] Flow 'volume_create_manager' (295097e8-1b31-4910-9fd0-2fd7ab585417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:24:48 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-f90fde46-6121-4344-b521-2196c854d8e2 tempest-TestStampPattern-1947170058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31e6ae5a-fc09-4cd3-adca-3bd0741e3aad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:24:48 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-f90fde46-6121-4344-b521-2196c854d8e2 tempest-TestStampPattern-1947170058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31e6ae5a-fc09-4cd3-adca-3bd0741e3aad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:24:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1564105826',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76c83cb3-8bd4-4efa-9940-142f21431def,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='573e731cd34c4c8eb5153858812df122',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:24:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c2ab48ef-ed57-4ae4-b2c8-36f363ca9948,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:24:48Z,use_quota=True,user_id='2fab4143c23a4deb8178d0113156f1e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:24:48 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-f90fde46-6121-4344-b521-2196c854d8e2 tempest-TestStampPattern-1947170058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a368a41-259b-4f1e-b157-ca85a4adeb23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:24:48 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-f90fde46-6121-4344-b521-2196c854d8e2 tempest-TestStampPattern-1947170058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a368a41-259b-4f1e-b157-ca85a4adeb23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:24:48 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-f90fde46-6121-4344-b521-2196c854d8e2 tempest-TestStampPattern-1947170058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec43ccd5-1ab7-4119-ba35-5a242240dcd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:24:48 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-f90fde46-6121-4344-b521-2196c854d8e2 tempest-TestStampPattern-1947170058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec43ccd5-1ab7-4119-ba35-5a242240dcd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '76c83cb3-8bd4-4efa-9940-142f21431def', 'volume_name': 'volume-76c83cb3-8bd4-4efa-9940-142f21431def', 'volume_size': 1, 'snapshot_id': 'c2ab48ef-ed57-4ae4-b2c8-36f363ca9948'}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:24:48 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-f90fde46-6121-4344-b521-2196c854d8e2 tempest-TestStampPattern-1947170058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c762909-6519-4c72-a557-2499973ab8e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:24:48 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-f90fde46-6121-4344-b521-2196c854d8e2 tempest-TestStampPattern-1947170058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c762909-6519-4c72-a557-2499973ab8e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:24:48 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-f90fde46-6121-4344-b521-2196c854d8e2 tempest-TestStampPattern-1947170058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a84c908-9021-402e-a2f4-c2ddcce025da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:24:48 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-f90fde46-6121-4344-b521-2196c854d8e2 tempest-TestStampPattern-1947170058 None] Volume 76c83cb3-8bd4-4efa-9940-142f21431def: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-76c83cb3-8bd4-4efa-9940-142f21431def', 'volume_size': 1, 'snapshot_id': 'c2ab48ef-ed57-4ae4-b2c8-36f363ca9948'} Sep 29 18:24:48 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-f90fde46-6121-4344-b521-2196c854d8e2 tempest-TestStampPattern-1947170058 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:24:48 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-f90fde46-6121-4344-b521-2196c854d8e2 tempest-TestStampPattern-1947170058 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:24:48 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-f90fde46-6121-4344-b521-2196c854d8e2 tempest-TestStampPattern-1947170058 None] Acquiring lock "cinder-quobyte-c2ab48ef-ed57-4ae4-b2c8-36f363ca9948-76c83cb3-8bd4-4efa-9940-142f21431def" by "_create_volume_from_snapshot" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:24:48 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-70e15341-003e-45ba-90cd-7b19df36d045 tempest-GroupsTest-1343710170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:24:48 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-70e15341-003e-45ba-90cd-7b19df36d045 tempest-GroupsTest-1343710170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:24:48 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-70e15341-003e-45ba-90cd-7b19df36d045 tempest-GroupsTest-1343710170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:24:48 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-70e15341-003e-45ba-90cd-7b19df36d045 tempest-GroupsTest-1343710170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:24:48 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-70e15341-003e-45ba-90cd-7b19df36d045 tempest-GroupsTest-1343710170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:24:48 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-70e15341-003e-45ba-90cd-7b19df36d045 tempest-GroupsTest-1343710170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:24:48 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-f90fde46-6121-4344-b521-2196c854d8e2 tempest-TestStampPattern-1947170058 None] Lock "cinder-quobyte-c2ab48ef-ed57-4ae4-b2c8-36f363ca9948-76c83cb3-8bd4-4efa-9940-142f21431def" acquired by "_create_volume_from_snapshot" :: waited 0.040s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:24:48 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-f90fde46-6121-4344-b521-2196c854d8e2 tempest-TestStampPattern-1947170058 None] Creating volume 76c83cb3-8bd4-4efa-9940-142f21431def from snapshot c2ab48ef-ed57-4ae4-b2c8-36f363ca9948 {{(pid=86512) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 29 18:24:48 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-f90fde46-6121-4344-b521-2196c854d8e2 tempest-TestStampPattern-1947170058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:24:48 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-f90fde46-6121-4344-b521-2196c854d8e2 tempest-TestStampPattern-1947170058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:24:48 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-f90fde46-6121-4344-b521-2196c854d8e2 tempest-TestStampPattern-1947170058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:24:48 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-f90fde46-6121-4344-b521-2196c854d8e2 tempest-TestStampPattern-1947170058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:24:48 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-f90fde46-6121-4344-b521-2196c854d8e2 tempest-TestStampPattern-1947170058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:24:48 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-f90fde46-6121-4344-b521-2196c854d8e2 tempest-TestStampPattern-1947170058 None] Selected osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 as target Quobyte volume. {{(pid=86512) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:24:48 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-f90fde46-6121-4344-b521-2196c854d8e2 tempest-TestStampPattern-1947170058 None] Acquiring lock "cinder-quobyte-76c83cb3-8bd4-4efa-9940-142f21431def" by "_copy_volume_from_snapshot" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:24:48 devstack sudo[96184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:24:48 devstack sudo[96184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:24:48 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-f90fde46-6121-4344-b521-2196c854d8e2 tempest-TestStampPattern-1947170058 None] Lock "cinder-quobyte-76c83cb3-8bd4-4efa-9940-142f21431def" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:24:48 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-f90fde46-6121-4344-b521-2196c854d8e2 tempest-TestStampPattern-1947170058 None] snapshot: c2ab48ef-ed57-4ae4-b2c8-36f363ca9948, volume: 76c83cb3-8bd4-4efa-9940-142f21431def, {{(pid=86512) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 29 18:24:48 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-f90fde46-6121-4344-b521-2196c854d8e2 tempest-TestStampPattern-1947170058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:24:48 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-f90fde46-6121-4344-b521-2196c854d8e2 tempest-TestStampPattern-1947170058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:24:48 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-f90fde46-6121-4344-b521-2196c854d8e2 tempest-TestStampPattern-1947170058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:24:48 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-f90fde46-6121-4344-b521-2196c854d8e2 tempest-TestStampPattern-1947170058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:24:48 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-f90fde46-6121-4344-b521-2196c854d8e2 tempest-TestStampPattern-1947170058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:24:48 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[db408e3c-2b63-4fa9-99dd-6cba28533dd6]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:24:48 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-f90fde46-6121-4344-b521-2196c854d8e2 tempest-TestStampPattern-1947170058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7fc95db1-8a95-4cd2-9802-eecd7eb24f64.c2ab48ef-ed57-4ae4-b2c8-36f363ca9948 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:24:48 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-f39e79e0-e568-4b3c-a257-3065824671b6 tempest-GroupsTest-1343710170 None] Created reservations ['61c16830-4cd7-4bee-abca-88a1351f2f01'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:24:48 devstack sudo[96186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7fc95db1-8a95-4cd2-9802-eecd7eb24f64.c2ab48ef-ed57-4ae4-b2c8-36f363ca9948 Sep 29 18:24:48 devstack sudo[96186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:24:48 devstack sudo[96184]: pam_unix(sudo:session): session closed for user root Sep 29 18:24:48 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-70e15341-003e-45ba-90cd-7b19df36d045 tempest-GroupsTest-1343710170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.429s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:24:48 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-70e15341-003e-45ba-90cd-7b19df36d045 tempest-GroupsTest-1343710170 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:24:48 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-f39e79e0-e568-4b3c-a257-3065824671b6 tempest-GroupsTest-1343710170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:24:48 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-f39e79e0-e568-4b3c-a257-3065824671b6 tempest-GroupsTest-1343710170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:24:48 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-f39e79e0-e568-4b3c-a257-3065824671b6 tempest-GroupsTest-1343710170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:24:48 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-f39e79e0-e568-4b3c-a257-3065824671b6 tempest-GroupsTest-1343710170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:24:48 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-f39e79e0-e568-4b3c-a257-3065824671b6 tempest-GroupsTest-1343710170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:24:48 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-f39e79e0-e568-4b3c-a257-3065824671b6 tempest-GroupsTest-1343710170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:24:48 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-70e15341-003e-45ba-90cd-7b19df36d045 tempest-GroupsTest-1343710170 None] Delete group completed successfully. Sep 29 18:24:48 devstack sudo[96189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:24:48 devstack sudo[96189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:24:48 devstack sudo[96186]: pam_unix(sudo:session): session closed for user root Sep 29 18:24:48 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-f90fde46-6121-4344-b521-2196c854d8e2 tempest-TestStampPattern-1947170058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7fc95db1-8a95-4cd2-9802-eecd7eb24f64.c2ab48ef-ed57-4ae4-b2c8-36f363ca9948" returned: 0 in 0.522s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:24:48 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-f90fde46-6121-4344-b521-2196c854d8e2 tempest-TestStampPattern-1947170058 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7fc95db1-8a95-4cd2-9802-eecd7eb24f64(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86512) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 18:24:48 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[28530833-e10f-406f-8523-935a97adc669]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:24:48 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-f90fde46-6121-4344-b521-2196c854d8e2 tempest-TestStampPattern-1947170058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7fc95db1-8a95-4cd2-9802-eecd7eb24f64 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:24:48 devstack sudo[96189]: pam_unix(sudo:session): session closed for user root Sep 29 18:24:48 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-f39e79e0-e568-4b3c-a257-3065824671b6 tempest-GroupsTest-1343710170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.352s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:24:48 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-f39e79e0-e568-4b3c-a257-3065824671b6 tempest-GroupsTest-1343710170 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:24:48 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-f39e79e0-e568-4b3c-a257-3065824671b6 tempest-GroupsTest-1343710170 None] Delete group completed successfully. Sep 29 18:24:49 devstack sudo[96194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7fc95db1-8a95-4cd2-9802-eecd7eb24f64 Sep 29 18:24:49 devstack sudo[96194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:24:49 devstack sudo[96194]: pam_unix(sudo:session): session closed for user root Sep 29 18:24:49 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-f90fde46-6121-4344-b521-2196c854d8e2 tempest-TestStampPattern-1947170058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7fc95db1-8a95-4cd2-9802-eecd7eb24f64" returned: 0 in 0.556s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:24:49 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-f90fde46-6121-4344-b521-2196c854d8e2 tempest-TestStampPattern-1947170058 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7fc95db1-8a95-4cd2-9802-eecd7eb24f64 {{(pid=86512) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 29 18:24:49 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-f90fde46-6121-4344-b521-2196c854d8e2 tempest-TestStampPattern-1947170058 None] Creating direct copy from snapshot {{(pid=86512) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 29 18:24:49 devstack cinder-volume[86512]: DEBUG cinder.utils [None req-f90fde46-6121-4344-b521-2196c854d8e2 tempest-TestStampPattern-1947170058 None] Path /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-76c83cb3-8bd4-4efa-9940-142f21431def not found in is_blk_device check {{(pid=86512) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 29 18:24:49 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-f90fde46-6121-4344-b521-2196c854d8e2 tempest-TestStampPattern-1947170058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7fc95db1-8a95-4cd2-9802-eecd7eb24f64 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-76c83cb3-8bd4-4efa-9940-142f21431def {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:24:49 devstack sudo[96204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7fc95db1-8a95-4cd2-9802-eecd7eb24f64 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-76c83cb3-8bd4-4efa-9940-142f21431def Sep 29 18:24:49 devstack sudo[96204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:24:50 devstack cinder-volume[86512]: DEBUG oslo_service.periodic_task [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86512) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 18:24:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:24:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:24:50 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:24:50 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:24:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:24:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:24:50 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-90e18887-0063-4242-aa8d-03c751b676fe tempest-GroupsTest-1343710170 None] Group tempest-GroupsTest-Group-1022076516: creating Sep 29 18:24:50 devstack sudo[96212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:24:50 devstack sudo[96212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:24:50 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-90e18887-0063-4242-aa8d-03c751b676fe tempest-GroupsTest-1343710170 None] Group tempest-GroupsTest-Group-1022076516: created successfully Sep 29 18:24:50 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-90e18887-0063-4242-aa8d-03c751b676fe tempest-GroupsTest-1343710170 None] Create group completed successfully. Sep 29 18:24:50 devstack sudo[96212]: pam_unix(sudo:session): session closed for user root Sep 29 18:24:51 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.411s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:24:51 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:24:51 devstack cinder-volume[86512]: DEBUG oslo_service.periodic_task [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Running periodic task VolumeManager._thread_info {{(pid=86512) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 18:24:51 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] thread count: 28 {{(pid=86512) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 29 18:24:51 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] thread info: [<_MainThread(MainThread, started 135593654804608)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86512) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 29 18:24:54 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a4f7dea-ca15-4fc8-9d15-20f7e43ffa84 tempest-GroupsTest-1343710170 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86512) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:24:54 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-4a4f7dea-ca15-4fc8-9d15-20f7e43ffa84 tempest-GroupsTest-1343710170 None] Flow 'volume_create_manager' (2c292e2e-8714-4b0c-be8c-8f46841fb12b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:24:54 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-4a4f7dea-ca15-4fc8-9d15-20f7e43ffa84 tempest-GroupsTest-1343710170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b2d1713-4af2-433c-82cc-80a3d7d7e783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:24:54 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-4a4f7dea-ca15-4fc8-9d15-20f7e43ffa84 tempest-GroupsTest-1343710170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b2d1713-4af2-433c-82cc-80a3d7d7e783) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:24:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1481581934',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=bb8d221d-bd7c-4da8-92a7-64d2457b0dae,host='devstack@QuobyteHD#QuobyteHD',id=df708e73-dfcb-40d5-9960-bfe5cfaf3038,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ef29abf54704f9189c2b14b7b0687fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:24:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:24:54Z,use_quota=True,user_id='a3f1a665aa40490aa415471eda187c04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(760b6985-6fe0-4ce1-96b4-d7cfafc6431f),volume_type_id=760b6985-6fe0-4ce1-96b4-d7cfafc6431f)' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:24:54 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-4a4f7dea-ca15-4fc8-9d15-20f7e43ffa84 tempest-GroupsTest-1343710170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18a2b644-8bf0-4fab-b8d6-f77d8a8e252c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:24:54 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-4a4f7dea-ca15-4fc8-9d15-20f7e43ffa84 tempest-GroupsTest-1343710170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18a2b644-8bf0-4fab-b8d6-f77d8a8e252c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:24:54 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-4a4f7dea-ca15-4fc8-9d15-20f7e43ffa84 tempest-GroupsTest-1343710170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d435eca-64cd-43c2-b562-e6a99ffab5c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:24:54 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-4a4f7dea-ca15-4fc8-9d15-20f7e43ffa84 tempest-GroupsTest-1343710170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d435eca-64cd-43c2-b562-e6a99ffab5c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df708e73-dfcb-40d5-9960-bfe5cfaf3038', 'volume_name': 'volume-df708e73-dfcb-40d5-9960-bfe5cfaf3038', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:24:54 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-4a4f7dea-ca15-4fc8-9d15-20f7e43ffa84 tempest-GroupsTest-1343710170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73007a3e-b6ac-44df-ba99-c285407a259b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:24:54 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-4a4f7dea-ca15-4fc8-9d15-20f7e43ffa84 tempest-GroupsTest-1343710170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73007a3e-b6ac-44df-ba99-c285407a259b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:24:54 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-4a4f7dea-ca15-4fc8-9d15-20f7e43ffa84 tempest-GroupsTest-1343710170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dec9451a-1aa6-4d6e-82a7-2659a4a2ac6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:24:54 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-4a4f7dea-ca15-4fc8-9d15-20f7e43ffa84 tempest-GroupsTest-1343710170 None] Volume df708e73-dfcb-40d5-9960-bfe5cfaf3038: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df708e73-dfcb-40d5-9960-bfe5cfaf3038', 'volume_size': 1} Sep 29 18:24:54 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-4a4f7dea-ca15-4fc8-9d15-20f7e43ffa84 tempest-GroupsTest-1343710170 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:24:54 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd71f0d2-76b3-4456-850c-2123a352abc5 tempest-AttachVolumeNegativeTest-1588161148 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86512) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:24:54 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-dd71f0d2-76b3-4456-850c-2123a352abc5 tempest-AttachVolumeNegativeTest-1588161148 None] Flow 'volume_create_manager' (c2996271-8215-4b25-9c27-5cd8028d8e7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:24:54 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-dd71f0d2-76b3-4456-850c-2123a352abc5 tempest-AttachVolumeNegativeTest-1588161148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b4b539b-5bd9-456d-8722-75ed1bae3262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:24:54 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-dd71f0d2-76b3-4456-850c-2123a352abc5 tempest-AttachVolumeNegativeTest-1588161148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b4b539b-5bd9-456d-8722-75ed1bae3262) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:24:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2104765381',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8c56791-d854-4764-838a-c21804e199af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05c82caa4fd348afbec7a526cbb20e18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:24:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:24:54Z,use_quota=True,user_id='64e1943d04f742059dd82e9c24eeaec0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:24:54 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-dd71f0d2-76b3-4456-850c-2123a352abc5 tempest-AttachVolumeNegativeTest-1588161148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d2fb141-dbcd-4b8b-9a1a-d3445a701886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:24:54 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-dd71f0d2-76b3-4456-850c-2123a352abc5 tempest-AttachVolumeNegativeTest-1588161148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d2fb141-dbcd-4b8b-9a1a-d3445a701886) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:24:54 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-dd71f0d2-76b3-4456-850c-2123a352abc5 tempest-AttachVolumeNegativeTest-1588161148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9c63850-8f01-4de7-ae51-555af5eea26a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:24:54 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-dd71f0d2-76b3-4456-850c-2123a352abc5 tempest-AttachVolumeNegativeTest-1588161148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9c63850-8f01-4de7-ae51-555af5eea26a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8c56791-d854-4764-838a-c21804e199af', 'volume_name': 'volume-e8c56791-d854-4764-838a-c21804e199af', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:24:54 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-dd71f0d2-76b3-4456-850c-2123a352abc5 tempest-AttachVolumeNegativeTest-1588161148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47697b3c-64c1-482d-a97e-abe28fdb5816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:24:54 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-dd71f0d2-76b3-4456-850c-2123a352abc5 tempest-AttachVolumeNegativeTest-1588161148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47697b3c-64c1-482d-a97e-abe28fdb5816) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:24:54 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-dd71f0d2-76b3-4456-850c-2123a352abc5 tempest-AttachVolumeNegativeTest-1588161148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (037582e2-63bf-4d6d-98d4-54f7214e19d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:24:54 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-dd71f0d2-76b3-4456-850c-2123a352abc5 tempest-AttachVolumeNegativeTest-1588161148 None] Volume e8c56791-d854-4764-838a-c21804e199af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8c56791-d854-4764-838a-c21804e199af', 'volume_size': 1} Sep 29 18:24:54 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-dd71f0d2-76b3-4456-850c-2123a352abc5 tempest-AttachVolumeNegativeTest-1588161148 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:24:58 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-5dcef34f-780b-4895-a3ec-f3016ba958a4 tempest-BackendsCapabilitiesAdminTestsJSON-1061371584 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.014518737793, 'free_capacity_gb': 1775.014518737793, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86512) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 29 18:24:58 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d5f6df9e-9c26-42c6-91ad-4e8ecc8acdb7 tempest-BackendsCapabilitiesAdminTestsJSON-1061371584 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.014518737793, 'free_capacity_gb': 1775.014518737793, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86512) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 29 18:25:01 devstack sudo[96204]: pam_unix(sudo:session): session closed for user root Sep 29 18:25:01 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-f90fde46-6121-4344-b521-2196c854d8e2 tempest-TestStampPattern-1947170058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7fc95db1-8a95-4cd2-9802-eecd7eb24f64 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-76c83cb3-8bd4-4efa-9940-142f21431def" returned: 0 in 11.583s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:25:01 devstack cinder-volume[86512]: DEBUG cinder.image.image_utils [None req-f90fde46-6121-4344-b521-2196c854d8e2 tempest-TestStampPattern-1947170058 None] Image conversion details: src /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7fc95db1-8a95-4cd2-9802-eecd7eb24f64, size 1024.00 MB, duration 11.59 sec, destination /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-76c83cb3-8bd4-4efa-9940-142f21431def {{(pid=86512) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 29 18:25:01 devstack cinder-volume[86512]: INFO cinder.image.image_utils [None req-f90fde46-6121-4344-b521-2196c854d8e2 tempest-TestStampPattern-1947170058 None] Converted 1024.00 MB image at 88.35 MB/s Sep 29 18:25:01 devstack cinder-volume[86512]: WARNING cinder.volume.drivers.remotefs [None req-f90fde46-6121-4344-b521-2196c854d8e2 tempest-TestStampPattern-1947170058 None] /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-76c83cb3-8bd4-4efa-9940-142f21431def is being set with open permissions: ugo+rw Sep 29 18:25:01 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-f90fde46-6121-4344-b521-2196c854d8e2 tempest-TestStampPattern-1947170058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-76c83cb3-8bd4-4efa-9940-142f21431def {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:25:01 devstack sudo[96292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-76c83cb3-8bd4-4efa-9940-142f21431def Sep 29 18:25:01 devstack sudo[96292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:25:01 devstack sudo[96292]: pam_unix(sudo:session): session closed for user root Sep 29 18:25:01 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-f90fde46-6121-4344-b521-2196c854d8e2 tempest-TestStampPattern-1947170058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-76c83cb3-8bd4-4efa-9940-142f21431def" returned: 0 in 0.441s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:25:01 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-f90fde46-6121-4344-b521-2196c854d8e2 tempest-TestStampPattern-1947170058 None] Lock "cinder-quobyte-76c83cb3-8bd4-4efa-9940-142f21431def" released by "_copy_volume_from_snapshot" :: held 13.287s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:25:01 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-f90fde46-6121-4344-b521-2196c854d8e2 tempest-TestStampPattern-1947170058 None] Lock "cinder-quobyte-c2ab48ef-ed57-4ae4-b2c8-36f363ca9948-76c83cb3-8bd4-4efa-9940-142f21431def" released by "_create_volume_from_snapshot" :: held 13.401s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:25:01 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-f90fde46-6121-4344-b521-2196c854d8e2 tempest-TestStampPattern-1947170058 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 13.443s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:25:01 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-4a4f7dea-ca15-4fc8-9d15-20f7e43ffa84 tempest-GroupsTest-1343710170 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.966s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:25:01 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-4a4f7dea-ca15-4fc8-9d15-20f7e43ffa84 tempest-GroupsTest-1343710170 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=bb8d221d-bd7c-4da8-92a7-64d2457b0dae,created_at=2026-09-29T16:24:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1481581934',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=bb8d221d-bd7c-4da8-92a7-64d2457b0dae,host='devstack@QuobyteHD#QuobyteHD',id=df708e73-dfcb-40d5-9960-bfe5cfaf3038,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ef29abf54704f9189c2b14b7b0687fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:24:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:24:54Z,use_quota=True,user_id='a3f1a665aa40490aa415471eda187c04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(760b6985-6fe0-4ce1-96b4-d7cfafc6431f),volume_type_id=760b6985-6fe0-4ce1-96b4-d7cfafc6431f)}" {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:25:01 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-4a4f7dea-ca15-4fc8-9d15-20f7e43ffa84 tempest-GroupsTest-1343710170 None] Creating volume df708e73-dfcb-40d5-9960-bfe5cfaf3038 {{(pid=86512) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:25:01 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-4a4f7dea-ca15-4fc8-9d15-20f7e43ffa84 tempest-GroupsTest-1343710170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:25:01 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-4a4f7dea-ca15-4fc8-9d15-20f7e43ffa84 tempest-GroupsTest-1343710170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:25:01 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-4a4f7dea-ca15-4fc8-9d15-20f7e43ffa84 tempest-GroupsTest-1343710170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:25:01 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-4a4f7dea-ca15-4fc8-9d15-20f7e43ffa84 tempest-GroupsTest-1343710170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:25:01 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-4a4f7dea-ca15-4fc8-9d15-20f7e43ffa84 tempest-GroupsTest-1343710170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:25:01 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-4a4f7dea-ca15-4fc8-9d15-20f7e43ffa84 tempest-GroupsTest-1343710170 None] Selected osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 as target Quobyte volume. {{(pid=86512) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:25:01 devstack cinder-volume[86512]: INFO cinder.volume.drivers.remotefs [None req-4a4f7dea-ca15-4fc8-9d15-20f7e43ffa84 tempest-GroupsTest-1343710170 None] casted to osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 Sep 29 18:25:01 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-4a4f7dea-ca15-4fc8-9d15-20f7e43ffa84 tempest-GroupsTest-1343710170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-df708e73-dfcb-40d5-9960-bfe5cfaf3038 1073741824 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:25:01 devstack sudo[96384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-df708e73-dfcb-40d5-9960-bfe5cfaf3038 1073741824 Sep 29 18:25:01 devstack sudo[96384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:25:01 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-f90fde46-6121-4344-b521-2196c854d8e2 tempest-TestStampPattern-1947170058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a84c908-9021-402e-a2f4-c2ddcce025da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76c83cb3-8bd4-4efa-9940-142f21431def', 'volume_size': 1, 'snapshot_id': 'c2ab48ef-ed57-4ae4-b2c8-36f363ca9948'}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:25:01 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-f90fde46-6121-4344-b521-2196c854d8e2 tempest-TestStampPattern-1947170058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1605c8ac-7941-46de-87de-f8e91192e636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:25:01 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-f90fde46-6121-4344-b521-2196c854d8e2 tempest-TestStampPattern-1947170058 None] Volume volume-76c83cb3-8bd4-4efa-9940-142f21431def (76c83cb3-8bd4-4efa-9940-142f21431def): created successfully Sep 29 18:25:01 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-f90fde46-6121-4344-b521-2196c854d8e2 tempest-TestStampPattern-1947170058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1605c8ac-7941-46de-87de-f8e91192e636) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:25:01 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-f90fde46-6121-4344-b521-2196c854d8e2 tempest-TestStampPattern-1947170058 None] Flow 'volume_create_manager' (295097e8-1b31-4910-9fd0-2fd7ab585417) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:25:01 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-f90fde46-6121-4344-b521-2196c854d8e2 tempest-TestStampPattern-1947170058 None] Created volume successfully. Sep 29 18:25:02 devstack sudo[96384]: pam_unix(sudo:session): session closed for user root Sep 29 18:25:02 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-4a4f7dea-ca15-4fc8-9d15-20f7e43ffa84 tempest-GroupsTest-1343710170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-df708e73-dfcb-40d5-9960-bfe5cfaf3038 1073741824" returned: 0 in 0.847s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:25:02 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-4a4f7dea-ca15-4fc8-9d15-20f7e43ffa84 tempest-GroupsTest-1343710170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-df708e73-dfcb-40d5-9960-bfe5cfaf3038 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:25:02 devstack sudo[96648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-df708e73-dfcb-40d5-9960-bfe5cfaf3038 Sep 29 18:25:02 devstack sudo[96648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:25:02 devstack sudo[96648]: pam_unix(sudo:session): session closed for user root Sep 29 18:25:02 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-4a4f7dea-ca15-4fc8-9d15-20f7e43ffa84 tempest-GroupsTest-1343710170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-df708e73-dfcb-40d5-9960-bfe5cfaf3038" returned: 0 in 0.435s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:25:02 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-4a4f7dea-ca15-4fc8-9d15-20f7e43ffa84 tempest-GroupsTest-1343710170 None] <== create_volume: return (1364ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'} {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:25:02 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-4a4f7dea-ca15-4fc8-9d15-20f7e43ffa84 tempest-GroupsTest-1343710170 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.368s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:25:02 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-dd71f0d2-76b3-4456-850c-2123a352abc5 tempest-AttachVolumeNegativeTest-1588161148 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.023s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:25:02 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-dd71f0d2-76b3-4456-850c-2123a352abc5 tempest-AttachVolumeNegativeTest-1588161148 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:24:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2104765381',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8c56791-d854-4764-838a-c21804e199af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05c82caa4fd348afbec7a526cbb20e18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:24:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:24:54Z,use_quota=True,user_id='64e1943d04f742059dd82e9c24eeaec0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)}" {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:25:02 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-dd71f0d2-76b3-4456-850c-2123a352abc5 tempest-AttachVolumeNegativeTest-1588161148 None] Creating volume e8c56791-d854-4764-838a-c21804e199af {{(pid=86512) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:25:02 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-dd71f0d2-76b3-4456-850c-2123a352abc5 tempest-AttachVolumeNegativeTest-1588161148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:25:02 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-dd71f0d2-76b3-4456-850c-2123a352abc5 tempest-AttachVolumeNegativeTest-1588161148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:25:02 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-dd71f0d2-76b3-4456-850c-2123a352abc5 tempest-AttachVolumeNegativeTest-1588161148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:25:02 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-dd71f0d2-76b3-4456-850c-2123a352abc5 tempest-AttachVolumeNegativeTest-1588161148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:25:02 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-dd71f0d2-76b3-4456-850c-2123a352abc5 tempest-AttachVolumeNegativeTest-1588161148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:25:02 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-dd71f0d2-76b3-4456-850c-2123a352abc5 tempest-AttachVolumeNegativeTest-1588161148 None] Selected osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 as target Quobyte volume. {{(pid=86512) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:25:02 devstack cinder-volume[86512]: INFO cinder.volume.drivers.remotefs [None req-dd71f0d2-76b3-4456-850c-2123a352abc5 tempest-AttachVolumeNegativeTest-1588161148 None] casted to osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 Sep 29 18:25:03 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-dd71f0d2-76b3-4456-850c-2123a352abc5 tempest-AttachVolumeNegativeTest-1588161148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e8c56791-d854-4764-838a-c21804e199af 1073741824 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:25:03 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-4a4f7dea-ca15-4fc8-9d15-20f7e43ffa84 tempest-GroupsTest-1343710170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dec9451a-1aa6-4d6e-82a7-2659a4a2ac6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df708e73-dfcb-40d5-9960-bfe5cfaf3038', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:25:03 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-4a4f7dea-ca15-4fc8-9d15-20f7e43ffa84 tempest-GroupsTest-1343710170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5572e109-0f51-43c8-8b2f-cdbc30198be5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:25:03 devstack sudo[96662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e8c56791-d854-4764-838a-c21804e199af 1073741824 Sep 29 18:25:03 devstack sudo[96662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:25:03 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-4a4f7dea-ca15-4fc8-9d15-20f7e43ffa84 tempest-GroupsTest-1343710170 None] Volume volume-df708e73-dfcb-40d5-9960-bfe5cfaf3038 (df708e73-dfcb-40d5-9960-bfe5cfaf3038): created successfully Sep 29 18:25:03 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-4a4f7dea-ca15-4fc8-9d15-20f7e43ffa84 tempest-GroupsTest-1343710170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5572e109-0f51-43c8-8b2f-cdbc30198be5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:25:03 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-4a4f7dea-ca15-4fc8-9d15-20f7e43ffa84 tempest-GroupsTest-1343710170 None] Flow 'volume_create_manager' (2c292e2e-8714-4b0c-be8c-8f46841fb12b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:25:03 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-4a4f7dea-ca15-4fc8-9d15-20f7e43ffa84 tempest-GroupsTest-1343710170 None] Created volume successfully. Sep 29 18:25:03 devstack sudo[96662]: pam_unix(sudo:session): session closed for user root Sep 29 18:25:03 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-dd71f0d2-76b3-4456-850c-2123a352abc5 tempest-AttachVolumeNegativeTest-1588161148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e8c56791-d854-4764-838a-c21804e199af 1073741824" returned: 0 in 0.807s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:25:03 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-dd71f0d2-76b3-4456-850c-2123a352abc5 tempest-AttachVolumeNegativeTest-1588161148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e8c56791-d854-4764-838a-c21804e199af {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:25:03 devstack sudo[96671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e8c56791-d854-4764-838a-c21804e199af Sep 29 18:25:03 devstack sudo[96671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:25:04 devstack sudo[96671]: pam_unix(sudo:session): session closed for user root Sep 29 18:25:04 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-dd71f0d2-76b3-4456-850c-2123a352abc5 tempest-AttachVolumeNegativeTest-1588161148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e8c56791-d854-4764-838a-c21804e199af" returned: 0 in 0.573s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:25:04 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-dd71f0d2-76b3-4456-850c-2123a352abc5 tempest-AttachVolumeNegativeTest-1588161148 None] <== create_volume: return (1439ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'} {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:25:04 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-dd71f0d2-76b3-4456-850c-2123a352abc5 tempest-AttachVolumeNegativeTest-1588161148 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.448s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:25:04 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-dd71f0d2-76b3-4456-850c-2123a352abc5 tempest-AttachVolumeNegativeTest-1588161148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (037582e2-63bf-4d6d-98d4-54f7214e19d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8c56791-d854-4764-838a-c21804e199af', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:25:04 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-dd71f0d2-76b3-4456-850c-2123a352abc5 tempest-AttachVolumeNegativeTest-1588161148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac6d87bf-0c2b-4289-a8d0-90ddd0bd51d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:25:04 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-dd71f0d2-76b3-4456-850c-2123a352abc5 tempest-AttachVolumeNegativeTest-1588161148 None] Volume volume-e8c56791-d854-4764-838a-c21804e199af (e8c56791-d854-4764-838a-c21804e199af): created successfully Sep 29 18:25:04 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-dd71f0d2-76b3-4456-850c-2123a352abc5 tempest-AttachVolumeNegativeTest-1588161148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac6d87bf-0c2b-4289-a8d0-90ddd0bd51d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:25:04 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-dd71f0d2-76b3-4456-850c-2123a352abc5 tempest-AttachVolumeNegativeTest-1588161148 None] Flow 'volume_create_manager' (c2996271-8215-4b25-9c27-5cd8028d8e7b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:25:04 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-dd71f0d2-76b3-4456-850c-2123a352abc5 tempest-AttachVolumeNegativeTest-1588161148 None] Created volume successfully. Sep 29 18:25:04 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-310ef37c-f11e-4fc7-950c-8225b7d3e0bb tempest-GroupsTest-1343710170 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86512) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:25:04 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-310ef37c-f11e-4fc7-950c-8225b7d3e0bb tempest-GroupsTest-1343710170 None] Flow 'volume_create_manager' (1623fa04-2934-48db-91d6-e97d0f202ba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:25:04 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-310ef37c-f11e-4fc7-950c-8225b7d3e0bb tempest-GroupsTest-1343710170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f859bec-73ed-49e4-92ca-fe28b6bde5cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:25:04 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-310ef37c-f11e-4fc7-950c-8225b7d3e0bb tempest-GroupsTest-1343710170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f859bec-73ed-49e4-92ca-fe28b6bde5cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:25:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1957904227',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=bb8d221d-bd7c-4da8-92a7-64d2457b0dae,host='devstack@QuobyteHD#QuobyteHD',id=ed15b3dc-ce83-4c80-8f6d-ae1d12238c17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ef29abf54704f9189c2b14b7b0687fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:25:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:25:05Z,use_quota=True,user_id='a3f1a665aa40490aa415471eda187c04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(760b6985-6fe0-4ce1-96b4-d7cfafc6431f),volume_type_id=760b6985-6fe0-4ce1-96b4-d7cfafc6431f)' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:25:04 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-310ef37c-f11e-4fc7-950c-8225b7d3e0bb tempest-GroupsTest-1343710170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f0f5736-eac4-42c7-9009-09c09ca4e936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:25:04 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-310ef37c-f11e-4fc7-950c-8225b7d3e0bb tempest-GroupsTest-1343710170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f0f5736-eac4-42c7-9009-09c09ca4e936) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:25:04 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-310ef37c-f11e-4fc7-950c-8225b7d3e0bb tempest-GroupsTest-1343710170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9855077d-1b13-4b8a-80f5-5defdb8da513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:25:04 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-310ef37c-f11e-4fc7-950c-8225b7d3e0bb tempest-GroupsTest-1343710170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9855077d-1b13-4b8a-80f5-5defdb8da513) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed15b3dc-ce83-4c80-8f6d-ae1d12238c17', 'volume_name': 'volume-ed15b3dc-ce83-4c80-8f6d-ae1d12238c17', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:25:04 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-310ef37c-f11e-4fc7-950c-8225b7d3e0bb tempest-GroupsTest-1343710170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d65f2cb-e028-444a-a8c6-77ee0d7796dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:25:04 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-310ef37c-f11e-4fc7-950c-8225b7d3e0bb tempest-GroupsTest-1343710170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d65f2cb-e028-444a-a8c6-77ee0d7796dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:25:04 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-310ef37c-f11e-4fc7-950c-8225b7d3e0bb tempest-GroupsTest-1343710170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6dcedda-242f-48c2-8865-0908a79286b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:25:04 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-310ef37c-f11e-4fc7-950c-8225b7d3e0bb tempest-GroupsTest-1343710170 None] Volume ed15b3dc-ce83-4c80-8f6d-ae1d12238c17: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed15b3dc-ce83-4c80-8f6d-ae1d12238c17', 'volume_size': 1} Sep 29 18:25:04 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-310ef37c-f11e-4fc7-950c-8225b7d3e0bb tempest-GroupsTest-1343710170 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:25:04 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-310ef37c-f11e-4fc7-950c-8225b7d3e0bb tempest-GroupsTest-1343710170 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:25:04 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-310ef37c-f11e-4fc7-950c-8225b7d3e0bb tempest-GroupsTest-1343710170 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=bb8d221d-bd7c-4da8-92a7-64d2457b0dae,created_at=2026-09-29T16:25:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1957904227',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=bb8d221d-bd7c-4da8-92a7-64d2457b0dae,host='devstack@QuobyteHD#QuobyteHD',id=ed15b3dc-ce83-4c80-8f6d-ae1d12238c17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ef29abf54704f9189c2b14b7b0687fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:25:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:25:05Z,use_quota=True,user_id='a3f1a665aa40490aa415471eda187c04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(760b6985-6fe0-4ce1-96b4-d7cfafc6431f),volume_type_id=760b6985-6fe0-4ce1-96b4-d7cfafc6431f)}" {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:25:04 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-310ef37c-f11e-4fc7-950c-8225b7d3e0bb tempest-GroupsTest-1343710170 None] Creating volume ed15b3dc-ce83-4c80-8f6d-ae1d12238c17 {{(pid=86512) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:25:04 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-310ef37c-f11e-4fc7-950c-8225b7d3e0bb tempest-GroupsTest-1343710170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:25:04 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-310ef37c-f11e-4fc7-950c-8225b7d3e0bb tempest-GroupsTest-1343710170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:25:04 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-310ef37c-f11e-4fc7-950c-8225b7d3e0bb tempest-GroupsTest-1343710170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:25:05 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-310ef37c-f11e-4fc7-950c-8225b7d3e0bb tempest-GroupsTest-1343710170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:25:05 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-310ef37c-f11e-4fc7-950c-8225b7d3e0bb tempest-GroupsTest-1343710170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:25:05 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-310ef37c-f11e-4fc7-950c-8225b7d3e0bb tempest-GroupsTest-1343710170 None] Selected osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 as target Quobyte volume. {{(pid=86512) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:25:05 devstack cinder-volume[86512]: INFO cinder.volume.drivers.remotefs [None req-310ef37c-f11e-4fc7-950c-8225b7d3e0bb tempest-GroupsTest-1343710170 None] casted to osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 Sep 29 18:25:05 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-310ef37c-f11e-4fc7-950c-8225b7d3e0bb tempest-GroupsTest-1343710170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ed15b3dc-ce83-4c80-8f6d-ae1d12238c17 1073741824 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:25:05 devstack sudo[96677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ed15b3dc-ce83-4c80-8f6d-ae1d12238c17 1073741824 Sep 29 18:25:05 devstack sudo[96677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:25:05 devstack sudo[96677]: pam_unix(sudo:session): session closed for user root Sep 29 18:25:05 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-310ef37c-f11e-4fc7-950c-8225b7d3e0bb tempest-GroupsTest-1343710170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ed15b3dc-ce83-4c80-8f6d-ae1d12238c17 1073741824" returned: 0 in 0.850s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:25:05 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-310ef37c-f11e-4fc7-950c-8225b7d3e0bb tempest-GroupsTest-1343710170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ed15b3dc-ce83-4c80-8f6d-ae1d12238c17 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:25:05 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [req-5de385ff-dc62-4548-986e-c7210a7b2c6c req-c40bbf1e-c15a-425e-bd27-5066a75f6268 tempest-AttachVolumeNegativeTest-1588161148 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:25:05 devstack sudo[96691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ed15b3dc-ce83-4c80-8f6d-ae1d12238c17 Sep 29 18:25:05 devstack sudo[96691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:25:06 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-310ef37c-f11e-4fc7-950c-8225b7d3e0bb tempest-GroupsTest-1343710170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ed15b3dc-ce83-4c80-8f6d-ae1d12238c17" returned: 0 in 0.340s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:25:06 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-310ef37c-f11e-4fc7-950c-8225b7d3e0bb tempest-GroupsTest-1343710170 None] <== create_volume: return (1278ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'} {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:25:06 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-310ef37c-f11e-4fc7-950c-8225b7d3e0bb tempest-GroupsTest-1343710170 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.281s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:25:06 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [req-5de385ff-dc62-4548-986e-c7210a7b2c6c req-c40bbf1e-c15a-425e-bd27-5066a75f6268 tempest-AttachVolumeNegativeTest-1588161148 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.309s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:25:06 devstack sudo[96691]: pam_unix(sudo:session): session closed for user root Sep 29 18:25:06 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-310ef37c-f11e-4fc7-950c-8225b7d3e0bb tempest-GroupsTest-1343710170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6dcedda-242f-48c2-8865-0908a79286b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed15b3dc-ce83-4c80-8f6d-ae1d12238c17', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:25:06 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-310ef37c-f11e-4fc7-950c-8225b7d3e0bb tempest-GroupsTest-1343710170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0d4bf16-6419-4734-ad99-ef7a9a9d3f2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:25:06 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [req-5de385ff-dc62-4548-986e-c7210a7b2c6c req-c40bbf1e-c15a-425e-bd27-5066a75f6268 tempest-AttachVolumeNegativeTest-1588161148 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.055s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:25:06 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-310ef37c-f11e-4fc7-950c-8225b7d3e0bb tempest-GroupsTest-1343710170 None] Volume volume-ed15b3dc-ce83-4c80-8f6d-ae1d12238c17 (ed15b3dc-ce83-4c80-8f6d-ae1d12238c17): created successfully Sep 29 18:25:06 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-310ef37c-f11e-4fc7-950c-8225b7d3e0bb tempest-GroupsTest-1343710170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0d4bf16-6419-4734-ad99-ef7a9a9d3f2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:25:06 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-310ef37c-f11e-4fc7-950c-8225b7d3e0bb tempest-GroupsTest-1343710170 None] Flow 'volume_create_manager' (1623fa04-2934-48db-91d6-e97d0f202ba3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:25:06 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [req-5de385ff-dc62-4548-986e-c7210a7b2c6c req-c40bbf1e-c15a-425e-bd27-5066a75f6268 tempest-AttachVolumeNegativeTest-1588161148 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883', 'name': 'volume-e8c56791-d854-4764-838a-c21804e199af', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '49397a8e-b94f-44f3-a3d6-5f1e33d45dc4', 'enforce_multipath': True} {{(pid=86512) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 29 18:25:06 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-310ef37c-f11e-4fc7-950c-8225b7d3e0bb tempest-GroupsTest-1343710170 None] Created volume successfully. Sep 29 18:25:06 devstack cinder-volume[86512]: INFO cinder.volume.manager [req-5de385ff-dc62-4548-986e-c7210a7b2c6c req-c40bbf1e-c15a-425e-bd27-5066a75f6268 tempest-AttachVolumeNegativeTest-1588161148 None] attachment_update completed successfully. Sep 29 18:25:07 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-bd43d965-cfd2-4f83-b340-e9bc88eb9478 tempest-GroupsTest-1343710170 None] Update group completed successfully. Sep 29 18:25:09 devstack cinder-volume[86512]: DEBUG dbcounter [-] [86512] Writing DB stats cinder:UPDATE=100,cinder:DELETE=7,cinder:SELECT=105,cinder:INSERT=15 {{(pid=86512) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 18:25:09 devstack cinder-volume[86512]: DEBUG dbcounter [-] [86512] Writing DB stats cinder:SELECT=107,cinder:INSERT=26,cinder:UPDATE=97,cinder:DELETE=6 {{(pid=86512) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 18:25:09 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-9d477ff4-d4f2-44f8-9d42-3224f2b9a794 tempest-GroupsTest-1343710170 None] Update group completed successfully. Sep 29 18:25:11 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-e7c7547c-4984-491a-ad90-ce49c6c5b98d tempest-GroupsTest-1343710170 None] Acquiring lock "cinder-quobyte-df708e73-dfcb-40d5-9960-bfe5cfaf3038" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:25:11 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-e7c7547c-4984-491a-ad90-ce49c6c5b98d tempest-GroupsTest-1343710170 None] Lock "cinder-quobyte-df708e73-dfcb-40d5-9960-bfe5cfaf3038" acquired by "delete_volume" :: waited 0.022s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:25:11 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa0a3111-9a2d-4d2a-b907-7c663df2df1b]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:25:11 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-e7c7547c-4984-491a-ad90-ce49c6c5b98d tempest-GroupsTest-1343710170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-df708e73-dfcb-40d5-9960-bfe5cfaf3038 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:25:11 devstack sudo[97115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-df708e73-dfcb-40d5-9960-bfe5cfaf3038 Sep 29 18:25:11 devstack sudo[97115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:25:11 devstack sudo[97115]: pam_unix(sudo:session): session closed for user root Sep 29 18:25:11 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-e7c7547c-4984-491a-ad90-ce49c6c5b98d tempest-GroupsTest-1343710170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-df708e73-dfcb-40d5-9960-bfe5cfaf3038" returned: 0 in 0.528s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:25:11 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-e7c7547c-4984-491a-ad90-ce49c6c5b98d tempest-GroupsTest-1343710170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-df708e73-dfcb-40d5-9960-bfe5cfaf3038 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:25:11 devstack sudo[97120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-df708e73-dfcb-40d5-9960-bfe5cfaf3038 Sep 29 18:25:11 devstack sudo[97120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:25:12 devstack sudo[97120]: pam_unix(sudo:session): session closed for user root Sep 29 18:25:12 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-e7c7547c-4984-491a-ad90-ce49c6c5b98d tempest-GroupsTest-1343710170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-df708e73-dfcb-40d5-9960-bfe5cfaf3038" returned: 0 in 0.293s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:25:12 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-e7c7547c-4984-491a-ad90-ce49c6c5b98d tempest-GroupsTest-1343710170 None] Lock "cinder-quobyte-df708e73-dfcb-40d5-9960-bfe5cfaf3038" released by "delete_volume" :: held 0.906s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:25:12 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-e7c7547c-4984-491a-ad90-ce49c6c5b98d tempest-GroupsTest-1343710170 None] Acquiring lock "cinder-quobyte-ed15b3dc-ce83-4c80-8f6d-ae1d12238c17" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:25:12 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-e7c7547c-4984-491a-ad90-ce49c6c5b98d tempest-GroupsTest-1343710170 None] Lock "cinder-quobyte-ed15b3dc-ce83-4c80-8f6d-ae1d12238c17" acquired by "delete_volume" :: waited 0.022s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:25:12 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1f2a051-92eb-48c0-b346-776c1ec61430]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:25:12 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-e7c7547c-4984-491a-ad90-ce49c6c5b98d tempest-GroupsTest-1343710170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ed15b3dc-ce83-4c80-8f6d-ae1d12238c17 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:25:12 devstack sudo[97123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ed15b3dc-ce83-4c80-8f6d-ae1d12238c17 Sep 29 18:25:12 devstack sudo[97123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:25:13 devstack sudo[97123]: pam_unix(sudo:session): session closed for user root Sep 29 18:25:13 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-e7c7547c-4984-491a-ad90-ce49c6c5b98d tempest-GroupsTest-1343710170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ed15b3dc-ce83-4c80-8f6d-ae1d12238c17" returned: 0 in 0.742s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:25:13 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-e7c7547c-4984-491a-ad90-ce49c6c5b98d tempest-GroupsTest-1343710170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ed15b3dc-ce83-4c80-8f6d-ae1d12238c17 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:25:13 devstack sudo[97131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ed15b3dc-ce83-4c80-8f6d-ae1d12238c17 Sep 29 18:25:13 devstack sudo[97131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:25:13 devstack sudo[97131]: pam_unix(sudo:session): session closed for user root Sep 29 18:25:13 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-e7c7547c-4984-491a-ad90-ce49c6c5b98d tempest-GroupsTest-1343710170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ed15b3dc-ce83-4c80-8f6d-ae1d12238c17" returned: 0 in 0.441s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:25:13 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-e7c7547c-4984-491a-ad90-ce49c6c5b98d tempest-GroupsTest-1343710170 None] Lock "cinder-quobyte-ed15b3dc-ce83-4c80-8f6d-ae1d12238c17" released by "delete_volume" :: held 1.268s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:25:13 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-e7c7547c-4984-491a-ad90-ce49c6c5b98d tempest-GroupsTest-1343710170 None] Created reservations ['184c5835-a7a0-4d9e-a64a-167110f89867'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:25:13 devstack cinder-volume[86512]: WARNING cinder.quota [None req-e7c7547c-4984-491a-ad90-ce49c6c5b98d tempest-GroupsTest-1343710170 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1980665030 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1980665030, it is now deprecated. Please use the default quota class for default quota. Sep 29 18:25:13 devstack cinder-volume[86512]: WARNING cinder.quota [None req-e7c7547c-4984-491a-ad90-ce49c6c5b98d tempest-GroupsTest-1343710170 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1980665030 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1980665030, it is now deprecated. Please use the default quota class for default quota. Sep 29 18:25:13 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-e7c7547c-4984-491a-ad90-ce49c6c5b98d tempest-GroupsTest-1343710170 None] Created reservations ['0e9bd790-748d-47a8-b351-ade48d5a23e2', 'fb9a6f21-44e4-4bc1-a117-4e5c39d24634', '1f213cea-7959-4e67-807c-31d682dbfe0f', 'c424c2eb-e2a2-4a82-b885-76f66da8524f'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:25:13 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-e7c7547c-4984-491a-ad90-ce49c6c5b98d tempest-GroupsTest-1343710170 None] Created reservations ['131b6ac0-7a26-43f8-9d13-3fa08d81aaac', '1ec892fb-205c-43df-bd6d-c61ee5fa8103', 'bcfa527b-412a-4c6e-a8da-51023c7cb922', '4f4625c0-3a6a-4323-8030-b260c94ac442'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:25:14 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-e7c7547c-4984-491a-ad90-ce49c6c5b98d tempest-GroupsTest-1343710170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:25:14 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-e7c7547c-4984-491a-ad90-ce49c6c5b98d tempest-GroupsTest-1343710170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:25:14 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-e7c7547c-4984-491a-ad90-ce49c6c5b98d tempest-GroupsTest-1343710170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:25:14 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-e7c7547c-4984-491a-ad90-ce49c6c5b98d tempest-GroupsTest-1343710170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:25:14 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-e7c7547c-4984-491a-ad90-ce49c6c5b98d tempest-GroupsTest-1343710170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:25:14 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-e7c7547c-4984-491a-ad90-ce49c6c5b98d tempest-GroupsTest-1343710170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:25:14 devstack sudo[97135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:25:14 devstack sudo[97135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:25:14 devstack sudo[97135]: pam_unix(sudo:session): session closed for user root Sep 29 18:25:14 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-e7c7547c-4984-491a-ad90-ce49c6c5b98d tempest-GroupsTest-1343710170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.359s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:25:14 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-e7c7547c-4984-491a-ad90-ce49c6c5b98d tempest-GroupsTest-1343710170 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:25:14 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-e7c7547c-4984-491a-ad90-ce49c6c5b98d tempest-GroupsTest-1343710170 None] Delete group completed successfully. Sep 29 18:25:21 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f72df20-f6a3-494d-b3f5-34237f89abb0 tempest-VolumeQuotasAdminTestJSON-383809102 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86512) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:25:21 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-5f72df20-f6a3-494d-b3f5-34237f89abb0 tempest-VolumeQuotasAdminTestJSON-383809102 None] Flow 'volume_create_manager' (1037f1df-5c70-4e34-bc11-b9747e5abfda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:25:21 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-5f72df20-f6a3-494d-b3f5-34237f89abb0 tempest-VolumeQuotasAdminTestJSON-383809102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3d4d171-b207-4431-9411-5da77662df07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:25:21 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-5f72df20-f6a3-494d-b3f5-34237f89abb0 tempest-VolumeQuotasAdminTestJSON-383809102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3d4d171-b207-4431-9411-5da77662df07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:25:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1585298148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09aa53f9-02d6-431b-a301-96d988810ff8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='387704439f4f49649d025cd1df14dd75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:25:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:25:21Z,use_quota=True,user_id='2c44e93639ef43e8ad1b026ea05f6ee8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:25:21 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-5f72df20-f6a3-494d-b3f5-34237f89abb0 tempest-VolumeQuotasAdminTestJSON-383809102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff7e294b-2431-4fc4-872a-5691aaf83a1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:25:21 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-5f72df20-f6a3-494d-b3f5-34237f89abb0 tempest-VolumeQuotasAdminTestJSON-383809102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff7e294b-2431-4fc4-872a-5691aaf83a1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:25:21 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-5f72df20-f6a3-494d-b3f5-34237f89abb0 tempest-VolumeQuotasAdminTestJSON-383809102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96b3c744-3fe2-4f91-8d3b-529b80f033c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:25:21 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-5f72df20-f6a3-494d-b3f5-34237f89abb0 tempest-VolumeQuotasAdminTestJSON-383809102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96b3c744-3fe2-4f91-8d3b-529b80f033c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09aa53f9-02d6-431b-a301-96d988810ff8', 'volume_name': 'volume-09aa53f9-02d6-431b-a301-96d988810ff8', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:25:21 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-5f72df20-f6a3-494d-b3f5-34237f89abb0 tempest-VolumeQuotasAdminTestJSON-383809102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cf2e701-7fc5-4a65-8ecb-59a3a8440870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:25:21 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-5f72df20-f6a3-494d-b3f5-34237f89abb0 tempest-VolumeQuotasAdminTestJSON-383809102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cf2e701-7fc5-4a65-8ecb-59a3a8440870) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:25:21 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-5f72df20-f6a3-494d-b3f5-34237f89abb0 tempest-VolumeQuotasAdminTestJSON-383809102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bfde5fd-e762-49e8-95a6-fd0f5584a9a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:25:21 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-5f72df20-f6a3-494d-b3f5-34237f89abb0 tempest-VolumeQuotasAdminTestJSON-383809102 None] Volume 09aa53f9-02d6-431b-a301-96d988810ff8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09aa53f9-02d6-431b-a301-96d988810ff8', 'volume_size': 1} Sep 29 18:25:21 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-5f72df20-f6a3-494d-b3f5-34237f89abb0 tempest-VolumeQuotasAdminTestJSON-383809102 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:25:21 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-5f72df20-f6a3-494d-b3f5-34237f89abb0 tempest-VolumeQuotasAdminTestJSON-383809102 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:25:21 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-5f72df20-f6a3-494d-b3f5-34237f89abb0 tempest-VolumeQuotasAdminTestJSON-383809102 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:25:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1585298148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09aa53f9-02d6-431b-a301-96d988810ff8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='387704439f4f49649d025cd1df14dd75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:25:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:25:21Z,use_quota=True,user_id='2c44e93639ef43e8ad1b026ea05f6ee8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)}" {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:25:21 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-5f72df20-f6a3-494d-b3f5-34237f89abb0 tempest-VolumeQuotasAdminTestJSON-383809102 None] Creating volume 09aa53f9-02d6-431b-a301-96d988810ff8 {{(pid=86512) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:25:21 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-5f72df20-f6a3-494d-b3f5-34237f89abb0 tempest-VolumeQuotasAdminTestJSON-383809102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:25:21 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-5f72df20-f6a3-494d-b3f5-34237f89abb0 tempest-VolumeQuotasAdminTestJSON-383809102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:25:21 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-5f72df20-f6a3-494d-b3f5-34237f89abb0 tempest-VolumeQuotasAdminTestJSON-383809102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:25:21 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-5f72df20-f6a3-494d-b3f5-34237f89abb0 tempest-VolumeQuotasAdminTestJSON-383809102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:25:21 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-5f72df20-f6a3-494d-b3f5-34237f89abb0 tempest-VolumeQuotasAdminTestJSON-383809102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:25:21 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-5f72df20-f6a3-494d-b3f5-34237f89abb0 tempest-VolumeQuotasAdminTestJSON-383809102 None] Selected osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 as target Quobyte volume. {{(pid=86512) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:25:21 devstack cinder-volume[86512]: INFO cinder.volume.drivers.remotefs [None req-5f72df20-f6a3-494d-b3f5-34237f89abb0 tempest-VolumeQuotasAdminTestJSON-383809102 None] casted to osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 Sep 29 18:25:21 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-5f72df20-f6a3-494d-b3f5-34237f89abb0 tempest-VolumeQuotasAdminTestJSON-383809102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-09aa53f9-02d6-431b-a301-96d988810ff8 1073741824 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:25:21 devstack sudo[97308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-09aa53f9-02d6-431b-a301-96d988810ff8 1073741824 Sep 29 18:25:21 devstack sudo[97308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:25:21 devstack sudo[97308]: pam_unix(sudo:session): session closed for user root Sep 29 18:25:21 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-5f72df20-f6a3-494d-b3f5-34237f89abb0 tempest-VolumeQuotasAdminTestJSON-383809102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-09aa53f9-02d6-431b-a301-96d988810ff8 1073741824" returned: 0 in 0.587s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:25:21 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-5f72df20-f6a3-494d-b3f5-34237f89abb0 tempest-VolumeQuotasAdminTestJSON-383809102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-09aa53f9-02d6-431b-a301-96d988810ff8 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:25:21 devstack sudo[97314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-09aa53f9-02d6-431b-a301-96d988810ff8 Sep 29 18:25:21 devstack sudo[97314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:25:22 devstack sudo[97314]: pam_unix(sudo:session): session closed for user root Sep 29 18:25:22 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-5f72df20-f6a3-494d-b3f5-34237f89abb0 tempest-VolumeQuotasAdminTestJSON-383809102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-09aa53f9-02d6-431b-a301-96d988810ff8" returned: 0 in 0.264s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:25:22 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-5f72df20-f6a3-494d-b3f5-34237f89abb0 tempest-VolumeQuotasAdminTestJSON-383809102 None] <== create_volume: return (926ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'} {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:25:22 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-5f72df20-f6a3-494d-b3f5-34237f89abb0 tempest-VolumeQuotasAdminTestJSON-383809102 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.929s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:25:22 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-5f72df20-f6a3-494d-b3f5-34237f89abb0 tempest-VolumeQuotasAdminTestJSON-383809102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bfde5fd-e762-49e8-95a6-fd0f5584a9a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09aa53f9-02d6-431b-a301-96d988810ff8', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:25:22 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-5f72df20-f6a3-494d-b3f5-34237f89abb0 tempest-VolumeQuotasAdminTestJSON-383809102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (459ce42c-aef2-43f5-80c4-fe4298df59fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:25:22 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-5f72df20-f6a3-494d-b3f5-34237f89abb0 tempest-VolumeQuotasAdminTestJSON-383809102 None] Volume volume-09aa53f9-02d6-431b-a301-96d988810ff8 (09aa53f9-02d6-431b-a301-96d988810ff8): created successfully Sep 29 18:25:22 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-5f72df20-f6a3-494d-b3f5-34237f89abb0 tempest-VolumeQuotasAdminTestJSON-383809102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (459ce42c-aef2-43f5-80c4-fe4298df59fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:25:22 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-5f72df20-f6a3-494d-b3f5-34237f89abb0 tempest-VolumeQuotasAdminTestJSON-383809102 None] Flow 'volume_create_manager' (1037f1df-5c70-4e34-bc11-b9747e5abfda) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:25:22 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-5f72df20-f6a3-494d-b3f5-34237f89abb0 tempest-VolumeQuotasAdminTestJSON-383809102 None] Created volume successfully. Sep 29 18:25:23 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-c7f95937-6d2c-4161-a44a-22944c3b9794 tempest-VolumeQuotasAdminTestJSON-383809102 None] Acquiring lock "cinder-09aa53f9-02d6-431b-a301-96d988810ff8-delete_volume" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:25:23 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-c7f95937-6d2c-4161-a44a-22944c3b9794 tempest-VolumeQuotasAdminTestJSON-383809102 None] Lock "cinder-09aa53f9-02d6-431b-a301-96d988810ff8-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:25:23 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-c7f95937-6d2c-4161-a44a-22944c3b9794 tempest-VolumeQuotasAdminTestJSON-383809102 None] Acquiring lock "cinder-quobyte-09aa53f9-02d6-431b-a301-96d988810ff8" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:25:23 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-c7f95937-6d2c-4161-a44a-22944c3b9794 tempest-VolumeQuotasAdminTestJSON-383809102 None] Lock "cinder-quobyte-09aa53f9-02d6-431b-a301-96d988810ff8" acquired by "delete_volume" :: waited 0.055s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:25:23 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[63a58760-f72b-4552-9916-1987537bfcdf]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:25:23 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-c7f95937-6d2c-4161-a44a-22944c3b9794 tempest-VolumeQuotasAdminTestJSON-383809102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-09aa53f9-02d6-431b-a301-96d988810ff8 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:25:23 devstack sudo[97319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-09aa53f9-02d6-431b-a301-96d988810ff8 Sep 29 18:25:23 devstack sudo[97319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:25:23 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-8c7ca0e7-19f3-48e6-909f-767d33a6f760 tempest-GroupsV320Test-312265474 None] Group tempest-GroupsV320Test-Group-36894160: creating Sep 29 18:25:23 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-8c7ca0e7-19f3-48e6-909f-767d33a6f760 tempest-GroupsV320Test-312265474 None] Group tempest-GroupsV320Test-Group-36894160: created successfully Sep 29 18:25:23 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-8c7ca0e7-19f3-48e6-909f-767d33a6f760 tempest-GroupsV320Test-312265474 None] Create group completed successfully. Sep 29 18:25:24 devstack sudo[97319]: pam_unix(sudo:session): session closed for user root Sep 29 18:25:24 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-c7f95937-6d2c-4161-a44a-22944c3b9794 tempest-VolumeQuotasAdminTestJSON-383809102 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-09aa53f9-02d6-431b-a301-96d988810ff8" returned: 0 in 0.562s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:25:24 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-c7f95937-6d2c-4161-a44a-22944c3b9794 tempest-VolumeQuotasAdminTestJSON-383809102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-09aa53f9-02d6-431b-a301-96d988810ff8 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:25:24 devstack sudo[97327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-09aa53f9-02d6-431b-a301-96d988810ff8 Sep 29 18:25:24 devstack sudo[97327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:25:24 devstack sudo[97327]: pam_unix(sudo:session): session closed for user root Sep 29 18:25:24 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-c7f95937-6d2c-4161-a44a-22944c3b9794 tempest-VolumeQuotasAdminTestJSON-383809102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-09aa53f9-02d6-431b-a301-96d988810ff8" returned: 0 in 0.293s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:25:24 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-c7f95937-6d2c-4161-a44a-22944c3b9794 tempest-VolumeQuotasAdminTestJSON-383809102 None] Lock "cinder-quobyte-09aa53f9-02d6-431b-a301-96d988810ff8" released by "delete_volume" :: held 0.936s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:25:24 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-c7f95937-6d2c-4161-a44a-22944c3b9794 tempest-VolumeQuotasAdminTestJSON-383809102 None] Created reservations ['3d315378-2bc3-4249-83f4-6d39d40dd19f', '8fa9b21c-d6b7-4cd2-bd8c-b3ea5fd5ed4f', 'cf035c24-942f-4145-bf65-059fd2948704', 'd1ed506f-1c9a-4132-85dc-2061d945bed9'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:25:24 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-c7f95937-6d2c-4161-a44a-22944c3b9794 tempest-VolumeQuotasAdminTestJSON-383809102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:25:24 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-c7f95937-6d2c-4161-a44a-22944c3b9794 tempest-VolumeQuotasAdminTestJSON-383809102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:25:24 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-c7f95937-6d2c-4161-a44a-22944c3b9794 tempest-VolumeQuotasAdminTestJSON-383809102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:25:24 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-c7f95937-6d2c-4161-a44a-22944c3b9794 tempest-VolumeQuotasAdminTestJSON-383809102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:25:24 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-c7f95937-6d2c-4161-a44a-22944c3b9794 tempest-VolumeQuotasAdminTestJSON-383809102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:25:24 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-c7f95937-6d2c-4161-a44a-22944c3b9794 tempest-VolumeQuotasAdminTestJSON-383809102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:25:24 devstack sudo[97330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:25:24 devstack sudo[97330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:25:24 devstack sudo[97330]: pam_unix(sudo:session): session closed for user root Sep 29 18:25:24 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-c7f95937-6d2c-4161-a44a-22944c3b9794 tempest-VolumeQuotasAdminTestJSON-383809102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.305s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:25:24 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-c7f95937-6d2c-4161-a44a-22944c3b9794 tempest-VolumeQuotasAdminTestJSON-383809102 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:25:24 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-c7f95937-6d2c-4161-a44a-22944c3b9794 tempest-VolumeQuotasAdminTestJSON-383809102 None] Deleted volume successfully. Sep 29 18:25:24 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-c7f95937-6d2c-4161-a44a-22944c3b9794 tempest-VolumeQuotasAdminTestJSON-383809102 None] Lock "cinder-09aa53f9-02d6-431b-a301-96d988810ff8-delete_volume" released by "delete_volume" :: held 1.547s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:25:25 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-938d59fa-1469-48d2-a084-2fb60abdf4be tempest-VolumeQuotasAdminTestJSON-383809102 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86512) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:25:25 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-938d59fa-1469-48d2-a084-2fb60abdf4be tempest-VolumeQuotasAdminTestJSON-383809102 None] Flow 'volume_create_manager' (e2159b16-3d0e-41fd-97c0-7413c8e713dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:25:25 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-938d59fa-1469-48d2-a084-2fb60abdf4be tempest-VolumeQuotasAdminTestJSON-383809102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab434e79-aa43-4178-9674-0d43bf54140f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:25:25 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-938d59fa-1469-48d2-a084-2fb60abdf4be tempest-VolumeQuotasAdminTestJSON-383809102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab434e79-aa43-4178-9674-0d43bf54140f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:25:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2109211402',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1af90879-18dc-47ab-86f5-5fe4c60f4a66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='387704439f4f49649d025cd1df14dd75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:25:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:25:25Z,use_quota=True,user_id='2c44e93639ef43e8ad1b026ea05f6ee8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:25:25 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-938d59fa-1469-48d2-a084-2fb60abdf4be tempest-VolumeQuotasAdminTestJSON-383809102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0515a5e9-774e-4b0f-b3b8-1c8fa5a485fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:25:25 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-938d59fa-1469-48d2-a084-2fb60abdf4be tempest-VolumeQuotasAdminTestJSON-383809102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0515a5e9-774e-4b0f-b3b8-1c8fa5a485fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:25:25 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-938d59fa-1469-48d2-a084-2fb60abdf4be tempest-VolumeQuotasAdminTestJSON-383809102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c74b4e9-c485-4451-be58-23fb8b32fa21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:25:25 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-938d59fa-1469-48d2-a084-2fb60abdf4be tempest-VolumeQuotasAdminTestJSON-383809102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c74b4e9-c485-4451-be58-23fb8b32fa21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1af90879-18dc-47ab-86f5-5fe4c60f4a66', 'volume_name': 'volume-1af90879-18dc-47ab-86f5-5fe4c60f4a66', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:25:25 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-938d59fa-1469-48d2-a084-2fb60abdf4be tempest-VolumeQuotasAdminTestJSON-383809102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ea003ff-480d-4784-bb42-f088a870962e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:25:25 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-938d59fa-1469-48d2-a084-2fb60abdf4be tempest-VolumeQuotasAdminTestJSON-383809102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ea003ff-480d-4784-bb42-f088a870962e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:25:25 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-938d59fa-1469-48d2-a084-2fb60abdf4be tempest-VolumeQuotasAdminTestJSON-383809102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ea3ffc7-c54b-4403-8084-c578f5b9495b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:25:25 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-938d59fa-1469-48d2-a084-2fb60abdf4be tempest-VolumeQuotasAdminTestJSON-383809102 None] Volume 1af90879-18dc-47ab-86f5-5fe4c60f4a66: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1af90879-18dc-47ab-86f5-5fe4c60f4a66', 'volume_size': 1} Sep 29 18:25:25 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-938d59fa-1469-48d2-a084-2fb60abdf4be tempest-VolumeQuotasAdminTestJSON-383809102 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:25:25 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-938d59fa-1469-48d2-a084-2fb60abdf4be tempest-VolumeQuotasAdminTestJSON-383809102 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:25:25 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-938d59fa-1469-48d2-a084-2fb60abdf4be tempest-VolumeQuotasAdminTestJSON-383809102 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:25:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2109211402',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1af90879-18dc-47ab-86f5-5fe4c60f4a66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='387704439f4f49649d025cd1df14dd75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:25:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:25:25Z,use_quota=True,user_id='2c44e93639ef43e8ad1b026ea05f6ee8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)}" {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:25:25 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-938d59fa-1469-48d2-a084-2fb60abdf4be tempest-VolumeQuotasAdminTestJSON-383809102 None] Creating volume 1af90879-18dc-47ab-86f5-5fe4c60f4a66 {{(pid=86512) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:25:25 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-938d59fa-1469-48d2-a084-2fb60abdf4be tempest-VolumeQuotasAdminTestJSON-383809102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:25:25 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-938d59fa-1469-48d2-a084-2fb60abdf4be tempest-VolumeQuotasAdminTestJSON-383809102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:25:25 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-938d59fa-1469-48d2-a084-2fb60abdf4be tempest-VolumeQuotasAdminTestJSON-383809102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:25:25 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-938d59fa-1469-48d2-a084-2fb60abdf4be tempest-VolumeQuotasAdminTestJSON-383809102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:25:25 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-938d59fa-1469-48d2-a084-2fb60abdf4be tempest-VolumeQuotasAdminTestJSON-383809102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:25:25 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-938d59fa-1469-48d2-a084-2fb60abdf4be tempest-VolumeQuotasAdminTestJSON-383809102 None] Selected osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 as target Quobyte volume. {{(pid=86512) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:25:25 devstack cinder-volume[86512]: INFO cinder.volume.drivers.remotefs [None req-938d59fa-1469-48d2-a084-2fb60abdf4be tempest-VolumeQuotasAdminTestJSON-383809102 None] casted to osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 Sep 29 18:25:25 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-938d59fa-1469-48d2-a084-2fb60abdf4be tempest-VolumeQuotasAdminTestJSON-383809102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-1af90879-18dc-47ab-86f5-5fe4c60f4a66 1073741824 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:25:25 devstack sudo[97333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-1af90879-18dc-47ab-86f5-5fe4c60f4a66 1073741824 Sep 29 18:25:25 devstack sudo[97333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:25:25 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-6c2ac40a-6bfe-4511-b7b7-144bf9b4084e tempest-GroupsV320Test-312265474 None] Created reservations ['db4cee14-5fd9-4d28-ab9f-83fc07864dd8'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:25:25 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-6c2ac40a-6bfe-4511-b7b7-144bf9b4084e tempest-GroupsV320Test-312265474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:25:25 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-6c2ac40a-6bfe-4511-b7b7-144bf9b4084e tempest-GroupsV320Test-312265474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:25:25 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-6c2ac40a-6bfe-4511-b7b7-144bf9b4084e tempest-GroupsV320Test-312265474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:25:25 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-6c2ac40a-6bfe-4511-b7b7-144bf9b4084e tempest-GroupsV320Test-312265474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:25:25 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-6c2ac40a-6bfe-4511-b7b7-144bf9b4084e tempest-GroupsV320Test-312265474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:25:25 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-6c2ac40a-6bfe-4511-b7b7-144bf9b4084e tempest-GroupsV320Test-312265474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:25:25 devstack sudo[97338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:25:25 devstack sudo[97338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:25:25 devstack sudo[97333]: pam_unix(sudo:session): session closed for user root Sep 29 18:25:25 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-938d59fa-1469-48d2-a084-2fb60abdf4be tempest-VolumeQuotasAdminTestJSON-383809102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-1af90879-18dc-47ab-86f5-5fe4c60f4a66 1073741824" returned: 0 in 0.501s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:25:25 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-938d59fa-1469-48d2-a084-2fb60abdf4be tempest-VolumeQuotasAdminTestJSON-383809102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-1af90879-18dc-47ab-86f5-5fe4c60f4a66 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:25:25 devstack sudo[97341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-1af90879-18dc-47ab-86f5-5fe4c60f4a66 Sep 29 18:25:25 devstack sudo[97341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:25:25 devstack sudo[97338]: pam_unix(sudo:session): session closed for user root Sep 29 18:25:25 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-6c2ac40a-6bfe-4511-b7b7-144bf9b4084e tempest-GroupsV320Test-312265474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.275s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:25:25 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-6c2ac40a-6bfe-4511-b7b7-144bf9b4084e tempest-GroupsV320Test-312265474 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:25:25 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-6c2ac40a-6bfe-4511-b7b7-144bf9b4084e tempest-GroupsV320Test-312265474 None] Delete group completed successfully. Sep 29 18:25:26 devstack sudo[97341]: pam_unix(sudo:session): session closed for user root Sep 29 18:25:26 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-938d59fa-1469-48d2-a084-2fb60abdf4be tempest-VolumeQuotasAdminTestJSON-383809102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-1af90879-18dc-47ab-86f5-5fe4c60f4a66" returned: 0 in 0.258s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:25:26 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-938d59fa-1469-48d2-a084-2fb60abdf4be tempest-VolumeQuotasAdminTestJSON-383809102 None] <== create_volume: return (810ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'} {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:25:26 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-938d59fa-1469-48d2-a084-2fb60abdf4be tempest-VolumeQuotasAdminTestJSON-383809102 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.813s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:25:26 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-938d59fa-1469-48d2-a084-2fb60abdf4be tempest-VolumeQuotasAdminTestJSON-383809102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ea3ffc7-c54b-4403-8084-c578f5b9495b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1af90879-18dc-47ab-86f5-5fe4c60f4a66', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:25:26 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-938d59fa-1469-48d2-a084-2fb60abdf4be tempest-VolumeQuotasAdminTestJSON-383809102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (174c6a0e-21fa-4242-a6e8-80aa318b268f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:25:26 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-938d59fa-1469-48d2-a084-2fb60abdf4be tempest-VolumeQuotasAdminTestJSON-383809102 None] Volume volume-1af90879-18dc-47ab-86f5-5fe4c60f4a66 (1af90879-18dc-47ab-86f5-5fe4c60f4a66): created successfully Sep 29 18:25:26 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-938d59fa-1469-48d2-a084-2fb60abdf4be tempest-VolumeQuotasAdminTestJSON-383809102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (174c6a0e-21fa-4242-a6e8-80aa318b268f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:25:26 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-938d59fa-1469-48d2-a084-2fb60abdf4be tempest-VolumeQuotasAdminTestJSON-383809102 None] Flow 'volume_create_manager' (e2159b16-3d0e-41fd-97c0-7413c8e713dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:25:26 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-938d59fa-1469-48d2-a084-2fb60abdf4be tempest-VolumeQuotasAdminTestJSON-383809102 None] Created volume successfully. Sep 29 18:25:28 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-e1db75c7-0a5e-47d7-bd43-f8ec412cd40b tempest-VolumeQuotasAdminTestJSON-1912907874 None] Transfer volume completed successfully. Sep 29 18:25:28 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-a7797f49-839d-424c-a909-7e9b30c20788 tempest-VolumeQuotasAdminTestJSON-930823633 None] Acquiring lock "cinder-1af90879-18dc-47ab-86f5-5fe4c60f4a66-delete_volume" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:25:28 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-a7797f49-839d-424c-a909-7e9b30c20788 tempest-VolumeQuotasAdminTestJSON-930823633 None] Lock "cinder-1af90879-18dc-47ab-86f5-5fe4c60f4a66-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:25:28 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-a7797f49-839d-424c-a909-7e9b30c20788 tempest-VolumeQuotasAdminTestJSON-930823633 None] Acquiring lock "cinder-quobyte-1af90879-18dc-47ab-86f5-5fe4c60f4a66" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:25:28 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-a7797f49-839d-424c-a909-7e9b30c20788 tempest-VolumeQuotasAdminTestJSON-930823633 None] Lock "cinder-quobyte-1af90879-18dc-47ab-86f5-5fe4c60f4a66" acquired by "delete_volume" :: waited 0.018s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:25:29 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[db683a6d-1115-4690-8d2a-a4ed34d9db40]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:25:29 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a7797f49-839d-424c-a909-7e9b30c20788 tempest-VolumeQuotasAdminTestJSON-930823633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-1af90879-18dc-47ab-86f5-5fe4c60f4a66 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:25:29 devstack sudo[97369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-1af90879-18dc-47ab-86f5-5fe4c60f4a66 Sep 29 18:25:29 devstack sudo[97369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:25:29 devstack sudo[97369]: pam_unix(sudo:session): session closed for user root Sep 29 18:25:29 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a7797f49-839d-424c-a909-7e9b30c20788 tempest-VolumeQuotasAdminTestJSON-930823633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-1af90879-18dc-47ab-86f5-5fe4c60f4a66" returned: 0 in 0.395s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:25:29 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a7797f49-839d-424c-a909-7e9b30c20788 tempest-VolumeQuotasAdminTestJSON-930823633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-1af90879-18dc-47ab-86f5-5fe4c60f4a66 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:25:29 devstack sudo[97374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-1af90879-18dc-47ab-86f5-5fe4c60f4a66 Sep 29 18:25:29 devstack sudo[97374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:25:29 devstack sudo[97374]: pam_unix(sudo:session): session closed for user root Sep 29 18:25:29 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a7797f49-839d-424c-a909-7e9b30c20788 tempest-VolumeQuotasAdminTestJSON-930823633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-1af90879-18dc-47ab-86f5-5fe4c60f4a66" returned: 0 in 0.288s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:25:29 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-a7797f49-839d-424c-a909-7e9b30c20788 tempest-VolumeQuotasAdminTestJSON-930823633 None] Lock "cinder-quobyte-1af90879-18dc-47ab-86f5-5fe4c60f4a66" released by "delete_volume" :: held 0.750s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:25:29 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-a7797f49-839d-424c-a909-7e9b30c20788 tempest-VolumeQuotasAdminTestJSON-930823633 None] Created reservations ['1ee7f832-0560-43ab-b741-c9ffed83d764', '234ce409-9831-42dc-b909-335d376e5d63', 'd3759207-44a8-4446-92ff-a4ef4299d38f', 'a4b70c8e-4f67-4d8b-abb6-b51c1ed02761'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:25:29 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-a7797f49-839d-424c-a909-7e9b30c20788 tempest-VolumeQuotasAdminTestJSON-930823633 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:25:29 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-a7797f49-839d-424c-a909-7e9b30c20788 tempest-VolumeQuotasAdminTestJSON-930823633 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:25:29 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-a7797f49-839d-424c-a909-7e9b30c20788 tempest-VolumeQuotasAdminTestJSON-930823633 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:25:29 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-a7797f49-839d-424c-a909-7e9b30c20788 tempest-VolumeQuotasAdminTestJSON-930823633 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:25:29 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-a7797f49-839d-424c-a909-7e9b30c20788 tempest-VolumeQuotasAdminTestJSON-930823633 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:25:29 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a7797f49-839d-424c-a909-7e9b30c20788 tempest-VolumeQuotasAdminTestJSON-930823633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:25:29 devstack sudo[97379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:25:29 devstack sudo[97379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:25:30 devstack sudo[97379]: pam_unix(sudo:session): session closed for user root Sep 29 18:25:30 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a7797f49-839d-424c-a909-7e9b30c20788 tempest-VolumeQuotasAdminTestJSON-930823633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.451s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:25:30 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-a7797f49-839d-424c-a909-7e9b30c20788 tempest-VolumeQuotasAdminTestJSON-930823633 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:25:30 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-a7797f49-839d-424c-a909-7e9b30c20788 tempest-VolumeQuotasAdminTestJSON-930823633 None] Deleted volume successfully. Sep 29 18:25:30 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-a7797f49-839d-424c-a909-7e9b30c20788 tempest-VolumeQuotasAdminTestJSON-930823633 None] Lock "cinder-1af90879-18dc-47ab-86f5-5fe4c60f4a66-delete_volume" released by "delete_volume" :: held 1.471s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:25:31 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [req-19eaf45a-5c5c-4c29-9417-de61a81628a9 req-23b44dac-2c75-4367-a8bd-a7776321aad7 tempest-TestStampPattern-1947170058 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:25:31 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [req-19eaf45a-5c5c-4c29-9417-de61a81628a9 req-23b44dac-2c75-4367-a8bd-a7776321aad7 tempest-TestStampPattern-1947170058 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:25:31 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [req-19eaf45a-5c5c-4c29-9417-de61a81628a9 req-23b44dac-2c75-4367-a8bd-a7776321aad7 tempest-TestStampPattern-1947170058 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.024s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:25:31 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [req-19eaf45a-5c5c-4c29-9417-de61a81628a9 req-23b44dac-2c75-4367-a8bd-a7776321aad7 tempest-TestStampPattern-1947170058 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883', 'name': 'volume-76c83cb3-8bd4-4efa-9940-142f21431def', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e8375570-cb71-4dde-a330-241c2951a36c', 'enforce_multipath': True} {{(pid=86512) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 29 18:25:31 devstack cinder-volume[86512]: INFO cinder.volume.manager [req-19eaf45a-5c5c-4c29-9417-de61a81628a9 req-23b44dac-2c75-4367-a8bd-a7776321aad7 tempest-TestStampPattern-1947170058 None] attachment_update completed successfully. Sep 29 18:25:35 devstack cinder-volume[86512]: INFO cinder.volume.manager [req-736f760c-9d34-4a1c-b9f2-872d8d1783a1 req-eb80b898-f8ef-40b6-8160-fa0b99944aec tempest-TestStampPattern-1947170058 None] Terminate volume connection completed successfully. Sep 29 18:25:35 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [req-736f760c-9d34-4a1c-b9f2-872d8d1783a1 req-eb80b898-f8ef-40b6-8160-fa0b99944aec tempest-TestStampPattern-1947170058 None] Deleting attachment e8375570-cb71-4dde-a330-241c2951a36c. {{(pid=86512) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 29 18:25:35 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d0ab857-ef2f-4c21-abee-f55fd2ca0b40 tempest-VolumesServicesTestJSON-1923345814 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86512) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:25:35 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-7d0ab857-ef2f-4c21-abee-f55fd2ca0b40 tempest-VolumesServicesTestJSON-1923345814 None] Flow 'volume_create_manager' (596c2870-97eb-40a6-a4d5-3314a515e340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:25:35 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-7d0ab857-ef2f-4c21-abee-f55fd2ca0b40 tempest-VolumesServicesTestJSON-1923345814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e25e1fa-d8b1-489f-9852-70d8609ff277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:25:35 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-7d0ab857-ef2f-4c21-abee-f55fd2ca0b40 tempest-VolumesServicesTestJSON-1923345814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e25e1fa-d8b1-489f-9852-70d8609ff277) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:25:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-138822992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c7f09ea-a0fa-4685-8358-e9b36b0e79fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a802a98b63a943ec965d6586a71c456b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:25:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:25:36Z,use_quota=True,user_id='7ce92dd6a22f4a96875edfcae7c2ac8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:25:35 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-7d0ab857-ef2f-4c21-abee-f55fd2ca0b40 tempest-VolumesServicesTestJSON-1923345814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c758842f-8f55-404e-b230-b013c1b8a9e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:25:35 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-7d0ab857-ef2f-4c21-abee-f55fd2ca0b40 tempest-VolumesServicesTestJSON-1923345814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c758842f-8f55-404e-b230-b013c1b8a9e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:25:35 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-7d0ab857-ef2f-4c21-abee-f55fd2ca0b40 tempest-VolumesServicesTestJSON-1923345814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2388b6bf-542b-40c3-85f0-d22e448ca059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:25:35 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-7d0ab857-ef2f-4c21-abee-f55fd2ca0b40 tempest-VolumesServicesTestJSON-1923345814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2388b6bf-542b-40c3-85f0-d22e448ca059) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c7f09ea-a0fa-4685-8358-e9b36b0e79fb', 'volume_name': 'volume-6c7f09ea-a0fa-4685-8358-e9b36b0e79fb', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:25:35 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-7d0ab857-ef2f-4c21-abee-f55fd2ca0b40 tempest-VolumesServicesTestJSON-1923345814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1df91dc4-a623-4acc-ad5d-997b98c7ff16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:25:35 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-7d0ab857-ef2f-4c21-abee-f55fd2ca0b40 tempest-VolumesServicesTestJSON-1923345814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1df91dc4-a623-4acc-ad5d-997b98c7ff16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:25:35 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-7d0ab857-ef2f-4c21-abee-f55fd2ca0b40 tempest-VolumesServicesTestJSON-1923345814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8696b3dd-ad32-4427-bb85-e7b1c1b00118) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:25:35 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-7d0ab857-ef2f-4c21-abee-f55fd2ca0b40 tempest-VolumesServicesTestJSON-1923345814 None] Volume 6c7f09ea-a0fa-4685-8358-e9b36b0e79fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c7f09ea-a0fa-4685-8358-e9b36b0e79fb', 'volume_size': 1} Sep 29 18:25:35 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-7d0ab857-ef2f-4c21-abee-f55fd2ca0b40 tempest-VolumesServicesTestJSON-1923345814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:25:35 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-7d0ab857-ef2f-4c21-abee-f55fd2ca0b40 tempest-VolumesServicesTestJSON-1923345814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:25:35 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-7d0ab857-ef2f-4c21-abee-f55fd2ca0b40 tempest-VolumesServicesTestJSON-1923345814 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:25:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-138822992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c7f09ea-a0fa-4685-8358-e9b36b0e79fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a802a98b63a943ec965d6586a71c456b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:25:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:25:36Z,use_quota=True,user_id='7ce92dd6a22f4a96875edfcae7c2ac8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)}" {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:25:35 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-7d0ab857-ef2f-4c21-abee-f55fd2ca0b40 tempest-VolumesServicesTestJSON-1923345814 None] Creating volume 6c7f09ea-a0fa-4685-8358-e9b36b0e79fb {{(pid=86512) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:25:35 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-7d0ab857-ef2f-4c21-abee-f55fd2ca0b40 tempest-VolumesServicesTestJSON-1923345814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:25:35 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-7d0ab857-ef2f-4c21-abee-f55fd2ca0b40 tempest-VolumesServicesTestJSON-1923345814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:25:35 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-7d0ab857-ef2f-4c21-abee-f55fd2ca0b40 tempest-VolumesServicesTestJSON-1923345814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:25:35 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-7d0ab857-ef2f-4c21-abee-f55fd2ca0b40 tempest-VolumesServicesTestJSON-1923345814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:25:35 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-7d0ab857-ef2f-4c21-abee-f55fd2ca0b40 tempest-VolumesServicesTestJSON-1923345814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:25:35 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-7d0ab857-ef2f-4c21-abee-f55fd2ca0b40 tempest-VolumesServicesTestJSON-1923345814 None] Selected osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 as target Quobyte volume. {{(pid=86512) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:25:35 devstack cinder-volume[86512]: INFO cinder.volume.drivers.remotefs [None req-7d0ab857-ef2f-4c21-abee-f55fd2ca0b40 tempest-VolumesServicesTestJSON-1923345814 None] casted to osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 Sep 29 18:25:35 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-7d0ab857-ef2f-4c21-abee-f55fd2ca0b40 tempest-VolumesServicesTestJSON-1923345814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-6c7f09ea-a0fa-4685-8358-e9b36b0e79fb 1073741824 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:25:35 devstack sudo[97477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-6c7f09ea-a0fa-4685-8358-e9b36b0e79fb 1073741824 Sep 29 18:25:35 devstack sudo[97477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:25:36 devstack sudo[97477]: pam_unix(sudo:session): session closed for user root Sep 29 18:25:36 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-7d0ab857-ef2f-4c21-abee-f55fd2ca0b40 tempest-VolumesServicesTestJSON-1923345814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-6c7f09ea-a0fa-4685-8358-e9b36b0e79fb 1073741824" returned: 0 in 0.542s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:25:36 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-7d0ab857-ef2f-4c21-abee-f55fd2ca0b40 tempest-VolumesServicesTestJSON-1923345814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-6c7f09ea-a0fa-4685-8358-e9b36b0e79fb {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:25:36 devstack sudo[97483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-6c7f09ea-a0fa-4685-8358-e9b36b0e79fb Sep 29 18:25:36 devstack sudo[97483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:25:36 devstack sudo[97483]: pam_unix(sudo:session): session closed for user root Sep 29 18:25:36 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-7d0ab857-ef2f-4c21-abee-f55fd2ca0b40 tempest-VolumesServicesTestJSON-1923345814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-6c7f09ea-a0fa-4685-8358-e9b36b0e79fb" returned: 0 in 0.378s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:25:36 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-7d0ab857-ef2f-4c21-abee-f55fd2ca0b40 tempest-VolumesServicesTestJSON-1923345814 None] <== create_volume: return (973ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'} {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:25:36 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-7d0ab857-ef2f-4c21-abee-f55fd2ca0b40 tempest-VolumesServicesTestJSON-1923345814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.978s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:25:36 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-7d0ab857-ef2f-4c21-abee-f55fd2ca0b40 tempest-VolumesServicesTestJSON-1923345814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8696b3dd-ad32-4427-bb85-e7b1c1b00118) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c7f09ea-a0fa-4685-8358-e9b36b0e79fb', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:25:36 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-7d0ab857-ef2f-4c21-abee-f55fd2ca0b40 tempest-VolumesServicesTestJSON-1923345814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (408ead7d-302a-4904-86fc-451a41ed44f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:25:36 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-7d0ab857-ef2f-4c21-abee-f55fd2ca0b40 tempest-VolumesServicesTestJSON-1923345814 None] Volume volume-6c7f09ea-a0fa-4685-8358-e9b36b0e79fb (6c7f09ea-a0fa-4685-8358-e9b36b0e79fb): created successfully Sep 29 18:25:36 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-7d0ab857-ef2f-4c21-abee-f55fd2ca0b40 tempest-VolumesServicesTestJSON-1923345814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (408ead7d-302a-4904-86fc-451a41ed44f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:25:36 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-7d0ab857-ef2f-4c21-abee-f55fd2ca0b40 tempest-VolumesServicesTestJSON-1923345814 None] Flow 'volume_create_manager' (596c2870-97eb-40a6-a4d5-3314a515e340) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:25:36 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-7d0ab857-ef2f-4c21-abee-f55fd2ca0b40 tempest-VolumesServicesTestJSON-1923345814 None] Created volume successfully. Sep 29 18:25:38 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-c66dc81c-b51a-4337-891b-5a7ab6ca8500 tempest-VolumesServicesTestJSON-1923345814 None] Acquiring lock "cinder-6c7f09ea-a0fa-4685-8358-e9b36b0e79fb-delete_volume" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:25:38 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-c66dc81c-b51a-4337-891b-5a7ab6ca8500 tempest-VolumesServicesTestJSON-1923345814 None] Lock "cinder-6c7f09ea-a0fa-4685-8358-e9b36b0e79fb-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:25:38 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-c66dc81c-b51a-4337-891b-5a7ab6ca8500 tempest-VolumesServicesTestJSON-1923345814 None] Acquiring lock "cinder-quobyte-6c7f09ea-a0fa-4685-8358-e9b36b0e79fb" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:25:38 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-c66dc81c-b51a-4337-891b-5a7ab6ca8500 tempest-VolumesServicesTestJSON-1923345814 None] Lock "cinder-quobyte-6c7f09ea-a0fa-4685-8358-e9b36b0e79fb" acquired by "delete_volume" :: waited 0.022s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:25:38 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[67a1b433-6aab-4459-bd65-92e1744258e2]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:25:38 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-c66dc81c-b51a-4337-891b-5a7ab6ca8500 tempest-VolumesServicesTestJSON-1923345814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-6c7f09ea-a0fa-4685-8358-e9b36b0e79fb {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:25:38 devstack sudo[97517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-6c7f09ea-a0fa-4685-8358-e9b36b0e79fb Sep 29 18:25:38 devstack sudo[97517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:25:38 devstack sudo[97517]: pam_unix(sudo:session): session closed for user root Sep 29 18:25:38 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-c66dc81c-b51a-4337-891b-5a7ab6ca8500 tempest-VolumesServicesTestJSON-1923345814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-6c7f09ea-a0fa-4685-8358-e9b36b0e79fb" returned: 0 in 0.455s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:25:38 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-c66dc81c-b51a-4337-891b-5a7ab6ca8500 tempest-VolumesServicesTestJSON-1923345814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-6c7f09ea-a0fa-4685-8358-e9b36b0e79fb {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:25:38 devstack sudo[97524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-6c7f09ea-a0fa-4685-8358-e9b36b0e79fb Sep 29 18:25:38 devstack sudo[97524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:25:38 devstack sudo[97524]: pam_unix(sudo:session): session closed for user root Sep 29 18:25:38 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-c66dc81c-b51a-4337-891b-5a7ab6ca8500 tempest-VolumesServicesTestJSON-1923345814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-6c7f09ea-a0fa-4685-8358-e9b36b0e79fb" returned: 0 in 0.274s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:25:39 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-c66dc81c-b51a-4337-891b-5a7ab6ca8500 tempest-VolumesServicesTestJSON-1923345814 None] Lock "cinder-quobyte-6c7f09ea-a0fa-4685-8358-e9b36b0e79fb" released by "delete_volume" :: held 0.818s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:25:39 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-c66dc81c-b51a-4337-891b-5a7ab6ca8500 tempest-VolumesServicesTestJSON-1923345814 None] Created reservations ['58b82ff9-a971-423d-b560-5ad6b94c3b56', '77f9c04c-b77a-4b52-b553-51c23998e39f', '1475e28a-08fc-445b-bde8-17473439f24a', '24fcdb9f-9bdf-4a54-b6c4-79e5c246d98e'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:25:39 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-c66dc81c-b51a-4337-891b-5a7ab6ca8500 tempest-VolumesServicesTestJSON-1923345814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:25:39 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-c66dc81c-b51a-4337-891b-5a7ab6ca8500 tempest-VolumesServicesTestJSON-1923345814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:25:39 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-c66dc81c-b51a-4337-891b-5a7ab6ca8500 tempest-VolumesServicesTestJSON-1923345814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:25:39 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-c66dc81c-b51a-4337-891b-5a7ab6ca8500 tempest-VolumesServicesTestJSON-1923345814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:25:39 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-c66dc81c-b51a-4337-891b-5a7ab6ca8500 tempest-VolumesServicesTestJSON-1923345814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:25:39 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-c66dc81c-b51a-4337-891b-5a7ab6ca8500 tempest-VolumesServicesTestJSON-1923345814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:25:39 devstack sudo[97527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:25:39 devstack sudo[97527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:25:39 devstack sudo[97527]: pam_unix(sudo:session): session closed for user root Sep 29 18:25:39 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-c66dc81c-b51a-4337-891b-5a7ab6ca8500 tempest-VolumesServicesTestJSON-1923345814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.265s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:25:39 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-c66dc81c-b51a-4337-891b-5a7ab6ca8500 tempest-VolumesServicesTestJSON-1923345814 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:25:39 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-c66dc81c-b51a-4337-891b-5a7ab6ca8500 tempest-VolumesServicesTestJSON-1923345814 None] Deleted volume successfully. Sep 29 18:25:39 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-c66dc81c-b51a-4337-891b-5a7ab6ca8500 tempest-VolumesServicesTestJSON-1923345814 None] Lock "cinder-6c7f09ea-a0fa-4685-8358-e9b36b0e79fb-delete_volume" released by "delete_volume" :: held 1.309s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:25:39 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-f9ae09eb-3f62-4994-b449-32d5ea2e6907 tempest-TestStampPattern-1947170058 None] Acquiring lock "cinder-76c83cb3-8bd4-4efa-9940-142f21431def-delete_volume" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:25:39 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-f9ae09eb-3f62-4994-b449-32d5ea2e6907 tempest-TestStampPattern-1947170058 None] Lock "cinder-76c83cb3-8bd4-4efa-9940-142f21431def-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:25:39 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-f9ae09eb-3f62-4994-b449-32d5ea2e6907 tempest-TestStampPattern-1947170058 None] Acquiring lock "cinder-quobyte-76c83cb3-8bd4-4efa-9940-142f21431def" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:25:39 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-f9ae09eb-3f62-4994-b449-32d5ea2e6907 tempest-TestStampPattern-1947170058 None] Lock "cinder-quobyte-76c83cb3-8bd4-4efa-9940-142f21431def" acquired by "delete_volume" :: waited 0.021s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:25:39 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2789ae1-1820-4a81-ad57-90f2df7e4d82]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:25:39 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-f9ae09eb-3f62-4994-b449-32d5ea2e6907 tempest-TestStampPattern-1947170058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-76c83cb3-8bd4-4efa-9940-142f21431def {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:25:39 devstack sudo[97530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-76c83cb3-8bd4-4efa-9940-142f21431def Sep 29 18:25:39 devstack sudo[97530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:25:40 devstack sudo[97530]: pam_unix(sudo:session): session closed for user root Sep 29 18:25:40 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-f9ae09eb-3f62-4994-b449-32d5ea2e6907 tempest-TestStampPattern-1947170058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-76c83cb3-8bd4-4efa-9940-142f21431def" returned: 0 in 0.441s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:25:40 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-f9ae09eb-3f62-4994-b449-32d5ea2e6907 tempest-TestStampPattern-1947170058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-76c83cb3-8bd4-4efa-9940-142f21431def {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:25:40 devstack sudo[97535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-76c83cb3-8bd4-4efa-9940-142f21431def Sep 29 18:25:40 devstack sudo[97535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:25:40 devstack sudo[97535]: pam_unix(sudo:session): session closed for user root Sep 29 18:25:40 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-f9ae09eb-3f62-4994-b449-32d5ea2e6907 tempest-TestStampPattern-1947170058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-76c83cb3-8bd4-4efa-9940-142f21431def" returned: 0 in 0.344s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:25:40 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-f9ae09eb-3f62-4994-b449-32d5ea2e6907 tempest-TestStampPattern-1947170058 None] Lock "cinder-quobyte-76c83cb3-8bd4-4efa-9940-142f21431def" released by "delete_volume" :: held 0.851s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:25:40 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-f9ae09eb-3f62-4994-b449-32d5ea2e6907 tempest-TestStampPattern-1947170058 None] Created reservations ['8190b62b-d635-4acb-914d-89efdc449789', '818ef1b7-f2f1-46a0-9a6f-5adf92370430', '9259d04e-d211-4301-8c1a-85ad231f5973', '2dd162d7-31b8-46bc-956c-2cbdabc66f33'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:25:40 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-f9ae09eb-3f62-4994-b449-32d5ea2e6907 tempest-TestStampPattern-1947170058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:25:40 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-f9ae09eb-3f62-4994-b449-32d5ea2e6907 tempest-TestStampPattern-1947170058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:25:40 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-f9ae09eb-3f62-4994-b449-32d5ea2e6907 tempest-TestStampPattern-1947170058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:25:40 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-f9ae09eb-3f62-4994-b449-32d5ea2e6907 tempest-TestStampPattern-1947170058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:25:40 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-f9ae09eb-3f62-4994-b449-32d5ea2e6907 tempest-TestStampPattern-1947170058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:25:40 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-f9ae09eb-3f62-4994-b449-32d5ea2e6907 tempest-TestStampPattern-1947170058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:25:40 devstack sudo[97538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:25:40 devstack sudo[97538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:25:41 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-3de9ce78-c5b3-4c90-babb-4568bb59d967 tempest-VolumeRetypeWithoutMigrationTest-372821743 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86512) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:25:41 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-3de9ce78-c5b3-4c90-babb-4568bb59d967 tempest-VolumeRetypeWithoutMigrationTest-372821743 None] Flow 'volume_create_manager' (9caa7db2-2233-49b2-929f-59bd4b739c5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:25:41 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-3de9ce78-c5b3-4c90-babb-4568bb59d967 tempest-VolumeRetypeWithoutMigrationTest-372821743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc50cc03-ba2b-41e0-ac08-2a63a0f58fe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:25:41 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-3de9ce78-c5b3-4c90-babb-4568bb59d967 tempest-VolumeRetypeWithoutMigrationTest-372821743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc50cc03-ba2b-41e0-ac08-2a63a0f58fe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:25:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1926270652',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0799a5e-9f3d-43eb-a768-bd1f04191a1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='526fb0dce2744dd9aba03fc3cf3097c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:25:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:25:41Z,use_quota=True,user_id='b0087fea4c6e4a37a2a5bb749c6e76ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43a69184-2e18-4d0a-bb29-5c0bd703abf3),volume_type_id=43a69184-2e18-4d0a-bb29-5c0bd703abf3)' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:25:41 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-3de9ce78-c5b3-4c90-babb-4568bb59d967 tempest-VolumeRetypeWithoutMigrationTest-372821743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7be3dc9c-b6db-43ad-99a4-922e3b3e9fee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:25:41 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-3de9ce78-c5b3-4c90-babb-4568bb59d967 tempest-VolumeRetypeWithoutMigrationTest-372821743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7be3dc9c-b6db-43ad-99a4-922e3b3e9fee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:25:41 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-3de9ce78-c5b3-4c90-babb-4568bb59d967 tempest-VolumeRetypeWithoutMigrationTest-372821743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afaade44-41aa-4d0e-892f-6d1f2008bdd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:25:41 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-3de9ce78-c5b3-4c90-babb-4568bb59d967 tempest-VolumeRetypeWithoutMigrationTest-372821743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afaade44-41aa-4d0e-892f-6d1f2008bdd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0799a5e-9f3d-43eb-a768-bd1f04191a1a', 'volume_name': 'volume-c0799a5e-9f3d-43eb-a768-bd1f04191a1a', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:25:41 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-3de9ce78-c5b3-4c90-babb-4568bb59d967 tempest-VolumeRetypeWithoutMigrationTest-372821743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42c2edcd-d524-4c1a-a399-7b62eed44764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:25:41 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-3de9ce78-c5b3-4c90-babb-4568bb59d967 tempest-VolumeRetypeWithoutMigrationTest-372821743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42c2edcd-d524-4c1a-a399-7b62eed44764) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:25:41 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-3de9ce78-c5b3-4c90-babb-4568bb59d967 tempest-VolumeRetypeWithoutMigrationTest-372821743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44bd90a8-ef3d-4da1-9ca1-3f60bcf37cdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:25:41 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-3de9ce78-c5b3-4c90-babb-4568bb59d967 tempest-VolumeRetypeWithoutMigrationTest-372821743 None] Volume c0799a5e-9f3d-43eb-a768-bd1f04191a1a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0799a5e-9f3d-43eb-a768-bd1f04191a1a', 'volume_size': 1} Sep 29 18:25:41 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-3de9ce78-c5b3-4c90-babb-4568bb59d967 tempest-VolumeRetypeWithoutMigrationTest-372821743 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:25:41 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-3de9ce78-c5b3-4c90-babb-4568bb59d967 tempest-VolumeRetypeWithoutMigrationTest-372821743 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:25:41 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-3de9ce78-c5b3-4c90-babb-4568bb59d967 tempest-VolumeRetypeWithoutMigrationTest-372821743 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:25:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1926270652',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0799a5e-9f3d-43eb-a768-bd1f04191a1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='526fb0dce2744dd9aba03fc3cf3097c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:25:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:25:41Z,use_quota=True,user_id='b0087fea4c6e4a37a2a5bb749c6e76ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43a69184-2e18-4d0a-bb29-5c0bd703abf3),volume_type_id=43a69184-2e18-4d0a-bb29-5c0bd703abf3)}" {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:25:41 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-3de9ce78-c5b3-4c90-babb-4568bb59d967 tempest-VolumeRetypeWithoutMigrationTest-372821743 None] Creating volume c0799a5e-9f3d-43eb-a768-bd1f04191a1a {{(pid=86512) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:25:41 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-3de9ce78-c5b3-4c90-babb-4568bb59d967 tempest-VolumeRetypeWithoutMigrationTest-372821743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:25:41 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-3de9ce78-c5b3-4c90-babb-4568bb59d967 tempest-VolumeRetypeWithoutMigrationTest-372821743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:25:41 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-3de9ce78-c5b3-4c90-babb-4568bb59d967 tempest-VolumeRetypeWithoutMigrationTest-372821743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:25:41 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-3de9ce78-c5b3-4c90-babb-4568bb59d967 tempest-VolumeRetypeWithoutMigrationTest-372821743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:25:41 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-3de9ce78-c5b3-4c90-babb-4568bb59d967 tempest-VolumeRetypeWithoutMigrationTest-372821743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:25:41 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-3de9ce78-c5b3-4c90-babb-4568bb59d967 tempest-VolumeRetypeWithoutMigrationTest-372821743 None] Selected osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 as target Quobyte volume. {{(pid=86512) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:25:41 devstack cinder-volume[86512]: INFO cinder.volume.drivers.remotefs [None req-3de9ce78-c5b3-4c90-babb-4568bb59d967 tempest-VolumeRetypeWithoutMigrationTest-372821743 None] casted to osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 Sep 29 18:25:41 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-3de9ce78-c5b3-4c90-babb-4568bb59d967 tempest-VolumeRetypeWithoutMigrationTest-372821743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-c0799a5e-9f3d-43eb-a768-bd1f04191a1a 1073741824 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:25:41 devstack sudo[97540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-c0799a5e-9f3d-43eb-a768-bd1f04191a1a 1073741824 Sep 29 18:25:41 devstack sudo[97540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:25:41 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-10d2be47-5eb6-4700-9a45-3332b9f798ac tempest-TestStampPattern-1947170058 None] Acquiring lock "cinder-c2ab48ef-ed57-4ae4-b2c8-36f363ca9948-delete_snapshot" by "delete_snapshot" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:25:41 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-10d2be47-5eb6-4700-9a45-3332b9f798ac tempest-TestStampPattern-1947170058 None] Lock "cinder-c2ab48ef-ed57-4ae4-b2c8-36f363ca9948-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:25:41 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-10d2be47-5eb6-4700-9a45-3332b9f798ac tempest-TestStampPattern-1947170058 None] Acquiring lock "cinder-quobyte-7fc95db1-8a95-4cd2-9802-eecd7eb24f64" by "delete_snapshot" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:25:41 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-10d2be47-5eb6-4700-9a45-3332b9f798ac tempest-TestStampPattern-1947170058 None] Lock "cinder-quobyte-7fc95db1-8a95-4cd2-9802-eecd7eb24f64" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:25:41 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-10d2be47-5eb6-4700-9a45-3332b9f798ac tempest-TestStampPattern-1947170058 None] Acquiring lock "cinder-quobyte-c2ab48ef-ed57-4ae4-b2c8-36f363ca9948" by "_delete_snapshot" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:25:41 devstack sudo[97538]: pam_unix(sudo:session): session closed for user root Sep 29 18:25:41 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-f9ae09eb-3f62-4994-b449-32d5ea2e6907 tempest-TestStampPattern-1947170058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.551s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:25:41 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-f9ae09eb-3f62-4994-b449-32d5ea2e6907 tempest-TestStampPattern-1947170058 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:25:41 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-f9ae09eb-3f62-4994-b449-32d5ea2e6907 tempest-TestStampPattern-1947170058 None] Deleted volume successfully. Sep 29 18:25:41 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-10d2be47-5eb6-4700-9a45-3332b9f798ac tempest-TestStampPattern-1947170058 None] Lock "cinder-quobyte-c2ab48ef-ed57-4ae4-b2c8-36f363ca9948" acquired by "_delete_snapshot" :: waited 0.046s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:25:41 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-10d2be47-5eb6-4700-9a45-3332b9f798ac tempest-TestStampPattern-1947170058 None] Deleting offline snapshot c2ab48ef-ed57-4ae4-b2c8-36f363ca9948 of volume 7fc95db1-8a95-4cd2-9802-eecd7eb24f64 {{(pid=86512) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 18:25:41 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-10d2be47-5eb6-4700-9a45-3332b9f798ac tempest-TestStampPattern-1947170058 None] snapshot_file for this snap is: volume-7fc95db1-8a95-4cd2-9802-eecd7eb24f64.c2ab48ef-ed57-4ae4-b2c8-36f363ca9948 {{(pid=86512) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 18:25:41 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-f9ae09eb-3f62-4994-b449-32d5ea2e6907 tempest-TestStampPattern-1947170058 None] Lock "cinder-76c83cb3-8bd4-4efa-9940-142f21431def-delete_volume" released by "delete_volume" :: held 1.779s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:25:41 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[91307f1d-4b0f-43d6-b6fd-cc157f553c14]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:25:41 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-10d2be47-5eb6-4700-9a45-3332b9f798ac tempest-TestStampPattern-1947170058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7fc95db1-8a95-4cd2-9802-eecd7eb24f64.c2ab48ef-ed57-4ae4-b2c8-36f363ca9948 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:25:41 devstack sudo[97543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7fc95db1-8a95-4cd2-9802-eecd7eb24f64.c2ab48ef-ed57-4ae4-b2c8-36f363ca9948 Sep 29 18:25:41 devstack sudo[97543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:25:41 devstack sudo[97540]: pam_unix(sudo:session): session closed for user root Sep 29 18:25:41 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-3de9ce78-c5b3-4c90-babb-4568bb59d967 tempest-VolumeRetypeWithoutMigrationTest-372821743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-c0799a5e-9f3d-43eb-a768-bd1f04191a1a 1073741824" returned: 0 in 0.773s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:25:41 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-3de9ce78-c5b3-4c90-babb-4568bb59d967 tempest-VolumeRetypeWithoutMigrationTest-372821743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-c0799a5e-9f3d-43eb-a768-bd1f04191a1a {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:25:42 devstack sudo[97543]: pam_unix(sudo:session): session closed for user root Sep 29 18:25:42 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-10d2be47-5eb6-4700-9a45-3332b9f798ac tempest-TestStampPattern-1947170058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7fc95db1-8a95-4cd2-9802-eecd7eb24f64.c2ab48ef-ed57-4ae4-b2c8-36f363ca9948" returned: 0 in 0.615s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:25:42 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-10d2be47-5eb6-4700-9a45-3332b9f798ac tempest-TestStampPattern-1947170058 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7fc95db1-8a95-4cd2-9802-eecd7eb24f64(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86512) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 18:25:42 devstack sudo[97587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-c0799a5e-9f3d-43eb-a768-bd1f04191a1a Sep 29 18:25:42 devstack sudo[97587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:25:42 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6806000-8b07-40f1-ab65-9ca310b83d40]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:25:42 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-10d2be47-5eb6-4700-9a45-3332b9f798ac tempest-TestStampPattern-1947170058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7fc95db1-8a95-4cd2-9802-eecd7eb24f64 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:25:42 devstack sudo[97589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7fc95db1-8a95-4cd2-9802-eecd7eb24f64 Sep 29 18:25:42 devstack sudo[97589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:25:42 devstack sudo[97587]: pam_unix(sudo:session): session closed for user root Sep 29 18:25:42 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-3de9ce78-c5b3-4c90-babb-4568bb59d967 tempest-VolumeRetypeWithoutMigrationTest-372821743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-c0799a5e-9f3d-43eb-a768-bd1f04191a1a" returned: 0 in 0.472s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:25:42 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-3de9ce78-c5b3-4c90-babb-4568bb59d967 tempest-VolumeRetypeWithoutMigrationTest-372821743 None] <== create_volume: return (1357ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'} {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:25:42 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-3de9ce78-c5b3-4c90-babb-4568bb59d967 tempest-VolumeRetypeWithoutMigrationTest-372821743 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.362s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:25:42 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-3de9ce78-c5b3-4c90-babb-4568bb59d967 tempest-VolumeRetypeWithoutMigrationTest-372821743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44bd90a8-ef3d-4da1-9ca1-3f60bcf37cdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0799a5e-9f3d-43eb-a768-bd1f04191a1a', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:25:42 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-3de9ce78-c5b3-4c90-babb-4568bb59d967 tempest-VolumeRetypeWithoutMigrationTest-372821743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1005778-4392-4d0c-9285-35d284615a96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:25:42 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-3de9ce78-c5b3-4c90-babb-4568bb59d967 tempest-VolumeRetypeWithoutMigrationTest-372821743 None] Volume volume-c0799a5e-9f3d-43eb-a768-bd1f04191a1a (c0799a5e-9f3d-43eb-a768-bd1f04191a1a): created successfully Sep 29 18:25:42 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-3de9ce78-c5b3-4c90-babb-4568bb59d967 tempest-VolumeRetypeWithoutMigrationTest-372821743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1005778-4392-4d0c-9285-35d284615a96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:25:42 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-3de9ce78-c5b3-4c90-babb-4568bb59d967 tempest-VolumeRetypeWithoutMigrationTest-372821743 None] Flow 'volume_create_manager' (9caa7db2-2233-49b2-929f-59bd4b739c5a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:25:42 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-3de9ce78-c5b3-4c90-babb-4568bb59d967 tempest-VolumeRetypeWithoutMigrationTest-372821743 None] Created volume successfully. Sep 29 18:25:42 devstack sudo[97589]: pam_unix(sudo:session): session closed for user root Sep 29 18:25:42 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-10d2be47-5eb6-4700-9a45-3332b9f798ac tempest-TestStampPattern-1947170058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7fc95db1-8a95-4cd2-9802-eecd7eb24f64" returned: 0 in 0.596s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:25:42 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-10d2be47-5eb6-4700-9a45-3332b9f798ac tempest-TestStampPattern-1947170058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7fc95db1-8a95-4cd2-9802-eecd7eb24f64.c2ab48ef-ed57-4ae4-b2c8-36f363ca9948 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:25:42 devstack sudo[97597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7fc95db1-8a95-4cd2-9802-eecd7eb24f64.c2ab48ef-ed57-4ae4-b2c8-36f363ca9948 Sep 29 18:25:42 devstack sudo[97597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:25:43 devstack sudo[97597]: pam_unix(sudo:session): session closed for user root Sep 29 18:25:43 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-10d2be47-5eb6-4700-9a45-3332b9f798ac tempest-TestStampPattern-1947170058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7fc95db1-8a95-4cd2-9802-eecd7eb24f64.c2ab48ef-ed57-4ae4-b2c8-36f363ca9948" returned: 0 in 0.357s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:25:43 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-10d2be47-5eb6-4700-9a45-3332b9f798ac tempest-TestStampPattern-1947170058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7fc95db1-8a95-4cd2-9802-eecd7eb24f64.c2ab48ef-ed57-4ae4-b2c8-36f363ca9948 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:25:43 devstack sudo[97602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7fc95db1-8a95-4cd2-9802-eecd7eb24f64.c2ab48ef-ed57-4ae4-b2c8-36f363ca9948 Sep 29 18:25:43 devstack sudo[97602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:25:43 devstack sudo[97602]: pam_unix(sudo:session): session closed for user root Sep 29 18:25:43 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-10d2be47-5eb6-4700-9a45-3332b9f798ac tempest-TestStampPattern-1947170058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7fc95db1-8a95-4cd2-9802-eecd7eb24f64.c2ab48ef-ed57-4ae4-b2c8-36f363ca9948" returned: 0 in 0.281s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:25:43 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-10d2be47-5eb6-4700-9a45-3332b9f798ac tempest-TestStampPattern-1947170058 None] Lock "cinder-quobyte-c2ab48ef-ed57-4ae4-b2c8-36f363ca9948" released by "_delete_snapshot" :: held 1.988s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:25:43 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-10d2be47-5eb6-4700-9a45-3332b9f798ac tempest-TestStampPattern-1947170058 None] Lock "cinder-quobyte-7fc95db1-8a95-4cd2-9802-eecd7eb24f64" released by "delete_snapshot" :: held 2.043s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:25:43 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-10d2be47-5eb6-4700-9a45-3332b9f798ac tempest-TestStampPattern-1947170058 None] Created reservations ['9ed017a1-451c-4a81-acbc-0e5ea0aa064a', 'cae34a65-cff6-45ef-bf02-6979623af82b', '80efb0a0-7ae2-4e38-92ba-66d8f0275d6a', '23f772b6-35f5-4953-a964-15f0eba2369e'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:25:43 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-10d2be47-5eb6-4700-9a45-3332b9f798ac tempest-TestStampPattern-1947170058 None] Delete snapshot completed successfully. Sep 29 18:25:43 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-10d2be47-5eb6-4700-9a45-3332b9f798ac tempest-TestStampPattern-1947170058 None] Lock "cinder-c2ab48ef-ed57-4ae4-b2c8-36f363ca9948-delete_snapshot" released by "delete_snapshot" :: held 2.274s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:25:43 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-78931ad5-d19d-493c-9e73-f910129abcb6 tempest-VolumeRetypeWithoutMigrationTest-372821743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:25:43 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-78931ad5-d19d-493c-9e73-f910129abcb6 tempest-VolumeRetypeWithoutMigrationTest-372821743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:25:43 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-78931ad5-d19d-493c-9e73-f910129abcb6 tempest-VolumeRetypeWithoutMigrationTest-372821743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:25:43 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-78931ad5-d19d-493c-9e73-f910129abcb6 tempest-VolumeRetypeWithoutMigrationTest-372821743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:25:43 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-78931ad5-d19d-493c-9e73-f910129abcb6 tempest-VolumeRetypeWithoutMigrationTest-372821743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:25:43 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-78931ad5-d19d-493c-9e73-f910129abcb6 tempest-VolumeRetypeWithoutMigrationTest-372821743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:25:43 devstack sudo[97606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:25:43 devstack sudo[97606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:25:43 devstack sudo[97606]: pam_unix(sudo:session): session closed for user root Sep 29 18:25:43 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-78931ad5-d19d-493c-9e73-f910129abcb6 tempest-VolumeRetypeWithoutMigrationTest-372821743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.262s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:25:43 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-78931ad5-d19d-493c-9e73-f910129abcb6 tempest-VolumeRetypeWithoutMigrationTest-372821743 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:25:43 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-78931ad5-d19d-493c-9e73-f910129abcb6 tempest-VolumeRetypeWithoutMigrationTest-372821743 None] Retype volume completed successfully. Sep 29 18:25:45 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-c2970ccf-8ea2-4e81-ad81-082c99bdc5a1 tempest-VolumeRetypeWithoutMigrationTest-372821743 None] Acquiring lock "cinder-c0799a5e-9f3d-43eb-a768-bd1f04191a1a-delete_volume" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:25:45 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-c2970ccf-8ea2-4e81-ad81-082c99bdc5a1 tempest-VolumeRetypeWithoutMigrationTest-372821743 None] Lock "cinder-c0799a5e-9f3d-43eb-a768-bd1f04191a1a-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:25:45 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-c2970ccf-8ea2-4e81-ad81-082c99bdc5a1 tempest-VolumeRetypeWithoutMigrationTest-372821743 None] Acquiring lock "cinder-quobyte-c0799a5e-9f3d-43eb-a768-bd1f04191a1a" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:25:45 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-c2970ccf-8ea2-4e81-ad81-082c99bdc5a1 tempest-VolumeRetypeWithoutMigrationTest-372821743 None] Lock "cinder-quobyte-c0799a5e-9f3d-43eb-a768-bd1f04191a1a" acquired by "delete_volume" :: waited 0.025s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:25:45 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[83f683df-39b9-4816-ba99-a5e24c2e08ed]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:25:45 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-c2970ccf-8ea2-4e81-ad81-082c99bdc5a1 tempest-VolumeRetypeWithoutMigrationTest-372821743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-c0799a5e-9f3d-43eb-a768-bd1f04191a1a {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:25:45 devstack sudo[97637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-c0799a5e-9f3d-43eb-a768-bd1f04191a1a Sep 29 18:25:45 devstack sudo[97637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:25:45 devstack sudo[97637]: pam_unix(sudo:session): session closed for user root Sep 29 18:25:45 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-c2970ccf-8ea2-4e81-ad81-082c99bdc5a1 tempest-VolumeRetypeWithoutMigrationTest-372821743 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-c0799a5e-9f3d-43eb-a768-bd1f04191a1a" returned: 0 in 0.507s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:25:45 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-c2970ccf-8ea2-4e81-ad81-082c99bdc5a1 tempest-VolumeRetypeWithoutMigrationTest-372821743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-c0799a5e-9f3d-43eb-a768-bd1f04191a1a {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:25:45 devstack sudo[97643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-c0799a5e-9f3d-43eb-a768-bd1f04191a1a Sep 29 18:25:45 devstack sudo[97643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:25:46 devstack sudo[97643]: pam_unix(sudo:session): session closed for user root Sep 29 18:25:46 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-c2970ccf-8ea2-4e81-ad81-082c99bdc5a1 tempest-VolumeRetypeWithoutMigrationTest-372821743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-c0799a5e-9f3d-43eb-a768-bd1f04191a1a" returned: 0 in 0.591s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:25:46 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-c2970ccf-8ea2-4e81-ad81-082c99bdc5a1 tempest-VolumeRetypeWithoutMigrationTest-372821743 None] Lock "cinder-quobyte-c0799a5e-9f3d-43eb-a768-bd1f04191a1a" released by "delete_volume" :: held 1.173s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:25:46 devstack cinder-volume[86512]: WARNING cinder.quota [None req-c2970ccf-8ea2-4e81-ad81-082c99bdc5a1 tempest-VolumeRetypeWithoutMigrationTest-372821743 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 29 18:25:46 devstack cinder-volume[86512]: WARNING cinder.quota [None req-c2970ccf-8ea2-4e81-ad81-082c99bdc5a1 tempest-VolumeRetypeWithoutMigrationTest-372821743 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 29 18:25:46 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-c2970ccf-8ea2-4e81-ad81-082c99bdc5a1 tempest-VolumeRetypeWithoutMigrationTest-372821743 None] Created reservations ['f4c0e0f3-07ae-4072-94e7-593d3ac5343e', 'eb4df5a6-ae7d-4d00-83f9-f89a5e577269', 'fe978588-753c-4029-bdc8-3b1b1ec2d2c4', '320bf07c-86aa-40d6-8e31-f05081f643ae'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:25:46 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-c2970ccf-8ea2-4e81-ad81-082c99bdc5a1 tempest-VolumeRetypeWithoutMigrationTest-372821743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:25:46 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-c2970ccf-8ea2-4e81-ad81-082c99bdc5a1 tempest-VolumeRetypeWithoutMigrationTest-372821743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:25:46 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-c2970ccf-8ea2-4e81-ad81-082c99bdc5a1 tempest-VolumeRetypeWithoutMigrationTest-372821743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:25:46 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-c2970ccf-8ea2-4e81-ad81-082c99bdc5a1 tempest-VolumeRetypeWithoutMigrationTest-372821743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:25:46 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-c2970ccf-8ea2-4e81-ad81-082c99bdc5a1 tempest-VolumeRetypeWithoutMigrationTest-372821743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:25:46 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-c2970ccf-8ea2-4e81-ad81-082c99bdc5a1 tempest-VolumeRetypeWithoutMigrationTest-372821743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:25:46 devstack sudo[97653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:25:46 devstack sudo[97653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:25:46 devstack sudo[97653]: pam_unix(sudo:session): session closed for user root Sep 29 18:25:46 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-c2970ccf-8ea2-4e81-ad81-082c99bdc5a1 tempest-VolumeRetypeWithoutMigrationTest-372821743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.333s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:25:46 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-c2970ccf-8ea2-4e81-ad81-082c99bdc5a1 tempest-VolumeRetypeWithoutMigrationTest-372821743 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:25:46 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-c2970ccf-8ea2-4e81-ad81-082c99bdc5a1 tempest-VolumeRetypeWithoutMigrationTest-372821743 None] Deleted volume successfully. Sep 29 18:25:47 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-c2970ccf-8ea2-4e81-ad81-082c99bdc5a1 tempest-VolumeRetypeWithoutMigrationTest-372821743 None] Lock "cinder-c0799a5e-9f3d-43eb-a768-bd1f04191a1a-delete_volume" released by "delete_volume" :: held 1.913s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:25:48 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-480393b5-0209-4b09-8066-c9ea4963ecc3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2130180141 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86512) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:25:48 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-480393b5-0209-4b09-8066-c9ea4963ecc3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2130180141 None] Flow 'volume_create_manager' (fbb37708-9c5d-4b98-adc5-e8325e2d24b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:25:48 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-480393b5-0209-4b09-8066-c9ea4963ecc3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2130180141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cb48d54-8598-464d-b18f-27d248e57fcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:25:48 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-480393b5-0209-4b09-8066-c9ea4963ecc3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2130180141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cb48d54-8598-464d-b18f-27d248e57fcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:25:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-2088698711',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02e3aa83-0ed6-4a44-8017-060f2007236d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64182dd0e310440c8351cd7926f4bbb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:25:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:25:48Z,use_quota=True,user_id='072d8821d959438d99596ca427679e38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:25:48 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-480393b5-0209-4b09-8066-c9ea4963ecc3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2130180141 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79b1f887-a6be-4d9c-ad63-372f83a0dc86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:25:48 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-480393b5-0209-4b09-8066-c9ea4963ecc3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2130180141 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79b1f887-a6be-4d9c-ad63-372f83a0dc86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:25:48 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-480393b5-0209-4b09-8066-c9ea4963ecc3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2130180141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0fa1544-1ca8-4470-ba24-1591677c2b3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:25:48 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-480393b5-0209-4b09-8066-c9ea4963ecc3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2130180141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0fa1544-1ca8-4470-ba24-1591677c2b3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02e3aa83-0ed6-4a44-8017-060f2007236d', 'volume_name': 'volume-02e3aa83-0ed6-4a44-8017-060f2007236d', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:25:48 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-480393b5-0209-4b09-8066-c9ea4963ecc3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2130180141 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29e39407-0a43-496d-ade6-cb49491ce075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:25:48 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-480393b5-0209-4b09-8066-c9ea4963ecc3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2130180141 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29e39407-0a43-496d-ade6-cb49491ce075) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:25:48 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-480393b5-0209-4b09-8066-c9ea4963ecc3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2130180141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (061172af-c52b-40df-a1ee-f27f14c9b924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:25:48 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-480393b5-0209-4b09-8066-c9ea4963ecc3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2130180141 None] Volume 02e3aa83-0ed6-4a44-8017-060f2007236d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02e3aa83-0ed6-4a44-8017-060f2007236d', 'volume_size': 1} Sep 29 18:25:48 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-480393b5-0209-4b09-8066-c9ea4963ecc3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2130180141 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:25:48 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-480393b5-0209-4b09-8066-c9ea4963ecc3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2130180141 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:25:48 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-480393b5-0209-4b09-8066-c9ea4963ecc3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2130180141 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:25:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-2088698711',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02e3aa83-0ed6-4a44-8017-060f2007236d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64182dd0e310440c8351cd7926f4bbb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:25:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:25:48Z,use_quota=True,user_id='072d8821d959438d99596ca427679e38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)}" {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:25:48 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-480393b5-0209-4b09-8066-c9ea4963ecc3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2130180141 None] Creating volume 02e3aa83-0ed6-4a44-8017-060f2007236d {{(pid=86512) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:25:48 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-480393b5-0209-4b09-8066-c9ea4963ecc3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2130180141 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:25:48 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-480393b5-0209-4b09-8066-c9ea4963ecc3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2130180141 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:25:48 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-480393b5-0209-4b09-8066-c9ea4963ecc3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2130180141 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:25:48 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-480393b5-0209-4b09-8066-c9ea4963ecc3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2130180141 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:25:48 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-480393b5-0209-4b09-8066-c9ea4963ecc3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2130180141 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:25:48 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-480393b5-0209-4b09-8066-c9ea4963ecc3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2130180141 None] Selected osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 as target Quobyte volume. {{(pid=86512) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:25:48 devstack cinder-volume[86512]: INFO cinder.volume.drivers.remotefs [None req-480393b5-0209-4b09-8066-c9ea4963ecc3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2130180141 None] casted to osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 Sep 29 18:25:48 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-480393b5-0209-4b09-8066-c9ea4963ecc3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2130180141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-02e3aa83-0ed6-4a44-8017-060f2007236d 1073741824 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:25:48 devstack sudo[97679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-02e3aa83-0ed6-4a44-8017-060f2007236d 1073741824 Sep 29 18:25:48 devstack sudo[97679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:25:49 devstack sudo[97679]: pam_unix(sudo:session): session closed for user root Sep 29 18:25:49 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-480393b5-0209-4b09-8066-c9ea4963ecc3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2130180141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-02e3aa83-0ed6-4a44-8017-060f2007236d 1073741824" returned: 0 in 0.732s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:25:49 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-480393b5-0209-4b09-8066-c9ea4963ecc3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2130180141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-02e3aa83-0ed6-4a44-8017-060f2007236d {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:25:49 devstack sudo[97685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-02e3aa83-0ed6-4a44-8017-060f2007236d Sep 29 18:25:49 devstack sudo[97685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:25:49 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-9b6133e6-07f2-4379-8034-faccf62f2417 tempest-TestStampPattern-1947170058 None] Acquiring lock "cinder-7fc95db1-8a95-4cd2-9802-eecd7eb24f64-delete_volume" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:25:49 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-9b6133e6-07f2-4379-8034-faccf62f2417 tempest-TestStampPattern-1947170058 None] Lock "cinder-7fc95db1-8a95-4cd2-9802-eecd7eb24f64-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:25:49 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-9b6133e6-07f2-4379-8034-faccf62f2417 tempest-TestStampPattern-1947170058 None] Acquiring lock "cinder-quobyte-7fc95db1-8a95-4cd2-9802-eecd7eb24f64" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:25:49 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-9b6133e6-07f2-4379-8034-faccf62f2417 tempest-TestStampPattern-1947170058 None] Lock "cinder-quobyte-7fc95db1-8a95-4cd2-9802-eecd7eb24f64" acquired by "delete_volume" :: waited 0.026s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:25:49 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5ec3626-a0f5-42ac-bc8a-02a4bab31985]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:25:49 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-9b6133e6-07f2-4379-8034-faccf62f2417 tempest-TestStampPattern-1947170058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7fc95db1-8a95-4cd2-9802-eecd7eb24f64 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:25:49 devstack sudo[97685]: pam_unix(sudo:session): session closed for user root Sep 29 18:25:49 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-480393b5-0209-4b09-8066-c9ea4963ecc3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2130180141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-02e3aa83-0ed6-4a44-8017-060f2007236d" returned: 0 in 0.422s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:25:49 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-480393b5-0209-4b09-8066-c9ea4963ecc3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2130180141 None] <== create_volume: return (1229ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'} {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:25:49 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-480393b5-0209-4b09-8066-c9ea4963ecc3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2130180141 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.231s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:25:49 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-480393b5-0209-4b09-8066-c9ea4963ecc3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2130180141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (061172af-c52b-40df-a1ee-f27f14c9b924) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02e3aa83-0ed6-4a44-8017-060f2007236d', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:25:49 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-480393b5-0209-4b09-8066-c9ea4963ecc3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2130180141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1d403ac-20ac-46ed-a3a2-691ad2bb4ce0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:25:49 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-480393b5-0209-4b09-8066-c9ea4963ecc3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2130180141 None] Volume volume-02e3aa83-0ed6-4a44-8017-060f2007236d (02e3aa83-0ed6-4a44-8017-060f2007236d): created successfully Sep 29 18:25:49 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-480393b5-0209-4b09-8066-c9ea4963ecc3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2130180141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1d403ac-20ac-46ed-a3a2-691ad2bb4ce0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:25:49 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-480393b5-0209-4b09-8066-c9ea4963ecc3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2130180141 None] Flow 'volume_create_manager' (fbb37708-9c5d-4b98-adc5-e8325e2d24b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:25:49 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-480393b5-0209-4b09-8066-c9ea4963ecc3 tempest-VolumeSnapshotQuotasNegativeTestJSON-2130180141 None] Created volume successfully. Sep 29 18:25:49 devstack sudo[97688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7fc95db1-8a95-4cd2-9802-eecd7eb24f64 Sep 29 18:25:49 devstack sudo[97688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:25:50 devstack sudo[97688]: pam_unix(sudo:session): session closed for user root Sep 29 18:25:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-9b6133e6-07f2-4379-8034-faccf62f2417 tempest-TestStampPattern-1947170058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7fc95db1-8a95-4cd2-9802-eecd7eb24f64" returned: 0 in 0.456s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:25:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-9b6133e6-07f2-4379-8034-faccf62f2417 tempest-TestStampPattern-1947170058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7fc95db1-8a95-4cd2-9802-eecd7eb24f64 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:25:50 devstack sudo[97693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7fc95db1-8a95-4cd2-9802-eecd7eb24f64 Sep 29 18:25:50 devstack sudo[97693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:25:50 devstack sudo[97693]: pam_unix(sudo:session): session closed for user root Sep 29 18:25:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-9b6133e6-07f2-4379-8034-faccf62f2417 tempest-TestStampPattern-1947170058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7fc95db1-8a95-4cd2-9802-eecd7eb24f64" returned: 0 in 0.283s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:25:50 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-9b6133e6-07f2-4379-8034-faccf62f2417 tempest-TestStampPattern-1947170058 None] Lock "cinder-quobyte-7fc95db1-8a95-4cd2-9802-eecd7eb24f64" released by "delete_volume" :: held 0.869s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:25:50 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-9b6133e6-07f2-4379-8034-faccf62f2417 tempest-TestStampPattern-1947170058 None] Created reservations ['f72dcc1c-7b93-43e5-b098-29de5e74160b', 'dcd45b33-0a15-4ebf-98e9-0e5cf316cb2b', 'a3405c1c-7045-4caa-9a48-67dba8337b25', '75a3ec67-75f4-4a95-ae2c-11c1c0a81d8c'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:25:50 devstack cinder-volume[86512]: DEBUG oslo_service.periodic_task [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86512) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 18:25:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:25:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:25:50 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:25:50 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:25:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:25:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:25:50 devstack sudo[97702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:25:50 devstack sudo[97702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:25:50 devstack cinder-volume[86512]: INFO cinder.volume.manager [req-6b97476a-a16e-40d0-9396-dddd9588bfd7 req-daa3260f-1bf4-458d-9965-4fbc9c5a17fc tempest-AttachVolumeNegativeTest-1588161148 None] Terminate volume connection completed successfully. Sep 29 18:25:50 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [req-6b97476a-a16e-40d0-9396-dddd9588bfd7 req-daa3260f-1bf4-458d-9965-4fbc9c5a17fc tempest-AttachVolumeNegativeTest-1588161148 None] Deleting attachment 49397a8e-b94f-44f3-a3d6-5f1e33d45dc4. {{(pid=86512) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 29 18:25:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-6695e4f5-b873-435b-b100-8a3ffcb53f30 tempest-VolumeSnapshotQuotasNegativeTestJSON-2130180141 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:25:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-6695e4f5-b873-435b-b100-8a3ffcb53f30 tempest-VolumeSnapshotQuotasNegativeTestJSON-2130180141 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:25:50 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-6695e4f5-b873-435b-b100-8a3ffcb53f30 tempest-VolumeSnapshotQuotasNegativeTestJSON-2130180141 None] Creating offline snapshot 2ab79b76-b4c3-46c0-8a12-9cbbb4b12074 of volume 02e3aa83-0ed6-4a44-8017-060f2007236d {{(pid=86512) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 18:25:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-9b6133e6-07f2-4379-8034-faccf62f2417 tempest-TestStampPattern-1947170058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:25:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-9b6133e6-07f2-4379-8034-faccf62f2417 tempest-TestStampPattern-1947170058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:25:50 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-9b6133e6-07f2-4379-8034-faccf62f2417 tempest-TestStampPattern-1947170058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:25:50 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-9b6133e6-07f2-4379-8034-faccf62f2417 tempest-TestStampPattern-1947170058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:25:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-9b6133e6-07f2-4379-8034-faccf62f2417 tempest-TestStampPattern-1947170058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:25:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-9b6133e6-07f2-4379-8034-faccf62f2417 tempest-TestStampPattern-1947170058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:25:50 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[a528a69b-9444-489f-935a-1e85662f7297]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:25:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-6695e4f5-b873-435b-b100-8a3ffcb53f30 tempest-VolumeSnapshotQuotasNegativeTestJSON-2130180141 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-02e3aa83-0ed6-4a44-8017-060f2007236d {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:25:50 devstack sudo[97704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:25:50 devstack sudo[97704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:25:50 devstack sudo[97705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-02e3aa83-0ed6-4a44-8017-060f2007236d Sep 29 18:25:50 devstack sudo[97705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:25:51 devstack sudo[97702]: pam_unix(sudo:session): session closed for user root Sep 29 18:25:51 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.411s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:25:51 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:25:51 devstack cinder-volume[86512]: DEBUG oslo_service.periodic_task [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Running periodic task VolumeManager._thread_info {{(pid=86512) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 18:25:51 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] thread count: 28 {{(pid=86512) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 29 18:25:51 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] thread info: [<_MainThread(MainThread, started 135593654804608)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86512) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 29 18:25:51 devstack sudo[97704]: pam_unix(sudo:session): session closed for user root Sep 29 18:25:51 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-9b6133e6-07f2-4379-8034-faccf62f2417 tempest-TestStampPattern-1947170058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.374s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:25:51 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-9b6133e6-07f2-4379-8034-faccf62f2417 tempest-TestStampPattern-1947170058 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:25:51 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-9b6133e6-07f2-4379-8034-faccf62f2417 tempest-TestStampPattern-1947170058 None] Deleted volume successfully. Sep 29 18:25:51 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-9b6133e6-07f2-4379-8034-faccf62f2417 tempest-TestStampPattern-1947170058 None] Lock "cinder-7fc95db1-8a95-4cd2-9802-eecd7eb24f64-delete_volume" released by "delete_volume" :: held 1.760s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:25:51 devstack sudo[97705]: pam_unix(sudo:session): session closed for user root Sep 29 18:25:51 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-6695e4f5-b873-435b-b100-8a3ffcb53f30 tempest-VolumeSnapshotQuotasNegativeTestJSON-2130180141 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-02e3aa83-0ed6-4a44-8017-060f2007236d" returned: 0 in 0.483s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:25:51 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-6695e4f5-b873-435b-b100-8a3ffcb53f30 tempest-VolumeSnapshotQuotasNegativeTestJSON-2130180141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-02e3aa83-0ed6-4a44-8017-060f2007236d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-02e3aa83-0ed6-4a44-8017-060f2007236d.2ab79b76-b4c3-46c0-8a12-9cbbb4b12074 1G {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:25:51 devstack sudo[97713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-02e3aa83-0ed6-4a44-8017-060f2007236d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-02e3aa83-0ed6-4a44-8017-060f2007236d.2ab79b76-b4c3-46c0-8a12-9cbbb4b12074 1G Sep 29 18:25:51 devstack sudo[97713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:25:51 devstack sudo[97713]: pam_unix(sudo:session): session closed for user root Sep 29 18:25:51 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-6695e4f5-b873-435b-b100-8a3ffcb53f30 tempest-VolumeSnapshotQuotasNegativeTestJSON-2130180141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-02e3aa83-0ed6-4a44-8017-060f2007236d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-02e3aa83-0ed6-4a44-8017-060f2007236d.2ab79b76-b4c3-46c0-8a12-9cbbb4b12074 1G" returned: 0 in 0.532s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:25:51 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-6695e4f5-b873-435b-b100-8a3ffcb53f30 tempest-VolumeSnapshotQuotasNegativeTestJSON-2130180141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02e3aa83-0ed6-4a44-8017-060f2007236d -F qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-02e3aa83-0ed6-4a44-8017-060f2007236d.2ab79b76-b4c3-46c0-8a12-9cbbb4b12074 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:25:51 devstack sudo[97723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02e3aa83-0ed6-4a44-8017-060f2007236d -F qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-02e3aa83-0ed6-4a44-8017-060f2007236d.2ab79b76-b4c3-46c0-8a12-9cbbb4b12074 Sep 29 18:25:51 devstack sudo[97723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:25:52 devstack sudo[97723]: pam_unix(sudo:session): session closed for user root Sep 29 18:25:52 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-6695e4f5-b873-435b-b100-8a3ffcb53f30 tempest-VolumeSnapshotQuotasNegativeTestJSON-2130180141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02e3aa83-0ed6-4a44-8017-060f2007236d -F qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-02e3aa83-0ed6-4a44-8017-060f2007236d.2ab79b76-b4c3-46c0-8a12-9cbbb4b12074" returned: 0 in 0.465s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:25:52 devstack cinder-volume[86512]: WARNING cinder.volume.drivers.remotefs [None req-6695e4f5-b873-435b-b100-8a3ffcb53f30 tempest-VolumeSnapshotQuotasNegativeTestJSON-2130180141 None] /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-02e3aa83-0ed6-4a44-8017-060f2007236d.2ab79b76-b4c3-46c0-8a12-9cbbb4b12074 is being set with open permissions: ugo+rw Sep 29 18:25:52 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-6695e4f5-b873-435b-b100-8a3ffcb53f30 tempest-VolumeSnapshotQuotasNegativeTestJSON-2130180141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-02e3aa83-0ed6-4a44-8017-060f2007236d.2ab79b76-b4c3-46c0-8a12-9cbbb4b12074 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:25:52 devstack sudo[97747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-02e3aa83-0ed6-4a44-8017-060f2007236d.2ab79b76-b4c3-46c0-8a12-9cbbb4b12074 Sep 29 18:25:52 devstack sudo[97747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:25:52 devstack sudo[97747]: pam_unix(sudo:session): session closed for user root Sep 29 18:25:52 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-6695e4f5-b873-435b-b100-8a3ffcb53f30 tempest-VolumeSnapshotQuotasNegativeTestJSON-2130180141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-02e3aa83-0ed6-4a44-8017-060f2007236d.2ab79b76-b4c3-46c0-8a12-9cbbb4b12074" returned: 0 in 0.454s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:25:52 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-6695e4f5-b873-435b-b100-8a3ffcb53f30 tempest-VolumeSnapshotQuotasNegativeTestJSON-2130180141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-02e3aa83-0ed6-4a44-8017-060f2007236d.info {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:25:52 devstack sudo[97751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-02e3aa83-0ed6-4a44-8017-060f2007236d.info Sep 29 18:25:52 devstack sudo[97751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:25:53 devstack sudo[97751]: pam_unix(sudo:session): session closed for user root Sep 29 18:25:53 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-6695e4f5-b873-435b-b100-8a3ffcb53f30 tempest-VolumeSnapshotQuotasNegativeTestJSON-2130180141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-02e3aa83-0ed6-4a44-8017-060f2007236d.info" returned: 0 in 0.345s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:25:53 devstack cinder-volume[86512]: WARNING cinder.volume.drivers.remotefs [None req-6695e4f5-b873-435b-b100-8a3ffcb53f30 tempest-VolumeSnapshotQuotasNegativeTestJSON-2130180141 None] /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-02e3aa83-0ed6-4a44-8017-060f2007236d.info is being set with open permissions: ugo+rw Sep 29 18:25:53 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-6695e4f5-b873-435b-b100-8a3ffcb53f30 tempest-VolumeSnapshotQuotasNegativeTestJSON-2130180141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-02e3aa83-0ed6-4a44-8017-060f2007236d.info {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:25:53 devstack sudo[97754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-02e3aa83-0ed6-4a44-8017-060f2007236d.info Sep 29 18:25:53 devstack sudo[97754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:25:53 devstack sudo[97754]: pam_unix(sudo:session): session closed for user root Sep 29 18:25:53 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-6695e4f5-b873-435b-b100-8a3ffcb53f30 tempest-VolumeSnapshotQuotasNegativeTestJSON-2130180141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-02e3aa83-0ed6-4a44-8017-060f2007236d.info" returned: 0 in 0.352s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:25:53 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-6695e4f5-b873-435b-b100-8a3ffcb53f30 tempest-VolumeSnapshotQuotasNegativeTestJSON-2130180141 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.813s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:25:53 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-6695e4f5-b873-435b-b100-8a3ffcb53f30 tempest-VolumeSnapshotQuotasNegativeTestJSON-2130180141 None] Create snapshot completed successfully Sep 29 18:25:54 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-2e1c1215-b10d-4de4-b0b0-4cf6d680ac41 tempest-VolumeSnapshotQuotasNegativeTestJSON-2130180141 None] Acquiring lock "cinder-2ab79b76-b4c3-46c0-8a12-9cbbb4b12074-delete_snapshot" by "delete_snapshot" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:25:54 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-2e1c1215-b10d-4de4-b0b0-4cf6d680ac41 tempest-VolumeSnapshotQuotasNegativeTestJSON-2130180141 None] Lock "cinder-2ab79b76-b4c3-46c0-8a12-9cbbb4b12074-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:25:54 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-2e1c1215-b10d-4de4-b0b0-4cf6d680ac41 tempest-VolumeSnapshotQuotasNegativeTestJSON-2130180141 None] Acquiring lock "cinder-quobyte-02e3aa83-0ed6-4a44-8017-060f2007236d" by "delete_snapshot" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:25:54 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-2e1c1215-b10d-4de4-b0b0-4cf6d680ac41 tempest-VolumeSnapshotQuotasNegativeTestJSON-2130180141 None] Lock "cinder-quobyte-02e3aa83-0ed6-4a44-8017-060f2007236d" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:25:54 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-2e1c1215-b10d-4de4-b0b0-4cf6d680ac41 tempest-VolumeSnapshotQuotasNegativeTestJSON-2130180141 None] Acquiring lock "cinder-quobyte-2ab79b76-b4c3-46c0-8a12-9cbbb4b12074" by "_delete_snapshot" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:25:54 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-2e1c1215-b10d-4de4-b0b0-4cf6d680ac41 tempest-VolumeSnapshotQuotasNegativeTestJSON-2130180141 None] Lock "cinder-quobyte-2ab79b76-b4c3-46c0-8a12-9cbbb4b12074" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:25:54 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-2e1c1215-b10d-4de4-b0b0-4cf6d680ac41 tempest-VolumeSnapshotQuotasNegativeTestJSON-2130180141 None] Deleting offline snapshot 2ab79b76-b4c3-46c0-8a12-9cbbb4b12074 of volume 02e3aa83-0ed6-4a44-8017-060f2007236d {{(pid=86512) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 18:25:54 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-2e1c1215-b10d-4de4-b0b0-4cf6d680ac41 tempest-VolumeSnapshotQuotasNegativeTestJSON-2130180141 None] snapshot_file for this snap is: volume-02e3aa83-0ed6-4a44-8017-060f2007236d.2ab79b76-b4c3-46c0-8a12-9cbbb4b12074 {{(pid=86512) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 18:25:54 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[63743028-85d2-4014-8a50-d4739b1d792f]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:25:54 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-2e1c1215-b10d-4de4-b0b0-4cf6d680ac41 tempest-VolumeSnapshotQuotasNegativeTestJSON-2130180141 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-02e3aa83-0ed6-4a44-8017-060f2007236d.2ab79b76-b4c3-46c0-8a12-9cbbb4b12074 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:25:54 devstack sudo[97762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-02e3aa83-0ed6-4a44-8017-060f2007236d.2ab79b76-b4c3-46c0-8a12-9cbbb4b12074 Sep 29 18:25:54 devstack sudo[97762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:25:55 devstack sudo[97762]: pam_unix(sudo:session): session closed for user root Sep 29 18:25:55 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-2e1c1215-b10d-4de4-b0b0-4cf6d680ac41 tempest-VolumeSnapshotQuotasNegativeTestJSON-2130180141 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-02e3aa83-0ed6-4a44-8017-060f2007236d.2ab79b76-b4c3-46c0-8a12-9cbbb4b12074" returned: 0 in 0.425s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:25:55 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-2e1c1215-b10d-4de4-b0b0-4cf6d680ac41 tempest-VolumeSnapshotQuotasNegativeTestJSON-2130180141 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-02e3aa83-0ed6-4a44-8017-060f2007236d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86512) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 18:25:55 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f0f37e7-61ab-418a-b2d3-a50f647fe425]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:25:55 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-2e1c1215-b10d-4de4-b0b0-4cf6d680ac41 tempest-VolumeSnapshotQuotasNegativeTestJSON-2130180141 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-02e3aa83-0ed6-4a44-8017-060f2007236d {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:25:55 devstack sudo[97769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-02e3aa83-0ed6-4a44-8017-060f2007236d Sep 29 18:25:55 devstack sudo[97769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:25:55 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-2e1c1215-b10d-4de4-b0b0-4cf6d680ac41 tempest-VolumeSnapshotQuotasNegativeTestJSON-2130180141 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-02e3aa83-0ed6-4a44-8017-060f2007236d" returned: 0 in 0.496s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:25:55 devstack sudo[97769]: pam_unix(sudo:session): session closed for user root Sep 29 18:25:55 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-2e1c1215-b10d-4de4-b0b0-4cf6d680ac41 tempest-VolumeSnapshotQuotasNegativeTestJSON-2130180141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-02e3aa83-0ed6-4a44-8017-060f2007236d.2ab79b76-b4c3-46c0-8a12-9cbbb4b12074 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:25:55 devstack sudo[97780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-02e3aa83-0ed6-4a44-8017-060f2007236d.2ab79b76-b4c3-46c0-8a12-9cbbb4b12074 Sep 29 18:25:55 devstack sudo[97780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:25:56 devstack sudo[97780]: pam_unix(sudo:session): session closed for user root Sep 29 18:25:56 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-2e1c1215-b10d-4de4-b0b0-4cf6d680ac41 tempest-VolumeSnapshotQuotasNegativeTestJSON-2130180141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-02e3aa83-0ed6-4a44-8017-060f2007236d.2ab79b76-b4c3-46c0-8a12-9cbbb4b12074" returned: 0 in 0.467s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:25:56 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-2e1c1215-b10d-4de4-b0b0-4cf6d680ac41 tempest-VolumeSnapshotQuotasNegativeTestJSON-2130180141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-02e3aa83-0ed6-4a44-8017-060f2007236d.2ab79b76-b4c3-46c0-8a12-9cbbb4b12074 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:25:56 devstack sudo[97785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-02e3aa83-0ed6-4a44-8017-060f2007236d.2ab79b76-b4c3-46c0-8a12-9cbbb4b12074 Sep 29 18:25:56 devstack sudo[97785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:25:56 devstack sudo[97785]: pam_unix(sudo:session): session closed for user root Sep 29 18:25:56 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-2e1c1215-b10d-4de4-b0b0-4cf6d680ac41 tempest-VolumeSnapshotQuotasNegativeTestJSON-2130180141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-02e3aa83-0ed6-4a44-8017-060f2007236d.2ab79b76-b4c3-46c0-8a12-9cbbb4b12074" returned: 0 in 0.389s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:25:56 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-2e1c1215-b10d-4de4-b0b0-4cf6d680ac41 tempest-VolumeSnapshotQuotasNegativeTestJSON-2130180141 None] Lock "cinder-quobyte-2ab79b76-b4c3-46c0-8a12-9cbbb4b12074" released by "_delete_snapshot" :: held 1.918s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:25:56 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-2e1c1215-b10d-4de4-b0b0-4cf6d680ac41 tempest-VolumeSnapshotQuotasNegativeTestJSON-2130180141 None] Lock "cinder-quobyte-02e3aa83-0ed6-4a44-8017-060f2007236d" released by "delete_snapshot" :: held 1.940s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:25:56 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-2e1c1215-b10d-4de4-b0b0-4cf6d680ac41 tempest-VolumeSnapshotQuotasNegativeTestJSON-2130180141 None] Created reservations ['ba62c613-ed32-4e13-95ad-c376431cdd71', '2e478410-68d7-4a4c-ab1a-0b714f3b0fa8', 'd76cad76-2db3-4e71-8d84-c847ce6e51ef', '85213712-bd66-4f5b-afa9-7b689b659832'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:25:56 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-2e1c1215-b10d-4de4-b0b0-4cf6d680ac41 tempest-VolumeSnapshotQuotasNegativeTestJSON-2130180141 None] Delete snapshot completed successfully. Sep 29 18:25:56 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-2e1c1215-b10d-4de4-b0b0-4cf6d680ac41 tempest-VolumeSnapshotQuotasNegativeTestJSON-2130180141 None] Lock "cinder-2ab79b76-b4c3-46c0-8a12-9cbbb4b12074-delete_snapshot" released by "delete_snapshot" :: held 2.104s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:25:56 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-4fb48865-a8f3-4eb3-8a04-6adde7386081 tempest-VolumeSnapshotQuotasNegativeTestJSON-2130180141 None] Acquiring lock "cinder-02e3aa83-0ed6-4a44-8017-060f2007236d-delete_volume" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:25:56 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-4fb48865-a8f3-4eb3-8a04-6adde7386081 tempest-VolumeSnapshotQuotasNegativeTestJSON-2130180141 None] Lock "cinder-02e3aa83-0ed6-4a44-8017-060f2007236d-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:25:57 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-4fb48865-a8f3-4eb3-8a04-6adde7386081 tempest-VolumeSnapshotQuotasNegativeTestJSON-2130180141 None] Acquiring lock "cinder-quobyte-02e3aa83-0ed6-4a44-8017-060f2007236d" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:25:57 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-4fb48865-a8f3-4eb3-8a04-6adde7386081 tempest-VolumeSnapshotQuotasNegativeTestJSON-2130180141 None] Lock "cinder-quobyte-02e3aa83-0ed6-4a44-8017-060f2007236d" acquired by "delete_volume" :: waited 0.022s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:25:57 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a822668-2928-49d6-8f1c-a0626e2e32d9]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:25:57 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-4fb48865-a8f3-4eb3-8a04-6adde7386081 tempest-VolumeSnapshotQuotasNegativeTestJSON-2130180141 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-02e3aa83-0ed6-4a44-8017-060f2007236d {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:25:57 devstack sudo[97788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-02e3aa83-0ed6-4a44-8017-060f2007236d Sep 29 18:25:57 devstack sudo[97788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:25:57 devstack sudo[97788]: pam_unix(sudo:session): session closed for user root Sep 29 18:25:57 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-4fb48865-a8f3-4eb3-8a04-6adde7386081 tempest-VolumeSnapshotQuotasNegativeTestJSON-2130180141 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-02e3aa83-0ed6-4a44-8017-060f2007236d" returned: 0 in 0.466s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:25:57 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-4fb48865-a8f3-4eb3-8a04-6adde7386081 tempest-VolumeSnapshotQuotasNegativeTestJSON-2130180141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-02e3aa83-0ed6-4a44-8017-060f2007236d {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:25:57 devstack sudo[97793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-02e3aa83-0ed6-4a44-8017-060f2007236d Sep 29 18:25:57 devstack sudo[97793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:25:57 devstack sudo[97793]: pam_unix(sudo:session): session closed for user root Sep 29 18:25:57 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-4fb48865-a8f3-4eb3-8a04-6adde7386081 tempest-VolumeSnapshotQuotasNegativeTestJSON-2130180141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-02e3aa83-0ed6-4a44-8017-060f2007236d" returned: 0 in 0.303s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:25:57 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-4fb48865-a8f3-4eb3-8a04-6adde7386081 tempest-VolumeSnapshotQuotasNegativeTestJSON-2130180141 None] Lock "cinder-quobyte-02e3aa83-0ed6-4a44-8017-060f2007236d" released by "delete_volume" :: held 0.860s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:25:57 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-4fb48865-a8f3-4eb3-8a04-6adde7386081 tempest-VolumeSnapshotQuotasNegativeTestJSON-2130180141 None] Created reservations ['9bbc0b41-9bc7-49ce-91aa-be36c4a85094', '6b861b1d-59be-4129-99b1-17866458c8ec', 'cf627f16-16c7-41d4-9825-a336ee7f942d', '54805a8d-41e2-4d6e-86ea-d461c8eebf04'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:25:58 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-4fb48865-a8f3-4eb3-8a04-6adde7386081 tempest-VolumeSnapshotQuotasNegativeTestJSON-2130180141 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:25:58 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-4fb48865-a8f3-4eb3-8a04-6adde7386081 tempest-VolumeSnapshotQuotasNegativeTestJSON-2130180141 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:25:58 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-4fb48865-a8f3-4eb3-8a04-6adde7386081 tempest-VolumeSnapshotQuotasNegativeTestJSON-2130180141 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:25:58 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-4fb48865-a8f3-4eb3-8a04-6adde7386081 tempest-VolumeSnapshotQuotasNegativeTestJSON-2130180141 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:25:58 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-4fb48865-a8f3-4eb3-8a04-6adde7386081 tempest-VolumeSnapshotQuotasNegativeTestJSON-2130180141 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:25:58 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-4fb48865-a8f3-4eb3-8a04-6adde7386081 tempest-VolumeSnapshotQuotasNegativeTestJSON-2130180141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:25:58 devstack sudo[97796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:25:58 devstack sudo[97796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:25:58 devstack sudo[97796]: pam_unix(sudo:session): session closed for user root Sep 29 18:25:58 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-4fb48865-a8f3-4eb3-8a04-6adde7386081 tempest-VolumeSnapshotQuotasNegativeTestJSON-2130180141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.364s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:25:58 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-4fb48865-a8f3-4eb3-8a04-6adde7386081 tempest-VolumeSnapshotQuotasNegativeTestJSON-2130180141 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:25:58 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-4fb48865-a8f3-4eb3-8a04-6adde7386081 tempest-VolumeSnapshotQuotasNegativeTestJSON-2130180141 None] Deleted volume successfully. Sep 29 18:25:58 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-4fb48865-a8f3-4eb3-8a04-6adde7386081 tempest-VolumeSnapshotQuotasNegativeTestJSON-2130180141 None] Lock "cinder-02e3aa83-0ed6-4a44-8017-060f2007236d-delete_volume" released by "delete_volume" :: held 1.471s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:26:04 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-22067436-8e88-406d-bde2-19de6e63378b tempest-VolumesListAdminTestJSON-423174112 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86512) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:26:04 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-22067436-8e88-406d-bde2-19de6e63378b tempest-VolumesListAdminTestJSON-423174112 None] Flow 'volume_create_manager' (7d3edc7c-1482-443f-9faf-02667c3865ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:26:04 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-22067436-8e88-406d-bde2-19de6e63378b tempest-VolumesListAdminTestJSON-423174112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23c67b5e-a606-4b37-bff1-12ae1d82409a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:26:04 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-22067436-8e88-406d-bde2-19de6e63378b tempest-VolumesListAdminTestJSON-423174112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23c67b5e-a606-4b37-bff1-12ae1d82409a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:26:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1571035649',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad1cb64d-b9e8-4076-927c-5aff4cb74003,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3111241f6254b06ab0a7dfc3d28480a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:26:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:26:04Z,use_quota=True,user_id='ec8273d86024498792158eb18a962012',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:26:04 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-22067436-8e88-406d-bde2-19de6e63378b tempest-VolumesListAdminTestJSON-423174112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (993cc8b7-3da0-45c0-a2a6-af30c062c126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:26:04 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-22067436-8e88-406d-bde2-19de6e63378b tempest-VolumesListAdminTestJSON-423174112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (993cc8b7-3da0-45c0-a2a6-af30c062c126) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:26:04 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-22067436-8e88-406d-bde2-19de6e63378b tempest-VolumesListAdminTestJSON-423174112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bb999bf-4789-4827-9b96-2685d789ade6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:26:04 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-22067436-8e88-406d-bde2-19de6e63378b tempest-VolumesListAdminTestJSON-423174112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bb999bf-4789-4827-9b96-2685d789ade6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad1cb64d-b9e8-4076-927c-5aff4cb74003', 'volume_name': 'volume-ad1cb64d-b9e8-4076-927c-5aff4cb74003', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:26:04 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-22067436-8e88-406d-bde2-19de6e63378b tempest-VolumesListAdminTestJSON-423174112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c022e4fd-a87e-48c5-89c9-327acc5e3a9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:26:04 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-22067436-8e88-406d-bde2-19de6e63378b tempest-VolumesListAdminTestJSON-423174112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c022e4fd-a87e-48c5-89c9-327acc5e3a9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:26:04 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-22067436-8e88-406d-bde2-19de6e63378b tempest-VolumesListAdminTestJSON-423174112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17f8bf56-b328-4259-b5e2-e72d60c353e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:26:04 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-22067436-8e88-406d-bde2-19de6e63378b tempest-VolumesListAdminTestJSON-423174112 None] Volume ad1cb64d-b9e8-4076-927c-5aff4cb74003: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad1cb64d-b9e8-4076-927c-5aff4cb74003', 'volume_size': 1} Sep 29 18:26:04 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-22067436-8e88-406d-bde2-19de6e63378b tempest-VolumesListAdminTestJSON-423174112 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:26:04 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-22067436-8e88-406d-bde2-19de6e63378b tempest-VolumesListAdminTestJSON-423174112 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:26:04 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-22067436-8e88-406d-bde2-19de6e63378b tempest-VolumesListAdminTestJSON-423174112 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:26:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1571035649',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad1cb64d-b9e8-4076-927c-5aff4cb74003,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3111241f6254b06ab0a7dfc3d28480a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:26:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:26:04Z,use_quota=True,user_id='ec8273d86024498792158eb18a962012',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)}" {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:26:04 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-22067436-8e88-406d-bde2-19de6e63378b tempest-VolumesListAdminTestJSON-423174112 None] Creating volume ad1cb64d-b9e8-4076-927c-5aff4cb74003 {{(pid=86512) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:26:04 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-22067436-8e88-406d-bde2-19de6e63378b tempest-VolumesListAdminTestJSON-423174112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:26:04 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-22067436-8e88-406d-bde2-19de6e63378b tempest-VolumesListAdminTestJSON-423174112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:26:04 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-22067436-8e88-406d-bde2-19de6e63378b tempest-VolumesListAdminTestJSON-423174112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:26:04 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-22067436-8e88-406d-bde2-19de6e63378b tempest-VolumesListAdminTestJSON-423174112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:26:04 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-22067436-8e88-406d-bde2-19de6e63378b tempest-VolumesListAdminTestJSON-423174112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:26:04 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-22067436-8e88-406d-bde2-19de6e63378b tempest-VolumesListAdminTestJSON-423174112 None] Selected osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 as target Quobyte volume. {{(pid=86512) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:26:04 devstack cinder-volume[86512]: INFO cinder.volume.drivers.remotefs [None req-22067436-8e88-406d-bde2-19de6e63378b tempest-VolumesListAdminTestJSON-423174112 None] casted to osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 Sep 29 18:26:04 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-22067436-8e88-406d-bde2-19de6e63378b tempest-VolumesListAdminTestJSON-423174112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ad1cb64d-b9e8-4076-927c-5aff4cb74003 1073741824 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:26:04 devstack sudo[97820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ad1cb64d-b9e8-4076-927c-5aff4cb74003 1073741824 Sep 29 18:26:04 devstack sudo[97820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:26:05 devstack sudo[97820]: pam_unix(sudo:session): session closed for user root Sep 29 18:26:05 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-22067436-8e88-406d-bde2-19de6e63378b tempest-VolumesListAdminTestJSON-423174112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ad1cb64d-b9e8-4076-927c-5aff4cb74003 1073741824" returned: 0 in 0.755s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:26:05 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-22067436-8e88-406d-bde2-19de6e63378b tempest-VolumesListAdminTestJSON-423174112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ad1cb64d-b9e8-4076-927c-5aff4cb74003 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:26:05 devstack sudo[97830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ad1cb64d-b9e8-4076-927c-5aff4cb74003 Sep 29 18:26:05 devstack sudo[97830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:26:05 devstack sudo[97830]: pam_unix(sudo:session): session closed for user root Sep 29 18:26:05 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-22067436-8e88-406d-bde2-19de6e63378b tempest-VolumesListAdminTestJSON-423174112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ad1cb64d-b9e8-4076-927c-5aff4cb74003" returned: 0 in 0.449s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:26:05 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-22067436-8e88-406d-bde2-19de6e63378b tempest-VolumesListAdminTestJSON-423174112 None] <== create_volume: return (1277ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'} {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:26:05 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-22067436-8e88-406d-bde2-19de6e63378b tempest-VolumesListAdminTestJSON-423174112 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.283s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:26:05 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-22067436-8e88-406d-bde2-19de6e63378b tempest-VolumesListAdminTestJSON-423174112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17f8bf56-b328-4259-b5e2-e72d60c353e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad1cb64d-b9e8-4076-927c-5aff4cb74003', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:26:05 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-22067436-8e88-406d-bde2-19de6e63378b tempest-VolumesListAdminTestJSON-423174112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e04eabc-0318-44d5-a5df-f33eea77d242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:26:05 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-22067436-8e88-406d-bde2-19de6e63378b tempest-VolumesListAdminTestJSON-423174112 None] Volume volume-ad1cb64d-b9e8-4076-927c-5aff4cb74003 (ad1cb64d-b9e8-4076-927c-5aff4cb74003): created successfully Sep 29 18:26:05 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-22067436-8e88-406d-bde2-19de6e63378b tempest-VolumesListAdminTestJSON-423174112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e04eabc-0318-44d5-a5df-f33eea77d242) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:26:05 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-22067436-8e88-406d-bde2-19de6e63378b tempest-VolumesListAdminTestJSON-423174112 None] Flow 'volume_create_manager' (7d3edc7c-1482-443f-9faf-02667c3865ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:26:05 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-22067436-8e88-406d-bde2-19de6e63378b tempest-VolumesListAdminTestJSON-423174112 None] Created volume successfully. Sep 29 18:26:07 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-5dbc6fa4-3beb-4b75-9223-5fe202ac1937 tempest-VolumesListAdminTestJSON-423174112 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86512) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:26:07 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-5dbc6fa4-3beb-4b75-9223-5fe202ac1937 tempest-VolumesListAdminTestJSON-423174112 None] Flow 'volume_create_manager' (5511f854-85d0-4b3c-bd54-75a3b6cd5e66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:26:07 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-5dbc6fa4-3beb-4b75-9223-5fe202ac1937 tempest-VolumesListAdminTestJSON-423174112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a96893c-425e-43fd-b47a-9e44b26fc827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:26:07 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-5dbc6fa4-3beb-4b75-9223-5fe202ac1937 tempest-VolumesListAdminTestJSON-423174112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a96893c-425e-43fd-b47a-9e44b26fc827) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:26:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1482515143',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c041f28-5e56-499b-9ba2-fe0a83dca458,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3111241f6254b06ab0a7dfc3d28480a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:26:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:26:07Z,use_quota=True,user_id='ec8273d86024498792158eb18a962012',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:26:07 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-5dbc6fa4-3beb-4b75-9223-5fe202ac1937 tempest-VolumesListAdminTestJSON-423174112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0008a4f9-e359-42a0-b563-455b64f01d18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:26:07 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-5dbc6fa4-3beb-4b75-9223-5fe202ac1937 tempest-VolumesListAdminTestJSON-423174112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0008a4f9-e359-42a0-b563-455b64f01d18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:26:07 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-5dbc6fa4-3beb-4b75-9223-5fe202ac1937 tempest-VolumesListAdminTestJSON-423174112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (438e989e-3edb-4b05-b8e3-4d43ff3f7bc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:26:07 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-5dbc6fa4-3beb-4b75-9223-5fe202ac1937 tempest-VolumesListAdminTestJSON-423174112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (438e989e-3edb-4b05-b8e3-4d43ff3f7bc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c041f28-5e56-499b-9ba2-fe0a83dca458', 'volume_name': 'volume-0c041f28-5e56-499b-9ba2-fe0a83dca458', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:26:07 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-5dbc6fa4-3beb-4b75-9223-5fe202ac1937 tempest-VolumesListAdminTestJSON-423174112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1891796-dc5b-4734-a263-d7e6d676700a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:26:07 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-5dbc6fa4-3beb-4b75-9223-5fe202ac1937 tempest-VolumesListAdminTestJSON-423174112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1891796-dc5b-4734-a263-d7e6d676700a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:26:07 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-5dbc6fa4-3beb-4b75-9223-5fe202ac1937 tempest-VolumesListAdminTestJSON-423174112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c0b29f4-7b25-4927-9c80-1ccd6b2b5c5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:26:07 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-5dbc6fa4-3beb-4b75-9223-5fe202ac1937 tempest-VolumesListAdminTestJSON-423174112 None] Volume 0c041f28-5e56-499b-9ba2-fe0a83dca458: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c041f28-5e56-499b-9ba2-fe0a83dca458', 'volume_size': 1} Sep 29 18:26:07 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-5dbc6fa4-3beb-4b75-9223-5fe202ac1937 tempest-VolumesListAdminTestJSON-423174112 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:26:07 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-5dbc6fa4-3beb-4b75-9223-5fe202ac1937 tempest-VolumesListAdminTestJSON-423174112 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:26:07 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-5dbc6fa4-3beb-4b75-9223-5fe202ac1937 tempest-VolumesListAdminTestJSON-423174112 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:26:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1482515143',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c041f28-5e56-499b-9ba2-fe0a83dca458,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3111241f6254b06ab0a7dfc3d28480a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:26:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:26:07Z,use_quota=True,user_id='ec8273d86024498792158eb18a962012',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)}" {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:26:07 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-5dbc6fa4-3beb-4b75-9223-5fe202ac1937 tempest-VolumesListAdminTestJSON-423174112 None] Creating volume 0c041f28-5e56-499b-9ba2-fe0a83dca458 {{(pid=86512) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:26:07 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-5dbc6fa4-3beb-4b75-9223-5fe202ac1937 tempest-VolumesListAdminTestJSON-423174112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:26:07 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-5dbc6fa4-3beb-4b75-9223-5fe202ac1937 tempest-VolumesListAdminTestJSON-423174112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:26:07 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-5dbc6fa4-3beb-4b75-9223-5fe202ac1937 tempest-VolumesListAdminTestJSON-423174112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:26:07 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-5dbc6fa4-3beb-4b75-9223-5fe202ac1937 tempest-VolumesListAdminTestJSON-423174112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:26:07 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-5dbc6fa4-3beb-4b75-9223-5fe202ac1937 tempest-VolumesListAdminTestJSON-423174112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:26:07 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-5dbc6fa4-3beb-4b75-9223-5fe202ac1937 tempest-VolumesListAdminTestJSON-423174112 None] Selected osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 as target Quobyte volume. {{(pid=86512) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:26:07 devstack cinder-volume[86512]: INFO cinder.volume.drivers.remotefs [None req-5dbc6fa4-3beb-4b75-9223-5fe202ac1937 tempest-VolumesListAdminTestJSON-423174112 None] casted to osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 Sep 29 18:26:07 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-5dbc6fa4-3beb-4b75-9223-5fe202ac1937 tempest-VolumesListAdminTestJSON-423174112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0c041f28-5e56-499b-9ba2-fe0a83dca458 1073741824 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:26:07 devstack sudo[97875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0c041f28-5e56-499b-9ba2-fe0a83dca458 1073741824 Sep 29 18:26:07 devstack sudo[97875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:26:08 devstack sudo[97875]: pam_unix(sudo:session): session closed for user root Sep 29 18:26:08 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-5dbc6fa4-3beb-4b75-9223-5fe202ac1937 tempest-VolumesListAdminTestJSON-423174112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0c041f28-5e56-499b-9ba2-fe0a83dca458 1073741824" returned: 0 in 0.696s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:26:08 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-5dbc6fa4-3beb-4b75-9223-5fe202ac1937 tempest-VolumesListAdminTestJSON-423174112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0c041f28-5e56-499b-9ba2-fe0a83dca458 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:26:08 devstack sudo[97920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0c041f28-5e56-499b-9ba2-fe0a83dca458 Sep 29 18:26:08 devstack sudo[97920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:26:08 devstack sudo[97920]: pam_unix(sudo:session): session closed for user root Sep 29 18:26:08 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-5dbc6fa4-3beb-4b75-9223-5fe202ac1937 tempest-VolumesListAdminTestJSON-423174112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0c041f28-5e56-499b-9ba2-fe0a83dca458" returned: 0 in 0.431s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:26:08 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-5dbc6fa4-3beb-4b75-9223-5fe202ac1937 tempest-VolumesListAdminTestJSON-423174112 None] <== create_volume: return (1417ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'} {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:26:08 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-5dbc6fa4-3beb-4b75-9223-5fe202ac1937 tempest-VolumesListAdminTestJSON-423174112 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.428s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:26:09 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-5dbc6fa4-3beb-4b75-9223-5fe202ac1937 tempest-VolumesListAdminTestJSON-423174112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c0b29f4-7b25-4927-9c80-1ccd6b2b5c5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c041f28-5e56-499b-9ba2-fe0a83dca458', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:26:09 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-5dbc6fa4-3beb-4b75-9223-5fe202ac1937 tempest-VolumesListAdminTestJSON-423174112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba82effc-c6d8-4a40-8a59-4917583d9ecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:26:09 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-5dbc6fa4-3beb-4b75-9223-5fe202ac1937 tempest-VolumesListAdminTestJSON-423174112 None] Volume volume-0c041f28-5e56-499b-9ba2-fe0a83dca458 (0c041f28-5e56-499b-9ba2-fe0a83dca458): created successfully Sep 29 18:26:09 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-5dbc6fa4-3beb-4b75-9223-5fe202ac1937 tempest-VolumesListAdminTestJSON-423174112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba82effc-c6d8-4a40-8a59-4917583d9ecc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:26:09 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-5dbc6fa4-3beb-4b75-9223-5fe202ac1937 tempest-VolumesListAdminTestJSON-423174112 None] Flow 'volume_create_manager' (5511f854-85d0-4b3c-bd54-75a3b6cd5e66) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:26:09 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-5dbc6fa4-3beb-4b75-9223-5fe202ac1937 tempest-VolumesListAdminTestJSON-423174112 None] Created volume successfully. Sep 29 18:26:09 devstack cinder-volume[86512]: DEBUG dbcounter [-] [86512] Writing DB stats cinder:UPDATE=130,cinder:SELECT=100,cinder:INSERT=36,cinder:DELETE=4 {{(pid=86512) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 18:26:09 devstack cinder-volume[86512]: DEBUG dbcounter [-] [86512] Writing DB stats cinder:SELECT=101,cinder:UPDATE=108,cinder:INSERT=18,cinder:DELETE=11 {{(pid=86512) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 18:26:09 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe5d4afd-865e-4d38-af31-d3245e95085e tempest-VolumeTypesAccessTest-1340040134 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86512) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:26:09 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-fe5d4afd-865e-4d38-af31-d3245e95085e tempest-VolumeTypesAccessTest-1340040134 None] Flow 'volume_create_manager' (83fb8481-db10-49cf-8e67-c455f2eaf53b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:26:09 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-fe5d4afd-865e-4d38-af31-d3245e95085e tempest-VolumeTypesAccessTest-1340040134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09bf7d27-1975-476f-bb06-941a39c52d04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:26:09 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-fe5d4afd-865e-4d38-af31-d3245e95085e tempest-VolumeTypesAccessTest-1340040134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09bf7d27-1975-476f-bb06-941a39c52d04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:26:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-537269757',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22cc721c-3f1e-47c3-986b-288561accffe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e75d1bd6f22408c81a8badc6794f391',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:26:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:26:09Z,use_quota=True,user_id='db620a1567f7491289070a657e63b0e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11547612-ef59-4c36-9db9-438c19bf4bf4),volume_type_id=11547612-ef59-4c36-9db9-438c19bf4bf4)' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:26:09 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-fe5d4afd-865e-4d38-af31-d3245e95085e tempest-VolumeTypesAccessTest-1340040134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd733114-cac7-4ffd-a6b4-50ffd5ab6418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:26:09 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-fe5d4afd-865e-4d38-af31-d3245e95085e tempest-VolumeTypesAccessTest-1340040134 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd733114-cac7-4ffd-a6b4-50ffd5ab6418) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:26:09 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-fe5d4afd-865e-4d38-af31-d3245e95085e tempest-VolumeTypesAccessTest-1340040134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab3333d5-5fc1-4d82-87b6-35186f75ccfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:26:09 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-fe5d4afd-865e-4d38-af31-d3245e95085e tempest-VolumeTypesAccessTest-1340040134 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab3333d5-5fc1-4d82-87b6-35186f75ccfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22cc721c-3f1e-47c3-986b-288561accffe', 'volume_name': 'volume-22cc721c-3f1e-47c3-986b-288561accffe', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:26:09 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-fe5d4afd-865e-4d38-af31-d3245e95085e tempest-VolumeTypesAccessTest-1340040134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1d5eda5-39ac-4988-b804-e2580cf4504b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:26:09 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-fe5d4afd-865e-4d38-af31-d3245e95085e tempest-VolumeTypesAccessTest-1340040134 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1d5eda5-39ac-4988-b804-e2580cf4504b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:26:09 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-fe5d4afd-865e-4d38-af31-d3245e95085e tempest-VolumeTypesAccessTest-1340040134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64880406-56bb-45df-9b4b-37f6ec124460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:26:09 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-fe5d4afd-865e-4d38-af31-d3245e95085e tempest-VolumeTypesAccessTest-1340040134 None] Volume 22cc721c-3f1e-47c3-986b-288561accffe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22cc721c-3f1e-47c3-986b-288561accffe', 'volume_size': 1} Sep 29 18:26:09 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-fe5d4afd-865e-4d38-af31-d3245e95085e tempest-VolumeTypesAccessTest-1340040134 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:26:09 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-fe5d4afd-865e-4d38-af31-d3245e95085e tempest-VolumeTypesAccessTest-1340040134 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:26:09 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-fe5d4afd-865e-4d38-af31-d3245e95085e tempest-VolumeTypesAccessTest-1340040134 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:26:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-537269757',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22cc721c-3f1e-47c3-986b-288561accffe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e75d1bd6f22408c81a8badc6794f391',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:26:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:26:09Z,use_quota=True,user_id='db620a1567f7491289070a657e63b0e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11547612-ef59-4c36-9db9-438c19bf4bf4),volume_type_id=11547612-ef59-4c36-9db9-438c19bf4bf4)}" {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:26:09 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-fe5d4afd-865e-4d38-af31-d3245e95085e tempest-VolumeTypesAccessTest-1340040134 None] Creating volume 22cc721c-3f1e-47c3-986b-288561accffe {{(pid=86512) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:26:09 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-fe5d4afd-865e-4d38-af31-d3245e95085e tempest-VolumeTypesAccessTest-1340040134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:26:09 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-fe5d4afd-865e-4d38-af31-d3245e95085e tempest-VolumeTypesAccessTest-1340040134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:26:09 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-fe5d4afd-865e-4d38-af31-d3245e95085e tempest-VolumeTypesAccessTest-1340040134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:26:09 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-fe5d4afd-865e-4d38-af31-d3245e95085e tempest-VolumeTypesAccessTest-1340040134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:26:09 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-fe5d4afd-865e-4d38-af31-d3245e95085e tempest-VolumeTypesAccessTest-1340040134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:26:09 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-fe5d4afd-865e-4d38-af31-d3245e95085e tempest-VolumeTypesAccessTest-1340040134 None] Selected osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 as target Quobyte volume. {{(pid=86512) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:26:09 devstack cinder-volume[86512]: INFO cinder.volume.drivers.remotefs [None req-fe5d4afd-865e-4d38-af31-d3245e95085e tempest-VolumeTypesAccessTest-1340040134 None] casted to osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 Sep 29 18:26:09 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-fe5d4afd-865e-4d38-af31-d3245e95085e tempest-VolumeTypesAccessTest-1340040134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-22cc721c-3f1e-47c3-986b-288561accffe 1073741824 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:26:09 devstack sudo[97926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-22cc721c-3f1e-47c3-986b-288561accffe 1073741824 Sep 29 18:26:09 devstack sudo[97926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:26:10 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-a532c131-266d-42e6-837d-13d5fc246b45 tempest-VolumesListAdminTestJSON-423174112 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86512) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:26:10 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-a532c131-266d-42e6-837d-13d5fc246b45 tempest-VolumesListAdminTestJSON-423174112 None] Flow 'volume_create_manager' (d2598645-e317-4999-8275-9648493e9b9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:26:10 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-a532c131-266d-42e6-837d-13d5fc246b45 tempest-VolumesListAdminTestJSON-423174112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44b41cea-10b9-458e-b7f6-0fc0dc8fdfb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:26:10 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-a532c131-266d-42e6-837d-13d5fc246b45 tempest-VolumesListAdminTestJSON-423174112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44b41cea-10b9-458e-b7f6-0fc0dc8fdfb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:26:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1565574438',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c867d1b2-63e8-4434-bd07-ee3328c9dd95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3111241f6254b06ab0a7dfc3d28480a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:26:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:26:10Z,use_quota=True,user_id='ec8273d86024498792158eb18a962012',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:26:10 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-a532c131-266d-42e6-837d-13d5fc246b45 tempest-VolumesListAdminTestJSON-423174112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (008b078d-ef91-4395-9e13-69089fc1ff2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:26:10 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-a532c131-266d-42e6-837d-13d5fc246b45 tempest-VolumesListAdminTestJSON-423174112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (008b078d-ef91-4395-9e13-69089fc1ff2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:26:10 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-a532c131-266d-42e6-837d-13d5fc246b45 tempest-VolumesListAdminTestJSON-423174112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7eb744d1-61cf-4a1f-b96f-e8a4f247d416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:26:10 devstack sudo[97926]: pam_unix(sudo:session): session closed for user root Sep 29 18:26:10 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-a532c131-266d-42e6-837d-13d5fc246b45 tempest-VolumesListAdminTestJSON-423174112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7eb744d1-61cf-4a1f-b96f-e8a4f247d416) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c867d1b2-63e8-4434-bd07-ee3328c9dd95', 'volume_name': 'volume-c867d1b2-63e8-4434-bd07-ee3328c9dd95', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:26:10 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-a532c131-266d-42e6-837d-13d5fc246b45 tempest-VolumesListAdminTestJSON-423174112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9af967d-2839-4cb1-bb6b-d96ee04c2ff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:26:10 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-a532c131-266d-42e6-837d-13d5fc246b45 tempest-VolumesListAdminTestJSON-423174112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9af967d-2839-4cb1-bb6b-d96ee04c2ff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:26:10 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-a532c131-266d-42e6-837d-13d5fc246b45 tempest-VolumesListAdminTestJSON-423174112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5e4f205-7748-4919-8c37-2fcb7c72eaaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:26:10 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-a532c131-266d-42e6-837d-13d5fc246b45 tempest-VolumesListAdminTestJSON-423174112 None] Volume c867d1b2-63e8-4434-bd07-ee3328c9dd95: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c867d1b2-63e8-4434-bd07-ee3328c9dd95', 'volume_size': 1} Sep 29 18:26:10 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-a532c131-266d-42e6-837d-13d5fc246b45 tempest-VolumesListAdminTestJSON-423174112 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:26:10 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-fe5d4afd-865e-4d38-af31-d3245e95085e tempest-VolumeTypesAccessTest-1340040134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-22cc721c-3f1e-47c3-986b-288561accffe 1073741824" returned: 0 in 0.965s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:26:10 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-fe5d4afd-865e-4d38-af31-d3245e95085e tempest-VolumeTypesAccessTest-1340040134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-22cc721c-3f1e-47c3-986b-288561accffe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:26:10 devstack sudo[97934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-22cc721c-3f1e-47c3-986b-288561accffe Sep 29 18:26:10 devstack sudo[97934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:26:10 devstack sudo[97934]: pam_unix(sudo:session): session closed for user root Sep 29 18:26:10 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-fe5d4afd-865e-4d38-af31-d3245e95085e tempest-VolumeTypesAccessTest-1340040134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-22cc721c-3f1e-47c3-986b-288561accffe" returned: 0 in 0.335s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:26:10 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-fe5d4afd-865e-4d38-af31-d3245e95085e tempest-VolumeTypesAccessTest-1340040134 None] <== create_volume: return (1356ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'} {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:26:10 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-fe5d4afd-865e-4d38-af31-d3245e95085e tempest-VolumeTypesAccessTest-1340040134 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.362s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:26:10 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-a532c131-266d-42e6-837d-13d5fc246b45 tempest-VolumesListAdminTestJSON-423174112 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.390s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:26:10 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-a532c131-266d-42e6-837d-13d5fc246b45 tempest-VolumesListAdminTestJSON-423174112 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:26:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1565574438',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c867d1b2-63e8-4434-bd07-ee3328c9dd95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3111241f6254b06ab0a7dfc3d28480a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:26:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:26:10Z,use_quota=True,user_id='ec8273d86024498792158eb18a962012',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)}" {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:26:10 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-a532c131-266d-42e6-837d-13d5fc246b45 tempest-VolumesListAdminTestJSON-423174112 None] Creating volume c867d1b2-63e8-4434-bd07-ee3328c9dd95 {{(pid=86512) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:26:10 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-a532c131-266d-42e6-837d-13d5fc246b45 tempest-VolumesListAdminTestJSON-423174112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:26:10 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-a532c131-266d-42e6-837d-13d5fc246b45 tempest-VolumesListAdminTestJSON-423174112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:26:10 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-a532c131-266d-42e6-837d-13d5fc246b45 tempest-VolumesListAdminTestJSON-423174112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:26:10 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-a532c131-266d-42e6-837d-13d5fc246b45 tempest-VolumesListAdminTestJSON-423174112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:26:10 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-a532c131-266d-42e6-837d-13d5fc246b45 tempest-VolumesListAdminTestJSON-423174112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:26:10 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-a532c131-266d-42e6-837d-13d5fc246b45 tempest-VolumesListAdminTestJSON-423174112 None] Selected osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 as target Quobyte volume. {{(pid=86512) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:26:10 devstack cinder-volume[86512]: INFO cinder.volume.drivers.remotefs [None req-a532c131-266d-42e6-837d-13d5fc246b45 tempest-VolumesListAdminTestJSON-423174112 None] casted to osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 Sep 29 18:26:10 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a532c131-266d-42e6-837d-13d5fc246b45 tempest-VolumesListAdminTestJSON-423174112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-c867d1b2-63e8-4434-bd07-ee3328c9dd95 1073741824 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:26:10 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-fe5d4afd-865e-4d38-af31-d3245e95085e tempest-VolumeTypesAccessTest-1340040134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64880406-56bb-45df-9b4b-37f6ec124460) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22cc721c-3f1e-47c3-986b-288561accffe', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:26:10 devstack sudo[97937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-c867d1b2-63e8-4434-bd07-ee3328c9dd95 1073741824 Sep 29 18:26:10 devstack sudo[97937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:26:10 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-fe5d4afd-865e-4d38-af31-d3245e95085e tempest-VolumeTypesAccessTest-1340040134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a2b7e0e-f706-47fa-9f78-4a4ec3a47edb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:26:11 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-fe5d4afd-865e-4d38-af31-d3245e95085e tempest-VolumeTypesAccessTest-1340040134 None] Volume volume-22cc721c-3f1e-47c3-986b-288561accffe (22cc721c-3f1e-47c3-986b-288561accffe): created successfully Sep 29 18:26:11 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-fe5d4afd-865e-4d38-af31-d3245e95085e tempest-VolumeTypesAccessTest-1340040134 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a2b7e0e-f706-47fa-9f78-4a4ec3a47edb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:26:11 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-fe5d4afd-865e-4d38-af31-d3245e95085e tempest-VolumeTypesAccessTest-1340040134 None] Flow 'volume_create_manager' (83fb8481-db10-49cf-8e67-c455f2eaf53b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:26:11 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-fe5d4afd-865e-4d38-af31-d3245e95085e tempest-VolumeTypesAccessTest-1340040134 None] Created volume successfully. Sep 29 18:26:11 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-c43eb608-e24b-4cd3-acba-2d17cbdb7dd3 tempest-VolumeTypesAccessTest-1340040134 None] Acquiring lock "cinder-22cc721c-3f1e-47c3-986b-288561accffe-delete_volume" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:26:11 devstack sudo[97937]: pam_unix(sudo:session): session closed for user root Sep 29 18:26:11 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-c43eb608-e24b-4cd3-acba-2d17cbdb7dd3 tempest-VolumeTypesAccessTest-1340040134 None] Lock "cinder-22cc721c-3f1e-47c3-986b-288561accffe-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:26:11 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a532c131-266d-42e6-837d-13d5fc246b45 tempest-VolumesListAdminTestJSON-423174112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-c867d1b2-63e8-4434-bd07-ee3328c9dd95 1073741824" returned: 0 in 0.891s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:26:11 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a532c131-266d-42e6-837d-13d5fc246b45 tempest-VolumesListAdminTestJSON-423174112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-c867d1b2-63e8-4434-bd07-ee3328c9dd95 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:26:11 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-c43eb608-e24b-4cd3-acba-2d17cbdb7dd3 tempest-VolumeTypesAccessTest-1340040134 None] Acquiring lock "cinder-quobyte-22cc721c-3f1e-47c3-986b-288561accffe" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:26:11 devstack sudo[97943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-c867d1b2-63e8-4434-bd07-ee3328c9dd95 Sep 29 18:26:11 devstack sudo[97943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:26:11 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-c43eb608-e24b-4cd3-acba-2d17cbdb7dd3 tempest-VolumeTypesAccessTest-1340040134 None] Lock "cinder-quobyte-22cc721c-3f1e-47c3-986b-288561accffe" acquired by "delete_volume" :: waited 0.043s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:26:11 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e7d56d1-f7bc-4341-bc5c-3192a4ce611f]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:26:11 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-c43eb608-e24b-4cd3-acba-2d17cbdb7dd3 tempest-VolumeTypesAccessTest-1340040134 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-22cc721c-3f1e-47c3-986b-288561accffe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:26:12 devstack sudo[97945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-22cc721c-3f1e-47c3-986b-288561accffe Sep 29 18:26:12 devstack sudo[97945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:26:12 devstack sudo[97943]: pam_unix(sudo:session): session closed for user root Sep 29 18:26:12 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a532c131-266d-42e6-837d-13d5fc246b45 tempest-VolumesListAdminTestJSON-423174112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-c867d1b2-63e8-4434-bd07-ee3328c9dd95" returned: 0 in 0.362s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:26:12 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-a532c131-266d-42e6-837d-13d5fc246b45 tempest-VolumesListAdminTestJSON-423174112 None] <== create_volume: return (1307ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'} {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:26:12 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-a532c131-266d-42e6-837d-13d5fc246b45 tempest-VolumesListAdminTestJSON-423174112 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.311s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:26:12 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-a532c131-266d-42e6-837d-13d5fc246b45 tempest-VolumesListAdminTestJSON-423174112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5e4f205-7748-4919-8c37-2fcb7c72eaaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c867d1b2-63e8-4434-bd07-ee3328c9dd95', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:26:12 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-a532c131-266d-42e6-837d-13d5fc246b45 tempest-VolumesListAdminTestJSON-423174112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34f5b1d3-dd76-46fd-887a-31f3c74ba7ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:26:12 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-a532c131-266d-42e6-837d-13d5fc246b45 tempest-VolumesListAdminTestJSON-423174112 None] Volume volume-c867d1b2-63e8-4434-bd07-ee3328c9dd95 (c867d1b2-63e8-4434-bd07-ee3328c9dd95): created successfully Sep 29 18:26:12 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-a532c131-266d-42e6-837d-13d5fc246b45 tempest-VolumesListAdminTestJSON-423174112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34f5b1d3-dd76-46fd-887a-31f3c74ba7ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:26:12 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-a532c131-266d-42e6-837d-13d5fc246b45 tempest-VolumesListAdminTestJSON-423174112 None] Flow 'volume_create_manager' (d2598645-e317-4999-8275-9648493e9b9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:26:12 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-a532c131-266d-42e6-837d-13d5fc246b45 tempest-VolumesListAdminTestJSON-423174112 None] Created volume successfully. Sep 29 18:26:12 devstack sudo[97945]: pam_unix(sudo:session): session closed for user root Sep 29 18:26:12 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-c43eb608-e24b-4cd3-acba-2d17cbdb7dd3 tempest-VolumeTypesAccessTest-1340040134 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-22cc721c-3f1e-47c3-986b-288561accffe" returned: 0 in 0.659s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:26:12 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-c43eb608-e24b-4cd3-acba-2d17cbdb7dd3 tempest-VolumeTypesAccessTest-1340040134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-22cc721c-3f1e-47c3-986b-288561accffe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:26:12 devstack sudo[97952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-22cc721c-3f1e-47c3-986b-288561accffe Sep 29 18:26:12 devstack sudo[97952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:26:13 devstack sudo[97952]: pam_unix(sudo:session): session closed for user root Sep 29 18:26:13 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-c43eb608-e24b-4cd3-acba-2d17cbdb7dd3 tempest-VolumeTypesAccessTest-1340040134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-22cc721c-3f1e-47c3-986b-288561accffe" returned: 0 in 0.490s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:26:13 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-c43eb608-e24b-4cd3-acba-2d17cbdb7dd3 tempest-VolumeTypesAccessTest-1340040134 None] Lock "cinder-quobyte-22cc721c-3f1e-47c3-986b-288561accffe" released by "delete_volume" :: held 1.231s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:26:13 devstack cinder-volume[86512]: WARNING cinder.quota [None req-c43eb608-e24b-4cd3-acba-2d17cbdb7dd3 tempest-VolumeTypesAccessTest-1340040134 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1690738999 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1690738999, it is now deprecated. Please use the default quota class for default quota. Sep 29 18:26:13 devstack cinder-volume[86512]: WARNING cinder.quota [None req-c43eb608-e24b-4cd3-acba-2d17cbdb7dd3 tempest-VolumeTypesAccessTest-1340040134 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1690738999 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1690738999, it is now deprecated. Please use the default quota class for default quota. Sep 29 18:26:13 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-c43eb608-e24b-4cd3-acba-2d17cbdb7dd3 tempest-VolumeTypesAccessTest-1340040134 None] Created reservations ['3a671949-d75f-4084-b83f-6ffc246232d8', '30f66224-2c80-4c59-8465-5b1d00de3123', '5f1458fd-e675-4272-95e8-4fe919e26d4b', '5ada9782-9b74-4e90-89ab-054f04273efa'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:26:13 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-c43eb608-e24b-4cd3-acba-2d17cbdb7dd3 tempest-VolumeTypesAccessTest-1340040134 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:26:13 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-c43eb608-e24b-4cd3-acba-2d17cbdb7dd3 tempest-VolumeTypesAccessTest-1340040134 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:26:13 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-c43eb608-e24b-4cd3-acba-2d17cbdb7dd3 tempest-VolumeTypesAccessTest-1340040134 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:26:13 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-c43eb608-e24b-4cd3-acba-2d17cbdb7dd3 tempest-VolumeTypesAccessTest-1340040134 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:26:13 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-c43eb608-e24b-4cd3-acba-2d17cbdb7dd3 tempest-VolumeTypesAccessTest-1340040134 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:26:13 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-c43eb608-e24b-4cd3-acba-2d17cbdb7dd3 tempest-VolumeTypesAccessTest-1340040134 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:26:13 devstack sudo[97955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:26:13 devstack sudo[97955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:26:13 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-257f0da8-229c-4f22-a1cf-7915e61fe133 tempest-VolumesListAdminTestJSON-158794254 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86512) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:26:13 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-257f0da8-229c-4f22-a1cf-7915e61fe133 tempest-VolumesListAdminTestJSON-158794254 None] Flow 'volume_create_manager' (26d38d51-d03c-40ba-baad-4cf91ac99eac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:26:13 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-257f0da8-229c-4f22-a1cf-7915e61fe133 tempest-VolumesListAdminTestJSON-158794254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e061c7a-5fde-4662-bbe2-5011f952ba6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:26:13 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-257f0da8-229c-4f22-a1cf-7915e61fe133 tempest-VolumesListAdminTestJSON-158794254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e061c7a-5fde-4662-bbe2-5011f952ba6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:26:13Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48e660e7-f1ec-4635-b912-0f4af8c7defa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d038ab3adb4436dabe18fe09d93dc3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:26:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:26:14Z,use_quota=True,user_id='ddfd95c25e654f3990c6d67060c64190',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:26:13 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-257f0da8-229c-4f22-a1cf-7915e61fe133 tempest-VolumesListAdminTestJSON-158794254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d7be1ac-582f-42e8-aa73-e5b5de2f4904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:26:13 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-257f0da8-229c-4f22-a1cf-7915e61fe133 tempest-VolumesListAdminTestJSON-158794254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d7be1ac-582f-42e8-aa73-e5b5de2f4904) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:26:13 devstack sudo[97955]: pam_unix(sudo:session): session closed for user root Sep 29 18:26:13 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-257f0da8-229c-4f22-a1cf-7915e61fe133 tempest-VolumesListAdminTestJSON-158794254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7acfb41a-01cd-4f96-b224-719d49ddb1fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:26:13 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-257f0da8-229c-4f22-a1cf-7915e61fe133 tempest-VolumesListAdminTestJSON-158794254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7acfb41a-01cd-4f96-b224-719d49ddb1fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48e660e7-f1ec-4635-b912-0f4af8c7defa', 'volume_name': 'volume-48e660e7-f1ec-4635-b912-0f4af8c7defa', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:26:13 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-257f0da8-229c-4f22-a1cf-7915e61fe133 tempest-VolumesListAdminTestJSON-158794254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b936554-fac4-41da-a96f-e07a543484ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:26:13 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-257f0da8-229c-4f22-a1cf-7915e61fe133 tempest-VolumesListAdminTestJSON-158794254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b936554-fac4-41da-a96f-e07a543484ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:26:13 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-257f0da8-229c-4f22-a1cf-7915e61fe133 tempest-VolumesListAdminTestJSON-158794254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7e62f3d-c870-4a71-a085-cfa8b7dbcf60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:26:13 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-257f0da8-229c-4f22-a1cf-7915e61fe133 tempest-VolumesListAdminTestJSON-158794254 None] Volume 48e660e7-f1ec-4635-b912-0f4af8c7defa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48e660e7-f1ec-4635-b912-0f4af8c7defa', 'volume_size': 1} Sep 29 18:26:13 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-257f0da8-229c-4f22-a1cf-7915e61fe133 tempest-VolumesListAdminTestJSON-158794254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:26:13 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-257f0da8-229c-4f22-a1cf-7915e61fe133 tempest-VolumesListAdminTestJSON-158794254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:26:13 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-257f0da8-229c-4f22-a1cf-7915e61fe133 tempest-VolumesListAdminTestJSON-158794254 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:26:13Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48e660e7-f1ec-4635-b912-0f4af8c7defa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d038ab3adb4436dabe18fe09d93dc3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:26:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:26:14Z,use_quota=True,user_id='ddfd95c25e654f3990c6d67060c64190',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)}" {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:26:13 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-257f0da8-229c-4f22-a1cf-7915e61fe133 tempest-VolumesListAdminTestJSON-158794254 None] Creating volume 48e660e7-f1ec-4635-b912-0f4af8c7defa {{(pid=86512) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:26:13 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-257f0da8-229c-4f22-a1cf-7915e61fe133 tempest-VolumesListAdminTestJSON-158794254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:26:13 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-257f0da8-229c-4f22-a1cf-7915e61fe133 tempest-VolumesListAdminTestJSON-158794254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:26:13 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-257f0da8-229c-4f22-a1cf-7915e61fe133 tempest-VolumesListAdminTestJSON-158794254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:26:13 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-257f0da8-229c-4f22-a1cf-7915e61fe133 tempest-VolumesListAdminTestJSON-158794254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:26:13 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-257f0da8-229c-4f22-a1cf-7915e61fe133 tempest-VolumesListAdminTestJSON-158794254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:26:13 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-257f0da8-229c-4f22-a1cf-7915e61fe133 tempest-VolumesListAdminTestJSON-158794254 None] Selected osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 as target Quobyte volume. {{(pid=86512) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:26:13 devstack cinder-volume[86512]: INFO cinder.volume.drivers.remotefs [None req-257f0da8-229c-4f22-a1cf-7915e61fe133 tempest-VolumesListAdminTestJSON-158794254 None] casted to osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 Sep 29 18:26:13 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-257f0da8-229c-4f22-a1cf-7915e61fe133 tempest-VolumesListAdminTestJSON-158794254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-48e660e7-f1ec-4635-b912-0f4af8c7defa 1073741824 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:26:13 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-c43eb608-e24b-4cd3-acba-2d17cbdb7dd3 tempest-VolumeTypesAccessTest-1340040134 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.378s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:26:13 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-c43eb608-e24b-4cd3-acba-2d17cbdb7dd3 tempest-VolumeTypesAccessTest-1340040134 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:26:13 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-c43eb608-e24b-4cd3-acba-2d17cbdb7dd3 tempest-VolumeTypesAccessTest-1340040134 None] Deleted volume successfully. Sep 29 18:26:13 devstack sudo[97959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-48e660e7-f1ec-4635-b912-0f4af8c7defa 1073741824 Sep 29 18:26:13 devstack sudo[97959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:26:13 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-c43eb608-e24b-4cd3-acba-2d17cbdb7dd3 tempest-VolumeTypesAccessTest-1340040134 None] Lock "cinder-22cc721c-3f1e-47c3-986b-288561accffe-delete_volume" released by "delete_volume" :: held 2.007s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:26:14 devstack sudo[97959]: pam_unix(sudo:session): session closed for user root Sep 29 18:26:14 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-257f0da8-229c-4f22-a1cf-7915e61fe133 tempest-VolumesListAdminTestJSON-158794254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-48e660e7-f1ec-4635-b912-0f4af8c7defa 1073741824" returned: 0 in 0.505s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:26:14 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-257f0da8-229c-4f22-a1cf-7915e61fe133 tempest-VolumesListAdminTestJSON-158794254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-48e660e7-f1ec-4635-b912-0f4af8c7defa {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:26:14 devstack sudo[97965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-48e660e7-f1ec-4635-b912-0f4af8c7defa Sep 29 18:26:14 devstack sudo[97965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:26:14 devstack sudo[97965]: pam_unix(sudo:session): session closed for user root Sep 29 18:26:14 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-257f0da8-229c-4f22-a1cf-7915e61fe133 tempest-VolumesListAdminTestJSON-158794254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-48e660e7-f1ec-4635-b912-0f4af8c7defa" returned: 0 in 0.410s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:26:14 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-257f0da8-229c-4f22-a1cf-7915e61fe133 tempest-VolumesListAdminTestJSON-158794254 None] <== create_volume: return (979ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'} {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:26:14 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-257f0da8-229c-4f22-a1cf-7915e61fe133 tempest-VolumesListAdminTestJSON-158794254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.983s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:26:14 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-257f0da8-229c-4f22-a1cf-7915e61fe133 tempest-VolumesListAdminTestJSON-158794254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7e62f3d-c870-4a71-a085-cfa8b7dbcf60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48e660e7-f1ec-4635-b912-0f4af8c7defa', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:26:14 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-257f0da8-229c-4f22-a1cf-7915e61fe133 tempest-VolumesListAdminTestJSON-158794254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccc19974-5ace-42a9-a162-6cda43bc32a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:26:14 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-257f0da8-229c-4f22-a1cf-7915e61fe133 tempest-VolumesListAdminTestJSON-158794254 None] Volume volume-48e660e7-f1ec-4635-b912-0f4af8c7defa (48e660e7-f1ec-4635-b912-0f4af8c7defa): created successfully Sep 29 18:26:14 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-257f0da8-229c-4f22-a1cf-7915e61fe133 tempest-VolumesListAdminTestJSON-158794254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccc19974-5ace-42a9-a162-6cda43bc32a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:26:14 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-257f0da8-229c-4f22-a1cf-7915e61fe133 tempest-VolumesListAdminTestJSON-158794254 None] Flow 'volume_create_manager' (26d38d51-d03c-40ba-baad-4cf91ac99eac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:26:14 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-257f0da8-229c-4f22-a1cf-7915e61fe133 tempest-VolumesListAdminTestJSON-158794254 None] Created volume successfully. Sep 29 18:26:15 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-e88723c7-998c-4b22-a353-be621f4b4d49 tempest-VolumesListAdminTestJSON-158794254 None] Acquiring lock "cinder-48e660e7-f1ec-4635-b912-0f4af8c7defa-delete_volume" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:26:15 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-e88723c7-998c-4b22-a353-be621f4b4d49 tempest-VolumesListAdminTestJSON-158794254 None] Lock "cinder-48e660e7-f1ec-4635-b912-0f4af8c7defa-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:26:15 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-e88723c7-998c-4b22-a353-be621f4b4d49 tempest-VolumesListAdminTestJSON-158794254 None] Acquiring lock "cinder-quobyte-48e660e7-f1ec-4635-b912-0f4af8c7defa" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:26:15 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-e88723c7-998c-4b22-a353-be621f4b4d49 tempest-VolumesListAdminTestJSON-158794254 None] Lock "cinder-quobyte-48e660e7-f1ec-4635-b912-0f4af8c7defa" acquired by "delete_volume" :: waited 0.020s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:26:16 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1ccdebe-de57-4007-8a9d-0c52146e2cf7]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:26:16 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-e88723c7-998c-4b22-a353-be621f4b4d49 tempest-VolumesListAdminTestJSON-158794254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-48e660e7-f1ec-4635-b912-0f4af8c7defa {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:26:16 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-ab888182-de4f-4168-85ee-a7ff9d483b6c tempest-VolumesListAdminTestJSON-423174112 None] Acquiring lock "cinder-c867d1b2-63e8-4434-bd07-ee3328c9dd95-delete_volume" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:26:16 devstack sudo[97968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-48e660e7-f1ec-4635-b912-0f4af8c7defa Sep 29 18:26:16 devstack sudo[97968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:26:16 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-ab888182-de4f-4168-85ee-a7ff9d483b6c tempest-VolumesListAdminTestJSON-423174112 None] Lock "cinder-c867d1b2-63e8-4434-bd07-ee3328c9dd95-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:26:16 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-ab888182-de4f-4168-85ee-a7ff9d483b6c tempest-VolumesListAdminTestJSON-423174112 None] Acquiring lock "cinder-quobyte-c867d1b2-63e8-4434-bd07-ee3328c9dd95" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:26:16 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-ab888182-de4f-4168-85ee-a7ff9d483b6c tempest-VolumesListAdminTestJSON-423174112 None] Lock "cinder-quobyte-c867d1b2-63e8-4434-bd07-ee3328c9dd95" acquired by "delete_volume" :: waited 0.041s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:26:16 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[b10c2e5d-4874-4a00-8bb7-3f960aa197df]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:26:16 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-ab888182-de4f-4168-85ee-a7ff9d483b6c tempest-VolumesListAdminTestJSON-423174112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-c867d1b2-63e8-4434-bd07-ee3328c9dd95 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:26:16 devstack sudo[97968]: pam_unix(sudo:session): session closed for user root Sep 29 18:26:16 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-e88723c7-998c-4b22-a353-be621f4b4d49 tempest-VolumesListAdminTestJSON-158794254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-48e660e7-f1ec-4635-b912-0f4af8c7defa" returned: 0 in 0.476s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:26:16 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-e88723c7-998c-4b22-a353-be621f4b4d49 tempest-VolumesListAdminTestJSON-158794254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-48e660e7-f1ec-4635-b912-0f4af8c7defa {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:26:16 devstack sudo[97970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-c867d1b2-63e8-4434-bd07-ee3328c9dd95 Sep 29 18:26:16 devstack sudo[97970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:26:16 devstack sudo[97975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-48e660e7-f1ec-4635-b912-0f4af8c7defa Sep 29 18:26:16 devstack sudo[97975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:26:16 devstack sudo[97970]: pam_unix(sudo:session): session closed for user root Sep 29 18:26:16 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-ab888182-de4f-4168-85ee-a7ff9d483b6c tempest-VolumesListAdminTestJSON-423174112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-c867d1b2-63e8-4434-bd07-ee3328c9dd95" returned: 0 in 0.564s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:26:16 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-ab888182-de4f-4168-85ee-a7ff9d483b6c tempest-VolumesListAdminTestJSON-423174112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-c867d1b2-63e8-4434-bd07-ee3328c9dd95 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:26:16 devstack sudo[97975]: pam_unix(sudo:session): session closed for user root Sep 29 18:26:16 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-e88723c7-998c-4b22-a353-be621f4b4d49 tempest-VolumesListAdminTestJSON-158794254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-48e660e7-f1ec-4635-b912-0f4af8c7defa" returned: 0 in 0.456s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:26:16 devstack sudo[97982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-c867d1b2-63e8-4434-bd07-ee3328c9dd95 Sep 29 18:26:16 devstack sudo[97982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:26:16 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-e88723c7-998c-4b22-a353-be621f4b4d49 tempest-VolumesListAdminTestJSON-158794254 None] Lock "cinder-quobyte-48e660e7-f1ec-4635-b912-0f4af8c7defa" released by "delete_volume" :: held 1.025s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:26:17 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-e88723c7-998c-4b22-a353-be621f4b4d49 tempest-VolumesListAdminTestJSON-158794254 None] Created reservations ['4c082e5c-ec73-4f88-8010-83cbe5021f38', 'ecacd16c-38f6-43f7-9596-627c0d41c2b8', 'ded86a09-a9ff-4703-829f-fe37ab895187', 'c2967150-e7c8-4a77-add3-6978d0b56184'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:26:17 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-e88723c7-998c-4b22-a353-be621f4b4d49 tempest-VolumesListAdminTestJSON-158794254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:26:17 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-e88723c7-998c-4b22-a353-be621f4b4d49 tempest-VolumesListAdminTestJSON-158794254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:26:17 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-e88723c7-998c-4b22-a353-be621f4b4d49 tempest-VolumesListAdminTestJSON-158794254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:26:17 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-e88723c7-998c-4b22-a353-be621f4b4d49 tempest-VolumesListAdminTestJSON-158794254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:26:17 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-e88723c7-998c-4b22-a353-be621f4b4d49 tempest-VolumesListAdminTestJSON-158794254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:26:17 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-e88723c7-998c-4b22-a353-be621f4b4d49 tempest-VolumesListAdminTestJSON-158794254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:26:17 devstack sudo[97984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:26:17 devstack sudo[97984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:26:17 devstack sudo[97982]: pam_unix(sudo:session): session closed for user root Sep 29 18:26:17 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-ab888182-de4f-4168-85ee-a7ff9d483b6c tempest-VolumesListAdminTestJSON-423174112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-c867d1b2-63e8-4434-bd07-ee3328c9dd95" returned: 0 in 0.451s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:26:17 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-ab888182-de4f-4168-85ee-a7ff9d483b6c tempest-VolumesListAdminTestJSON-423174112 None] Lock "cinder-quobyte-c867d1b2-63e8-4434-bd07-ee3328c9dd95" released by "delete_volume" :: held 1.082s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:26:17 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-ab888182-de4f-4168-85ee-a7ff9d483b6c tempest-VolumesListAdminTestJSON-423174112 None] Created reservations ['350eb00b-21f6-4aa1-b2d2-a416666a77c7', '05bc9974-da07-4513-80e9-0f7b947a432b', 'ac3e15fe-6213-4439-8ca0-cbd63677e403', 'f2a0c0b7-fafb-4fc9-bb59-3f795ff1359e'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:26:17 devstack sudo[97984]: pam_unix(sudo:session): session closed for user root Sep 29 18:26:17 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-e88723c7-998c-4b22-a353-be621f4b4d49 tempest-VolumesListAdminTestJSON-158794254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.470s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:26:17 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-e88723c7-998c-4b22-a353-be621f4b4d49 tempest-VolumesListAdminTestJSON-158794254 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:26:17 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-ab888182-de4f-4168-85ee-a7ff9d483b6c tempest-VolumesListAdminTestJSON-423174112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:26:17 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-ab888182-de4f-4168-85ee-a7ff9d483b6c tempest-VolumesListAdminTestJSON-423174112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:26:17 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-ab888182-de4f-4168-85ee-a7ff9d483b6c tempest-VolumesListAdminTestJSON-423174112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:26:17 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-ab888182-de4f-4168-85ee-a7ff9d483b6c tempest-VolumesListAdminTestJSON-423174112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:26:17 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-ab888182-de4f-4168-85ee-a7ff9d483b6c tempest-VolumesListAdminTestJSON-423174112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:26:17 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-ab888182-de4f-4168-85ee-a7ff9d483b6c tempest-VolumesListAdminTestJSON-423174112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:26:17 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-e88723c7-998c-4b22-a353-be621f4b4d49 tempest-VolumesListAdminTestJSON-158794254 None] Deleted volume successfully. Sep 29 18:26:17 devstack sudo[97988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:26:17 devstack sudo[97988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:26:17 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-e88723c7-998c-4b22-a353-be621f4b4d49 tempest-VolumesListAdminTestJSON-158794254 None] Lock "cinder-48e660e7-f1ec-4635-b912-0f4af8c7defa-delete_volume" released by "delete_volume" :: held 1.933s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:26:17 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-71acde2b-eb51-4110-b978-a63c9db3e24a tempest-VolumeAndVolumeTypeFromImageTest-780182631 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86512) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:26:17 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-71acde2b-eb51-4110-b978-a63c9db3e24a tempest-VolumeAndVolumeTypeFromImageTest-780182631 None] Flow 'volume_create_manager' (25079b38-1786-44c7-ab4f-459a8f6b45d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:26:17 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-71acde2b-eb51-4110-b978-a63c9db3e24a tempest-VolumeAndVolumeTypeFromImageTest-780182631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e5937bc-f1f4-4a98-ab97-875a18cd5d5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:26:18 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-71acde2b-eb51-4110-b978-a63c9db3e24a tempest-VolumeAndVolumeTypeFromImageTest-780182631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e5937bc-f1f4-4a98-ab97-875a18cd5d5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:26:17Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4507adfe-4487-4706-aa4b-2672a1185944,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a78afffa580440ab07f34c1c888927c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:26:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:26:18Z,use_quota=True,user_id='e8075ab31af54946beb7a65dbf507c95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a2478ce7-1819-4f81-afa7-2e7769cc4d2e),volume_type_id=a2478ce7-1819-4f81-afa7-2e7769cc4d2e)' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:26:18 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-71acde2b-eb51-4110-b978-a63c9db3e24a tempest-VolumeAndVolumeTypeFromImageTest-780182631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd364484-0166-4879-9f12-1db47d23c3f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:26:18 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-71acde2b-eb51-4110-b978-a63c9db3e24a tempest-VolumeAndVolumeTypeFromImageTest-780182631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd364484-0166-4879-9f12-1db47d23c3f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:26:18 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-71acde2b-eb51-4110-b978-a63c9db3e24a tempest-VolumeAndVolumeTypeFromImageTest-780182631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (409b6aa2-b9b5-41c0-a1a7-debb7a21c408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:26:18 devstack cinder-volume[86512]: DEBUG cinder.image.glance [None req-71acde2b-eb51-4110-b978-a63c9db3e24a tempest-VolumeAndVolumeTypeFromImageTest-780182631 None] Creating Keystone auth plugin from conf {{(pid=86512) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 29 18:26:18 devstack sudo[97988]: pam_unix(sudo:session): session closed for user root Sep 29 18:26:18 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-ab888182-de4f-4168-85ee-a7ff9d483b6c tempest-VolumesListAdminTestJSON-423174112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.450s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:26:18 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-ab888182-de4f-4168-85ee-a7ff9d483b6c tempest-VolumesListAdminTestJSON-423174112 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:26:18 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-ab888182-de4f-4168-85ee-a7ff9d483b6c tempest-VolumesListAdminTestJSON-423174112 None] Deleted volume successfully. Sep 29 18:26:18 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-ab888182-de4f-4168-85ee-a7ff9d483b6c tempest-VolumesListAdminTestJSON-423174112 None] Lock "cinder-c867d1b2-63e8-4434-bd07-ee3328c9dd95-delete_volume" released by "delete_volume" :: held 2.047s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:26:18 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-71acde2b-eb51-4110-b978-a63c9db3e24a tempest-VolumeAndVolumeTypeFromImageTest-780182631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (409b6aa2-b9b5-41c0-a1a7-debb7a21c408) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4507adfe-4487-4706-aa4b-2672a1185944', 'volume_name': 'volume-4507adfe-4487-4706-aa4b-2672a1185944', 'volume_size': 1, 'image_id': '2ab6f2fa-4ab3-463f-8dea-d88913f37a52', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2ab6f2fa-4ab3-463f-8dea-d88913f37a52', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'da066f17f59582d762fbaec008d5d93c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '5a78afffa580440ab07f34c1c888927c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c87873f416b512f965d7adde28512995436548be047f6beed6657ef59976430f5e677ea16509dcd2b550af6dc42b14f59103625aa1f410d723f26662cabd3cbb', 'id': '2ab6f2fa-4ab3-463f-8dea-d88913f37a52', 'created_at': datetime.datetime(2026, 9, 29, 16, 26, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 16, 26, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2ab6f2fa-4ab3-463f-8dea-d88913f37a52/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:26:18 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-71acde2b-eb51-4110-b978-a63c9db3e24a tempest-VolumeAndVolumeTypeFromImageTest-780182631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eab9255e-b806-40d8-843d-919246f21f6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:26:18 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-71acde2b-eb51-4110-b978-a63c9db3e24a tempest-VolumeAndVolumeTypeFromImageTest-780182631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eab9255e-b806-40d8-843d-919246f21f6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:26:18 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-71acde2b-eb51-4110-b978-a63c9db3e24a tempest-VolumeAndVolumeTypeFromImageTest-780182631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9622b09-9dc0-4a60-98c2-4ca3a3d51fc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:26:18 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-71acde2b-eb51-4110-b978-a63c9db3e24a tempest-VolumeAndVolumeTypeFromImageTest-780182631 None] Volume 4507adfe-4487-4706-aa4b-2672a1185944: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4507adfe-4487-4706-aa4b-2672a1185944', 'volume_size': 1, 'image_id': '2ab6f2fa-4ab3-463f-8dea-d88913f37a52', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2ab6f2fa-4ab3-463f-8dea-d88913f37a52', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'da066f17f59582d762fbaec008d5d93c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '5a78afffa580440ab07f34c1c888927c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c87873f416b512f965d7adde28512995436548be047f6beed6657ef59976430f5e677ea16509dcd2b550af6dc42b14f59103625aa1f410d723f26662cabd3cbb', 'id': '2ab6f2fa-4ab3-463f-8dea-d88913f37a52', 'created_at': datetime.datetime(2026, 9, 29, 16, 26, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 16, 26, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2ab6f2fa-4ab3-463f-8dea-d88913f37a52/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 29 18:26:18 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-71acde2b-eb51-4110-b978-a63c9db3e24a tempest-VolumeAndVolumeTypeFromImageTest-780182631 None] Trying to clone 4507adfe-4487-4706-aa4b-2672a1185944 from image 2ab6f2fa-4ab3-463f-8dea-d88913f37a52 at location (None, [{'url': 'file:///opt/stack/data/glance/images/2ab6f2fa-4ab3-463f-8dea-d88913f37a52', 'metadata': {}}]). {{(pid=86512) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 29 18:26:18 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-89916501-f10a-4077-a95b-b6dd87d0fd41 tempest-VolumesListAdminTestJSON-423174112 None] Acquiring lock "cinder-0c041f28-5e56-499b-9ba2-fe0a83dca458-delete_volume" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:26:18 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-89916501-f10a-4077-a95b-b6dd87d0fd41 tempest-VolumesListAdminTestJSON-423174112 None] Lock "cinder-0c041f28-5e56-499b-9ba2-fe0a83dca458-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:26:18 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-89916501-f10a-4077-a95b-b6dd87d0fd41 tempest-VolumesListAdminTestJSON-423174112 None] Acquiring lock "cinder-quobyte-0c041f28-5e56-499b-9ba2-fe0a83dca458" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:26:18 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-89916501-f10a-4077-a95b-b6dd87d0fd41 tempest-VolumesListAdminTestJSON-423174112 None] Lock "cinder-quobyte-0c041f28-5e56-499b-9ba2-fe0a83dca458" acquired by "delete_volume" :: waited 0.017s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:26:18 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a8c2b2d-153d-4665-9455-104bd786ac5c]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:26:18 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-89916501-f10a-4077-a95b-b6dd87d0fd41 tempest-VolumesListAdminTestJSON-423174112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0c041f28-5e56-499b-9ba2-fe0a83dca458 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:26:18 devstack cinder-volume[86512]: DEBUG cinder.image.image_utils [None req-71acde2b-eb51-4110-b978-a63c9db3e24a tempest-VolumeAndVolumeTypeFromImageTest-780182631 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2ab6f2fa-4ab3-463f-8dea-d88913f37a52_u37nam6adevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86512) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 29 18:26:18 devstack cinder-volume[86512]: INFO cinder.image.image_utils [None req-71acde2b-eb51-4110-b978-a63c9db3e24a tempest-VolumeAndVolumeTypeFromImageTest-780182631 None] Image download 0.00 MB at 0.00 MB/s Sep 29 18:26:18 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[40b11693-55e2-47ca-b2eb-57b33720135c]: (4, 'raw') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:26:18 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-71acde2b-eb51-4110-b978-a63c9db3e24a tempest-VolumeAndVolumeTypeFromImageTest-780182631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2ab6f2fa-4ab3-463f-8dea-d88913f37a52_u37nam6adevstack@QuobyteHD {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:26:18 devstack sudo[97991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0c041f28-5e56-499b-9ba2-fe0a83dca458 Sep 29 18:26:18 devstack sudo[97991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:26:19 devstack sudo[97992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2ab6f2fa-4ab3-463f-8dea-d88913f37a52_u37nam6adevstack@QuobyteHD Sep 29 18:26:19 devstack sudo[97992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:26:19 devstack sudo[97991]: pam_unix(sudo:session): session closed for user root Sep 29 18:26:19 devstack sudo[97992]: pam_unix(sudo:session): session closed for user root Sep 29 18:26:19 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-89916501-f10a-4077-a95b-b6dd87d0fd41 tempest-VolumesListAdminTestJSON-423174112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0c041f28-5e56-499b-9ba2-fe0a83dca458" returned: 0 in 0.497s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:26:19 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-89916501-f10a-4077-a95b-b6dd87d0fd41 tempest-VolumesListAdminTestJSON-423174112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0c041f28-5e56-499b-9ba2-fe0a83dca458 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:26:19 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-71acde2b-eb51-4110-b978-a63c9db3e24a tempest-VolumeAndVolumeTypeFromImageTest-780182631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2ab6f2fa-4ab3-463f-8dea-d88913f37a52_u37nam6adevstack@QuobyteHD" returned: 0 in 0.391s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:26:19 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-71acde2b-eb51-4110-b978-a63c9db3e24a tempest-VolumeAndVolumeTypeFromImageTest-780182631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2ab6f2fa-4ab3-463f-8dea-d88913f37a52_u37nam6adevstack@QuobyteHD {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:26:19 devstack sudo[98000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0c041f28-5e56-499b-9ba2-fe0a83dca458 Sep 29 18:26:19 devstack sudo[98000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:26:19 devstack sudo[98001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2ab6f2fa-4ab3-463f-8dea-d88913f37a52_u37nam6adevstack@QuobyteHD Sep 29 18:26:19 devstack sudo[98001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:26:19 devstack sudo[98000]: pam_unix(sudo:session): session closed for user root Sep 29 18:26:19 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-89916501-f10a-4077-a95b-b6dd87d0fd41 tempest-VolumesListAdminTestJSON-423174112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0c041f28-5e56-499b-9ba2-fe0a83dca458" returned: 0 in 0.345s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:26:19 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-89916501-f10a-4077-a95b-b6dd87d0fd41 tempest-VolumesListAdminTestJSON-423174112 None] Lock "cinder-quobyte-0c041f28-5e56-499b-9ba2-fe0a83dca458" released by "delete_volume" :: held 0.915s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:26:19 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-89916501-f10a-4077-a95b-b6dd87d0fd41 tempest-VolumesListAdminTestJSON-423174112 None] Created reservations ['ddbbd402-1b15-4c48-a166-bfb3dc21146c', 'e3591ecd-1d46-48ed-93e7-4f95e87a242e', 'b35ff6b1-a67b-43fa-aa9b-43a75872f92e', '9d00f5b4-b5be-48cc-b02c-22755a68ff61'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:26:19 devstack sudo[98001]: pam_unix(sudo:session): session closed for user root Sep 29 18:26:19 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-71acde2b-eb51-4110-b978-a63c9db3e24a tempest-VolumeAndVolumeTypeFromImageTest-780182631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2ab6f2fa-4ab3-463f-8dea-d88913f37a52_u37nam6adevstack@QuobyteHD" returned: 1 in 0.532s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:26:19 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-71acde2b-eb51-4110-b978-a63c9db3e24a tempest-VolumeAndVolumeTypeFromImageTest-780182631 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2ab6f2fa-4ab3-463f-8dea-d88913f37a52_u37nam6adevstack@QuobyteHD' failed. Not Retrying. {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 29 18:26:19 devstack cinder-volume[86512]: DEBUG cinder.image.image_utils [None req-71acde2b-eb51-4110-b978-a63c9db3e24a tempest-VolumeAndVolumeTypeFromImageTest-780182631 None] Temporary image 2ab6f2fa-4ab3-463f-8dea-d88913f37a52 is fetched for user e8075ab31af54946beb7a65dbf507c95. {{(pid=86512) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 29 18:26:19 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-89916501-f10a-4077-a95b-b6dd87d0fd41 tempest-VolumesListAdminTestJSON-423174112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:26:19 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-89916501-f10a-4077-a95b-b6dd87d0fd41 tempest-VolumesListAdminTestJSON-423174112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:26:19 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-89916501-f10a-4077-a95b-b6dd87d0fd41 tempest-VolumesListAdminTestJSON-423174112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:26:19 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-89916501-f10a-4077-a95b-b6dd87d0fd41 tempest-VolumesListAdminTestJSON-423174112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:26:19 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-89916501-f10a-4077-a95b-b6dd87d0fd41 tempest-VolumesListAdminTestJSON-423174112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:26:19 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-89916501-f10a-4077-a95b-b6dd87d0fd41 tempest-VolumesListAdminTestJSON-423174112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:26:19 devstack sudo[98008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:26:19 devstack sudo[98008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:26:19 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfd2a32a-b373-45b7-8cdf-b414590df8a0]: (4, 'raw') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:26:19 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-71acde2b-eb51-4110-b978-a63c9db3e24a tempest-VolumeAndVolumeTypeFromImageTest-780182631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2ab6f2fa-4ab3-463f-8dea-d88913f37a52_u37nam6adevstack@QuobyteHD {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:26:20 devstack sudo[98010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2ab6f2fa-4ab3-463f-8dea-d88913f37a52_u37nam6adevstack@QuobyteHD Sep 29 18:26:20 devstack sudo[98010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:26:20 devstack sudo[98008]: pam_unix(sudo:session): session closed for user root Sep 29 18:26:20 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-89916501-f10a-4077-a95b-b6dd87d0fd41 tempest-VolumesListAdminTestJSON-423174112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.434s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:26:20 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-89916501-f10a-4077-a95b-b6dd87d0fd41 tempest-VolumesListAdminTestJSON-423174112 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:26:20 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-89916501-f10a-4077-a95b-b6dd87d0fd41 tempest-VolumesListAdminTestJSON-423174112 None] Deleted volume successfully. Sep 29 18:26:20 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-89916501-f10a-4077-a95b-b6dd87d0fd41 tempest-VolumesListAdminTestJSON-423174112 None] Lock "cinder-0c041f28-5e56-499b-9ba2-fe0a83dca458-delete_volume" released by "delete_volume" :: held 1.714s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:26:20 devstack sudo[98010]: pam_unix(sudo:session): session closed for user root Sep 29 18:26:20 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-71acde2b-eb51-4110-b978-a63c9db3e24a tempest-VolumeAndVolumeTypeFromImageTest-780182631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2ab6f2fa-4ab3-463f-8dea-d88913f37a52_u37nam6adevstack@QuobyteHD" returned: 0 in 0.470s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:26:20 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-71acde2b-eb51-4110-b978-a63c9db3e24a tempest-VolumeAndVolumeTypeFromImageTest-780182631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2ab6f2fa-4ab3-463f-8dea-d88913f37a52_u37nam6adevstack@QuobyteHD {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:26:20 devstack sudo[98015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2ab6f2fa-4ab3-463f-8dea-d88913f37a52_u37nam6adevstack@QuobyteHD Sep 29 18:26:20 devstack sudo[98015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:26:20 devstack sudo[98015]: pam_unix(sudo:session): session closed for user root Sep 29 18:26:20 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-71acde2b-eb51-4110-b978-a63c9db3e24a tempest-VolumeAndVolumeTypeFromImageTest-780182631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2ab6f2fa-4ab3-463f-8dea-d88913f37a52_u37nam6adevstack@QuobyteHD" returned: 1 in 0.369s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:26:20 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-71acde2b-eb51-4110-b978-a63c9db3e24a tempest-VolumeAndVolumeTypeFromImageTest-780182631 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2ab6f2fa-4ab3-463f-8dea-d88913f37a52_u37nam6adevstack@QuobyteHD' failed. Not Retrying. {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 29 18:26:20 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-71acde2b-eb51-4110-b978-a63c9db3e24a tempest-VolumeAndVolumeTypeFromImageTest-780182631 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:26:20 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-71acde2b-eb51-4110-b978-a63c9db3e24a tempest-VolumeAndVolumeTypeFromImageTest-780182631 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:26:20 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-71acde2b-eb51-4110-b978-a63c9db3e24a tempest-VolumeAndVolumeTypeFromImageTest-780182631 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:26:17Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4507adfe-4487-4706-aa4b-2672a1185944,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a78afffa580440ab07f34c1c888927c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:26:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:26:18Z,use_quota=True,user_id='e8075ab31af54946beb7a65dbf507c95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a2478ce7-1819-4f81-afa7-2e7769cc4d2e),volume_type_id=a2478ce7-1819-4f81-afa7-2e7769cc4d2e)}" {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:26:20 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-71acde2b-eb51-4110-b978-a63c9db3e24a tempest-VolumeAndVolumeTypeFromImageTest-780182631 None] Creating volume 4507adfe-4487-4706-aa4b-2672a1185944 {{(pid=86512) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:26:20 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-71acde2b-eb51-4110-b978-a63c9db3e24a tempest-VolumeAndVolumeTypeFromImageTest-780182631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:26:20 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-71acde2b-eb51-4110-b978-a63c9db3e24a tempest-VolumeAndVolumeTypeFromImageTest-780182631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:26:20 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-71acde2b-eb51-4110-b978-a63c9db3e24a tempest-VolumeAndVolumeTypeFromImageTest-780182631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:26:20 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-71acde2b-eb51-4110-b978-a63c9db3e24a tempest-VolumeAndVolumeTypeFromImageTest-780182631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:26:20 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-71acde2b-eb51-4110-b978-a63c9db3e24a tempest-VolumeAndVolumeTypeFromImageTest-780182631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:26:20 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-71acde2b-eb51-4110-b978-a63c9db3e24a tempest-VolumeAndVolumeTypeFromImageTest-780182631 None] Selected osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 as target Quobyte volume. {{(pid=86512) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:26:20 devstack cinder-volume[86512]: INFO cinder.volume.drivers.remotefs [None req-71acde2b-eb51-4110-b978-a63c9db3e24a tempest-VolumeAndVolumeTypeFromImageTest-780182631 None] casted to osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 Sep 29 18:26:20 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-71acde2b-eb51-4110-b978-a63c9db3e24a tempest-VolumeAndVolumeTypeFromImageTest-780182631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-4507adfe-4487-4706-aa4b-2672a1185944 1073741824 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:26:20 devstack sudo[98021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-4507adfe-4487-4706-aa4b-2672a1185944 1073741824 Sep 29 18:26:20 devstack sudo[98021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:26:21 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-136aaaee-3106-477a-aca2-c96bb419f680 tempest-VolumesListAdminTestJSON-423174112 None] Acquiring lock "cinder-ad1cb64d-b9e8-4076-927c-5aff4cb74003-delete_volume" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:26:21 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-136aaaee-3106-477a-aca2-c96bb419f680 tempest-VolumesListAdminTestJSON-423174112 None] Lock "cinder-ad1cb64d-b9e8-4076-927c-5aff4cb74003-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:26:21 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-136aaaee-3106-477a-aca2-c96bb419f680 tempest-VolumesListAdminTestJSON-423174112 None] Acquiring lock "cinder-quobyte-ad1cb64d-b9e8-4076-927c-5aff4cb74003" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:26:21 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-136aaaee-3106-477a-aca2-c96bb419f680 tempest-VolumesListAdminTestJSON-423174112 None] Lock "cinder-quobyte-ad1cb64d-b9e8-4076-927c-5aff4cb74003" acquired by "delete_volume" :: waited 0.037s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:26:21 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3ce1765-99a5-4d2b-8b3b-2f2d394782d9]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:26:21 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-136aaaee-3106-477a-aca2-c96bb419f680 tempest-VolumesListAdminTestJSON-423174112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ad1cb64d-b9e8-4076-927c-5aff4cb74003 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:26:21 devstack sudo[98027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ad1cb64d-b9e8-4076-927c-5aff4cb74003 Sep 29 18:26:21 devstack sudo[98027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:26:21 devstack sudo[98021]: pam_unix(sudo:session): session closed for user root Sep 29 18:26:21 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-71acde2b-eb51-4110-b978-a63c9db3e24a tempest-VolumeAndVolumeTypeFromImageTest-780182631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-4507adfe-4487-4706-aa4b-2672a1185944 1073741824" returned: 0 in 0.663s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:26:21 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-71acde2b-eb51-4110-b978-a63c9db3e24a tempest-VolumeAndVolumeTypeFromImageTest-780182631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-4507adfe-4487-4706-aa4b-2672a1185944 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:26:21 devstack sudo[98030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-4507adfe-4487-4706-aa4b-2672a1185944 Sep 29 18:26:21 devstack sudo[98030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:26:21 devstack sudo[98027]: pam_unix(sudo:session): session closed for user root Sep 29 18:26:21 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-136aaaee-3106-477a-aca2-c96bb419f680 tempest-VolumesListAdminTestJSON-423174112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ad1cb64d-b9e8-4076-927c-5aff4cb74003" returned: 0 in 0.479s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:26:21 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-136aaaee-3106-477a-aca2-c96bb419f680 tempest-VolumesListAdminTestJSON-423174112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ad1cb64d-b9e8-4076-927c-5aff4cb74003 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:26:21 devstack sudo[98035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ad1cb64d-b9e8-4076-927c-5aff4cb74003 Sep 29 18:26:21 devstack sudo[98035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:26:21 devstack sudo[98030]: pam_unix(sudo:session): session closed for user root Sep 29 18:26:21 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-71acde2b-eb51-4110-b978-a63c9db3e24a tempest-VolumeAndVolumeTypeFromImageTest-780182631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-4507adfe-4487-4706-aa4b-2672a1185944" returned: 0 in 0.320s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:26:21 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-71acde2b-eb51-4110-b978-a63c9db3e24a tempest-VolumeAndVolumeTypeFromImageTest-780182631 None] <== create_volume: return (1034ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'} {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:26:21 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-71acde2b-eb51-4110-b978-a63c9db3e24a tempest-VolumeAndVolumeTypeFromImageTest-780182631 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.038s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:26:21 devstack cinder-volume[86512]: DEBUG cinder.volume.volume_utils [None req-71acde2b-eb51-4110-b978-a63c9db3e24a tempest-VolumeAndVolumeTypeFromImageTest-780182631 None] Attempting download of 2ab6f2fa-4ab3-463f-8dea-d88913f37a52 ((None, [{'url': 'file:///opt/stack/data/glance/images/2ab6f2fa-4ab3-463f-8dea-d88913f37a52', 'metadata': {}}])) to volume 4507adfe-4487-4706-aa4b-2672a1185944. {{(pid=86512) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 29 18:26:21 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[0be2e24e-6650-4fa0-b06f-cc732b993775]: (4, 'raw') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:26:21 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-71acde2b-eb51-4110-b978-a63c9db3e24a tempest-VolumeAndVolumeTypeFromImageTest-780182631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2ab6f2fa-4ab3-463f-8dea-d88913f37a52_pies1og8 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:26:22 devstack sudo[98035]: pam_unix(sudo:session): session closed for user root Sep 29 18:26:22 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-136aaaee-3106-477a-aca2-c96bb419f680 tempest-VolumesListAdminTestJSON-423174112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ad1cb64d-b9e8-4076-927c-5aff4cb74003" returned: 0 in 0.346s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:26:22 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-136aaaee-3106-477a-aca2-c96bb419f680 tempest-VolumesListAdminTestJSON-423174112 None] Lock "cinder-quobyte-ad1cb64d-b9e8-4076-927c-5aff4cb74003" released by "delete_volume" :: held 0.903s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:26:22 devstack sudo[98055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2ab6f2fa-4ab3-463f-8dea-d88913f37a52_pies1og8 Sep 29 18:26:22 devstack sudo[98055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:26:22 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-136aaaee-3106-477a-aca2-c96bb419f680 tempest-VolumesListAdminTestJSON-423174112 None] Created reservations ['290e20ed-d405-421e-b92f-455a09e8f834', 'd8c8ebaf-e72e-4be3-bfe9-e7dffb297978', 'c7e75362-ff39-4299-b783-9804b2e09449', 'd1bc6372-7ce2-455b-b6a6-7f8d8d2665cf'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:26:22 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-136aaaee-3106-477a-aca2-c96bb419f680 tempest-VolumesListAdminTestJSON-423174112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:26:22 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-136aaaee-3106-477a-aca2-c96bb419f680 tempest-VolumesListAdminTestJSON-423174112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:26:22 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-136aaaee-3106-477a-aca2-c96bb419f680 tempest-VolumesListAdminTestJSON-423174112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:26:22 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-136aaaee-3106-477a-aca2-c96bb419f680 tempest-VolumesListAdminTestJSON-423174112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:26:22 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-136aaaee-3106-477a-aca2-c96bb419f680 tempest-VolumesListAdminTestJSON-423174112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:26:22 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-136aaaee-3106-477a-aca2-c96bb419f680 tempest-VolumesListAdminTestJSON-423174112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:26:22 devstack sudo[98058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:26:22 devstack sudo[98058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:26:22 devstack sudo[98055]: pam_unix(sudo:session): session closed for user root Sep 29 18:26:22 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-71acde2b-eb51-4110-b978-a63c9db3e24a tempest-VolumeAndVolumeTypeFromImageTest-780182631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2ab6f2fa-4ab3-463f-8dea-d88913f37a52_pies1og8" returned: 0 in 0.589s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:26:22 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-71acde2b-eb51-4110-b978-a63c9db3e24a tempest-VolumeAndVolumeTypeFromImageTest-780182631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2ab6f2fa-4ab3-463f-8dea-d88913f37a52_pies1og8 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:26:22 devstack sudo[98058]: pam_unix(sudo:session): session closed for user root Sep 29 18:26:22 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-136aaaee-3106-477a-aca2-c96bb419f680 tempest-VolumesListAdminTestJSON-423174112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.327s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:26:22 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-136aaaee-3106-477a-aca2-c96bb419f680 tempest-VolumesListAdminTestJSON-423174112 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:26:22 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-136aaaee-3106-477a-aca2-c96bb419f680 tempest-VolumesListAdminTestJSON-423174112 None] Deleted volume successfully. Sep 29 18:26:22 devstack sudo[98062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2ab6f2fa-4ab3-463f-8dea-d88913f37a52_pies1og8 Sep 29 18:26:22 devstack sudo[98062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:26:22 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-136aaaee-3106-477a-aca2-c96bb419f680 tempest-VolumesListAdminTestJSON-423174112 None] Lock "cinder-ad1cb64d-b9e8-4076-927c-5aff4cb74003-delete_volume" released by "delete_volume" :: held 1.604s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:26:22 devstack sudo[98062]: pam_unix(sudo:session): session closed for user root Sep 29 18:26:22 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-71acde2b-eb51-4110-b978-a63c9db3e24a tempest-VolumeAndVolumeTypeFromImageTest-780182631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2ab6f2fa-4ab3-463f-8dea-d88913f37a52_pies1og8" returned: 1 in 0.391s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:26:22 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-71acde2b-eb51-4110-b978-a63c9db3e24a tempest-VolumeAndVolumeTypeFromImageTest-780182631 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2ab6f2fa-4ab3-463f-8dea-d88913f37a52_pies1og8' failed. Not Retrying. {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 29 18:26:22 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab092c3b-14a3-4f93-b7be-0ecd09d742fa]: (4, 'raw') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:26:22 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-71acde2b-eb51-4110-b978-a63c9db3e24a tempest-VolumeAndVolumeTypeFromImageTest-780182631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2ab6f2fa-4ab3-463f-8dea-d88913f37a52_u37nam6adevstack@QuobyteHD {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:26:23 devstack sudo[98067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2ab6f2fa-4ab3-463f-8dea-d88913f37a52_u37nam6adevstack@QuobyteHD Sep 29 18:26:23 devstack sudo[98067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:26:23 devstack sudo[98067]: pam_unix(sudo:session): session closed for user root Sep 29 18:26:23 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-71acde2b-eb51-4110-b978-a63c9db3e24a tempest-VolumeAndVolumeTypeFromImageTest-780182631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2ab6f2fa-4ab3-463f-8dea-d88913f37a52_u37nam6adevstack@QuobyteHD" returned: 0 in 0.372s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:26:23 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-71acde2b-eb51-4110-b978-a63c9db3e24a tempest-VolumeAndVolumeTypeFromImageTest-780182631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2ab6f2fa-4ab3-463f-8dea-d88913f37a52_u37nam6adevstack@QuobyteHD {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:26:23 devstack sudo[98071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2ab6f2fa-4ab3-463f-8dea-d88913f37a52_u37nam6adevstack@QuobyteHD Sep 29 18:26:23 devstack sudo[98071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:26:23 devstack sudo[98071]: pam_unix(sudo:session): session closed for user root Sep 29 18:26:23 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-71acde2b-eb51-4110-b978-a63c9db3e24a tempest-VolumeAndVolumeTypeFromImageTest-780182631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2ab6f2fa-4ab3-463f-8dea-d88913f37a52_u37nam6adevstack@QuobyteHD" returned: 1 in 0.369s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:26:23 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-71acde2b-eb51-4110-b978-a63c9db3e24a tempest-VolumeAndVolumeTypeFromImageTest-780182631 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2ab6f2fa-4ab3-463f-8dea-d88913f37a52_u37nam6adevstack@QuobyteHD' failed. Not Retrying. {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 29 18:26:23 devstack cinder-volume[86512]: DEBUG cinder.image.image_utils [None req-71acde2b-eb51-4110-b978-a63c9db3e24a tempest-VolumeAndVolumeTypeFromImageTest-780182631 None] 2ab6f2fa-4ab3-463f-8dea-d88913f37a52 was raw, converting to qcow2 {{(pid=86512) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 29 18:26:23 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-71acde2b-eb51-4110-b978-a63c9db3e24a tempest-VolumeAndVolumeTypeFromImageTest-780182631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_2ab6f2fa-4ab3-463f-8dea-d88913f37a52_u37nam6adevstack@QuobyteHD /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-4507adfe-4487-4706-aa4b-2672a1185944 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:26:23 devstack sudo[98077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_2ab6f2fa-4ab3-463f-8dea-d88913f37a52_u37nam6adevstack@QuobyteHD /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-4507adfe-4487-4706-aa4b-2672a1185944 Sep 29 18:26:23 devstack sudo[98077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:26:24 devstack sudo[98077]: pam_unix(sudo:session): session closed for user root Sep 29 18:26:24 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-71acde2b-eb51-4110-b978-a63c9db3e24a tempest-VolumeAndVolumeTypeFromImageTest-780182631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_2ab6f2fa-4ab3-463f-8dea-d88913f37a52_u37nam6adevstack@QuobyteHD /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-4507adfe-4487-4706-aa4b-2672a1185944" returned: 0 in 0.585s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:26:24 devstack cinder-volume[86512]: DEBUG cinder.image.image_utils [None req-71acde2b-eb51-4110-b978-a63c9db3e24a tempest-VolumeAndVolumeTypeFromImageTest-780182631 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2ab6f2fa-4ab3-463f-8dea-d88913f37a52_u37nam6adevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-4507adfe-4487-4706-aa4b-2672a1185944 {{(pid=86512) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 29 18:26:24 devstack cinder-volume[86512]: INFO cinder.image.image_utils [None req-71acde2b-eb51-4110-b978-a63c9db3e24a tempest-VolumeAndVolumeTypeFromImageTest-780182631 None] Converted 0.00 MB image at 0.00 MB/s Sep 29 18:26:24 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-71acde2b-eb51-4110-b978-a63c9db3e24a tempest-VolumeAndVolumeTypeFromImageTest-780182631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-4507adfe-4487-4706-aa4b-2672a1185944 1G {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:26:24 devstack sudo[98085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-4507adfe-4487-4706-aa4b-2672a1185944 1G Sep 29 18:26:24 devstack sudo[98085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:26:24 devstack sudo[98085]: pam_unix(sudo:session): session closed for user root Sep 29 18:26:24 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-71acde2b-eb51-4110-b978-a63c9db3e24a tempest-VolumeAndVolumeTypeFromImageTest-780182631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-4507adfe-4487-4706-aa4b-2672a1185944 1G" returned: 0 in 0.385s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:26:24 devstack cinder-volume[86512]: DEBUG cinder.volume.volume_utils [None req-71acde2b-eb51-4110-b978-a63c9db3e24a tempest-VolumeAndVolumeTypeFromImageTest-780182631 None] Downloaded image 2ab6f2fa-4ab3-463f-8dea-d88913f37a52 ((None, [{'url': 'file:///opt/stack/data/glance/images/2ab6f2fa-4ab3-463f-8dea-d88913f37a52', 'metadata': {}}])) to volume 4507adfe-4487-4706-aa4b-2672a1185944 successfully. {{(pid=86512) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 29 18:26:24 devstack cinder-volume[86512]: DEBUG cinder.image.image_utils [None req-71acde2b-eb51-4110-b978-a63c9db3e24a tempest-VolumeAndVolumeTypeFromImageTest-780182631 None] Temporary image 2ab6f2fa-4ab3-463f-8dea-d88913f37a52 for user e8075ab31af54946beb7a65dbf507c95 is deleted. {{(pid=86512) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 29 18:26:24 devstack cinder-volume[86512]: DEBUG cinder.volume.volume_utils [None req-71acde2b-eb51-4110-b978-a63c9db3e24a tempest-VolumeAndVolumeTypeFromImageTest-780182631 None] Marking volume 4507adfe-4487-4706-aa4b-2672a1185944 as bootable. {{(pid=86512) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 29 18:26:24 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-71acde2b-eb51-4110-b978-a63c9db3e24a tempest-VolumeAndVolumeTypeFromImageTest-780182631 None] Copying metadata from image 2ab6f2fa-4ab3-463f-8dea-d88913f37a52 to 4507adfe-4487-4706-aa4b-2672a1185944. {{(pid=86512) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 29 18:26:24 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-71acde2b-eb51-4110-b978-a63c9db3e24a tempest-VolumeAndVolumeTypeFromImageTest-780182631 None] Creating volume glance metadata for volume 4507adfe-4487-4706-aa4b-2672a1185944 backed by image 2ab6f2fa-4ab3-463f-8dea-d88913f37a52 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '2ab6f2fa-4ab3-463f-8dea-d88913f37a52', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'da066f17f59582d762fbaec008d5d93c', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86512) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 29 18:26:24 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-71acde2b-eb51-4110-b978-a63c9db3e24a tempest-VolumeAndVolumeTypeFromImageTest-780182631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9622b09-9dc0-4a60-98c2-4ca3a3d51fc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4507adfe-4487-4706-aa4b-2672a1185944', 'volume_size': 1, 'image_id': '2ab6f2fa-4ab3-463f-8dea-d88913f37a52', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2ab6f2fa-4ab3-463f-8dea-d88913f37a52', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'da066f17f59582d762fbaec008d5d93c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '5a78afffa580440ab07f34c1c888927c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c87873f416b512f965d7adde28512995436548be047f6beed6657ef59976430f5e677ea16509dcd2b550af6dc42b14f59103625aa1f410d723f26662cabd3cbb', 'id': '2ab6f2fa-4ab3-463f-8dea-d88913f37a52', 'created_at': datetime.datetime(2026, 9, 29, 16, 26, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 16, 26, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2ab6f2fa-4ab3-463f-8dea-d88913f37a52/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:26:24 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-71acde2b-eb51-4110-b978-a63c9db3e24a tempest-VolumeAndVolumeTypeFromImageTest-780182631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a943febc-0ab9-4e9b-ab0f-255fcd3a5486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:26:24 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-71acde2b-eb51-4110-b978-a63c9db3e24a tempest-VolumeAndVolumeTypeFromImageTest-780182631 None] Volume volume-4507adfe-4487-4706-aa4b-2672a1185944 (4507adfe-4487-4706-aa4b-2672a1185944): created successfully Sep 29 18:26:24 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-71acde2b-eb51-4110-b978-a63c9db3e24a tempest-VolumeAndVolumeTypeFromImageTest-780182631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a943febc-0ab9-4e9b-ab0f-255fcd3a5486) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:26:24 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-71acde2b-eb51-4110-b978-a63c9db3e24a tempest-VolumeAndVolumeTypeFromImageTest-780182631 None] Flow 'volume_create_manager' (25079b38-1786-44c7-ab4f-459a8f6b45d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:26:24 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-71acde2b-eb51-4110-b978-a63c9db3e24a tempest-VolumeAndVolumeTypeFromImageTest-780182631 None] Created volume successfully. Sep 29 18:26:25 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-6ee75e83-2b93-490d-a3d8-37431bee0b40 tempest-VolumeAndVolumeTypeFromImageTest-780182631 None] Acquiring lock "cinder-4507adfe-4487-4706-aa4b-2672a1185944-delete_volume" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:26:25 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-6ee75e83-2b93-490d-a3d8-37431bee0b40 tempest-VolumeAndVolumeTypeFromImageTest-780182631 None] Lock "cinder-4507adfe-4487-4706-aa4b-2672a1185944-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:26:25 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-6ee75e83-2b93-490d-a3d8-37431bee0b40 tempest-VolumeAndVolumeTypeFromImageTest-780182631 None] Acquiring lock "cinder-quobyte-4507adfe-4487-4706-aa4b-2672a1185944" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:26:25 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-6ee75e83-2b93-490d-a3d8-37431bee0b40 tempest-VolumeAndVolumeTypeFromImageTest-780182631 None] Lock "cinder-quobyte-4507adfe-4487-4706-aa4b-2672a1185944" acquired by "delete_volume" :: waited 0.019s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:26:25 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[3788295f-ec9d-450c-bef9-571455f173de]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:26:25 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-6ee75e83-2b93-490d-a3d8-37431bee0b40 tempest-VolumeAndVolumeTypeFromImageTest-780182631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-4507adfe-4487-4706-aa4b-2672a1185944 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:26:25 devstack sudo[98091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-4507adfe-4487-4706-aa4b-2672a1185944 Sep 29 18:26:25 devstack sudo[98091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:26:26 devstack sudo[98091]: pam_unix(sudo:session): session closed for user root Sep 29 18:26:26 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-6ee75e83-2b93-490d-a3d8-37431bee0b40 tempest-VolumeAndVolumeTypeFromImageTest-780182631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-4507adfe-4487-4706-aa4b-2672a1185944" returned: 0 in 0.414s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:26:26 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-6ee75e83-2b93-490d-a3d8-37431bee0b40 tempest-VolumeAndVolumeTypeFromImageTest-780182631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-4507adfe-4487-4706-aa4b-2672a1185944 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:26:26 devstack sudo[98096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-4507adfe-4487-4706-aa4b-2672a1185944 Sep 29 18:26:26 devstack sudo[98096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:26:26 devstack sudo[98096]: pam_unix(sudo:session): session closed for user root Sep 29 18:26:26 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-6ee75e83-2b93-490d-a3d8-37431bee0b40 tempest-VolumeAndVolumeTypeFromImageTest-780182631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-4507adfe-4487-4706-aa4b-2672a1185944" returned: 0 in 0.275s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:26:26 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-6ee75e83-2b93-490d-a3d8-37431bee0b40 tempest-VolumeAndVolumeTypeFromImageTest-780182631 None] Lock "cinder-quobyte-4507adfe-4487-4706-aa4b-2672a1185944" released by "delete_volume" :: held 0.752s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:26:26 devstack cinder-volume[86512]: WARNING cinder.quota [None req-6ee75e83-2b93-490d-a3d8-37431bee0b40 tempest-VolumeAndVolumeTypeFromImageTest-780182631 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 29 18:26:26 devstack cinder-volume[86512]: WARNING cinder.quota [None req-6ee75e83-2b93-490d-a3d8-37431bee0b40 tempest-VolumeAndVolumeTypeFromImageTest-780182631 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 29 18:26:26 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-6ee75e83-2b93-490d-a3d8-37431bee0b40 tempest-VolumeAndVolumeTypeFromImageTest-780182631 None] Created reservations ['411689ca-80b8-425f-9ef9-883152539a9c', '5a502fe2-9502-4941-adc9-1fc090888c2d', '4870c2a0-7c23-4f84-ba5d-f7bc6058f838', '66f6e1a4-8c1a-457c-be76-baa510da10f8'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:26:26 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-6ee75e83-2b93-490d-a3d8-37431bee0b40 tempest-VolumeAndVolumeTypeFromImageTest-780182631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:26:26 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-6ee75e83-2b93-490d-a3d8-37431bee0b40 tempest-VolumeAndVolumeTypeFromImageTest-780182631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:26:26 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-6ee75e83-2b93-490d-a3d8-37431bee0b40 tempest-VolumeAndVolumeTypeFromImageTest-780182631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:26:26 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-6ee75e83-2b93-490d-a3d8-37431bee0b40 tempest-VolumeAndVolumeTypeFromImageTest-780182631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:26:26 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-6ee75e83-2b93-490d-a3d8-37431bee0b40 tempest-VolumeAndVolumeTypeFromImageTest-780182631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:26:26 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-6ee75e83-2b93-490d-a3d8-37431bee0b40 tempest-VolumeAndVolumeTypeFromImageTest-780182631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:26:26 devstack sudo[98099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:26:26 devstack sudo[98099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:26:27 devstack sudo[98099]: pam_unix(sudo:session): session closed for user root Sep 29 18:26:27 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-6ee75e83-2b93-490d-a3d8-37431bee0b40 tempest-VolumeAndVolumeTypeFromImageTest-780182631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.305s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:26:27 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-6ee75e83-2b93-490d-a3d8-37431bee0b40 tempest-VolumeAndVolumeTypeFromImageTest-780182631 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:26:27 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-6ee75e83-2b93-490d-a3d8-37431bee0b40 tempest-VolumeAndVolumeTypeFromImageTest-780182631 None] Deleted volume successfully. Sep 29 18:26:27 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-6ee75e83-2b93-490d-a3d8-37431bee0b40 tempest-VolumeAndVolumeTypeFromImageTest-780182631 None] Lock "cinder-4507adfe-4487-4706-aa4b-2672a1185944-delete_volume" released by "delete_volume" :: held 1.337s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:26:29 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f913aae-7e05-429d-9b25-f3145d33c6d7 tempest-VolumesImageMetadata-1110495063 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86512) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:26:29 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-7f913aae-7e05-429d-9b25-f3145d33c6d7 tempest-VolumesImageMetadata-1110495063 None] Flow 'volume_create_manager' (1619269a-6aea-43ad-b7be-75f09c220552) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:26:29 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-7f913aae-7e05-429d-9b25-f3145d33c6d7 tempest-VolumesImageMetadata-1110495063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b95911c7-19c7-4b12-bd0e-d78e058e55ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:26:29 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-7f913aae-7e05-429d-9b25-f3145d33c6d7 tempest-VolumesImageMetadata-1110495063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b95911c7-19c7-4b12-bd0e-d78e058e55ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:26:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1763208169',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be620625-3b47-4348-98fb-44599ec7029d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='252e913fd75d40c199dbd39b66c07a11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:26:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:26:29Z,use_quota=True,user_id='cc440b5c277e41459be76c1fa691d133',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:26:29 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-7f913aae-7e05-429d-9b25-f3145d33c6d7 tempest-VolumesImageMetadata-1110495063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f9495f6-2aaa-4f06-8ab5-ab08a260a639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:26:29 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-7f913aae-7e05-429d-9b25-f3145d33c6d7 tempest-VolumesImageMetadata-1110495063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f9495f6-2aaa-4f06-8ab5-ab08a260a639) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:26:29 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-7f913aae-7e05-429d-9b25-f3145d33c6d7 tempest-VolumesImageMetadata-1110495063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c45850a0-cd4e-4728-a07e-74d7f3012fc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:26:29 devstack cinder-volume[86512]: DEBUG cinder.image.glance [None req-7f913aae-7e05-429d-9b25-f3145d33c6d7 tempest-VolumesImageMetadata-1110495063 None] Creating Keystone auth plugin from conf {{(pid=86512) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 29 18:26:30 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-7f913aae-7e05-429d-9b25-f3145d33c6d7 tempest-VolumesImageMetadata-1110495063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c45850a0-cd4e-4728-a07e-74d7f3012fc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'be620625-3b47-4348-98fb-44599ec7029d', 'volume_name': 'volume-be620625-3b47-4348-98fb-44599ec7029d', 'volume_size': 1, 'image_id': 'd8ebca63-1178-4b36-a1a2-e10949cbc87f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d8ebca63-1178-4b36-a1a2-e10949cbc87f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '987aeb00888a4b9bb9954392d91b8741', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd8ebca63-1178-4b36-a1a2-e10949cbc87f', 'created_at': datetime.datetime(2026, 9, 29, 16, 11, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 16, 11, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d8ebca63-1178-4b36-a1a2-e10949cbc87f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:26:30 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-7f913aae-7e05-429d-9b25-f3145d33c6d7 tempest-VolumesImageMetadata-1110495063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a58ab2a-ff92-45c5-b4bb-6bad6cc6e228) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:26:30 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-7f913aae-7e05-429d-9b25-f3145d33c6d7 tempest-VolumesImageMetadata-1110495063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a58ab2a-ff92-45c5-b4bb-6bad6cc6e228) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:26:30 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-7f913aae-7e05-429d-9b25-f3145d33c6d7 tempest-VolumesImageMetadata-1110495063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9250793-e404-4294-9b6d-47270bfcf49e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:26:30 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-7f913aae-7e05-429d-9b25-f3145d33c6d7 tempest-VolumesImageMetadata-1110495063 None] Volume be620625-3b47-4348-98fb-44599ec7029d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-be620625-3b47-4348-98fb-44599ec7029d', 'volume_size': 1, 'image_id': 'd8ebca63-1178-4b36-a1a2-e10949cbc87f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d8ebca63-1178-4b36-a1a2-e10949cbc87f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '987aeb00888a4b9bb9954392d91b8741', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd8ebca63-1178-4b36-a1a2-e10949cbc87f', 'created_at': datetime.datetime(2026, 9, 29, 16, 11, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 16, 11, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d8ebca63-1178-4b36-a1a2-e10949cbc87f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 29 18:26:30 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f913aae-7e05-429d-9b25-f3145d33c6d7 tempest-VolumesImageMetadata-1110495063 None] Trying to clone be620625-3b47-4348-98fb-44599ec7029d from image d8ebca63-1178-4b36-a1a2-e10949cbc87f at location (None, [{'url': 'file:///opt/stack/data/glance/images/d8ebca63-1178-4b36-a1a2-e10949cbc87f', 'metadata': {}}]). {{(pid=86512) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 29 18:26:30 devstack cinder-volume[86512]: DEBUG cinder.image.image_utils [None req-7f913aae-7e05-429d-9b25-f3145d33c6d7 tempest-VolumesImageMetadata-1110495063 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d8ebca63-1178-4b36-a1a2-e10949cbc87f_s68fdqcidevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86512) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 29 18:26:30 devstack cinder-volume[86512]: INFO cinder.image.image_utils [None req-7f913aae-7e05-429d-9b25-f3145d33c6d7 tempest-VolumesImageMetadata-1110495063 None] Image download 20.69 MB at 20.69 MB/s Sep 29 18:26:30 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[788d1727-2578-4bfd-bd49-ea2ae4d8ed14]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:26:30 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-7f913aae-7e05-429d-9b25-f3145d33c6d7 tempest-VolumesImageMetadata-1110495063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d8ebca63-1178-4b36-a1a2-e10949cbc87f_s68fdqcidevstack@QuobyteHD {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:26:30 devstack sudo[98103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d8ebca63-1178-4b36-a1a2-e10949cbc87f_s68fdqcidevstack@QuobyteHD Sep 29 18:26:30 devstack sudo[98103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:26:31 devstack sudo[98103]: pam_unix(sudo:session): session closed for user root Sep 29 18:26:31 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-7f913aae-7e05-429d-9b25-f3145d33c6d7 tempest-VolumesImageMetadata-1110495063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d8ebca63-1178-4b36-a1a2-e10949cbc87f_s68fdqcidevstack@QuobyteHD" returned: 0 in 0.413s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:26:31 devstack cinder-volume[86512]: DEBUG cinder.image.image_utils [None req-7f913aae-7e05-429d-9b25-f3145d33c6d7 tempest-VolumesImageMetadata-1110495063 None] Temporary image d8ebca63-1178-4b36-a1a2-e10949cbc87f is fetched for user cc440b5c277e41459be76c1fa691d133. {{(pid=86512) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 29 18:26:31 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f7ece18-54e3-4899-8e73-7402b8bfe522]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:26:31 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-7f913aae-7e05-429d-9b25-f3145d33c6d7 tempest-VolumesImageMetadata-1110495063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d8ebca63-1178-4b36-a1a2-e10949cbc87f_s68fdqcidevstack@QuobyteHD {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:26:31 devstack sudo[98108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d8ebca63-1178-4b36-a1a2-e10949cbc87f_s68fdqcidevstack@QuobyteHD Sep 29 18:26:31 devstack sudo[98108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:26:31 devstack sudo[98108]: pam_unix(sudo:session): session closed for user root Sep 29 18:26:31 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-7f913aae-7e05-429d-9b25-f3145d33c6d7 tempest-VolumesImageMetadata-1110495063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d8ebca63-1178-4b36-a1a2-e10949cbc87f_s68fdqcidevstack@QuobyteHD" returned: 0 in 0.464s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:26:31 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-7f913aae-7e05-429d-9b25-f3145d33c6d7 tempest-VolumesImageMetadata-1110495063 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:26:31 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-7f913aae-7e05-429d-9b25-f3145d33c6d7 tempest-VolumesImageMetadata-1110495063 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:26:31 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-7f913aae-7e05-429d-9b25-f3145d33c6d7 tempest-VolumesImageMetadata-1110495063 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:26:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1763208169',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be620625-3b47-4348-98fb-44599ec7029d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='252e913fd75d40c199dbd39b66c07a11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:26:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:26:29Z,use_quota=True,user_id='cc440b5c277e41459be76c1fa691d133',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)}" {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:26:31 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-7f913aae-7e05-429d-9b25-f3145d33c6d7 tempest-VolumesImageMetadata-1110495063 None] Creating volume be620625-3b47-4348-98fb-44599ec7029d {{(pid=86512) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:26:31 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-7f913aae-7e05-429d-9b25-f3145d33c6d7 tempest-VolumesImageMetadata-1110495063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:26:31 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-7f913aae-7e05-429d-9b25-f3145d33c6d7 tempest-VolumesImageMetadata-1110495063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:26:31 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-7f913aae-7e05-429d-9b25-f3145d33c6d7 tempest-VolumesImageMetadata-1110495063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:26:31 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-7f913aae-7e05-429d-9b25-f3145d33c6d7 tempest-VolumesImageMetadata-1110495063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:26:31 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-7f913aae-7e05-429d-9b25-f3145d33c6d7 tempest-VolumesImageMetadata-1110495063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:26:31 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-7f913aae-7e05-429d-9b25-f3145d33c6d7 tempest-VolumesImageMetadata-1110495063 None] Selected osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 as target Quobyte volume. {{(pid=86512) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:26:31 devstack cinder-volume[86512]: INFO cinder.volume.drivers.remotefs [None req-7f913aae-7e05-429d-9b25-f3145d33c6d7 tempest-VolumesImageMetadata-1110495063 None] casted to osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 Sep 29 18:26:31 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-7f913aae-7e05-429d-9b25-f3145d33c6d7 tempest-VolumesImageMetadata-1110495063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-be620625-3b47-4348-98fb-44599ec7029d 1073741824 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:26:31 devstack sudo[98113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-be620625-3b47-4348-98fb-44599ec7029d 1073741824 Sep 29 18:26:31 devstack sudo[98113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:26:32 devstack sudo[98113]: pam_unix(sudo:session): session closed for user root Sep 29 18:26:32 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-7f913aae-7e05-429d-9b25-f3145d33c6d7 tempest-VolumesImageMetadata-1110495063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-be620625-3b47-4348-98fb-44599ec7029d 1073741824" returned: 0 in 0.631s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:26:32 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-7f913aae-7e05-429d-9b25-f3145d33c6d7 tempest-VolumesImageMetadata-1110495063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-be620625-3b47-4348-98fb-44599ec7029d {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:26:32 devstack sudo[98121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-be620625-3b47-4348-98fb-44599ec7029d Sep 29 18:26:32 devstack sudo[98121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:26:32 devstack sudo[98121]: pam_unix(sudo:session): session closed for user root Sep 29 18:26:32 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-7f913aae-7e05-429d-9b25-f3145d33c6d7 tempest-VolumesImageMetadata-1110495063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-be620625-3b47-4348-98fb-44599ec7029d" returned: 0 in 0.316s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:26:32 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-7f913aae-7e05-429d-9b25-f3145d33c6d7 tempest-VolumesImageMetadata-1110495063 None] <== create_volume: return (1012ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'} {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:26:32 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-7f913aae-7e05-429d-9b25-f3145d33c6d7 tempest-VolumesImageMetadata-1110495063 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.018s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:26:32 devstack cinder-volume[86512]: DEBUG cinder.volume.volume_utils [None req-7f913aae-7e05-429d-9b25-f3145d33c6d7 tempest-VolumesImageMetadata-1110495063 None] Attempting download of d8ebca63-1178-4b36-a1a2-e10949cbc87f ((None, [{'url': 'file:///opt/stack/data/glance/images/d8ebca63-1178-4b36-a1a2-e10949cbc87f', 'metadata': {}}])) to volume be620625-3b47-4348-98fb-44599ec7029d. {{(pid=86512) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 29 18:26:32 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[10263ff3-58d6-49b5-97fe-0edb723cb1c9]: (4, 'raw') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:26:32 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-1fd6c4ca-b4bb-4b0a-bb15-352755a5205d tempest-AttachVolumeNegativeTest-1588161148 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86512) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:26:32 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-1fd6c4ca-b4bb-4b0a-bb15-352755a5205d tempest-AttachVolumeNegativeTest-1588161148 None] Flow 'volume_create_manager' (aed8fc1c-bf35-4fa9-8d14-e48711d70b40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:26:32 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-1fd6c4ca-b4bb-4b0a-bb15-352755a5205d tempest-AttachVolumeNegativeTest-1588161148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d314f840-48d8-40fb-ab2a-12c047e84152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:26:32 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-7f913aae-7e05-429d-9b25-f3145d33c6d7 tempest-VolumesImageMetadata-1110495063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d8ebca63-1178-4b36-a1a2-e10949cbc87f_uhur_3nw {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:26:32 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-1fd6c4ca-b4bb-4b0a-bb15-352755a5205d tempest-AttachVolumeNegativeTest-1588161148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d314f840-48d8-40fb-ab2a-12c047e84152) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:26:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1598231486',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5de338e3-f797-4f6e-a646-5fc0ca18c6b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05c82caa4fd348afbec7a526cbb20e18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:26:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:26:33Z,use_quota=True,user_id='64e1943d04f742059dd82e9c24eeaec0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:26:32 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-1fd6c4ca-b4bb-4b0a-bb15-352755a5205d tempest-AttachVolumeNegativeTest-1588161148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afb91821-f23e-4a36-a33b-bd6c3f8fb60e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:26:32 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-1fd6c4ca-b4bb-4b0a-bb15-352755a5205d tempest-AttachVolumeNegativeTest-1588161148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afb91821-f23e-4a36-a33b-bd6c3f8fb60e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:26:32 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-1fd6c4ca-b4bb-4b0a-bb15-352755a5205d tempest-AttachVolumeNegativeTest-1588161148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04d3e73d-d03b-4224-8dc0-0177d7444569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:26:32 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-1fd6c4ca-b4bb-4b0a-bb15-352755a5205d tempest-AttachVolumeNegativeTest-1588161148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04d3e73d-d03b-4224-8dc0-0177d7444569) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5de338e3-f797-4f6e-a646-5fc0ca18c6b4', 'volume_name': 'volume-5de338e3-f797-4f6e-a646-5fc0ca18c6b4', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:26:32 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-1fd6c4ca-b4bb-4b0a-bb15-352755a5205d tempest-AttachVolumeNegativeTest-1588161148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06096914-8159-4daa-a624-ca8cc69758ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:26:32 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-1fd6c4ca-b4bb-4b0a-bb15-352755a5205d tempest-AttachVolumeNegativeTest-1588161148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06096914-8159-4daa-a624-ca8cc69758ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:26:32 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-1fd6c4ca-b4bb-4b0a-bb15-352755a5205d tempest-AttachVolumeNegativeTest-1588161148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57fbbaab-f546-422c-bd33-93e1aa22c028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:26:32 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-1fd6c4ca-b4bb-4b0a-bb15-352755a5205d tempest-AttachVolumeNegativeTest-1588161148 None] Volume 5de338e3-f797-4f6e-a646-5fc0ca18c6b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5de338e3-f797-4f6e-a646-5fc0ca18c6b4', 'volume_size': 1} Sep 29 18:26:32 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-1fd6c4ca-b4bb-4b0a-bb15-352755a5205d tempest-AttachVolumeNegativeTest-1588161148 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:26:32 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-1fd6c4ca-b4bb-4b0a-bb15-352755a5205d tempest-AttachVolumeNegativeTest-1588161148 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:26:32 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-1fd6c4ca-b4bb-4b0a-bb15-352755a5205d tempest-AttachVolumeNegativeTest-1588161148 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:26:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1598231486',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5de338e3-f797-4f6e-a646-5fc0ca18c6b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05c82caa4fd348afbec7a526cbb20e18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:26:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:26:33Z,use_quota=True,user_id='64e1943d04f742059dd82e9c24eeaec0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)}" {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:26:32 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-1fd6c4ca-b4bb-4b0a-bb15-352755a5205d tempest-AttachVolumeNegativeTest-1588161148 None] Creating volume 5de338e3-f797-4f6e-a646-5fc0ca18c6b4 {{(pid=86512) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:26:32 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-1fd6c4ca-b4bb-4b0a-bb15-352755a5205d tempest-AttachVolumeNegativeTest-1588161148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:26:32 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-1fd6c4ca-b4bb-4b0a-bb15-352755a5205d tempest-AttachVolumeNegativeTest-1588161148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:26:32 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-1fd6c4ca-b4bb-4b0a-bb15-352755a5205d tempest-AttachVolumeNegativeTest-1588161148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:26:32 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-1fd6c4ca-b4bb-4b0a-bb15-352755a5205d tempest-AttachVolumeNegativeTest-1588161148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:26:32 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-1fd6c4ca-b4bb-4b0a-bb15-352755a5205d tempest-AttachVolumeNegativeTest-1588161148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:26:32 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-1fd6c4ca-b4bb-4b0a-bb15-352755a5205d tempest-AttachVolumeNegativeTest-1588161148 None] Selected osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 as target Quobyte volume. {{(pid=86512) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:26:32 devstack cinder-volume[86512]: INFO cinder.volume.drivers.remotefs [None req-1fd6c4ca-b4bb-4b0a-bb15-352755a5205d tempest-AttachVolumeNegativeTest-1588161148 None] casted to osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 Sep 29 18:26:32 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-1fd6c4ca-b4bb-4b0a-bb15-352755a5205d tempest-AttachVolumeNegativeTest-1588161148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-5de338e3-f797-4f6e-a646-5fc0ca18c6b4 1073741824 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:26:33 devstack sudo[98125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-5de338e3-f797-4f6e-a646-5fc0ca18c6b4 1073741824 Sep 29 18:26:33 devstack sudo[98125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:26:33 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1c10700-0b0e-4ccf-9398-21e79ebcdd91 tempest-CreateVolumesFromImageTest-1109030344 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86512) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:26:33 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d1c10700-0b0e-4ccf-9398-21e79ebcdd91 tempest-CreateVolumesFromImageTest-1109030344 None] Flow 'volume_create_manager' (38da8501-d780-4691-a426-918c11441b9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:26:33 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d1c10700-0b0e-4ccf-9398-21e79ebcdd91 tempest-CreateVolumesFromImageTest-1109030344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (faa6d7f3-a0b5-4e2f-99d1-405ede135b90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:26:33 devstack sudo[98124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d8ebca63-1178-4b36-a1a2-e10949cbc87f_uhur_3nw Sep 29 18:26:33 devstack sudo[98124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:26:33 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d1c10700-0b0e-4ccf-9398-21e79ebcdd91 tempest-CreateVolumesFromImageTest-1109030344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (faa6d7f3-a0b5-4e2f-99d1-405ede135b90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:26:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2133020911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a44b345-958e-4b23-9110-280c927a57c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4cd845c59af4566b19f24f3c9e6be54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:26:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:26:33Z,use_quota=True,user_id='d71f11f5623c4c7daed625a09e8be04d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:26:33 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d1c10700-0b0e-4ccf-9398-21e79ebcdd91 tempest-CreateVolumesFromImageTest-1109030344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e7d55d4-2444-4c4d-b7be-dbf65edec1ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:26:33 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d1c10700-0b0e-4ccf-9398-21e79ebcdd91 tempest-CreateVolumesFromImageTest-1109030344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e7d55d4-2444-4c4d-b7be-dbf65edec1ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:26:33 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d1c10700-0b0e-4ccf-9398-21e79ebcdd91 tempest-CreateVolumesFromImageTest-1109030344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d37c5f7-ccac-48ca-88a9-81cc678f142a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:26:33 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d1c10700-0b0e-4ccf-9398-21e79ebcdd91 tempest-CreateVolumesFromImageTest-1109030344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d37c5f7-ccac-48ca-88a9-81cc678f142a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a44b345-958e-4b23-9110-280c927a57c5', 'volume_name': 'volume-7a44b345-958e-4b23-9110-280c927a57c5', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:26:33 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d1c10700-0b0e-4ccf-9398-21e79ebcdd91 tempest-CreateVolumesFromImageTest-1109030344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8254358f-f7ad-4771-a04a-0841aca7ded1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:26:33 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d1c10700-0b0e-4ccf-9398-21e79ebcdd91 tempest-CreateVolumesFromImageTest-1109030344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8254358f-f7ad-4771-a04a-0841aca7ded1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:26:33 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d1c10700-0b0e-4ccf-9398-21e79ebcdd91 tempest-CreateVolumesFromImageTest-1109030344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e44eac3-07aa-458d-a71f-7ea467d3a9be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:26:33 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-d1c10700-0b0e-4ccf-9398-21e79ebcdd91 tempest-CreateVolumesFromImageTest-1109030344 None] Volume 7a44b345-958e-4b23-9110-280c927a57c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a44b345-958e-4b23-9110-280c927a57c5', 'volume_size': 1} Sep 29 18:26:33 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-d1c10700-0b0e-4ccf-9398-21e79ebcdd91 tempest-CreateVolumesFromImageTest-1109030344 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:26:33 devstack sudo[98124]: pam_unix(sudo:session): session closed for user root Sep 29 18:26:33 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-7f913aae-7e05-429d-9b25-f3145d33c6d7 tempest-VolumesImageMetadata-1110495063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d8ebca63-1178-4b36-a1a2-e10949cbc87f_uhur_3nw" returned: 0 in 0.701s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:26:33 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-7f913aae-7e05-429d-9b25-f3145d33c6d7 tempest-VolumesImageMetadata-1110495063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d8ebca63-1178-4b36-a1a2-e10949cbc87f_uhur_3nw {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:26:33 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-d508655c-babe-46a8-978d-b7884135efde tempest-CreateVolumesFromImageTest-1109030344 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86512) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:26:33 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d508655c-babe-46a8-978d-b7884135efde tempest-CreateVolumesFromImageTest-1109030344 None] Flow 'volume_create_manager' (2de663d7-304f-48b0-bd9b-12de11644605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:26:33 devstack sudo[98144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d8ebca63-1178-4b36-a1a2-e10949cbc87f_uhur_3nw Sep 29 18:26:33 devstack sudo[98144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:26:33 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d508655c-babe-46a8-978d-b7884135efde tempest-CreateVolumesFromImageTest-1109030344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ec6ed2a-85ae-4383-817b-fbcac6e4c9ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:26:33 devstack sudo[98125]: pam_unix(sudo:session): session closed for user root Sep 29 18:26:33 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d508655c-babe-46a8-978d-b7884135efde tempest-CreateVolumesFromImageTest-1109030344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ec6ed2a-85ae-4383-817b-fbcac6e4c9ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:26:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1594158195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44a3ce75-6d8b-49a8-bec4-f179c41b9422,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4cd845c59af4566b19f24f3c9e6be54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:26:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:26:34Z,use_quota=True,user_id='d71f11f5623c4c7daed625a09e8be04d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:26:33 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d508655c-babe-46a8-978d-b7884135efde tempest-CreateVolumesFromImageTest-1109030344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e843a18-b43c-499f-b636-653743738319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:26:33 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d508655c-babe-46a8-978d-b7884135efde tempest-CreateVolumesFromImageTest-1109030344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e843a18-b43c-499f-b636-653743738319) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:26:33 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d508655c-babe-46a8-978d-b7884135efde tempest-CreateVolumesFromImageTest-1109030344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50d86e58-01ac-41d0-a069-b1e995a09754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:26:33 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d508655c-babe-46a8-978d-b7884135efde tempest-CreateVolumesFromImageTest-1109030344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50d86e58-01ac-41d0-a069-b1e995a09754) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44a3ce75-6d8b-49a8-bec4-f179c41b9422', 'volume_name': 'volume-44a3ce75-6d8b-49a8-bec4-f179c41b9422', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:26:33 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d508655c-babe-46a8-978d-b7884135efde tempest-CreateVolumesFromImageTest-1109030344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e4e9842-cf4d-4916-87fd-cf2ef36b8eec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:26:33 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d508655c-babe-46a8-978d-b7884135efde tempest-CreateVolumesFromImageTest-1109030344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e4e9842-cf4d-4916-87fd-cf2ef36b8eec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:26:33 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d508655c-babe-46a8-978d-b7884135efde tempest-CreateVolumesFromImageTest-1109030344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b3a2fd1-5992-45d3-b3db-a6ac79101c7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:26:33 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-d508655c-babe-46a8-978d-b7884135efde tempest-CreateVolumesFromImageTest-1109030344 None] Volume 44a3ce75-6d8b-49a8-bec4-f179c41b9422: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44a3ce75-6d8b-49a8-bec4-f179c41b9422', 'volume_size': 1} Sep 29 18:26:33 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-d508655c-babe-46a8-978d-b7884135efde tempest-CreateVolumesFromImageTest-1109030344 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:26:33 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-1fd6c4ca-b4bb-4b0a-bb15-352755a5205d tempest-AttachVolumeNegativeTest-1588161148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-5de338e3-f797-4f6e-a646-5fc0ca18c6b4 1073741824" returned: 0 in 0.849s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:26:33 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-1fd6c4ca-b4bb-4b0a-bb15-352755a5205d tempest-AttachVolumeNegativeTest-1588161148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-5de338e3-f797-4f6e-a646-5fc0ca18c6b4 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:26:33 devstack sudo[98146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-5de338e3-f797-4f6e-a646-5fc0ca18c6b4 Sep 29 18:26:33 devstack sudo[98146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:26:34 devstack sudo[98144]: pam_unix(sudo:session): session closed for user root Sep 29 18:26:34 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-7f913aae-7e05-429d-9b25-f3145d33c6d7 tempest-VolumesImageMetadata-1110495063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d8ebca63-1178-4b36-a1a2-e10949cbc87f_uhur_3nw" returned: 1 in 0.485s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:26:34 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-7f913aae-7e05-429d-9b25-f3145d33c6d7 tempest-VolumesImageMetadata-1110495063 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d8ebca63-1178-4b36-a1a2-e10949cbc87f_uhur_3nw' failed. Not Retrying. {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 29 18:26:34 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e7a4884-efcb-4d10-8498-1e716da222a1]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:26:34 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-7f913aae-7e05-429d-9b25-f3145d33c6d7 tempest-VolumesImageMetadata-1110495063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d8ebca63-1178-4b36-a1a2-e10949cbc87f_s68fdqcidevstack@QuobyteHD {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:26:34 devstack sudo[98150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d8ebca63-1178-4b36-a1a2-e10949cbc87f_s68fdqcidevstack@QuobyteHD Sep 29 18:26:34 devstack sudo[98150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:26:34 devstack sudo[98146]: pam_unix(sudo:session): session closed for user root Sep 29 18:26:34 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-1fd6c4ca-b4bb-4b0a-bb15-352755a5205d tempest-AttachVolumeNegativeTest-1588161148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-5de338e3-f797-4f6e-a646-5fc0ca18c6b4" returned: 0 in 0.565s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:26:34 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-1fd6c4ca-b4bb-4b0a-bb15-352755a5205d tempest-AttachVolumeNegativeTest-1588161148 None] <== create_volume: return (1483ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'} {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:26:34 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-1fd6c4ca-b4bb-4b0a-bb15-352755a5205d tempest-AttachVolumeNegativeTest-1588161148 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.489s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:26:34 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-d1c10700-0b0e-4ccf-9398-21e79ebcdd91 tempest-CreateVolumesFromImageTest-1109030344 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.248s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:26:34 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-d1c10700-0b0e-4ccf-9398-21e79ebcdd91 tempest-CreateVolumesFromImageTest-1109030344 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:26:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2133020911',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a44b345-958e-4b23-9110-280c927a57c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4cd845c59af4566b19f24f3c9e6be54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:26:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:26:33Z,use_quota=True,user_id='d71f11f5623c4c7daed625a09e8be04d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)}" {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:26:34 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-d1c10700-0b0e-4ccf-9398-21e79ebcdd91 tempest-CreateVolumesFromImageTest-1109030344 None] Creating volume 7a44b345-958e-4b23-9110-280c927a57c5 {{(pid=86512) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:26:34 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-d1c10700-0b0e-4ccf-9398-21e79ebcdd91 tempest-CreateVolumesFromImageTest-1109030344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:26:34 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-d1c10700-0b0e-4ccf-9398-21e79ebcdd91 tempest-CreateVolumesFromImageTest-1109030344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:26:34 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-d1c10700-0b0e-4ccf-9398-21e79ebcdd91 tempest-CreateVolumesFromImageTest-1109030344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:26:34 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-d1c10700-0b0e-4ccf-9398-21e79ebcdd91 tempest-CreateVolumesFromImageTest-1109030344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:26:34 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-d1c10700-0b0e-4ccf-9398-21e79ebcdd91 tempest-CreateVolumesFromImageTest-1109030344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:26:34 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-d1c10700-0b0e-4ccf-9398-21e79ebcdd91 tempest-CreateVolumesFromImageTest-1109030344 None] Selected osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 as target Quobyte volume. {{(pid=86512) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:26:34 devstack cinder-volume[86512]: INFO cinder.volume.drivers.remotefs [None req-d1c10700-0b0e-4ccf-9398-21e79ebcdd91 tempest-CreateVolumesFromImageTest-1109030344 None] casted to osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 Sep 29 18:26:34 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-d1c10700-0b0e-4ccf-9398-21e79ebcdd91 tempest-CreateVolumesFromImageTest-1109030344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7a44b345-958e-4b23-9110-280c927a57c5 1073741824 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:26:34 devstack sudo[98153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7a44b345-958e-4b23-9110-280c927a57c5 1073741824 Sep 29 18:26:34 devstack sudo[98153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:26:34 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-1fd6c4ca-b4bb-4b0a-bb15-352755a5205d tempest-AttachVolumeNegativeTest-1588161148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57fbbaab-f546-422c-bd33-93e1aa22c028) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5de338e3-f797-4f6e-a646-5fc0ca18c6b4', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:26:34 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-1fd6c4ca-b4bb-4b0a-bb15-352755a5205d tempest-AttachVolumeNegativeTest-1588161148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1563cc3b-d1e7-481d-a6d6-6b71cfb59fb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:26:34 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-ebd7d1b0-7242-43e6-82e9-2f4865acee45 tempest-CreateVolumesFromImageTest-1109030344 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86512) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:26:34 devstack sudo[98150]: pam_unix(sudo:session): session closed for user root Sep 29 18:26:34 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-ebd7d1b0-7242-43e6-82e9-2f4865acee45 tempest-CreateVolumesFromImageTest-1109030344 None] Flow 'volume_create_manager' (bf42923c-ae55-4543-b39a-e5655413ebd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:26:34 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-ebd7d1b0-7242-43e6-82e9-2f4865acee45 tempest-CreateVolumesFromImageTest-1109030344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68499bef-2792-4249-bbd7-dab9e43caa67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:26:34 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-1fd6c4ca-b4bb-4b0a-bb15-352755a5205d tempest-AttachVolumeNegativeTest-1588161148 None] Volume volume-5de338e3-f797-4f6e-a646-5fc0ca18c6b4 (5de338e3-f797-4f6e-a646-5fc0ca18c6b4): created successfully Sep 29 18:26:34 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-1fd6c4ca-b4bb-4b0a-bb15-352755a5205d tempest-AttachVolumeNegativeTest-1588161148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1563cc3b-d1e7-481d-a6d6-6b71cfb59fb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:26:34 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-1fd6c4ca-b4bb-4b0a-bb15-352755a5205d tempest-AttachVolumeNegativeTest-1588161148 None] Flow 'volume_create_manager' (aed8fc1c-bf35-4fa9-8d14-e48711d70b40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:26:34 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-7f913aae-7e05-429d-9b25-f3145d33c6d7 tempest-VolumesImageMetadata-1110495063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d8ebca63-1178-4b36-a1a2-e10949cbc87f_s68fdqcidevstack@QuobyteHD" returned: 0 in 0.704s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:26:34 devstack cinder-volume[86512]: DEBUG cinder.image.image_utils [None req-7f913aae-7e05-429d-9b25-f3145d33c6d7 tempest-VolumesImageMetadata-1110495063 None] d8ebca63-1178-4b36-a1a2-e10949cbc87f was qcow2, converting to qcow2 {{(pid=86512) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 29 18:26:34 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-7f913aae-7e05-429d-9b25-f3145d33c6d7 tempest-VolumesImageMetadata-1110495063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d8ebca63-1178-4b36-a1a2-e10949cbc87f_s68fdqcidevstack@QuobyteHD /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-be620625-3b47-4348-98fb-44599ec7029d {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:26:34 devstack sudo[98158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d8ebca63-1178-4b36-a1a2-e10949cbc87f_s68fdqcidevstack@QuobyteHD /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-be620625-3b47-4348-98fb-44599ec7029d Sep 29 18:26:34 devstack sudo[98158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:26:34 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-ebd7d1b0-7242-43e6-82e9-2f4865acee45 tempest-CreateVolumesFromImageTest-1109030344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68499bef-2792-4249-bbd7-dab9e43caa67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:26:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-892799331',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50d9375e-1fdd-4bf1-8315-4615098767ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4cd845c59af4566b19f24f3c9e6be54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:26:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:26:34Z,use_quota=True,user_id='d71f11f5623c4c7daed625a09e8be04d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:26:34 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-ebd7d1b0-7242-43e6-82e9-2f4865acee45 tempest-CreateVolumesFromImageTest-1109030344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19666ca5-0109-4db5-870e-455049bbdb3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:26:34 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-ebd7d1b0-7242-43e6-82e9-2f4865acee45 tempest-CreateVolumesFromImageTest-1109030344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19666ca5-0109-4db5-870e-455049bbdb3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:26:34 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-ebd7d1b0-7242-43e6-82e9-2f4865acee45 tempest-CreateVolumesFromImageTest-1109030344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72f293fb-85c3-4c22-bdde-9fc4fe4b2e54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:26:34 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-ebd7d1b0-7242-43e6-82e9-2f4865acee45 tempest-CreateVolumesFromImageTest-1109030344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72f293fb-85c3-4c22-bdde-9fc4fe4b2e54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50d9375e-1fdd-4bf1-8315-4615098767ba', 'volume_name': 'volume-50d9375e-1fdd-4bf1-8315-4615098767ba', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:26:34 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-ebd7d1b0-7242-43e6-82e9-2f4865acee45 tempest-CreateVolumesFromImageTest-1109030344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (469ef0b5-fe7a-4685-8bb2-128aaedadaac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:26:34 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-ebd7d1b0-7242-43e6-82e9-2f4865acee45 tempest-CreateVolumesFromImageTest-1109030344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (469ef0b5-fe7a-4685-8bb2-128aaedadaac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:26:34 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-ebd7d1b0-7242-43e6-82e9-2f4865acee45 tempest-CreateVolumesFromImageTest-1109030344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac34d3fd-62ae-4276-b034-cc7d2487b586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:26:34 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-ebd7d1b0-7242-43e6-82e9-2f4865acee45 tempest-CreateVolumesFromImageTest-1109030344 None] Volume 50d9375e-1fdd-4bf1-8315-4615098767ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50d9375e-1fdd-4bf1-8315-4615098767ba', 'volume_size': 1} Sep 29 18:26:34 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-ebd7d1b0-7242-43e6-82e9-2f4865acee45 tempest-CreateVolumesFromImageTest-1109030344 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:26:34 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-1fd6c4ca-b4bb-4b0a-bb15-352755a5205d tempest-AttachVolumeNegativeTest-1588161148 None] Created volume successfully. Sep 29 18:26:34 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-7cc792ba-7c04-4991-b612-914977618182 tempest-CreateVolumesFromImageTest-1109030344 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86512) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:26:34 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-7cc792ba-7c04-4991-b612-914977618182 tempest-CreateVolumesFromImageTest-1109030344 None] Flow 'volume_create_manager' (34fe2299-cf7b-478f-b543-1e9292521d7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:26:34 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-7cc792ba-7c04-4991-b612-914977618182 tempest-CreateVolumesFromImageTest-1109030344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b957699-5a3d-4b80-a227-b47a162a42b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:26:34 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-7cc792ba-7c04-4991-b612-914977618182 tempest-CreateVolumesFromImageTest-1109030344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b957699-5a3d-4b80-a227-b47a162a42b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:26:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1851950897',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fac2935b-2b66-49c6-90f7-52e9610b22a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4cd845c59af4566b19f24f3c9e6be54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:26:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:26:35Z,use_quota=True,user_id='d71f11f5623c4c7daed625a09e8be04d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:26:35 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-7cc792ba-7c04-4991-b612-914977618182 tempest-CreateVolumesFromImageTest-1109030344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ef99075-0cda-4d07-a488-f1d9bc06f19d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:26:35 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-7cc792ba-7c04-4991-b612-914977618182 tempest-CreateVolumesFromImageTest-1109030344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ef99075-0cda-4d07-a488-f1d9bc06f19d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:26:35 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-7cc792ba-7c04-4991-b612-914977618182 tempest-CreateVolumesFromImageTest-1109030344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9ce478d-25d9-448a-a06d-284088e15a5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:26:35 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-7cc792ba-7c04-4991-b612-914977618182 tempest-CreateVolumesFromImageTest-1109030344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9ce478d-25d9-448a-a06d-284088e15a5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fac2935b-2b66-49c6-90f7-52e9610b22a5', 'volume_name': 'volume-fac2935b-2b66-49c6-90f7-52e9610b22a5', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:26:35 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-7cc792ba-7c04-4991-b612-914977618182 tempest-CreateVolumesFromImageTest-1109030344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a228baa-cf6a-4eaa-a211-d370d382dec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:26:35 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-7cc792ba-7c04-4991-b612-914977618182 tempest-CreateVolumesFromImageTest-1109030344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a228baa-cf6a-4eaa-a211-d370d382dec2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:26:35 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-7cc792ba-7c04-4991-b612-914977618182 tempest-CreateVolumesFromImageTest-1109030344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a27ccbb-1a99-411f-8ce4-de69286e9df8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:26:35 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-7cc792ba-7c04-4991-b612-914977618182 tempest-CreateVolumesFromImageTest-1109030344 None] Volume fac2935b-2b66-49c6-90f7-52e9610b22a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fac2935b-2b66-49c6-90f7-52e9610b22a5', 'volume_size': 1} Sep 29 18:26:35 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-7cc792ba-7c04-4991-b612-914977618182 tempest-CreateVolumesFromImageTest-1109030344 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:26:35 devstack sudo[98153]: pam_unix(sudo:session): session closed for user root Sep 29 18:26:35 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-d1c10700-0b0e-4ccf-9398-21e79ebcdd91 tempest-CreateVolumesFromImageTest-1109030344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7a44b345-958e-4b23-9110-280c927a57c5 1073741824" returned: 0 in 0.895s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:26:35 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-d1c10700-0b0e-4ccf-9398-21e79ebcdd91 tempest-CreateVolumesFromImageTest-1109030344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7a44b345-958e-4b23-9110-280c927a57c5 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:26:35 devstack sudo[98170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7a44b345-958e-4b23-9110-280c927a57c5 Sep 29 18:26:35 devstack sudo[98170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:26:35 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7a7be55-5d28-4156-bfc8-13392a719b5c tempest-CreateVolumesFromImageTest-1109030344 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86512) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:26:35 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-b7a7be55-5d28-4156-bfc8-13392a719b5c tempest-CreateVolumesFromImageTest-1109030344 None] Flow 'volume_create_manager' (22e71990-25c1-48a4-88e1-c0e817d628bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:26:35 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-b7a7be55-5d28-4156-bfc8-13392a719b5c tempest-CreateVolumesFromImageTest-1109030344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3863b6b3-5e78-406b-aab6-9ab5d2543159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:26:35 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-b7a7be55-5d28-4156-bfc8-13392a719b5c tempest-CreateVolumesFromImageTest-1109030344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3863b6b3-5e78-406b-aab6-9ab5d2543159) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:26:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-849178194',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd45f3ee-902b-4fa1-a545-4cefebf63968,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4cd845c59af4566b19f24f3c9e6be54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:26:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:26:35Z,use_quota=True,user_id='d71f11f5623c4c7daed625a09e8be04d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:26:35 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-b7a7be55-5d28-4156-bfc8-13392a719b5c tempest-CreateVolumesFromImageTest-1109030344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84cc6ac4-aac0-4488-8775-2014037409ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:26:35 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-b7a7be55-5d28-4156-bfc8-13392a719b5c tempest-CreateVolumesFromImageTest-1109030344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84cc6ac4-aac0-4488-8775-2014037409ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:26:35 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-b7a7be55-5d28-4156-bfc8-13392a719b5c tempest-CreateVolumesFromImageTest-1109030344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f8f080e-40bb-4d99-80fa-799b4602bfff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:26:35 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-b7a7be55-5d28-4156-bfc8-13392a719b5c tempest-CreateVolumesFromImageTest-1109030344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f8f080e-40bb-4d99-80fa-799b4602bfff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd45f3ee-902b-4fa1-a545-4cefebf63968', 'volume_name': 'volume-bd45f3ee-902b-4fa1-a545-4cefebf63968', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:26:35 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-b7a7be55-5d28-4156-bfc8-13392a719b5c tempest-CreateVolumesFromImageTest-1109030344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6b61c9a-380b-4a1d-9c26-37578660b68c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:26:35 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-b7a7be55-5d28-4156-bfc8-13392a719b5c tempest-CreateVolumesFromImageTest-1109030344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6b61c9a-380b-4a1d-9c26-37578660b68c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:26:35 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-b7a7be55-5d28-4156-bfc8-13392a719b5c tempest-CreateVolumesFromImageTest-1109030344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08e1ec98-6a72-42a7-aaaf-c89dd9df77ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:26:35 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-b7a7be55-5d28-4156-bfc8-13392a719b5c tempest-CreateVolumesFromImageTest-1109030344 None] Volume bd45f3ee-902b-4fa1-a545-4cefebf63968: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd45f3ee-902b-4fa1-a545-4cefebf63968', 'volume_size': 1} Sep 29 18:26:35 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-b7a7be55-5d28-4156-bfc8-13392a719b5c tempest-CreateVolumesFromImageTest-1109030344 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:26:35 devstack sudo[98170]: pam_unix(sudo:session): session closed for user root Sep 29 18:26:35 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-d1c10700-0b0e-4ccf-9398-21e79ebcdd91 tempest-CreateVolumesFromImageTest-1109030344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7a44b345-958e-4b23-9110-280c927a57c5" returned: 0 in 0.372s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:26:35 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-d1c10700-0b0e-4ccf-9398-21e79ebcdd91 tempest-CreateVolumesFromImageTest-1109030344 None] <== create_volume: return (1351ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'} {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:26:35 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-d1c10700-0b0e-4ccf-9398-21e79ebcdd91 tempest-CreateVolumesFromImageTest-1109030344 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.354s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:26:35 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-d508655c-babe-46a8-978d-b7884135efde tempest-CreateVolumesFromImageTest-1109030344 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.992s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:26:35 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-d508655c-babe-46a8-978d-b7884135efde tempest-CreateVolumesFromImageTest-1109030344 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:26:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1594158195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44a3ce75-6d8b-49a8-bec4-f179c41b9422,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4cd845c59af4566b19f24f3c9e6be54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:26:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:26:34Z,use_quota=True,user_id='d71f11f5623c4c7daed625a09e8be04d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)}" {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:26:35 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-d508655c-babe-46a8-978d-b7884135efde tempest-CreateVolumesFromImageTest-1109030344 None] Creating volume 44a3ce75-6d8b-49a8-bec4-f179c41b9422 {{(pid=86512) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:26:35 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-d508655c-babe-46a8-978d-b7884135efde tempest-CreateVolumesFromImageTest-1109030344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:26:35 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-d508655c-babe-46a8-978d-b7884135efde tempest-CreateVolumesFromImageTest-1109030344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:26:35 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-d508655c-babe-46a8-978d-b7884135efde tempest-CreateVolumesFromImageTest-1109030344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:26:35 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-d508655c-babe-46a8-978d-b7884135efde tempest-CreateVolumesFromImageTest-1109030344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:26:35 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-d508655c-babe-46a8-978d-b7884135efde tempest-CreateVolumesFromImageTest-1109030344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:26:35 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-d508655c-babe-46a8-978d-b7884135efde tempest-CreateVolumesFromImageTest-1109030344 None] Selected osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 as target Quobyte volume. {{(pid=86512) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:26:35 devstack cinder-volume[86512]: INFO cinder.volume.drivers.remotefs [None req-d508655c-babe-46a8-978d-b7884135efde tempest-CreateVolumesFromImageTest-1109030344 None] casted to osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 Sep 29 18:26:35 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-d508655c-babe-46a8-978d-b7884135efde tempest-CreateVolumesFromImageTest-1109030344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-44a3ce75-6d8b-49a8-bec4-f179c41b9422 1073741824 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:26:35 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d1c10700-0b0e-4ccf-9398-21e79ebcdd91 tempest-CreateVolumesFromImageTest-1109030344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e44eac3-07aa-458d-a71f-7ea467d3a9be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a44b345-958e-4b23-9110-280c927a57c5', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:26:35 devstack sudo[98181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-44a3ce75-6d8b-49a8-bec4-f179c41b9422 1073741824 Sep 29 18:26:35 devstack sudo[98181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:26:35 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d1c10700-0b0e-4ccf-9398-21e79ebcdd91 tempest-CreateVolumesFromImageTest-1109030344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c6ea7a1-16b0-41f6-a0f3-ea5bfbe94522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:26:35 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-d1c10700-0b0e-4ccf-9398-21e79ebcdd91 tempest-CreateVolumesFromImageTest-1109030344 None] Volume volume-7a44b345-958e-4b23-9110-280c927a57c5 (7a44b345-958e-4b23-9110-280c927a57c5): created successfully Sep 29 18:26:35 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d1c10700-0b0e-4ccf-9398-21e79ebcdd91 tempest-CreateVolumesFromImageTest-1109030344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c6ea7a1-16b0-41f6-a0f3-ea5bfbe94522) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:26:35 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d1c10700-0b0e-4ccf-9398-21e79ebcdd91 tempest-CreateVolumesFromImageTest-1109030344 None] Flow 'volume_create_manager' (38da8501-d780-4691-a426-918c11441b9c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:26:35 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-d1c10700-0b0e-4ccf-9398-21e79ebcdd91 tempest-CreateVolumesFromImageTest-1109030344 None] Created volume successfully. Sep 29 18:26:36 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [req-1b538186-ee51-424e-b04d-cadc92cbb7ad req-bae4ec26-b138-4442-b9a4-a8328122dfaf tempest-AttachVolumeNegativeTest-1588161148 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:26:36 devstack sudo[98181]: pam_unix(sudo:session): session closed for user root Sep 29 18:26:36 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-d508655c-babe-46a8-978d-b7884135efde tempest-CreateVolumesFromImageTest-1109030344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-44a3ce75-6d8b-49a8-bec4-f179c41b9422 1073741824" returned: 0 in 0.643s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:26:36 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-d508655c-babe-46a8-978d-b7884135efde tempest-CreateVolumesFromImageTest-1109030344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-44a3ce75-6d8b-49a8-bec4-f179c41b9422 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:26:36 devstack sudo[98189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-44a3ce75-6d8b-49a8-bec4-f179c41b9422 Sep 29 18:26:36 devstack sudo[98189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:26:36 devstack sudo[98189]: pam_unix(sudo:session): session closed for user root Sep 29 18:26:36 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-d508655c-babe-46a8-978d-b7884135efde tempest-CreateVolumesFromImageTest-1109030344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-44a3ce75-6d8b-49a8-bec4-f179c41b9422" returned: 0 in 0.283s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:26:36 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-d508655c-babe-46a8-978d-b7884135efde tempest-CreateVolumesFromImageTest-1109030344 None] <== create_volume: return (989ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'} {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:26:36 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-d508655c-babe-46a8-978d-b7884135efde tempest-CreateVolumesFromImageTest-1109030344 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.992s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:26:36 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-ebd7d1b0-7242-43e6-82e9-2f4865acee45 tempest-CreateVolumesFromImageTest-1109030344 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.953s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:26:36 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-ebd7d1b0-7242-43e6-82e9-2f4865acee45 tempest-CreateVolumesFromImageTest-1109030344 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:26:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-892799331',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50d9375e-1fdd-4bf1-8315-4615098767ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4cd845c59af4566b19f24f3c9e6be54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:26:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:26:34Z,use_quota=True,user_id='d71f11f5623c4c7daed625a09e8be04d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)}" {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:26:36 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-ebd7d1b0-7242-43e6-82e9-2f4865acee45 tempest-CreateVolumesFromImageTest-1109030344 None] Creating volume 50d9375e-1fdd-4bf1-8315-4615098767ba {{(pid=86512) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:26:36 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-ebd7d1b0-7242-43e6-82e9-2f4865acee45 tempest-CreateVolumesFromImageTest-1109030344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:26:36 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-ebd7d1b0-7242-43e6-82e9-2f4865acee45 tempest-CreateVolumesFromImageTest-1109030344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:26:36 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-ebd7d1b0-7242-43e6-82e9-2f4865acee45 tempest-CreateVolumesFromImageTest-1109030344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:26:36 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-ebd7d1b0-7242-43e6-82e9-2f4865acee45 tempest-CreateVolumesFromImageTest-1109030344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:26:36 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-ebd7d1b0-7242-43e6-82e9-2f4865acee45 tempest-CreateVolumesFromImageTest-1109030344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:26:36 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-ebd7d1b0-7242-43e6-82e9-2f4865acee45 tempest-CreateVolumesFromImageTest-1109030344 None] Selected osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 as target Quobyte volume. {{(pid=86512) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:26:36 devstack cinder-volume[86512]: INFO cinder.volume.drivers.remotefs [None req-ebd7d1b0-7242-43e6-82e9-2f4865acee45 tempest-CreateVolumesFromImageTest-1109030344 None] casted to osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 Sep 29 18:26:36 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-ebd7d1b0-7242-43e6-82e9-2f4865acee45 tempest-CreateVolumesFromImageTest-1109030344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-50d9375e-1fdd-4bf1-8315-4615098767ba 1073741824 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:26:36 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d508655c-babe-46a8-978d-b7884135efde tempest-CreateVolumesFromImageTest-1109030344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b3a2fd1-5992-45d3-b3db-a6ac79101c7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44a3ce75-6d8b-49a8-bec4-f179c41b9422', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:26:36 devstack sudo[98192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-50d9375e-1fdd-4bf1-8315-4615098767ba 1073741824 Sep 29 18:26:36 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d508655c-babe-46a8-978d-b7884135efde tempest-CreateVolumesFromImageTest-1109030344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f79ee2d6-3363-4d4f-a626-38d74e10e037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:26:36 devstack sudo[98192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:26:36 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-d508655c-babe-46a8-978d-b7884135efde tempest-CreateVolumesFromImageTest-1109030344 None] Volume volume-44a3ce75-6d8b-49a8-bec4-f179c41b9422 (44a3ce75-6d8b-49a8-bec4-f179c41b9422): created successfully Sep 29 18:26:36 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d508655c-babe-46a8-978d-b7884135efde tempest-CreateVolumesFromImageTest-1109030344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f79ee2d6-3363-4d4f-a626-38d74e10e037) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:26:36 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d508655c-babe-46a8-978d-b7884135efde tempest-CreateVolumesFromImageTest-1109030344 None] Flow 'volume_create_manager' (2de663d7-304f-48b0-bd9b-12de11644605) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:26:36 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-d508655c-babe-46a8-978d-b7884135efde tempest-CreateVolumesFromImageTest-1109030344 None] Created volume successfully. Sep 29 18:26:37 devstack sudo[98158]: pam_unix(sudo:session): session closed for user root Sep 29 18:26:37 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-7f913aae-7e05-429d-9b25-f3145d33c6d7 tempest-VolumesImageMetadata-1110495063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d8ebca63-1178-4b36-a1a2-e10949cbc87f_s68fdqcidevstack@QuobyteHD /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-be620625-3b47-4348-98fb-44599ec7029d" returned: 0 in 2.656s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:26:37 devstack cinder-volume[86512]: DEBUG cinder.image.image_utils [None req-7f913aae-7e05-429d-9b25-f3145d33c6d7 tempest-VolumesImageMetadata-1110495063 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d8ebca63-1178-4b36-a1a2-e10949cbc87f_s68fdqcidevstack@QuobyteHD, size 112.00 MB, duration 2.66 sec, destination /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-be620625-3b47-4348-98fb-44599ec7029d {{(pid=86512) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 29 18:26:37 devstack cinder-volume[86512]: INFO cinder.image.image_utils [None req-7f913aae-7e05-429d-9b25-f3145d33c6d7 tempest-VolumesImageMetadata-1110495063 None] Converted 112.00 MB image at 42.15 MB/s Sep 29 18:26:37 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-7f913aae-7e05-429d-9b25-f3145d33c6d7 tempest-VolumesImageMetadata-1110495063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-be620625-3b47-4348-98fb-44599ec7029d 1G {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:26:37 devstack sudo[98192]: pam_unix(sudo:session): session closed for user root Sep 29 18:26:37 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-ebd7d1b0-7242-43e6-82e9-2f4865acee45 tempest-CreateVolumesFromImageTest-1109030344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-50d9375e-1fdd-4bf1-8315-4615098767ba 1073741824" returned: 0 in 0.635s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:26:37 devstack sudo[98200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-be620625-3b47-4348-98fb-44599ec7029d 1G Sep 29 18:26:37 devstack sudo[98200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:26:37 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-ebd7d1b0-7242-43e6-82e9-2f4865acee45 tempest-CreateVolumesFromImageTest-1109030344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-50d9375e-1fdd-4bf1-8315-4615098767ba {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:26:37 devstack sudo[98202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-50d9375e-1fdd-4bf1-8315-4615098767ba Sep 29 18:26:37 devstack sudo[98202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:26:37 devstack sudo[98202]: pam_unix(sudo:session): session closed for user root Sep 29 18:26:37 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-ebd7d1b0-7242-43e6-82e9-2f4865acee45 tempest-CreateVolumesFromImageTest-1109030344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-50d9375e-1fdd-4bf1-8315-4615098767ba" returned: 0 in 0.283s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:26:37 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-ebd7d1b0-7242-43e6-82e9-2f4865acee45 tempest-CreateVolumesFromImageTest-1109030344 None] <== create_volume: return (983ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'} {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:26:37 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-ebd7d1b0-7242-43e6-82e9-2f4865acee45 tempest-CreateVolumesFromImageTest-1109030344 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.988s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:26:37 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-7cc792ba-7c04-4991-b612-914977618182 tempest-CreateVolumesFromImageTest-1109030344 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.698s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:26:37 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-7cc792ba-7c04-4991-b612-914977618182 tempest-CreateVolumesFromImageTest-1109030344 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:26:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1851950897',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fac2935b-2b66-49c6-90f7-52e9610b22a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4cd845c59af4566b19f24f3c9e6be54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:26:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:26:35Z,use_quota=True,user_id='d71f11f5623c4c7daed625a09e8be04d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)}" {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:26:37 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-7cc792ba-7c04-4991-b612-914977618182 tempest-CreateVolumesFromImageTest-1109030344 None] Creating volume fac2935b-2b66-49c6-90f7-52e9610b22a5 {{(pid=86512) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:26:37 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-7cc792ba-7c04-4991-b612-914977618182 tempest-CreateVolumesFromImageTest-1109030344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:26:37 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-7cc792ba-7c04-4991-b612-914977618182 tempest-CreateVolumesFromImageTest-1109030344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:26:37 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-7cc792ba-7c04-4991-b612-914977618182 tempest-CreateVolumesFromImageTest-1109030344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:26:37 devstack sudo[98200]: pam_unix(sudo:session): session closed for user root Sep 29 18:26:37 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-7cc792ba-7c04-4991-b612-914977618182 tempest-CreateVolumesFromImageTest-1109030344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:26:37 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-7cc792ba-7c04-4991-b612-914977618182 tempest-CreateVolumesFromImageTest-1109030344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:26:37 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-7cc792ba-7c04-4991-b612-914977618182 tempest-CreateVolumesFromImageTest-1109030344 None] Selected osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 as target Quobyte volume. {{(pid=86512) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:26:37 devstack cinder-volume[86512]: INFO cinder.volume.drivers.remotefs [None req-7cc792ba-7c04-4991-b612-914977618182 tempest-CreateVolumesFromImageTest-1109030344 None] casted to osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 Sep 29 18:26:37 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-7cc792ba-7c04-4991-b612-914977618182 tempest-CreateVolumesFromImageTest-1109030344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fac2935b-2b66-49c6-90f7-52e9610b22a5 1073741824 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:26:37 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-7f913aae-7e05-429d-9b25-f3145d33c6d7 tempest-VolumesImageMetadata-1110495063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-be620625-3b47-4348-98fb-44599ec7029d 1G" returned: 0 in 0.405s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:26:37 devstack cinder-volume[86512]: DEBUG cinder.volume.volume_utils [None req-7f913aae-7e05-429d-9b25-f3145d33c6d7 tempest-VolumesImageMetadata-1110495063 None] Downloaded image d8ebca63-1178-4b36-a1a2-e10949cbc87f ((None, [{'url': 'file:///opt/stack/data/glance/images/d8ebca63-1178-4b36-a1a2-e10949cbc87f', 'metadata': {}}])) to volume be620625-3b47-4348-98fb-44599ec7029d successfully. {{(pid=86512) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 29 18:26:37 devstack cinder-volume[86512]: DEBUG cinder.image.image_utils [None req-7f913aae-7e05-429d-9b25-f3145d33c6d7 tempest-VolumesImageMetadata-1110495063 None] Temporary image d8ebca63-1178-4b36-a1a2-e10949cbc87f for user cc440b5c277e41459be76c1fa691d133 is deleted. {{(pid=86512) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 29 18:26:37 devstack cinder-volume[86512]: DEBUG cinder.volume.volume_utils [None req-7f913aae-7e05-429d-9b25-f3145d33c6d7 tempest-VolumesImageMetadata-1110495063 None] Marking volume be620625-3b47-4348-98fb-44599ec7029d as bootable. {{(pid=86512) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 29 18:26:37 devstack sudo[98208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fac2935b-2b66-49c6-90f7-52e9610b22a5 1073741824 Sep 29 18:26:37 devstack sudo[98208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:26:37 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-ebd7d1b0-7242-43e6-82e9-2f4865acee45 tempest-CreateVolumesFromImageTest-1109030344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac34d3fd-62ae-4276-b034-cc7d2487b586) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50d9375e-1fdd-4bf1-8315-4615098767ba', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:26:37 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-ebd7d1b0-7242-43e6-82e9-2f4865acee45 tempest-CreateVolumesFromImageTest-1109030344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0844cbec-1355-4ff0-a85e-75f5c7eeba74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:26:37 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f913aae-7e05-429d-9b25-f3145d33c6d7 tempest-VolumesImageMetadata-1110495063 None] Copying metadata from image d8ebca63-1178-4b36-a1a2-e10949cbc87f to be620625-3b47-4348-98fb-44599ec7029d. {{(pid=86512) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 29 18:26:37 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f913aae-7e05-429d-9b25-f3145d33c6d7 tempest-VolumesImageMetadata-1110495063 None] Creating volume glance metadata for volume be620625-3b47-4348-98fb-44599ec7029d backed by image d8ebca63-1178-4b36-a1a2-e10949cbc87f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'd8ebca63-1178-4b36-a1a2-e10949cbc87f', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86512) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 29 18:26:37 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-ebd7d1b0-7242-43e6-82e9-2f4865acee45 tempest-CreateVolumesFromImageTest-1109030344 None] Volume volume-50d9375e-1fdd-4bf1-8315-4615098767ba (50d9375e-1fdd-4bf1-8315-4615098767ba): created successfully Sep 29 18:26:37 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-ebd7d1b0-7242-43e6-82e9-2f4865acee45 tempest-CreateVolumesFromImageTest-1109030344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0844cbec-1355-4ff0-a85e-75f5c7eeba74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:26:37 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-ebd7d1b0-7242-43e6-82e9-2f4865acee45 tempest-CreateVolumesFromImageTest-1109030344 None] Flow 'volume_create_manager' (bf42923c-ae55-4543-b39a-e5655413ebd7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:26:37 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-ebd7d1b0-7242-43e6-82e9-2f4865acee45 tempest-CreateVolumesFromImageTest-1109030344 None] Created volume successfully. Sep 29 18:26:38 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-7f913aae-7e05-429d-9b25-f3145d33c6d7 tempest-VolumesImageMetadata-1110495063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9250793-e404-4294-9b6d-47270bfcf49e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be620625-3b47-4348-98fb-44599ec7029d', 'volume_size': 1, 'image_id': 'd8ebca63-1178-4b36-a1a2-e10949cbc87f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d8ebca63-1178-4b36-a1a2-e10949cbc87f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '987aeb00888a4b9bb9954392d91b8741', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd8ebca63-1178-4b36-a1a2-e10949cbc87f', 'created_at': datetime.datetime(2026, 9, 29, 16, 11, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 16, 11, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d8ebca63-1178-4b36-a1a2-e10949cbc87f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:26:38 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-7f913aae-7e05-429d-9b25-f3145d33c6d7 tempest-VolumesImageMetadata-1110495063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f3208d6-4a3a-499e-b328-ff3a4c8f13ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:26:38 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-7f913aae-7e05-429d-9b25-f3145d33c6d7 tempest-VolumesImageMetadata-1110495063 None] Volume volume-be620625-3b47-4348-98fb-44599ec7029d (be620625-3b47-4348-98fb-44599ec7029d): created successfully Sep 29 18:26:38 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-7f913aae-7e05-429d-9b25-f3145d33c6d7 tempest-VolumesImageMetadata-1110495063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f3208d6-4a3a-499e-b328-ff3a4c8f13ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:26:38 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-7f913aae-7e05-429d-9b25-f3145d33c6d7 tempest-VolumesImageMetadata-1110495063 None] Flow 'volume_create_manager' (1619269a-6aea-43ad-b7be-75f09c220552) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:26:38 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-7f913aae-7e05-429d-9b25-f3145d33c6d7 tempest-VolumesImageMetadata-1110495063 None] Created volume successfully. Sep 29 18:26:38 devstack sudo[98208]: pam_unix(sudo:session): session closed for user root Sep 29 18:26:38 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-7cc792ba-7c04-4991-b612-914977618182 tempest-CreateVolumesFromImageTest-1109030344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fac2935b-2b66-49c6-90f7-52e9610b22a5 1073741824" returned: 0 in 0.497s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:26:38 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-7cc792ba-7c04-4991-b612-914977618182 tempest-CreateVolumesFromImageTest-1109030344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fac2935b-2b66-49c6-90f7-52e9610b22a5 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:26:38 devstack sudo[98214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fac2935b-2b66-49c6-90f7-52e9610b22a5 Sep 29 18:26:38 devstack sudo[98214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:26:38 devstack sudo[98214]: pam_unix(sudo:session): session closed for user root Sep 29 18:26:38 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-7cc792ba-7c04-4991-b612-914977618182 tempest-CreateVolumesFromImageTest-1109030344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fac2935b-2b66-49c6-90f7-52e9610b22a5" returned: 0 in 0.253s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:26:38 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-7cc792ba-7c04-4991-b612-914977618182 tempest-CreateVolumesFromImageTest-1109030344 None] <== create_volume: return (848ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'} {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:26:38 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-7cc792ba-7c04-4991-b612-914977618182 tempest-CreateVolumesFromImageTest-1109030344 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.852s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:26:38 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-b7a7be55-5d28-4156-bfc8-13392a719b5c tempest-CreateVolumesFromImageTest-1109030344 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.061s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:26:38 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-b7a7be55-5d28-4156-bfc8-13392a719b5c tempest-CreateVolumesFromImageTest-1109030344 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:26:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-849178194',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd45f3ee-902b-4fa1-a545-4cefebf63968,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4cd845c59af4566b19f24f3c9e6be54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:26:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:26:35Z,use_quota=True,user_id='d71f11f5623c4c7daed625a09e8be04d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)}" {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:26:38 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-b7a7be55-5d28-4156-bfc8-13392a719b5c tempest-CreateVolumesFromImageTest-1109030344 None] Creating volume bd45f3ee-902b-4fa1-a545-4cefebf63968 {{(pid=86512) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:26:38 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-b7a7be55-5d28-4156-bfc8-13392a719b5c tempest-CreateVolumesFromImageTest-1109030344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:26:38 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-b7a7be55-5d28-4156-bfc8-13392a719b5c tempest-CreateVolumesFromImageTest-1109030344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:26:38 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-b7a7be55-5d28-4156-bfc8-13392a719b5c tempest-CreateVolumesFromImageTest-1109030344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:26:38 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-b7a7be55-5d28-4156-bfc8-13392a719b5c tempest-CreateVolumesFromImageTest-1109030344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:26:38 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-b7a7be55-5d28-4156-bfc8-13392a719b5c tempest-CreateVolumesFromImageTest-1109030344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:26:38 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-b7a7be55-5d28-4156-bfc8-13392a719b5c tempest-CreateVolumesFromImageTest-1109030344 None] Selected osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 as target Quobyte volume. {{(pid=86512) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:26:38 devstack cinder-volume[86512]: INFO cinder.volume.drivers.remotefs [None req-b7a7be55-5d28-4156-bfc8-13392a719b5c tempest-CreateVolumesFromImageTest-1109030344 None] casted to osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 Sep 29 18:26:38 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-b7a7be55-5d28-4156-bfc8-13392a719b5c tempest-CreateVolumesFromImageTest-1109030344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-bd45f3ee-902b-4fa1-a545-4cefebf63968 1073741824 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:26:38 devstack sudo[98217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-bd45f3ee-902b-4fa1-a545-4cefebf63968 1073741824 Sep 29 18:26:38 devstack sudo[98217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:26:38 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-7cc792ba-7c04-4991-b612-914977618182 tempest-CreateVolumesFromImageTest-1109030344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a27ccbb-1a99-411f-8ce4-de69286e9df8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fac2935b-2b66-49c6-90f7-52e9610b22a5', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:26:38 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-7cc792ba-7c04-4991-b612-914977618182 tempest-CreateVolumesFromImageTest-1109030344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (374f3452-15e9-450a-9b46-8e03ee668242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:26:38 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-7cc792ba-7c04-4991-b612-914977618182 tempest-CreateVolumesFromImageTest-1109030344 None] Volume volume-fac2935b-2b66-49c6-90f7-52e9610b22a5 (fac2935b-2b66-49c6-90f7-52e9610b22a5): created successfully Sep 29 18:26:38 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-7cc792ba-7c04-4991-b612-914977618182 tempest-CreateVolumesFromImageTest-1109030344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (374f3452-15e9-450a-9b46-8e03ee668242) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:26:38 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-7cc792ba-7c04-4991-b612-914977618182 tempest-CreateVolumesFromImageTest-1109030344 None] Flow 'volume_create_manager' (34fe2299-cf7b-478f-b543-1e9292521d7c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:26:38 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-7cc792ba-7c04-4991-b612-914977618182 tempest-CreateVolumesFromImageTest-1109030344 None] Created volume successfully. Sep 29 18:26:39 devstack sudo[98217]: pam_unix(sudo:session): session closed for user root Sep 29 18:26:39 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-b7a7be55-5d28-4156-bfc8-13392a719b5c tempest-CreateVolumesFromImageTest-1109030344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-bd45f3ee-902b-4fa1-a545-4cefebf63968 1073741824" returned: 0 in 0.562s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:26:39 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-b7a7be55-5d28-4156-bfc8-13392a719b5c tempest-CreateVolumesFromImageTest-1109030344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-bd45f3ee-902b-4fa1-a545-4cefebf63968 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:26:39 devstack sudo[98223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-bd45f3ee-902b-4fa1-a545-4cefebf63968 Sep 29 18:26:39 devstack sudo[98223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:26:39 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-4a1f72e2-e599-4b60-afd1-384b20746415 tempest-VolumesImageMetadata-1110495063 None] Acquiring lock "cinder-be620625-3b47-4348-98fb-44599ec7029d-delete_volume" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:26:39 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-4a1f72e2-e599-4b60-afd1-384b20746415 tempest-VolumesImageMetadata-1110495063 None] Lock "cinder-be620625-3b47-4348-98fb-44599ec7029d-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:26:39 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-4a1f72e2-e599-4b60-afd1-384b20746415 tempest-VolumesImageMetadata-1110495063 None] Acquiring lock "cinder-quobyte-be620625-3b47-4348-98fb-44599ec7029d" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:26:39 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-4a1f72e2-e599-4b60-afd1-384b20746415 tempest-VolumesImageMetadata-1110495063 None] Lock "cinder-quobyte-be620625-3b47-4348-98fb-44599ec7029d" acquired by "delete_volume" :: waited 0.024s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:26:39 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[300cf4f9-074c-49d5-ab72-846cf87572c9]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:26:39 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-4a1f72e2-e599-4b60-afd1-384b20746415 tempest-VolumesImageMetadata-1110495063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-be620625-3b47-4348-98fb-44599ec7029d {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:26:39 devstack sudo[98223]: pam_unix(sudo:session): session closed for user root Sep 29 18:26:39 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-b7a7be55-5d28-4156-bfc8-13392a719b5c tempest-CreateVolumesFromImageTest-1109030344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-bd45f3ee-902b-4fa1-a545-4cefebf63968" returned: 0 in 0.315s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:26:39 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-b7a7be55-5d28-4156-bfc8-13392a719b5c tempest-CreateVolumesFromImageTest-1109030344 None] <== create_volume: return (938ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'} {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:26:39 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-b7a7be55-5d28-4156-bfc8-13392a719b5c tempest-CreateVolumesFromImageTest-1109030344 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.941s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:26:39 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [req-1b538186-ee51-424e-b04d-cadc92cbb7ad req-bae4ec26-b138-4442-b9a4-a8328122dfaf tempest-AttachVolumeNegativeTest-1588161148 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.564s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:26:39 devstack sudo[98225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-be620625-3b47-4348-98fb-44599ec7029d Sep 29 18:26:39 devstack sudo[98225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:26:39 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [req-1b538186-ee51-424e-b04d-cadc92cbb7ad req-bae4ec26-b138-4442-b9a4-a8328122dfaf tempest-AttachVolumeNegativeTest-1588161148 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:26:39 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-b7a7be55-5d28-4156-bfc8-13392a719b5c tempest-CreateVolumesFromImageTest-1109030344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08e1ec98-6a72-42a7-aaaf-c89dd9df77ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd45f3ee-902b-4fa1-a545-4cefebf63968', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:26:39 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-b7a7be55-5d28-4156-bfc8-13392a719b5c tempest-CreateVolumesFromImageTest-1109030344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d86e3772-9ad9-4ba1-948d-772368947d39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:26:39 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-b7a7be55-5d28-4156-bfc8-13392a719b5c tempest-CreateVolumesFromImageTest-1109030344 None] Volume volume-bd45f3ee-902b-4fa1-a545-4cefebf63968 (bd45f3ee-902b-4fa1-a545-4cefebf63968): created successfully Sep 29 18:26:39 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-b7a7be55-5d28-4156-bfc8-13392a719b5c tempest-CreateVolumesFromImageTest-1109030344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d86e3772-9ad9-4ba1-948d-772368947d39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:26:39 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-b7a7be55-5d28-4156-bfc8-13392a719b5c tempest-CreateVolumesFromImageTest-1109030344 None] Flow 'volume_create_manager' (22e71990-25c1-48a4-88e1-c0e817d628bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:26:39 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-b7a7be55-5d28-4156-bfc8-13392a719b5c tempest-CreateVolumesFromImageTest-1109030344 None] Created volume successfully. Sep 29 18:26:39 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [req-1b538186-ee51-424e-b04d-cadc92cbb7ad req-bae4ec26-b138-4442-b9a4-a8328122dfaf tempest-AttachVolumeNegativeTest-1588161148 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883', 'name': 'volume-5de338e3-f797-4f6e-a646-5fc0ca18c6b4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '574eba37-ed4e-4a00-af61-e93db6dcceb5', 'enforce_multipath': True} {{(pid=86512) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 29 18:26:39 devstack cinder-volume[86512]: INFO cinder.volume.manager [req-1b538186-ee51-424e-b04d-cadc92cbb7ad req-bae4ec26-b138-4442-b9a4-a8328122dfaf tempest-AttachVolumeNegativeTest-1588161148 None] attachment_update completed successfully. Sep 29 18:26:39 devstack sudo[98225]: pam_unix(sudo:session): session closed for user root Sep 29 18:26:39 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-4a1f72e2-e599-4b60-afd1-384b20746415 tempest-VolumesImageMetadata-1110495063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-be620625-3b47-4348-98fb-44599ec7029d" returned: 0 in 0.432s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:26:39 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-4a1f72e2-e599-4b60-afd1-384b20746415 tempest-VolumesImageMetadata-1110495063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-be620625-3b47-4348-98fb-44599ec7029d {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:26:39 devstack sudo[98256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-be620625-3b47-4348-98fb-44599ec7029d Sep 29 18:26:39 devstack sudo[98256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:26:40 devstack sudo[98256]: pam_unix(sudo:session): session closed for user root Sep 29 18:26:40 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-4a1f72e2-e599-4b60-afd1-384b20746415 tempest-VolumesImageMetadata-1110495063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-be620625-3b47-4348-98fb-44599ec7029d" returned: 0 in 0.295s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:26:40 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-4a1f72e2-e599-4b60-afd1-384b20746415 tempest-VolumesImageMetadata-1110495063 None] Lock "cinder-quobyte-be620625-3b47-4348-98fb-44599ec7029d" released by "delete_volume" :: held 0.787s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:26:40 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-4a1f72e2-e599-4b60-afd1-384b20746415 tempest-VolumesImageMetadata-1110495063 None] Created reservations ['9bcd50b9-3241-4530-bc80-2438f2d0180f', 'a0535692-9089-45ce-8b31-0447cbf21ff3', 'b8960ca6-a19c-4ca6-8be2-308ee6d29b86', '2aec7c38-559e-4fc3-b294-12a06c7aaae0'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:26:40 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-a9736c6a-9ab8-4a8d-a361-38e57ed41d9e tempest-CreateVolumesFromImageTest-1109030344 None] Acquiring lock "cinder-bd45f3ee-902b-4fa1-a545-4cefebf63968-delete_volume" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:26:40 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-4a1f72e2-e599-4b60-afd1-384b20746415 tempest-VolumesImageMetadata-1110495063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:26:40 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-4a1f72e2-e599-4b60-afd1-384b20746415 tempest-VolumesImageMetadata-1110495063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:26:40 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-4a1f72e2-e599-4b60-afd1-384b20746415 tempest-VolumesImageMetadata-1110495063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:26:40 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-4a1f72e2-e599-4b60-afd1-384b20746415 tempest-VolumesImageMetadata-1110495063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:26:40 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-4a1f72e2-e599-4b60-afd1-384b20746415 tempest-VolumesImageMetadata-1110495063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:26:40 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-4a1f72e2-e599-4b60-afd1-384b20746415 tempest-VolumesImageMetadata-1110495063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:26:40 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-a9736c6a-9ab8-4a8d-a361-38e57ed41d9e tempest-CreateVolumesFromImageTest-1109030344 None] Lock "cinder-bd45f3ee-902b-4fa1-a545-4cefebf63968-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:26:40 devstack sudo[98651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:26:40 devstack sudo[98651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:26:40 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-a9736c6a-9ab8-4a8d-a361-38e57ed41d9e tempest-CreateVolumesFromImageTest-1109030344 None] Acquiring lock "cinder-quobyte-bd45f3ee-902b-4fa1-a545-4cefebf63968" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:26:40 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-a9736c6a-9ab8-4a8d-a361-38e57ed41d9e tempest-CreateVolumesFromImageTest-1109030344 None] Lock "cinder-quobyte-bd45f3ee-902b-4fa1-a545-4cefebf63968" acquired by "delete_volume" :: waited 0.025s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:26:40 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[04fe8339-2a0a-4d57-9613-5a8e017f235f]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:26:40 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a9736c6a-9ab8-4a8d-a361-38e57ed41d9e tempest-CreateVolumesFromImageTest-1109030344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-bd45f3ee-902b-4fa1-a545-4cefebf63968 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:26:40 devstack sudo[98651]: pam_unix(sudo:session): session closed for user root Sep 29 18:26:40 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-4a1f72e2-e599-4b60-afd1-384b20746415 tempest-VolumesImageMetadata-1110495063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.331s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:26:40 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-4a1f72e2-e599-4b60-afd1-384b20746415 tempest-VolumesImageMetadata-1110495063 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:26:40 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-4a1f72e2-e599-4b60-afd1-384b20746415 tempest-VolumesImageMetadata-1110495063 None] Deleted volume successfully. Sep 29 18:26:40 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-4a1f72e2-e599-4b60-afd1-384b20746415 tempest-VolumesImageMetadata-1110495063 None] Lock "cinder-be620625-3b47-4348-98fb-44599ec7029d-delete_volume" released by "delete_volume" :: held 1.411s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:26:40 devstack sudo[98656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-bd45f3ee-902b-4fa1-a545-4cefebf63968 Sep 29 18:26:40 devstack sudo[98656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:26:41 devstack sudo[98656]: pam_unix(sudo:session): session closed for user root Sep 29 18:26:41 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a9736c6a-9ab8-4a8d-a361-38e57ed41d9e tempest-CreateVolumesFromImageTest-1109030344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-bd45f3ee-902b-4fa1-a545-4cefebf63968" returned: 0 in 0.598s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:26:41 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a9736c6a-9ab8-4a8d-a361-38e57ed41d9e tempest-CreateVolumesFromImageTest-1109030344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-bd45f3ee-902b-4fa1-a545-4cefebf63968 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:26:41 devstack sudo[98662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-bd45f3ee-902b-4fa1-a545-4cefebf63968 Sep 29 18:26:41 devstack sudo[98662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:26:41 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-275deee2-ffa3-458b-8eee-6d4c0eaea703 tempest-SnapshotMetadataTestJSON-697562683 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86512) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:26:41 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-275deee2-ffa3-458b-8eee-6d4c0eaea703 tempest-SnapshotMetadataTestJSON-697562683 None] Flow 'volume_create_manager' (81f427c9-b878-413e-a815-a2b0d60df355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:26:41 devstack sudo[98662]: pam_unix(sudo:session): session closed for user root Sep 29 18:26:41 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-275deee2-ffa3-458b-8eee-6d4c0eaea703 tempest-SnapshotMetadataTestJSON-697562683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83780d03-7c29-4092-b87e-16a2b822b453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:26:41 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a9736c6a-9ab8-4a8d-a361-38e57ed41d9e tempest-CreateVolumesFromImageTest-1109030344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-bd45f3ee-902b-4fa1-a545-4cefebf63968" returned: 0 in 0.298s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:26:41 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-275deee2-ffa3-458b-8eee-6d4c0eaea703 tempest-SnapshotMetadataTestJSON-697562683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83780d03-7c29-4092-b87e-16a2b822b453) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:26:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1669701420',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a359324d-18fe-4bfe-acca-49b79b6b5b56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24380ba0b78e414ebd69f121a15ef04d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:26:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:26:41Z,use_quota=True,user_id='f98a05224ea947a8b8af73e57fdfa655',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:26:41 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-275deee2-ffa3-458b-8eee-6d4c0eaea703 tempest-SnapshotMetadataTestJSON-697562683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c21bbfa7-fb87-4cc1-9169-9643c4e0bc56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:26:41 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-275deee2-ffa3-458b-8eee-6d4c0eaea703 tempest-SnapshotMetadataTestJSON-697562683 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c21bbfa7-fb87-4cc1-9169-9643c4e0bc56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:26:41 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-275deee2-ffa3-458b-8eee-6d4c0eaea703 tempest-SnapshotMetadataTestJSON-697562683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d037c81c-3d88-474f-8b93-82c163e18c7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:26:41 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-275deee2-ffa3-458b-8eee-6d4c0eaea703 tempest-SnapshotMetadataTestJSON-697562683 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d037c81c-3d88-474f-8b93-82c163e18c7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a359324d-18fe-4bfe-acca-49b79b6b5b56', 'volume_name': 'volume-a359324d-18fe-4bfe-acca-49b79b6b5b56', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:26:41 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-275deee2-ffa3-458b-8eee-6d4c0eaea703 tempest-SnapshotMetadataTestJSON-697562683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ec43063-9aa4-4c36-8b95-c5abae298862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:26:41 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-275deee2-ffa3-458b-8eee-6d4c0eaea703 tempest-SnapshotMetadataTestJSON-697562683 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ec43063-9aa4-4c36-8b95-c5abae298862) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:26:41 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-275deee2-ffa3-458b-8eee-6d4c0eaea703 tempest-SnapshotMetadataTestJSON-697562683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca19d0e9-6f2d-444a-9f63-835d4bad9838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:26:41 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-275deee2-ffa3-458b-8eee-6d4c0eaea703 tempest-SnapshotMetadataTestJSON-697562683 None] Volume a359324d-18fe-4bfe-acca-49b79b6b5b56: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a359324d-18fe-4bfe-acca-49b79b6b5b56', 'volume_size': 1} Sep 29 18:26:41 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-275deee2-ffa3-458b-8eee-6d4c0eaea703 tempest-SnapshotMetadataTestJSON-697562683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:26:41 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-275deee2-ffa3-458b-8eee-6d4c0eaea703 tempest-SnapshotMetadataTestJSON-697562683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:26:41 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-275deee2-ffa3-458b-8eee-6d4c0eaea703 tempest-SnapshotMetadataTestJSON-697562683 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:26:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1669701420',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a359324d-18fe-4bfe-acca-49b79b6b5b56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24380ba0b78e414ebd69f121a15ef04d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:26:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:26:41Z,use_quota=True,user_id='f98a05224ea947a8b8af73e57fdfa655',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)}" {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:26:41 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-275deee2-ffa3-458b-8eee-6d4c0eaea703 tempest-SnapshotMetadataTestJSON-697562683 None] Creating volume a359324d-18fe-4bfe-acca-49b79b6b5b56 {{(pid=86512) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:26:41 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-275deee2-ffa3-458b-8eee-6d4c0eaea703 tempest-SnapshotMetadataTestJSON-697562683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:26:41 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-275deee2-ffa3-458b-8eee-6d4c0eaea703 tempest-SnapshotMetadataTestJSON-697562683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:26:41 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-275deee2-ffa3-458b-8eee-6d4c0eaea703 tempest-SnapshotMetadataTestJSON-697562683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:26:41 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-275deee2-ffa3-458b-8eee-6d4c0eaea703 tempest-SnapshotMetadataTestJSON-697562683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:26:41 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-275deee2-ffa3-458b-8eee-6d4c0eaea703 tempest-SnapshotMetadataTestJSON-697562683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:26:41 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-275deee2-ffa3-458b-8eee-6d4c0eaea703 tempest-SnapshotMetadataTestJSON-697562683 None] Selected osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 as target Quobyte volume. {{(pid=86512) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:26:41 devstack cinder-volume[86512]: INFO cinder.volume.drivers.remotefs [None req-275deee2-ffa3-458b-8eee-6d4c0eaea703 tempest-SnapshotMetadataTestJSON-697562683 None] casted to osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 Sep 29 18:26:41 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-275deee2-ffa3-458b-8eee-6d4c0eaea703 tempest-SnapshotMetadataTestJSON-697562683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a359324d-18fe-4bfe-acca-49b79b6b5b56 1073741824 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:26:41 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-a9736c6a-9ab8-4a8d-a361-38e57ed41d9e tempest-CreateVolumesFromImageTest-1109030344 None] Lock "cinder-quobyte-bd45f3ee-902b-4fa1-a545-4cefebf63968" released by "delete_volume" :: held 1.058s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:26:41 devstack sudo[98665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a359324d-18fe-4bfe-acca-49b79b6b5b56 1073741824 Sep 29 18:26:41 devstack sudo[98665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:26:41 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-a9736c6a-9ab8-4a8d-a361-38e57ed41d9e tempest-CreateVolumesFromImageTest-1109030344 None] Created reservations ['1098fc06-70a9-4630-923d-6cd6b22cf356', '8bd45b4e-3e74-4360-9df9-10147e8d2165', '89f23fae-4622-42e8-b3e7-1efe10fe285b', '1626495a-9f73-4dd3-b7e0-ee4f20d42a88'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:26:41 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-a9736c6a-9ab8-4a8d-a361-38e57ed41d9e tempest-CreateVolumesFromImageTest-1109030344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:26:41 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-a9736c6a-9ab8-4a8d-a361-38e57ed41d9e tempest-CreateVolumesFromImageTest-1109030344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:26:41 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-a9736c6a-9ab8-4a8d-a361-38e57ed41d9e tempest-CreateVolumesFromImageTest-1109030344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:26:41 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-a9736c6a-9ab8-4a8d-a361-38e57ed41d9e tempest-CreateVolumesFromImageTest-1109030344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:26:41 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-a9736c6a-9ab8-4a8d-a361-38e57ed41d9e tempest-CreateVolumesFromImageTest-1109030344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:26:41 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a9736c6a-9ab8-4a8d-a361-38e57ed41d9e tempest-CreateVolumesFromImageTest-1109030344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:26:41 devstack sudo[98667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:26:41 devstack sudo[98667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:26:42 devstack sudo[98667]: pam_unix(sudo:session): session closed for user root Sep 29 18:26:42 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a9736c6a-9ab8-4a8d-a361-38e57ed41d9e tempest-CreateVolumesFromImageTest-1109030344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.342s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:26:42 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-a9736c6a-9ab8-4a8d-a361-38e57ed41d9e tempest-CreateVolumesFromImageTest-1109030344 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:26:42 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-a9736c6a-9ab8-4a8d-a361-38e57ed41d9e tempest-CreateVolumesFromImageTest-1109030344 None] Deleted volume successfully. Sep 29 18:26:42 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-a9736c6a-9ab8-4a8d-a361-38e57ed41d9e tempest-CreateVolumesFromImageTest-1109030344 None] Lock "cinder-bd45f3ee-902b-4fa1-a545-4cefebf63968-delete_volume" released by "delete_volume" :: held 1.694s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:26:42 devstack sudo[98665]: pam_unix(sudo:session): session closed for user root Sep 29 18:26:42 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-275deee2-ffa3-458b-8eee-6d4c0eaea703 tempest-SnapshotMetadataTestJSON-697562683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a359324d-18fe-4bfe-acca-49b79b6b5b56 1073741824" returned: 0 in 0.646s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:26:42 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-275deee2-ffa3-458b-8eee-6d4c0eaea703 tempest-SnapshotMetadataTestJSON-697562683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a359324d-18fe-4bfe-acca-49b79b6b5b56 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:26:42 devstack sudo[98674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a359324d-18fe-4bfe-acca-49b79b6b5b56 Sep 29 18:26:42 devstack sudo[98674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:26:42 devstack sudo[98674]: pam_unix(sudo:session): session closed for user root Sep 29 18:26:42 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-275deee2-ffa3-458b-8eee-6d4c0eaea703 tempest-SnapshotMetadataTestJSON-697562683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a359324d-18fe-4bfe-acca-49b79b6b5b56" returned: 0 in 0.325s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:26:42 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-275deee2-ffa3-458b-8eee-6d4c0eaea703 tempest-SnapshotMetadataTestJSON-697562683 None] <== create_volume: return (1022ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'} {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:26:42 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-275deee2-ffa3-458b-8eee-6d4c0eaea703 tempest-SnapshotMetadataTestJSON-697562683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.029s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:26:42 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-275deee2-ffa3-458b-8eee-6d4c0eaea703 tempest-SnapshotMetadataTestJSON-697562683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca19d0e9-6f2d-444a-9f63-835d4bad9838) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a359324d-18fe-4bfe-acca-49b79b6b5b56', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:26:42 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-275deee2-ffa3-458b-8eee-6d4c0eaea703 tempest-SnapshotMetadataTestJSON-697562683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c57e27ab-a45c-45b8-b8a9-7d602ae37161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:26:42 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-275deee2-ffa3-458b-8eee-6d4c0eaea703 tempest-SnapshotMetadataTestJSON-697562683 None] Volume volume-a359324d-18fe-4bfe-acca-49b79b6b5b56 (a359324d-18fe-4bfe-acca-49b79b6b5b56): created successfully Sep 29 18:26:42 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-275deee2-ffa3-458b-8eee-6d4c0eaea703 tempest-SnapshotMetadataTestJSON-697562683 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c57e27ab-a45c-45b8-b8a9-7d602ae37161) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:26:42 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-275deee2-ffa3-458b-8eee-6d4c0eaea703 tempest-SnapshotMetadataTestJSON-697562683 None] Flow 'volume_create_manager' (81f427c9-b878-413e-a815-a2b0d60df355) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:26:42 devstack cinder-volume[86512]: INFO cinder.volume.manager [req-dedd46de-f126-4c4d-b3ec-a9a6401f183e req-f8badf99-f6a2-4f71-8024-b4ef0ee5ef40 tempest-AttachVolumeNegativeTest-1588161148 None] Terminate volume connection completed successfully. Sep 29 18:26:42 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [req-dedd46de-f126-4c4d-b3ec-a9a6401f183e req-f8badf99-f6a2-4f71-8024-b4ef0ee5ef40 tempest-AttachVolumeNegativeTest-1588161148 None] Deleting attachment 574eba37-ed4e-4a00-af61-e93db6dcceb5. {{(pid=86512) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 29 18:26:42 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-275deee2-ffa3-458b-8eee-6d4c0eaea703 tempest-SnapshotMetadataTestJSON-697562683 None] Created volume successfully. Sep 29 18:26:42 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-5affc278-2ed9-4cb1-9b93-a5f1d1760772 tempest-CreateVolumesFromImageTest-1109030344 None] Acquiring lock "cinder-fac2935b-2b66-49c6-90f7-52e9610b22a5-delete_volume" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:26:42 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-5affc278-2ed9-4cb1-9b93-a5f1d1760772 tempest-CreateVolumesFromImageTest-1109030344 None] Lock "cinder-fac2935b-2b66-49c6-90f7-52e9610b22a5-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:26:42 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-5affc278-2ed9-4cb1-9b93-a5f1d1760772 tempest-CreateVolumesFromImageTest-1109030344 None] Acquiring lock "cinder-quobyte-fac2935b-2b66-49c6-90f7-52e9610b22a5" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:26:42 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-5affc278-2ed9-4cb1-9b93-a5f1d1760772 tempest-CreateVolumesFromImageTest-1109030344 None] Lock "cinder-quobyte-fac2935b-2b66-49c6-90f7-52e9610b22a5" acquired by "delete_volume" :: waited 0.021s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:26:42 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[90083b1f-9020-4a33-855d-188bdb1c5dd8]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:26:42 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-5affc278-2ed9-4cb1-9b93-a5f1d1760772 tempest-CreateVolumesFromImageTest-1109030344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fac2935b-2b66-49c6-90f7-52e9610b22a5 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:26:43 devstack sudo[98740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fac2935b-2b66-49c6-90f7-52e9610b22a5 Sep 29 18:26:43 devstack sudo[98740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:26:43 devstack sudo[98740]: pam_unix(sudo:session): session closed for user root Sep 29 18:26:43 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-5affc278-2ed9-4cb1-9b93-a5f1d1760772 tempest-CreateVolumesFromImageTest-1109030344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fac2935b-2b66-49c6-90f7-52e9610b22a5" returned: 0 in 0.559s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:26:43 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-5affc278-2ed9-4cb1-9b93-a5f1d1760772 tempest-CreateVolumesFromImageTest-1109030344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fac2935b-2b66-49c6-90f7-52e9610b22a5 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:26:43 devstack sudo[98747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fac2935b-2b66-49c6-90f7-52e9610b22a5 Sep 29 18:26:43 devstack sudo[98747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:26:43 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-3a198c56-3b77-47a7-a7ce-062a238ec0e6 tempest-SnapshotMetadataTestJSON-697562683 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:26:43 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-3a198c56-3b77-47a7-a7ce-062a238ec0e6 tempest-SnapshotMetadataTestJSON-697562683 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:26:43 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-3a198c56-3b77-47a7-a7ce-062a238ec0e6 tempest-SnapshotMetadataTestJSON-697562683 None] Creating offline snapshot 2ce5bd80-7fc3-4533-963f-147f8a9f8b88 of volume a359324d-18fe-4bfe-acca-49b79b6b5b56 {{(pid=86512) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 18:26:43 devstack sudo[98747]: pam_unix(sudo:session): session closed for user root Sep 29 18:26:43 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-5affc278-2ed9-4cb1-9b93-a5f1d1760772 tempest-CreateVolumesFromImageTest-1109030344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fac2935b-2b66-49c6-90f7-52e9610b22a5" returned: 0 in 0.364s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:26:43 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[0238a8fb-ae6d-4119-921f-9f3784c703bb]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:26:43 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-3a198c56-3b77-47a7-a7ce-062a238ec0e6 tempest-SnapshotMetadataTestJSON-697562683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a359324d-18fe-4bfe-acca-49b79b6b5b56 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:26:43 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-5affc278-2ed9-4cb1-9b93-a5f1d1760772 tempest-CreateVolumesFromImageTest-1109030344 None] Lock "cinder-quobyte-fac2935b-2b66-49c6-90f7-52e9610b22a5" released by "delete_volume" :: held 1.005s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:26:43 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-5affc278-2ed9-4cb1-9b93-a5f1d1760772 tempest-CreateVolumesFromImageTest-1109030344 None] Created reservations ['9462ed2b-3b3a-430d-b1a9-21b03f5f13d3', '7b943b8b-b956-4906-978c-9149435599cc', '865aa702-b8e5-4815-af90-568ba30b45e1', 'f6d16dab-010f-4c1a-b3b7-81a447915080'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:26:43 devstack sudo[98754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a359324d-18fe-4bfe-acca-49b79b6b5b56 Sep 29 18:26:44 devstack sudo[98754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:26:44 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-5affc278-2ed9-4cb1-9b93-a5f1d1760772 tempest-CreateVolumesFromImageTest-1109030344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:26:44 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-5affc278-2ed9-4cb1-9b93-a5f1d1760772 tempest-CreateVolumesFromImageTest-1109030344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:26:44 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-5affc278-2ed9-4cb1-9b93-a5f1d1760772 tempest-CreateVolumesFromImageTest-1109030344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:26:44 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-5affc278-2ed9-4cb1-9b93-a5f1d1760772 tempest-CreateVolumesFromImageTest-1109030344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:26:44 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-5affc278-2ed9-4cb1-9b93-a5f1d1760772 tempest-CreateVolumesFromImageTest-1109030344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:26:44 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-5affc278-2ed9-4cb1-9b93-a5f1d1760772 tempest-CreateVolumesFromImageTest-1109030344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:26:44 devstack sudo[98771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:26:44 devstack sudo[98771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:26:44 devstack sudo[98754]: pam_unix(sudo:session): session closed for user root Sep 29 18:26:44 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-3a198c56-3b77-47a7-a7ce-062a238ec0e6 tempest-SnapshotMetadataTestJSON-697562683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a359324d-18fe-4bfe-acca-49b79b6b5b56" returned: 0 in 0.582s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:26:44 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-3a198c56-3b77-47a7-a7ce-062a238ec0e6 tempest-SnapshotMetadataTestJSON-697562683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a359324d-18fe-4bfe-acca-49b79b6b5b56,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a359324d-18fe-4bfe-acca-49b79b6b5b56.2ce5bd80-7fc3-4533-963f-147f8a9f8b88 1G {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:26:44 devstack sudo[98781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a359324d-18fe-4bfe-acca-49b79b6b5b56,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a359324d-18fe-4bfe-acca-49b79b6b5b56.2ce5bd80-7fc3-4533-963f-147f8a9f8b88 1G Sep 29 18:26:44 devstack sudo[98781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:26:44 devstack sudo[98771]: pam_unix(sudo:session): session closed for user root Sep 29 18:26:44 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-5affc278-2ed9-4cb1-9b93-a5f1d1760772 tempest-CreateVolumesFromImageTest-1109030344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.342s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:26:44 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-5affc278-2ed9-4cb1-9b93-a5f1d1760772 tempest-CreateVolumesFromImageTest-1109030344 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:26:44 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-5affc278-2ed9-4cb1-9b93-a5f1d1760772 tempest-CreateVolumesFromImageTest-1109030344 None] Deleted volume successfully. Sep 29 18:26:44 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-5affc278-2ed9-4cb1-9b93-a5f1d1760772 tempest-CreateVolumesFromImageTest-1109030344 None] Lock "cinder-fac2935b-2b66-49c6-90f7-52e9610b22a5-delete_volume" released by "delete_volume" :: held 1.801s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:26:45 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-e1a6230e-e232-4471-9ae7-f3d6228ced83 tempest-CreateVolumesFromImageTest-1109030344 None] Acquiring lock "cinder-50d9375e-1fdd-4bf1-8315-4615098767ba-delete_volume" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:26:45 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-e1a6230e-e232-4471-9ae7-f3d6228ced83 tempest-CreateVolumesFromImageTest-1109030344 None] Lock "cinder-50d9375e-1fdd-4bf1-8315-4615098767ba-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:26:45 devstack sudo[98781]: pam_unix(sudo:session): session closed for user root Sep 29 18:26:45 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-3a198c56-3b77-47a7-a7ce-062a238ec0e6 tempest-SnapshotMetadataTestJSON-697562683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a359324d-18fe-4bfe-acca-49b79b6b5b56,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a359324d-18fe-4bfe-acca-49b79b6b5b56.2ce5bd80-7fc3-4533-963f-147f8a9f8b88 1G" returned: 0 in 0.709s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:26:45 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-3a198c56-3b77-47a7-a7ce-062a238ec0e6 tempest-SnapshotMetadataTestJSON-697562683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a359324d-18fe-4bfe-acca-49b79b6b5b56 -F qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a359324d-18fe-4bfe-acca-49b79b6b5b56.2ce5bd80-7fc3-4533-963f-147f8a9f8b88 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:26:45 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-e1a6230e-e232-4471-9ae7-f3d6228ced83 tempest-CreateVolumesFromImageTest-1109030344 None] Acquiring lock "cinder-quobyte-50d9375e-1fdd-4bf1-8315-4615098767ba" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:26:45 devstack sudo[98789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a359324d-18fe-4bfe-acca-49b79b6b5b56 -F qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a359324d-18fe-4bfe-acca-49b79b6b5b56.2ce5bd80-7fc3-4533-963f-147f8a9f8b88 Sep 29 18:26:45 devstack sudo[98789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:26:45 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-e1a6230e-e232-4471-9ae7-f3d6228ced83 tempest-CreateVolumesFromImageTest-1109030344 None] Lock "cinder-quobyte-50d9375e-1fdd-4bf1-8315-4615098767ba" acquired by "delete_volume" :: waited 0.030s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:26:45 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e755d97-11d9-451c-b3c7-fb50a5919489]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:26:45 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-e1a6230e-e232-4471-9ae7-f3d6228ced83 tempest-CreateVolumesFromImageTest-1109030344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-50d9375e-1fdd-4bf1-8315-4615098767ba {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:26:45 devstack sudo[98792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-50d9375e-1fdd-4bf1-8315-4615098767ba Sep 29 18:26:45 devstack sudo[98792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:26:45 devstack sudo[98789]: pam_unix(sudo:session): session closed for user root Sep 29 18:26:45 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-3a198c56-3b77-47a7-a7ce-062a238ec0e6 tempest-SnapshotMetadataTestJSON-697562683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a359324d-18fe-4bfe-acca-49b79b6b5b56 -F qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a359324d-18fe-4bfe-acca-49b79b6b5b56.2ce5bd80-7fc3-4533-963f-147f8a9f8b88" returned: 0 in 0.377s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:26:45 devstack cinder-volume[86512]: WARNING cinder.volume.drivers.remotefs [None req-3a198c56-3b77-47a7-a7ce-062a238ec0e6 tempest-SnapshotMetadataTestJSON-697562683 None] /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a359324d-18fe-4bfe-acca-49b79b6b5b56.2ce5bd80-7fc3-4533-963f-147f8a9f8b88 is being set with open permissions: ugo+rw Sep 29 18:26:45 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-3a198c56-3b77-47a7-a7ce-062a238ec0e6 tempest-SnapshotMetadataTestJSON-697562683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a359324d-18fe-4bfe-acca-49b79b6b5b56.2ce5bd80-7fc3-4533-963f-147f8a9f8b88 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:26:45 devstack sudo[98797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a359324d-18fe-4bfe-acca-49b79b6b5b56.2ce5bd80-7fc3-4533-963f-147f8a9f8b88 Sep 29 18:26:45 devstack sudo[98797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:26:45 devstack sudo[98792]: pam_unix(sudo:session): session closed for user root Sep 29 18:26:45 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-e1a6230e-e232-4471-9ae7-f3d6228ced83 tempest-CreateVolumesFromImageTest-1109030344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-50d9375e-1fdd-4bf1-8315-4615098767ba" returned: 0 in 0.537s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:26:45 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-e1a6230e-e232-4471-9ae7-f3d6228ced83 tempest-CreateVolumesFromImageTest-1109030344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-50d9375e-1fdd-4bf1-8315-4615098767ba {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:26:45 devstack sudo[98803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-50d9375e-1fdd-4bf1-8315-4615098767ba Sep 29 18:26:45 devstack sudo[98803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:26:45 devstack sudo[98797]: pam_unix(sudo:session): session closed for user root Sep 29 18:26:45 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-3a198c56-3b77-47a7-a7ce-062a238ec0e6 tempest-SnapshotMetadataTestJSON-697562683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a359324d-18fe-4bfe-acca-49b79b6b5b56.2ce5bd80-7fc3-4533-963f-147f8a9f8b88" returned: 0 in 0.408s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:26:45 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-3a198c56-3b77-47a7-a7ce-062a238ec0e6 tempest-SnapshotMetadataTestJSON-697562683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a359324d-18fe-4bfe-acca-49b79b6b5b56.info {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:26:45 devstack sudo[98806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a359324d-18fe-4bfe-acca-49b79b6b5b56.info Sep 29 18:26:45 devstack sudo[98806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:26:46 devstack sudo[98803]: pam_unix(sudo:session): session closed for user root Sep 29 18:26:46 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ed4698f-8784-4254-9d9f-8d6ef28cc83e tempest-VolumesDeleteCascade-158504705 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86512) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:26:46 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-3ed4698f-8784-4254-9d9f-8d6ef28cc83e tempest-VolumesDeleteCascade-158504705 None] Flow 'volume_create_manager' (fca201a6-7119-4e2e-8964-6526787ef006) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:26:46 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-3ed4698f-8784-4254-9d9f-8d6ef28cc83e tempest-VolumesDeleteCascade-158504705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13097a23-e07a-482b-8cb9-43447c327b7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:26:46 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-e1a6230e-e232-4471-9ae7-f3d6228ced83 tempest-CreateVolumesFromImageTest-1109030344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-50d9375e-1fdd-4bf1-8315-4615098767ba" returned: 0 in 0.413s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:26:46 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-3ed4698f-8784-4254-9d9f-8d6ef28cc83e tempest-VolumesDeleteCascade-158504705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13097a23-e07a-482b-8cb9-43447c327b7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:26:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1602243563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11d5f1ae-8fe8-4425-a5d6-de66ff8fc974,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='770f4f6aa0164efb80a3486ba3336f27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:26:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:26:46Z,use_quota=True,user_id='ad8c28a474f747ac82720337dd0cac9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:26:46 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-3ed4698f-8784-4254-9d9f-8d6ef28cc83e tempest-VolumesDeleteCascade-158504705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c345874-5c93-45d7-8aa6-37ef89fdb47f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:26:46 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-3ed4698f-8784-4254-9d9f-8d6ef28cc83e tempest-VolumesDeleteCascade-158504705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c345874-5c93-45d7-8aa6-37ef89fdb47f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:26:46 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-3ed4698f-8784-4254-9d9f-8d6ef28cc83e tempest-VolumesDeleteCascade-158504705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4afac3b2-b08c-490a-ba3f-5c9e829826d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:26:46 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-3ed4698f-8784-4254-9d9f-8d6ef28cc83e tempest-VolumesDeleteCascade-158504705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4afac3b2-b08c-490a-ba3f-5c9e829826d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11d5f1ae-8fe8-4425-a5d6-de66ff8fc974', 'volume_name': 'volume-11d5f1ae-8fe8-4425-a5d6-de66ff8fc974', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:26:46 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-3ed4698f-8784-4254-9d9f-8d6ef28cc83e tempest-VolumesDeleteCascade-158504705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76dd1e9f-5a8a-4fc1-9a4d-8b112e9c92b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:26:46 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-3ed4698f-8784-4254-9d9f-8d6ef28cc83e tempest-VolumesDeleteCascade-158504705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76dd1e9f-5a8a-4fc1-9a4d-8b112e9c92b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:26:46 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-3ed4698f-8784-4254-9d9f-8d6ef28cc83e tempest-VolumesDeleteCascade-158504705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54bac358-7aaf-4632-adb6-75d093a18843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:26:46 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-3ed4698f-8784-4254-9d9f-8d6ef28cc83e tempest-VolumesDeleteCascade-158504705 None] Volume 11d5f1ae-8fe8-4425-a5d6-de66ff8fc974: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11d5f1ae-8fe8-4425-a5d6-de66ff8fc974', 'volume_size': 1} Sep 29 18:26:46 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-3ed4698f-8784-4254-9d9f-8d6ef28cc83e tempest-VolumesDeleteCascade-158504705 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:26:46 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-e1a6230e-e232-4471-9ae7-f3d6228ced83 tempest-CreateVolumesFromImageTest-1109030344 None] Lock "cinder-quobyte-50d9375e-1fdd-4bf1-8315-4615098767ba" released by "delete_volume" :: held 1.096s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:26:46 devstack sudo[98806]: pam_unix(sudo:session): session closed for user root Sep 29 18:26:46 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-3a198c56-3b77-47a7-a7ce-062a238ec0e6 tempest-SnapshotMetadataTestJSON-697562683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a359324d-18fe-4bfe-acca-49b79b6b5b56.info" returned: 0 in 0.384s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:26:46 devstack cinder-volume[86512]: WARNING cinder.volume.drivers.remotefs [None req-3a198c56-3b77-47a7-a7ce-062a238ec0e6 tempest-SnapshotMetadataTestJSON-697562683 None] /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a359324d-18fe-4bfe-acca-49b79b6b5b56.info is being set with open permissions: ugo+rw Sep 29 18:26:46 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-3a198c56-3b77-47a7-a7ce-062a238ec0e6 tempest-SnapshotMetadataTestJSON-697562683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a359324d-18fe-4bfe-acca-49b79b6b5b56.info {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:26:46 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-e1a6230e-e232-4471-9ae7-f3d6228ced83 tempest-CreateVolumesFromImageTest-1109030344 None] Created reservations ['df8cd1cf-5ca3-4b6e-a5a5-9bb6c5997d1a', '877f66ff-8398-4bfb-bcf6-57638e1c3fbe', 'a85866c9-f13a-4b40-9a95-e830483a6411', '80099aa6-6c3a-459d-b860-d165195e365a'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:26:46 devstack sudo[98810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a359324d-18fe-4bfe-acca-49b79b6b5b56.info Sep 29 18:26:46 devstack sudo[98810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:26:46 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-e1a6230e-e232-4471-9ae7-f3d6228ced83 tempest-CreateVolumesFromImageTest-1109030344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:26:46 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-e1a6230e-e232-4471-9ae7-f3d6228ced83 tempest-CreateVolumesFromImageTest-1109030344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:26:46 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-e1a6230e-e232-4471-9ae7-f3d6228ced83 tempest-CreateVolumesFromImageTest-1109030344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:26:46 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-e1a6230e-e232-4471-9ae7-f3d6228ced83 tempest-CreateVolumesFromImageTest-1109030344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:26:46 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-e1a6230e-e232-4471-9ae7-f3d6228ced83 tempest-CreateVolumesFromImageTest-1109030344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:26:46 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-e1a6230e-e232-4471-9ae7-f3d6228ced83 tempest-CreateVolumesFromImageTest-1109030344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:26:46 devstack sudo[98812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:26:46 devstack sudo[98812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:26:46 devstack sudo[98810]: pam_unix(sudo:session): session closed for user root Sep 29 18:26:46 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-3a198c56-3b77-47a7-a7ce-062a238ec0e6 tempest-SnapshotMetadataTestJSON-697562683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a359324d-18fe-4bfe-acca-49b79b6b5b56.info" returned: 0 in 0.293s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:26:46 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-3a198c56-3b77-47a7-a7ce-062a238ec0e6 tempest-SnapshotMetadataTestJSON-697562683 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.916s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:26:46 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-3ed4698f-8784-4254-9d9f-8d6ef28cc83e tempest-VolumesDeleteCascade-158504705 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.401s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:26:46 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-3ed4698f-8784-4254-9d9f-8d6ef28cc83e tempest-VolumesDeleteCascade-158504705 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:26:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1602243563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11d5f1ae-8fe8-4425-a5d6-de66ff8fc974,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='770f4f6aa0164efb80a3486ba3336f27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:26:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:26:46Z,use_quota=True,user_id='ad8c28a474f747ac82720337dd0cac9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)}" {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:26:46 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-3ed4698f-8784-4254-9d9f-8d6ef28cc83e tempest-VolumesDeleteCascade-158504705 None] Creating volume 11d5f1ae-8fe8-4425-a5d6-de66ff8fc974 {{(pid=86512) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:26:46 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-3ed4698f-8784-4254-9d9f-8d6ef28cc83e tempest-VolumesDeleteCascade-158504705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:26:46 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-3ed4698f-8784-4254-9d9f-8d6ef28cc83e tempest-VolumesDeleteCascade-158504705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:26:46 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-3ed4698f-8784-4254-9d9f-8d6ef28cc83e tempest-VolumesDeleteCascade-158504705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:26:46 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-3ed4698f-8784-4254-9d9f-8d6ef28cc83e tempest-VolumesDeleteCascade-158504705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:26:46 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-3ed4698f-8784-4254-9d9f-8d6ef28cc83e tempest-VolumesDeleteCascade-158504705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:26:46 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-3ed4698f-8784-4254-9d9f-8d6ef28cc83e tempest-VolumesDeleteCascade-158504705 None] Selected osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 as target Quobyte volume. {{(pid=86512) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:26:46 devstack cinder-volume[86512]: INFO cinder.volume.drivers.remotefs [None req-3ed4698f-8784-4254-9d9f-8d6ef28cc83e tempest-VolumesDeleteCascade-158504705 None] casted to osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 Sep 29 18:26:46 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-3ed4698f-8784-4254-9d9f-8d6ef28cc83e tempest-VolumesDeleteCascade-158504705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-11d5f1ae-8fe8-4425-a5d6-de66ff8fc974 1073741824 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:26:46 devstack sudo[98812]: pam_unix(sudo:session): session closed for user root Sep 29 18:26:46 devstack sudo[98816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-11d5f1ae-8fe8-4425-a5d6-de66ff8fc974 1073741824 Sep 29 18:26:46 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-e1a6230e-e232-4471-9ae7-f3d6228ced83 tempest-CreateVolumesFromImageTest-1109030344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.268s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:26:46 devstack sudo[98816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:26:46 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-e1a6230e-e232-4471-9ae7-f3d6228ced83 tempest-CreateVolumesFromImageTest-1109030344 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:26:46 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-3a198c56-3b77-47a7-a7ce-062a238ec0e6 tempest-SnapshotMetadataTestJSON-697562683 None] Create snapshot completed successfully Sep 29 18:26:46 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-e1a6230e-e232-4471-9ae7-f3d6228ced83 tempest-CreateVolumesFromImageTest-1109030344 None] Deleted volume successfully. Sep 29 18:26:46 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-e1a6230e-e232-4471-9ae7-f3d6228ced83 tempest-CreateVolumesFromImageTest-1109030344 None] Lock "cinder-50d9375e-1fdd-4bf1-8315-4615098767ba-delete_volume" released by "delete_volume" :: held 1.667s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:26:47 devstack sudo[98816]: pam_unix(sudo:session): session closed for user root Sep 29 18:26:47 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-3ed4698f-8784-4254-9d9f-8d6ef28cc83e tempest-VolumesDeleteCascade-158504705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-11d5f1ae-8fe8-4425-a5d6-de66ff8fc974 1073741824" returned: 0 in 0.480s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:26:47 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-3ed4698f-8784-4254-9d9f-8d6ef28cc83e tempest-VolumesDeleteCascade-158504705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-11d5f1ae-8fe8-4425-a5d6-de66ff8fc974 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:26:47 devstack sudo[98822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-11d5f1ae-8fe8-4425-a5d6-de66ff8fc974 Sep 29 18:26:47 devstack sudo[98822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:26:47 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-cf7f6769-890d-4f82-8c2a-91d9eb65243a tempest-CreateVolumesFromImageTest-1109030344 None] Acquiring lock "cinder-44a3ce75-6d8b-49a8-bec4-f179c41b9422-delete_volume" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:26:47 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-cf7f6769-890d-4f82-8c2a-91d9eb65243a tempest-CreateVolumesFromImageTest-1109030344 None] Lock "cinder-44a3ce75-6d8b-49a8-bec4-f179c41b9422-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:26:47 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-cf7f6769-890d-4f82-8c2a-91d9eb65243a tempest-CreateVolumesFromImageTest-1109030344 None] Acquiring lock "cinder-quobyte-44a3ce75-6d8b-49a8-bec4-f179c41b9422" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:26:47 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-cf7f6769-890d-4f82-8c2a-91d9eb65243a tempest-CreateVolumesFromImageTest-1109030344 None] Lock "cinder-quobyte-44a3ce75-6d8b-49a8-bec4-f179c41b9422" acquired by "delete_volume" :: waited 0.028s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:26:47 devstack sudo[98822]: pam_unix(sudo:session): session closed for user root Sep 29 18:26:47 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-3ed4698f-8784-4254-9d9f-8d6ef28cc83e tempest-VolumesDeleteCascade-158504705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-11d5f1ae-8fe8-4425-a5d6-de66ff8fc974" returned: 0 in 0.297s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:26:47 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-3ed4698f-8784-4254-9d9f-8d6ef28cc83e tempest-VolumesDeleteCascade-158504705 None] <== create_volume: return (817ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'} {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:26:47 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-3ed4698f-8784-4254-9d9f-8d6ef28cc83e tempest-VolumesDeleteCascade-158504705 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.822s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:26:47 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[58111c09-219c-4736-8886-cb4d5e9084a1]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:26:47 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-cf7f6769-890d-4f82-8c2a-91d9eb65243a tempest-CreateVolumesFromImageTest-1109030344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-44a3ce75-6d8b-49a8-bec4-f179c41b9422 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:26:47 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-3ed4698f-8784-4254-9d9f-8d6ef28cc83e tempest-VolumesDeleteCascade-158504705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54bac358-7aaf-4632-adb6-75d093a18843) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11d5f1ae-8fe8-4425-a5d6-de66ff8fc974', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:26:47 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-3ed4698f-8784-4254-9d9f-8d6ef28cc83e tempest-VolumesDeleteCascade-158504705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b94add87-ddef-401a-b132-d29a23cba24f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:26:47 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-3ed4698f-8784-4254-9d9f-8d6ef28cc83e tempest-VolumesDeleteCascade-158504705 None] Volume volume-11d5f1ae-8fe8-4425-a5d6-de66ff8fc974 (11d5f1ae-8fe8-4425-a5d6-de66ff8fc974): created successfully Sep 29 18:26:47 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-3ed4698f-8784-4254-9d9f-8d6ef28cc83e tempest-VolumesDeleteCascade-158504705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b94add87-ddef-401a-b132-d29a23cba24f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:26:47 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-3ed4698f-8784-4254-9d9f-8d6ef28cc83e tempest-VolumesDeleteCascade-158504705 None] Flow 'volume_create_manager' (fca201a6-7119-4e2e-8964-6526787ef006) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:26:47 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-3ed4698f-8784-4254-9d9f-8d6ef28cc83e tempest-VolumesDeleteCascade-158504705 None] Created volume successfully. Sep 29 18:26:47 devstack sudo[98825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-44a3ce75-6d8b-49a8-bec4-f179c41b9422 Sep 29 18:26:47 devstack sudo[98825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:26:47 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-796d3334-a10c-4c67-b3da-a957d64be70b tempest-SnapshotMetadataTestJSON-697562683 None] Acquiring lock "cinder-2ce5bd80-7fc3-4533-963f-147f8a9f8b88-delete_snapshot" by "delete_snapshot" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:26:47 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-796d3334-a10c-4c67-b3da-a957d64be70b tempest-SnapshotMetadataTestJSON-697562683 None] Lock "cinder-2ce5bd80-7fc3-4533-963f-147f8a9f8b88-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:26:47 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-796d3334-a10c-4c67-b3da-a957d64be70b tempest-SnapshotMetadataTestJSON-697562683 None] Acquiring lock "cinder-quobyte-a359324d-18fe-4bfe-acca-49b79b6b5b56" by "delete_snapshot" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:26:47 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-796d3334-a10c-4c67-b3da-a957d64be70b tempest-SnapshotMetadataTestJSON-697562683 None] Lock "cinder-quobyte-a359324d-18fe-4bfe-acca-49b79b6b5b56" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:26:47 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-796d3334-a10c-4c67-b3da-a957d64be70b tempest-SnapshotMetadataTestJSON-697562683 None] Acquiring lock "cinder-quobyte-2ce5bd80-7fc3-4533-963f-147f8a9f8b88" by "_delete_snapshot" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:26:47 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-796d3334-a10c-4c67-b3da-a957d64be70b tempest-SnapshotMetadataTestJSON-697562683 None] Lock "cinder-quobyte-2ce5bd80-7fc3-4533-963f-147f8a9f8b88" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:26:47 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-796d3334-a10c-4c67-b3da-a957d64be70b tempest-SnapshotMetadataTestJSON-697562683 None] Deleting offline snapshot 2ce5bd80-7fc3-4533-963f-147f8a9f8b88 of volume a359324d-18fe-4bfe-acca-49b79b6b5b56 {{(pid=86512) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 18:26:47 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-796d3334-a10c-4c67-b3da-a957d64be70b tempest-SnapshotMetadataTestJSON-697562683 None] snapshot_file for this snap is: volume-a359324d-18fe-4bfe-acca-49b79b6b5b56.2ce5bd80-7fc3-4533-963f-147f8a9f8b88 {{(pid=86512) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 18:26:47 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[6785b5e9-ec96-41f9-9abe-b2c3d839c851]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:26:47 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-796d3334-a10c-4c67-b3da-a957d64be70b tempest-SnapshotMetadataTestJSON-697562683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a359324d-18fe-4bfe-acca-49b79b6b5b56.2ce5bd80-7fc3-4533-963f-147f8a9f8b88 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:26:47 devstack sudo[98825]: pam_unix(sudo:session): session closed for user root Sep 29 18:26:47 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-cf7f6769-890d-4f82-8c2a-91d9eb65243a tempest-CreateVolumesFromImageTest-1109030344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-44a3ce75-6d8b-49a8-bec4-f179c41b9422" returned: 0 in 0.474s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:26:47 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-cf7f6769-890d-4f82-8c2a-91d9eb65243a tempest-CreateVolumesFromImageTest-1109030344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-44a3ce75-6d8b-49a8-bec4-f179c41b9422 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:26:48 devstack sudo[98831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-44a3ce75-6d8b-49a8-bec4-f179c41b9422 Sep 29 18:26:48 devstack sudo[98831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:26:48 devstack sudo[98830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a359324d-18fe-4bfe-acca-49b79b6b5b56.2ce5bd80-7fc3-4533-963f-147f8a9f8b88 Sep 29 18:26:48 devstack sudo[98830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:26:48 devstack sudo[98831]: pam_unix(sudo:session): session closed for user root Sep 29 18:26:48 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-cf7f6769-890d-4f82-8c2a-91d9eb65243a tempest-CreateVolumesFromImageTest-1109030344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-44a3ce75-6d8b-49a8-bec4-f179c41b9422" returned: 0 in 0.307s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:26:48 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-cf7f6769-890d-4f82-8c2a-91d9eb65243a tempest-CreateVolumesFromImageTest-1109030344 None] Lock "cinder-quobyte-44a3ce75-6d8b-49a8-bec4-f179c41b9422" released by "delete_volume" :: held 0.845s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:26:48 devstack sudo[98830]: pam_unix(sudo:session): session closed for user root Sep 29 18:26:48 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-796d3334-a10c-4c67-b3da-a957d64be70b tempest-SnapshotMetadataTestJSON-697562683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a359324d-18fe-4bfe-acca-49b79b6b5b56.2ce5bd80-7fc3-4533-963f-147f8a9f8b88" returned: 0 in 0.452s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:26:48 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-796d3334-a10c-4c67-b3da-a957d64be70b tempest-SnapshotMetadataTestJSON-697562683 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a359324d-18fe-4bfe-acca-49b79b6b5b56(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86512) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 18:26:48 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-cf7f6769-890d-4f82-8c2a-91d9eb65243a tempest-CreateVolumesFromImageTest-1109030344 None] Created reservations ['c8d0b3c0-09bf-4821-aa48-6fbf8eaa46df', 'f5290d2a-7bf8-4a3e-97c3-2c73c24ab1eb', 'c89c10ea-a955-4a80-b97b-423bb5fff1ca', 'a6eafcf9-a698-4882-8c67-ab7f549da6a3'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:26:48 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[77672823-3563-4468-b081-c1e032db1bab]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:26:48 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-796d3334-a10c-4c67-b3da-a957d64be70b tempest-SnapshotMetadataTestJSON-697562683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a359324d-18fe-4bfe-acca-49b79b6b5b56 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:26:48 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-9027a7dc-f7fe-46a8-b3bd-97431538b9e7 tempest-VolumesDeleteCascade-158504705 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:26:48 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-9027a7dc-f7fe-46a8-b3bd-97431538b9e7 tempest-VolumesDeleteCascade-158504705 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:26:48 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-9027a7dc-f7fe-46a8-b3bd-97431538b9e7 tempest-VolumesDeleteCascade-158504705 None] Creating offline snapshot c77318bd-0324-47ba-9824-577fa5aa531a of volume 11d5f1ae-8fe8-4425-a5d6-de66ff8fc974 {{(pid=86512) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 18:26:48 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[2084bce1-cd6c-48fa-a4b0-2193532490d9]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:26:48 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-9027a7dc-f7fe-46a8-b3bd-97431538b9e7 tempest-VolumesDeleteCascade-158504705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-11d5f1ae-8fe8-4425-a5d6-de66ff8fc974 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:26:48 devstack sudo[98838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a359324d-18fe-4bfe-acca-49b79b6b5b56 Sep 29 18:26:48 devstack sudo[98838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:26:48 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-cf7f6769-890d-4f82-8c2a-91d9eb65243a tempest-CreateVolumesFromImageTest-1109030344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:26:48 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-cf7f6769-890d-4f82-8c2a-91d9eb65243a tempest-CreateVolumesFromImageTest-1109030344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:26:48 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-cf7f6769-890d-4f82-8c2a-91d9eb65243a tempest-CreateVolumesFromImageTest-1109030344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:26:48 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-cf7f6769-890d-4f82-8c2a-91d9eb65243a tempest-CreateVolumesFromImageTest-1109030344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:26:48 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-cf7f6769-890d-4f82-8c2a-91d9eb65243a tempest-CreateVolumesFromImageTest-1109030344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:26:48 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-cf7f6769-890d-4f82-8c2a-91d9eb65243a tempest-CreateVolumesFromImageTest-1109030344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:26:48 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-3c5796bf-c3cf-4fa9-af90-4744777d8359 tempest-CreateVolumesFromImageTest-1109030344 None] Acquiring lock "cinder-7a44b345-958e-4b23-9110-280c927a57c5-delete_volume" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:26:48 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-3c5796bf-c3cf-4fa9-af90-4744777d8359 tempest-CreateVolumesFromImageTest-1109030344 None] Lock "cinder-7a44b345-958e-4b23-9110-280c927a57c5-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:26:48 devstack sudo[98841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:26:48 devstack sudo[98841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:26:48 devstack sudo[98839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-11d5f1ae-8fe8-4425-a5d6-de66ff8fc974 Sep 29 18:26:48 devstack sudo[98839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:26:48 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-3c5796bf-c3cf-4fa9-af90-4744777d8359 tempest-CreateVolumesFromImageTest-1109030344 None] Acquiring lock "cinder-quobyte-7a44b345-958e-4b23-9110-280c927a57c5" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:26:48 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-3c5796bf-c3cf-4fa9-af90-4744777d8359 tempest-CreateVolumesFromImageTest-1109030344 None] Lock "cinder-quobyte-7a44b345-958e-4b23-9110-280c927a57c5" acquired by "delete_volume" :: waited 0.023s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:26:48 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[29a60b70-5cb7-48ce-b85d-f31ff36b982a]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:26:48 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-3c5796bf-c3cf-4fa9-af90-4744777d8359 tempest-CreateVolumesFromImageTest-1109030344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7a44b345-958e-4b23-9110-280c927a57c5 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:26:48 devstack sudo[98841]: pam_unix(sudo:session): session closed for user root Sep 29 18:26:48 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-cf7f6769-890d-4f82-8c2a-91d9eb65243a tempest-CreateVolumesFromImageTest-1109030344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.350s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:26:48 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-cf7f6769-890d-4f82-8c2a-91d9eb65243a tempest-CreateVolumesFromImageTest-1109030344 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:26:48 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-cf7f6769-890d-4f82-8c2a-91d9eb65243a tempest-CreateVolumesFromImageTest-1109030344 None] Deleted volume successfully. Sep 29 18:26:49 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-cf7f6769-890d-4f82-8c2a-91d9eb65243a tempest-CreateVolumesFromImageTest-1109030344 None] Lock "cinder-44a3ce75-6d8b-49a8-bec4-f179c41b9422-delete_volume" released by "delete_volume" :: held 1.628s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:26:49 devstack sudo[98844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7a44b345-958e-4b23-9110-280c927a57c5 Sep 29 18:26:49 devstack sudo[98844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:26:49 devstack sudo[98838]: pam_unix(sudo:session): session closed for user root Sep 29 18:26:49 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-796d3334-a10c-4c67-b3da-a957d64be70b tempest-SnapshotMetadataTestJSON-697562683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a359324d-18fe-4bfe-acca-49b79b6b5b56" returned: 0 in 0.605s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:26:49 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-796d3334-a10c-4c67-b3da-a957d64be70b tempest-SnapshotMetadataTestJSON-697562683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a359324d-18fe-4bfe-acca-49b79b6b5b56.2ce5bd80-7fc3-4533-963f-147f8a9f8b88 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:26:49 devstack sudo[98850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a359324d-18fe-4bfe-acca-49b79b6b5b56.2ce5bd80-7fc3-4533-963f-147f8a9f8b88 Sep 29 18:26:49 devstack sudo[98850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:26:49 devstack sudo[98839]: pam_unix(sudo:session): session closed for user root Sep 29 18:26:49 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-9027a7dc-f7fe-46a8-b3bd-97431538b9e7 tempest-VolumesDeleteCascade-158504705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-11d5f1ae-8fe8-4425-a5d6-de66ff8fc974" returned: 0 in 0.624s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:26:49 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-9027a7dc-f7fe-46a8-b3bd-97431538b9e7 tempest-VolumesDeleteCascade-158504705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-11d5f1ae-8fe8-4425-a5d6-de66ff8fc974,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-11d5f1ae-8fe8-4425-a5d6-de66ff8fc974.c77318bd-0324-47ba-9824-577fa5aa531a 1G {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:26:49 devstack sudo[98855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-11d5f1ae-8fe8-4425-a5d6-de66ff8fc974,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-11d5f1ae-8fe8-4425-a5d6-de66ff8fc974.c77318bd-0324-47ba-9824-577fa5aa531a 1G Sep 29 18:26:49 devstack sudo[98855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:26:49 devstack sudo[98844]: pam_unix(sudo:session): session closed for user root Sep 29 18:26:49 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-3c5796bf-c3cf-4fa9-af90-4744777d8359 tempest-CreateVolumesFromImageTest-1109030344 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7a44b345-958e-4b23-9110-280c927a57c5" returned: 0 in 0.540s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:26:49 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-3c5796bf-c3cf-4fa9-af90-4744777d8359 tempest-CreateVolumesFromImageTest-1109030344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7a44b345-958e-4b23-9110-280c927a57c5 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:26:49 devstack sudo[98864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7a44b345-958e-4b23-9110-280c927a57c5 Sep 29 18:26:49 devstack sudo[98864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:26:49 devstack sudo[98850]: pam_unix(sudo:session): session closed for user root Sep 29 18:26:49 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-796d3334-a10c-4c67-b3da-a957d64be70b tempest-SnapshotMetadataTestJSON-697562683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a359324d-18fe-4bfe-acca-49b79b6b5b56.2ce5bd80-7fc3-4533-963f-147f8a9f8b88" returned: 0 in 0.425s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:26:49 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-796d3334-a10c-4c67-b3da-a957d64be70b tempest-SnapshotMetadataTestJSON-697562683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a359324d-18fe-4bfe-acca-49b79b6b5b56.2ce5bd80-7fc3-4533-963f-147f8a9f8b88 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:26:49 devstack sudo[98867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a359324d-18fe-4bfe-acca-49b79b6b5b56.2ce5bd80-7fc3-4533-963f-147f8a9f8b88 Sep 29 18:26:49 devstack sudo[98867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:26:49 devstack sudo[98864]: pam_unix(sudo:session): session closed for user root Sep 29 18:26:49 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-3c5796bf-c3cf-4fa9-af90-4744777d8359 tempest-CreateVolumesFromImageTest-1109030344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7a44b345-958e-4b23-9110-280c927a57c5" returned: 0 in 0.324s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:26:49 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-3c5796bf-c3cf-4fa9-af90-4744777d8359 tempest-CreateVolumesFromImageTest-1109030344 None] Lock "cinder-quobyte-7a44b345-958e-4b23-9110-280c927a57c5" released by "delete_volume" :: held 0.935s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:26:49 devstack sudo[98855]: pam_unix(sudo:session): session closed for user root Sep 29 18:26:49 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-9027a7dc-f7fe-46a8-b3bd-97431538b9e7 tempest-VolumesDeleteCascade-158504705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-11d5f1ae-8fe8-4425-a5d6-de66ff8fc974,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-11d5f1ae-8fe8-4425-a5d6-de66ff8fc974.c77318bd-0324-47ba-9824-577fa5aa531a 1G" returned: 0 in 0.565s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:26:49 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-9027a7dc-f7fe-46a8-b3bd-97431538b9e7 tempest-VolumesDeleteCascade-158504705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11d5f1ae-8fe8-4425-a5d6-de66ff8fc974 -F qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-11d5f1ae-8fe8-4425-a5d6-de66ff8fc974.c77318bd-0324-47ba-9824-577fa5aa531a {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:26:49 devstack sudo[98874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11d5f1ae-8fe8-4425-a5d6-de66ff8fc974 -F qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-11d5f1ae-8fe8-4425-a5d6-de66ff8fc974.c77318bd-0324-47ba-9824-577fa5aa531a Sep 29 18:26:49 devstack sudo[98874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:26:49 devstack sudo[98867]: pam_unix(sudo:session): session closed for user root Sep 29 18:26:49 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-796d3334-a10c-4c67-b3da-a957d64be70b tempest-SnapshotMetadataTestJSON-697562683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a359324d-18fe-4bfe-acca-49b79b6b5b56.2ce5bd80-7fc3-4533-963f-147f8a9f8b88" returned: 0 in 0.319s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:26:49 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-3c5796bf-c3cf-4fa9-af90-4744777d8359 tempest-CreateVolumesFromImageTest-1109030344 None] Created reservations ['081a9c5d-ac23-4dec-b94a-e157bb602586', '62553707-48e8-4548-91c2-63e688853b19', 'e13db3fc-c9e8-4ae0-8b6c-70cd604d4fd6', 'fee106e9-2d1e-41c1-afb3-e76176e43285'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:26:49 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-796d3334-a10c-4c67-b3da-a957d64be70b tempest-SnapshotMetadataTestJSON-697562683 None] Lock "cinder-quobyte-2ce5bd80-7fc3-4533-963f-147f8a9f8b88" released by "_delete_snapshot" :: held 1.966s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:26:49 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-796d3334-a10c-4c67-b3da-a957d64be70b tempest-SnapshotMetadataTestJSON-697562683 None] Lock "cinder-quobyte-a359324d-18fe-4bfe-acca-49b79b6b5b56" released by "delete_snapshot" :: held 2.014s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:26:49 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-3c5796bf-c3cf-4fa9-af90-4744777d8359 tempest-CreateVolumesFromImageTest-1109030344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:26:49 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-3c5796bf-c3cf-4fa9-af90-4744777d8359 tempest-CreateVolumesFromImageTest-1109030344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:26:49 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-3c5796bf-c3cf-4fa9-af90-4744777d8359 tempest-CreateVolumesFromImageTest-1109030344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:26:49 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-3c5796bf-c3cf-4fa9-af90-4744777d8359 tempest-CreateVolumesFromImageTest-1109030344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:26:49 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-3c5796bf-c3cf-4fa9-af90-4744777d8359 tempest-CreateVolumesFromImageTest-1109030344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:26:49 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-3c5796bf-c3cf-4fa9-af90-4744777d8359 tempest-CreateVolumesFromImageTest-1109030344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:26:49 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-796d3334-a10c-4c67-b3da-a957d64be70b tempest-SnapshotMetadataTestJSON-697562683 None] Created reservations ['9270fc89-b6ff-4db1-a7d8-5684b4dabf29', 'db422234-9ba7-4c8a-9fbc-04fa78919c4c', '61b7f6d8-6457-4922-9259-211086349e75', 'f786a717-0c37-4c55-8aa9-888ff2f40811'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:26:49 devstack sudo[98876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:26:49 devstack sudo[98876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:26:50 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-796d3334-a10c-4c67-b3da-a957d64be70b tempest-SnapshotMetadataTestJSON-697562683 None] Delete snapshot completed successfully. Sep 29 18:26:50 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-796d3334-a10c-4c67-b3da-a957d64be70b tempest-SnapshotMetadataTestJSON-697562683 None] Lock "cinder-2ce5bd80-7fc3-4533-963f-147f8a9f8b88-delete_snapshot" released by "delete_snapshot" :: held 2.253s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:26:50 devstack sudo[98874]: pam_unix(sudo:session): session closed for user root Sep 29 18:26:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-9027a7dc-f7fe-46a8-b3bd-97431538b9e7 tempest-VolumesDeleteCascade-158504705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11d5f1ae-8fe8-4425-a5d6-de66ff8fc974 -F qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-11d5f1ae-8fe8-4425-a5d6-de66ff8fc974.c77318bd-0324-47ba-9824-577fa5aa531a" returned: 0 in 0.406s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:26:50 devstack cinder-volume[86512]: WARNING cinder.volume.drivers.remotefs [None req-9027a7dc-f7fe-46a8-b3bd-97431538b9e7 tempest-VolumesDeleteCascade-158504705 None] /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-11d5f1ae-8fe8-4425-a5d6-de66ff8fc974.c77318bd-0324-47ba-9824-577fa5aa531a is being set with open permissions: ugo+rw Sep 29 18:26:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-9027a7dc-f7fe-46a8-b3bd-97431538b9e7 tempest-VolumesDeleteCascade-158504705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-11d5f1ae-8fe8-4425-a5d6-de66ff8fc974.c77318bd-0324-47ba-9824-577fa5aa531a {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:26:50 devstack sudo[98882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-11d5f1ae-8fe8-4425-a5d6-de66ff8fc974.c77318bd-0324-47ba-9824-577fa5aa531a Sep 29 18:26:50 devstack sudo[98882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:26:50 devstack sudo[98876]: pam_unix(sudo:session): session closed for user root Sep 29 18:26:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-3c5796bf-c3cf-4fa9-af90-4744777d8359 tempest-CreateVolumesFromImageTest-1109030344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.278s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:26:50 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-3c5796bf-c3cf-4fa9-af90-4744777d8359 tempest-CreateVolumesFromImageTest-1109030344 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:26:50 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-3c5796bf-c3cf-4fa9-af90-4744777d8359 tempest-CreateVolumesFromImageTest-1109030344 None] Deleted volume successfully. Sep 29 18:26:50 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-3c5796bf-c3cf-4fa9-af90-4744777d8359 tempest-CreateVolumesFromImageTest-1109030344 None] Lock "cinder-7a44b345-958e-4b23-9110-280c927a57c5-delete_volume" released by "delete_volume" :: held 1.630s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:26:50 devstack sudo[98882]: pam_unix(sudo:session): session closed for user root Sep 29 18:26:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-9027a7dc-f7fe-46a8-b3bd-97431538b9e7 tempest-VolumesDeleteCascade-158504705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-11d5f1ae-8fe8-4425-a5d6-de66ff8fc974.c77318bd-0324-47ba-9824-577fa5aa531a" returned: 0 in 0.265s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:26:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-9027a7dc-f7fe-46a8-b3bd-97431538b9e7 tempest-VolumesDeleteCascade-158504705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-11d5f1ae-8fe8-4425-a5d6-de66ff8fc974.info {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:26:50 devstack sudo[98886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-11d5f1ae-8fe8-4425-a5d6-de66ff8fc974.info Sep 29 18:26:50 devstack sudo[98886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:26:50 devstack cinder-volume[86512]: DEBUG oslo_service.periodic_task [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86512) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 18:26:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:26:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:26:50 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:26:50 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:26:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:26:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:26:50 devstack sudo[98889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:26:50 devstack sudo[98889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:26:50 devstack sudo[98886]: pam_unix(sudo:session): session closed for user root Sep 29 18:26:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-9027a7dc-f7fe-46a8-b3bd-97431538b9e7 tempest-VolumesDeleteCascade-158504705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-11d5f1ae-8fe8-4425-a5d6-de66ff8fc974.info" returned: 0 in 0.265s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:26:50 devstack cinder-volume[86512]: WARNING cinder.volume.drivers.remotefs [None req-9027a7dc-f7fe-46a8-b3bd-97431538b9e7 tempest-VolumesDeleteCascade-158504705 None] /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-11d5f1ae-8fe8-4425-a5d6-de66ff8fc974.info is being set with open permissions: ugo+rw Sep 29 18:26:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-9027a7dc-f7fe-46a8-b3bd-97431538b9e7 tempest-VolumesDeleteCascade-158504705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-11d5f1ae-8fe8-4425-a5d6-de66ff8fc974.info {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:26:50 devstack sudo[98891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-11d5f1ae-8fe8-4425-a5d6-de66ff8fc974.info Sep 29 18:26:50 devstack sudo[98891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:26:50 devstack sudo[98889]: pam_unix(sudo:session): session closed for user root Sep 29 18:26:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.261s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:26:50 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:26:50 devstack cinder-volume[86512]: DEBUG oslo_service.periodic_task [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Running periodic task VolumeManager._thread_info {{(pid=86512) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 18:26:50 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] thread count: 28 {{(pid=86512) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 29 18:26:50 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] thread info: [<_MainThread(MainThread, started 135593654804608)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86512) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 29 18:26:50 devstack sudo[98891]: pam_unix(sudo:session): session closed for user root Sep 29 18:26:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-9027a7dc-f7fe-46a8-b3bd-97431538b9e7 tempest-VolumesDeleteCascade-158504705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-11d5f1ae-8fe8-4425-a5d6-de66ff8fc974.info" returned: 0 in 0.277s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:26:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-9027a7dc-f7fe-46a8-b3bd-97431538b9e7 tempest-VolumesDeleteCascade-158504705 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.534s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:26:51 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-9027a7dc-f7fe-46a8-b3bd-97431538b9e7 tempest-VolumesDeleteCascade-158504705 None] Create snapshot completed successfully Sep 29 18:26:51 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-5415961c-44a1-4082-bb63-828d69f569a6 tempest-SnapshotMetadataTestJSON-697562683 None] Acquiring lock "cinder-a359324d-18fe-4bfe-acca-49b79b6b5b56-delete_volume" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:26:51 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-5415961c-44a1-4082-bb63-828d69f569a6 tempest-SnapshotMetadataTestJSON-697562683 None] Lock "cinder-a359324d-18fe-4bfe-acca-49b79b6b5b56-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:26:51 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-5415961c-44a1-4082-bb63-828d69f569a6 tempest-SnapshotMetadataTestJSON-697562683 None] Acquiring lock "cinder-quobyte-a359324d-18fe-4bfe-acca-49b79b6b5b56" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:26:51 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-5415961c-44a1-4082-bb63-828d69f569a6 tempest-SnapshotMetadataTestJSON-697562683 None] Lock "cinder-quobyte-a359324d-18fe-4bfe-acca-49b79b6b5b56" acquired by "delete_volume" :: waited 0.025s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:26:51 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0d0c1e4-b3a7-4696-8d5b-8a6c61d1d08a]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:26:51 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-5415961c-44a1-4082-bb63-828d69f569a6 tempest-SnapshotMetadataTestJSON-697562683 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a359324d-18fe-4bfe-acca-49b79b6b5b56 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:26:51 devstack sudo[98895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a359324d-18fe-4bfe-acca-49b79b6b5b56 Sep 29 18:26:51 devstack sudo[98895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:26:51 devstack sudo[98895]: pam_unix(sudo:session): session closed for user root Sep 29 18:26:51 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-5415961c-44a1-4082-bb63-828d69f569a6 tempest-SnapshotMetadataTestJSON-697562683 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a359324d-18fe-4bfe-acca-49b79b6b5b56" returned: 0 in 0.435s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:26:51 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-5415961c-44a1-4082-bb63-828d69f569a6 tempest-SnapshotMetadataTestJSON-697562683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a359324d-18fe-4bfe-acca-49b79b6b5b56 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:26:51 devstack sudo[98900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a359324d-18fe-4bfe-acca-49b79b6b5b56 Sep 29 18:26:51 devstack sudo[98900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:26:51 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-7956d90f-3b7b-4ad3-96b1-848a03c8fe82 tempest-VolumesDeleteCascade-158504705 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:26:51 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-7956d90f-3b7b-4ad3-96b1-848a03c8fe82 tempest-VolumesDeleteCascade-158504705 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:26:51 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-7956d90f-3b7b-4ad3-96b1-848a03c8fe82 tempest-VolumesDeleteCascade-158504705 None] Creating offline snapshot 0abe0f77-2d67-417b-a861-fb704b4719b6 of volume 11d5f1ae-8fe8-4425-a5d6-de66ff8fc974 {{(pid=86512) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 18:26:51 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[7100187c-0f75-424c-b126-e800700dc355]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:26:51 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-7956d90f-3b7b-4ad3-96b1-848a03c8fe82 tempest-VolumesDeleteCascade-158504705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-11d5f1ae-8fe8-4425-a5d6-de66ff8fc974.c77318bd-0324-47ba-9824-577fa5aa531a {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:26:52 devstack sudo[98903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-11d5f1ae-8fe8-4425-a5d6-de66ff8fc974.c77318bd-0324-47ba-9824-577fa5aa531a Sep 29 18:26:52 devstack sudo[98903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:26:52 devstack sudo[98900]: pam_unix(sudo:session): session closed for user root Sep 29 18:26:52 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-5415961c-44a1-4082-bb63-828d69f569a6 tempest-SnapshotMetadataTestJSON-697562683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a359324d-18fe-4bfe-acca-49b79b6b5b56" returned: 0 in 0.425s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:26:52 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-5415961c-44a1-4082-bb63-828d69f569a6 tempest-SnapshotMetadataTestJSON-697562683 None] Lock "cinder-quobyte-a359324d-18fe-4bfe-acca-49b79b6b5b56" released by "delete_volume" :: held 0.953s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:26:52 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-5415961c-44a1-4082-bb63-828d69f569a6 tempest-SnapshotMetadataTestJSON-697562683 None] Created reservations ['fde66c53-45f4-417a-8bbe-91ef296d2009', '81036055-de0d-4c32-87e2-b309c3f584e2', 'acbe7e70-519b-4f2e-9834-ee426ad5637e', 'f8ad26aa-5bcb-4a57-acd9-387ec8c186af'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:26:52 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-5415961c-44a1-4082-bb63-828d69f569a6 tempest-SnapshotMetadataTestJSON-697562683 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:26:52 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-5415961c-44a1-4082-bb63-828d69f569a6 tempest-SnapshotMetadataTestJSON-697562683 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:26:52 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-5415961c-44a1-4082-bb63-828d69f569a6 tempest-SnapshotMetadataTestJSON-697562683 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:26:52 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-5415961c-44a1-4082-bb63-828d69f569a6 tempest-SnapshotMetadataTestJSON-697562683 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:26:52 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-5415961c-44a1-4082-bb63-828d69f569a6 tempest-SnapshotMetadataTestJSON-697562683 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:26:52 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-5415961c-44a1-4082-bb63-828d69f569a6 tempest-SnapshotMetadataTestJSON-697562683 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:26:52 devstack sudo[98910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:26:52 devstack sudo[98910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:26:52 devstack sudo[98903]: pam_unix(sudo:session): session closed for user root Sep 29 18:26:52 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-7956d90f-3b7b-4ad3-96b1-848a03c8fe82 tempest-VolumesDeleteCascade-158504705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-11d5f1ae-8fe8-4425-a5d6-de66ff8fc974.c77318bd-0324-47ba-9824-577fa5aa531a" returned: 0 in 0.487s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:26:52 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-7956d90f-3b7b-4ad3-96b1-848a03c8fe82 tempest-VolumesDeleteCascade-158504705 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-11d5f1ae-8fe8-4425-a5d6-de66ff8fc974(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86512) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 18:26:52 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-7956d90f-3b7b-4ad3-96b1-848a03c8fe82 tempest-VolumesDeleteCascade-158504705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-11d5f1ae-8fe8-4425-a5d6-de66ff8fc974.c77318bd-0324-47ba-9824-577fa5aa531a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-11d5f1ae-8fe8-4425-a5d6-de66ff8fc974.0abe0f77-2d67-417b-a861-fb704b4719b6 1G {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:26:52 devstack sudo[98913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-11d5f1ae-8fe8-4425-a5d6-de66ff8fc974.c77318bd-0324-47ba-9824-577fa5aa531a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-11d5f1ae-8fe8-4425-a5d6-de66ff8fc974.0abe0f77-2d67-417b-a861-fb704b4719b6 1G Sep 29 18:26:52 devstack sudo[98913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:26:52 devstack sudo[98910]: pam_unix(sudo:session): session closed for user root Sep 29 18:26:52 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-5415961c-44a1-4082-bb63-828d69f569a6 tempest-SnapshotMetadataTestJSON-697562683 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.299s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:26:52 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-5415961c-44a1-4082-bb63-828d69f569a6 tempest-SnapshotMetadataTestJSON-697562683 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:26:52 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-5415961c-44a1-4082-bb63-828d69f569a6 tempest-SnapshotMetadataTestJSON-697562683 None] Deleted volume successfully. Sep 29 18:26:52 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-5415961c-44a1-4082-bb63-828d69f569a6 tempest-SnapshotMetadataTestJSON-697562683 None] Lock "cinder-a359324d-18fe-4bfe-acca-49b79b6b5b56-delete_volume" released by "delete_volume" :: held 1.595s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:26:53 devstack sudo[98913]: pam_unix(sudo:session): session closed for user root Sep 29 18:26:53 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-7956d90f-3b7b-4ad3-96b1-848a03c8fe82 tempest-VolumesDeleteCascade-158504705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-11d5f1ae-8fe8-4425-a5d6-de66ff8fc974.c77318bd-0324-47ba-9824-577fa5aa531a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-11d5f1ae-8fe8-4425-a5d6-de66ff8fc974.0abe0f77-2d67-417b-a861-fb704b4719b6 1G" returned: 0 in 0.585s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:26:53 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-7956d90f-3b7b-4ad3-96b1-848a03c8fe82 tempest-VolumesDeleteCascade-158504705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11d5f1ae-8fe8-4425-a5d6-de66ff8fc974.c77318bd-0324-47ba-9824-577fa5aa531a -F qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-11d5f1ae-8fe8-4425-a5d6-de66ff8fc974.0abe0f77-2d67-417b-a861-fb704b4719b6 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:26:53 devstack sudo[98920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11d5f1ae-8fe8-4425-a5d6-de66ff8fc974.c77318bd-0324-47ba-9824-577fa5aa531a -F qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-11d5f1ae-8fe8-4425-a5d6-de66ff8fc974.0abe0f77-2d67-417b-a861-fb704b4719b6 Sep 29 18:26:53 devstack sudo[98920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:26:53 devstack sudo[98920]: pam_unix(sudo:session): session closed for user root Sep 29 18:26:53 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-7956d90f-3b7b-4ad3-96b1-848a03c8fe82 tempest-VolumesDeleteCascade-158504705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11d5f1ae-8fe8-4425-a5d6-de66ff8fc974.c77318bd-0324-47ba-9824-577fa5aa531a -F qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-11d5f1ae-8fe8-4425-a5d6-de66ff8fc974.0abe0f77-2d67-417b-a861-fb704b4719b6" returned: 0 in 0.414s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:26:53 devstack cinder-volume[86512]: WARNING cinder.volume.drivers.remotefs [None req-7956d90f-3b7b-4ad3-96b1-848a03c8fe82 tempest-VolumesDeleteCascade-158504705 None] /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-11d5f1ae-8fe8-4425-a5d6-de66ff8fc974.0abe0f77-2d67-417b-a861-fb704b4719b6 is being set with open permissions: ugo+rw Sep 29 18:26:53 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-7956d90f-3b7b-4ad3-96b1-848a03c8fe82 tempest-VolumesDeleteCascade-158504705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-11d5f1ae-8fe8-4425-a5d6-de66ff8fc974.0abe0f77-2d67-417b-a861-fb704b4719b6 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:26:53 devstack sudo[98925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-11d5f1ae-8fe8-4425-a5d6-de66ff8fc974.0abe0f77-2d67-417b-a861-fb704b4719b6 Sep 29 18:26:53 devstack sudo[98925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:26:53 devstack sudo[98925]: pam_unix(sudo:session): session closed for user root Sep 29 18:26:53 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-7956d90f-3b7b-4ad3-96b1-848a03c8fe82 tempest-VolumesDeleteCascade-158504705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-11d5f1ae-8fe8-4425-a5d6-de66ff8fc974.0abe0f77-2d67-417b-a861-fb704b4719b6" returned: 0 in 0.414s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:26:53 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-7956d90f-3b7b-4ad3-96b1-848a03c8fe82 tempest-VolumesDeleteCascade-158504705 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.067s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:26:54 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-7956d90f-3b7b-4ad3-96b1-848a03c8fe82 tempest-VolumesDeleteCascade-158504705 None] Create snapshot completed successfully Sep 29 18:26:54 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3fcb219-740f-4aa5-a2e9-d8698894535f tempest-CreateVolumesFromSnapshotTest-515199839 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86512) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:26:54 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d3fcb219-740f-4aa5-a2e9-d8698894535f tempest-CreateVolumesFromSnapshotTest-515199839 None] Flow 'volume_create_manager' (9195369d-0af5-4d74-84c8-d3a16e24413a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:26:54 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d3fcb219-740f-4aa5-a2e9-d8698894535f tempest-CreateVolumesFromSnapshotTest-515199839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f288f11-b2fa-475a-94a7-edc41202d1e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:26:55 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d3fcb219-740f-4aa5-a2e9-d8698894535f tempest-CreateVolumesFromSnapshotTest-515199839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f288f11-b2fa-475a-94a7-edc41202d1e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:26:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-430057799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae551dac-23ee-48c5-88ef-0b6d6df6742e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42352513d13b49d384ad0ddab561ad2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:26:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:26:55Z,use_quota=True,user_id='d79db4b811bb4b208581b32dd39a2685',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:26:55 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d3fcb219-740f-4aa5-a2e9-d8698894535f tempest-CreateVolumesFromSnapshotTest-515199839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3112a928-fec1-4273-9a23-58173cb03e5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:26:55 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d3fcb219-740f-4aa5-a2e9-d8698894535f tempest-CreateVolumesFromSnapshotTest-515199839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3112a928-fec1-4273-9a23-58173cb03e5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:26:55 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d3fcb219-740f-4aa5-a2e9-d8698894535f tempest-CreateVolumesFromSnapshotTest-515199839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (887c4dc9-db3b-45d7-8ab2-40d1e0f35a5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:26:55 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d3fcb219-740f-4aa5-a2e9-d8698894535f tempest-CreateVolumesFromSnapshotTest-515199839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (887c4dc9-db3b-45d7-8ab2-40d1e0f35a5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae551dac-23ee-48c5-88ef-0b6d6df6742e', 'volume_name': 'volume-ae551dac-23ee-48c5-88ef-0b6d6df6742e', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:26:55 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d3fcb219-740f-4aa5-a2e9-d8698894535f tempest-CreateVolumesFromSnapshotTest-515199839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab0024c2-1f81-4339-a931-d2094e7cfa64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:26:55 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d3fcb219-740f-4aa5-a2e9-d8698894535f tempest-CreateVolumesFromSnapshotTest-515199839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab0024c2-1f81-4339-a931-d2094e7cfa64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:26:55 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d3fcb219-740f-4aa5-a2e9-d8698894535f tempest-CreateVolumesFromSnapshotTest-515199839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d371f84-ed5e-4cc9-a94e-ec64350ce3a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:26:55 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-d3fcb219-740f-4aa5-a2e9-d8698894535f tempest-CreateVolumesFromSnapshotTest-515199839 None] Volume ae551dac-23ee-48c5-88ef-0b6d6df6742e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae551dac-23ee-48c5-88ef-0b6d6df6742e', 'volume_size': 1} Sep 29 18:26:55 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-d3fcb219-740f-4aa5-a2e9-d8698894535f tempest-CreateVolumesFromSnapshotTest-515199839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:26:55 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-d3fcb219-740f-4aa5-a2e9-d8698894535f tempest-CreateVolumesFromSnapshotTest-515199839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:26:55 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-d3fcb219-740f-4aa5-a2e9-d8698894535f tempest-CreateVolumesFromSnapshotTest-515199839 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:26:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-430057799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae551dac-23ee-48c5-88ef-0b6d6df6742e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42352513d13b49d384ad0ddab561ad2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:26:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:26:55Z,use_quota=True,user_id='d79db4b811bb4b208581b32dd39a2685',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)}" {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:26:55 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-d3fcb219-740f-4aa5-a2e9-d8698894535f tempest-CreateVolumesFromSnapshotTest-515199839 None] Creating volume ae551dac-23ee-48c5-88ef-0b6d6df6742e {{(pid=86512) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:26:55 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-d3fcb219-740f-4aa5-a2e9-d8698894535f tempest-CreateVolumesFromSnapshotTest-515199839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:26:55 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-d3fcb219-740f-4aa5-a2e9-d8698894535f tempest-CreateVolumesFromSnapshotTest-515199839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:26:55 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-d3fcb219-740f-4aa5-a2e9-d8698894535f tempest-CreateVolumesFromSnapshotTest-515199839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:26:55 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-d3fcb219-740f-4aa5-a2e9-d8698894535f tempest-CreateVolumesFromSnapshotTest-515199839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:26:55 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-d3fcb219-740f-4aa5-a2e9-d8698894535f tempest-CreateVolumesFromSnapshotTest-515199839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:26:55 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-d3fcb219-740f-4aa5-a2e9-d8698894535f tempest-CreateVolumesFromSnapshotTest-515199839 None] Selected osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 as target Quobyte volume. {{(pid=86512) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:26:55 devstack cinder-volume[86512]: INFO cinder.volume.drivers.remotefs [None req-d3fcb219-740f-4aa5-a2e9-d8698894535f tempest-CreateVolumesFromSnapshotTest-515199839 None] casted to osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 Sep 29 18:26:55 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-d3fcb219-740f-4aa5-a2e9-d8698894535f tempest-CreateVolumesFromSnapshotTest-515199839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ae551dac-23ee-48c5-88ef-0b6d6df6742e 1073741824 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:26:55 devstack sudo[98950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ae551dac-23ee-48c5-88ef-0b6d6df6742e 1073741824 Sep 29 18:26:55 devstack sudo[98950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:26:55 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-d7fef3fe-f4a8-45f2-839b-eb21c84d358c tempest-VolumesDeleteCascade-158504705 None] Acquiring lock "cinder-11d5f1ae-8fe8-4425-a5d6-de66ff8fc974-delete_volume" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:26:55 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-d7fef3fe-f4a8-45f2-839b-eb21c84d358c tempest-VolumesDeleteCascade-158504705 None] Lock "cinder-11d5f1ae-8fe8-4425-a5d6-de66ff8fc974-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:26:55 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d7fef3fe-f4a8-45f2-839b-eb21c84d358c tempest-VolumesDeleteCascade-158504705 None] Performing cascade delete. {{(pid=86512) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 29 18:26:55 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-d7fef3fe-f4a8-45f2-839b-eb21c84d358c tempest-VolumesDeleteCascade-158504705 None] Acquiring lock "cinder-0abe0f77-2d67-417b-a861-fb704b4719b6-delete_snapshot" by "delete_snapshot" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:26:55 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-d7fef3fe-f4a8-45f2-839b-eb21c84d358c tempest-VolumesDeleteCascade-158504705 None] Lock "cinder-0abe0f77-2d67-417b-a861-fb704b4719b6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:26:55 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-d7fef3fe-f4a8-45f2-839b-eb21c84d358c tempest-VolumesDeleteCascade-158504705 None] Acquiring lock "cinder-quobyte-11d5f1ae-8fe8-4425-a5d6-de66ff8fc974" by "delete_snapshot" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:26:55 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-d7fef3fe-f4a8-45f2-839b-eb21c84d358c tempest-VolumesDeleteCascade-158504705 None] Lock "cinder-quobyte-11d5f1ae-8fe8-4425-a5d6-de66ff8fc974" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:26:55 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-d7fef3fe-f4a8-45f2-839b-eb21c84d358c tempest-VolumesDeleteCascade-158504705 None] Acquiring lock "cinder-quobyte-0abe0f77-2d67-417b-a861-fb704b4719b6" by "_delete_snapshot" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:26:55 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-d7fef3fe-f4a8-45f2-839b-eb21c84d358c tempest-VolumesDeleteCascade-158504705 None] Lock "cinder-quobyte-0abe0f77-2d67-417b-a861-fb704b4719b6" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:26:55 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-d7fef3fe-f4a8-45f2-839b-eb21c84d358c tempest-VolumesDeleteCascade-158504705 None] Deleting offline snapshot 0abe0f77-2d67-417b-a861-fb704b4719b6 of volume 11d5f1ae-8fe8-4425-a5d6-de66ff8fc974 {{(pid=86512) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 18:26:55 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-d7fef3fe-f4a8-45f2-839b-eb21c84d358c tempest-VolumesDeleteCascade-158504705 None] snapshot_file for this snap is: volume-11d5f1ae-8fe8-4425-a5d6-de66ff8fc974.0abe0f77-2d67-417b-a861-fb704b4719b6 {{(pid=86512) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 18:26:55 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0a4aee5-55e6-4cc9-b5e6-b5264eaa6684]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:26:55 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-d7fef3fe-f4a8-45f2-839b-eb21c84d358c tempest-VolumesDeleteCascade-158504705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-11d5f1ae-8fe8-4425-a5d6-de66ff8fc974.0abe0f77-2d67-417b-a861-fb704b4719b6 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:26:55 devstack sudo[98955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-11d5f1ae-8fe8-4425-a5d6-de66ff8fc974.0abe0f77-2d67-417b-a861-fb704b4719b6 Sep 29 18:26:55 devstack sudo[98955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:26:55 devstack sudo[98950]: pam_unix(sudo:session): session closed for user root Sep 29 18:26:55 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-d3fcb219-740f-4aa5-a2e9-d8698894535f tempest-CreateVolumesFromSnapshotTest-515199839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ae551dac-23ee-48c5-88ef-0b6d6df6742e 1073741824" returned: 0 in 0.593s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:26:55 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-d3fcb219-740f-4aa5-a2e9-d8698894535f tempest-CreateVolumesFromSnapshotTest-515199839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ae551dac-23ee-48c5-88ef-0b6d6df6742e {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:26:55 devstack sudo[98964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ae551dac-23ee-48c5-88ef-0b6d6df6742e Sep 29 18:26:55 devstack sudo[98964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:26:55 devstack sudo[98955]: pam_unix(sudo:session): session closed for user root Sep 29 18:26:55 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-d7fef3fe-f4a8-45f2-839b-eb21c84d358c tempest-VolumesDeleteCascade-158504705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-11d5f1ae-8fe8-4425-a5d6-de66ff8fc974.0abe0f77-2d67-417b-a861-fb704b4719b6" returned: 0 in 0.549s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:26:55 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-d7fef3fe-f4a8-45f2-839b-eb21c84d358c tempest-VolumesDeleteCascade-158504705 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-11d5f1ae-8fe8-4425-a5d6-de66ff8fc974(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86512) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 18:26:55 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[f49f0ef9-c473-4db2-9785-51464f3e94bd]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:26:55 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-d7fef3fe-f4a8-45f2-839b-eb21c84d358c tempest-VolumesDeleteCascade-158504705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-11d5f1ae-8fe8-4425-a5d6-de66ff8fc974.c77318bd-0324-47ba-9824-577fa5aa531a {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:26:56 devstack sudo[98964]: pam_unix(sudo:session): session closed for user root Sep 29 18:26:56 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-d3fcb219-740f-4aa5-a2e9-d8698894535f tempest-CreateVolumesFromSnapshotTest-515199839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ae551dac-23ee-48c5-88ef-0b6d6df6742e" returned: 0 in 0.306s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:26:56 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-d3fcb219-740f-4aa5-a2e9-d8698894535f tempest-CreateVolumesFromSnapshotTest-515199839 None] <== create_volume: return (979ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'} {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:26:56 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-d3fcb219-740f-4aa5-a2e9-d8698894535f tempest-CreateVolumesFromSnapshotTest-515199839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.982s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:26:56 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d3fcb219-740f-4aa5-a2e9-d8698894535f tempest-CreateVolumesFromSnapshotTest-515199839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d371f84-ed5e-4cc9-a94e-ec64350ce3a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae551dac-23ee-48c5-88ef-0b6d6df6742e', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:26:56 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d3fcb219-740f-4aa5-a2e9-d8698894535f tempest-CreateVolumesFromSnapshotTest-515199839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0b91e3c-0675-4e5d-b2d9-d3e85e14390c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:26:56 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-d3fcb219-740f-4aa5-a2e9-d8698894535f tempest-CreateVolumesFromSnapshotTest-515199839 None] Volume volume-ae551dac-23ee-48c5-88ef-0b6d6df6742e (ae551dac-23ee-48c5-88ef-0b6d6df6742e): created successfully Sep 29 18:26:56 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d3fcb219-740f-4aa5-a2e9-d8698894535f tempest-CreateVolumesFromSnapshotTest-515199839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0b91e3c-0675-4e5d-b2d9-d3e85e14390c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:26:56 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d3fcb219-740f-4aa5-a2e9-d8698894535f tempest-CreateVolumesFromSnapshotTest-515199839 None] Flow 'volume_create_manager' (9195369d-0af5-4d74-84c8-d3a16e24413a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:26:56 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-d3fcb219-740f-4aa5-a2e9-d8698894535f tempest-CreateVolumesFromSnapshotTest-515199839 None] Created volume successfully. Sep 29 18:26:56 devstack sudo[98970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-11d5f1ae-8fe8-4425-a5d6-de66ff8fc974.c77318bd-0324-47ba-9824-577fa5aa531a Sep 29 18:26:56 devstack sudo[98970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:26:56 devstack sudo[98970]: pam_unix(sudo:session): session closed for user root Sep 29 18:26:56 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-d7fef3fe-f4a8-45f2-839b-eb21c84d358c tempest-VolumesDeleteCascade-158504705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-11d5f1ae-8fe8-4425-a5d6-de66ff8fc974.c77318bd-0324-47ba-9824-577fa5aa531a" returned: 0 in 0.500s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:26:56 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-d7fef3fe-f4a8-45f2-839b-eb21c84d358c tempest-VolumesDeleteCascade-158504705 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-11d5f1ae-8fe8-4425-a5d6-de66ff8fc974(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86512) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 18:26:56 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-d7fef3fe-f4a8-45f2-839b-eb21c84d358c tempest-VolumesDeleteCascade-158504705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-11d5f1ae-8fe8-4425-a5d6-de66ff8fc974.0abe0f77-2d67-417b-a861-fb704b4719b6 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:26:56 devstack sudo[98976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-11d5f1ae-8fe8-4425-a5d6-de66ff8fc974.0abe0f77-2d67-417b-a861-fb704b4719b6 Sep 29 18:26:56 devstack sudo[98976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:26:56 devstack sudo[98976]: pam_unix(sudo:session): session closed for user root Sep 29 18:26:57 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-d7fef3fe-f4a8-45f2-839b-eb21c84d358c tempest-VolumesDeleteCascade-158504705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-11d5f1ae-8fe8-4425-a5d6-de66ff8fc974.0abe0f77-2d67-417b-a861-fb704b4719b6" returned: 0 in 0.520s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:26:57 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-d7fef3fe-f4a8-45f2-839b-eb21c84d358c tempest-VolumesDeleteCascade-158504705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-11d5f1ae-8fe8-4425-a5d6-de66ff8fc974.0abe0f77-2d67-417b-a861-fb704b4719b6 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:26:57 devstack sudo[98982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-11d5f1ae-8fe8-4425-a5d6-de66ff8fc974.0abe0f77-2d67-417b-a861-fb704b4719b6 Sep 29 18:26:57 devstack sudo[98982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:26:57 devstack sudo[98982]: pam_unix(sudo:session): session closed for user root Sep 29 18:26:57 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-d7fef3fe-f4a8-45f2-839b-eb21c84d358c tempest-VolumesDeleteCascade-158504705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-11d5f1ae-8fe8-4425-a5d6-de66ff8fc974.0abe0f77-2d67-417b-a861-fb704b4719b6" returned: 0 in 0.500s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:26:57 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-d7fef3fe-f4a8-45f2-839b-eb21c84d358c tempest-VolumesDeleteCascade-158504705 None] Lock "cinder-quobyte-0abe0f77-2d67-417b-a861-fb704b4719b6" released by "_delete_snapshot" :: held 2.239s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:26:57 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-d7fef3fe-f4a8-45f2-839b-eb21c84d358c tempest-VolumesDeleteCascade-158504705 None] Lock "cinder-quobyte-11d5f1ae-8fe8-4425-a5d6-de66ff8fc974" released by "delete_snapshot" :: held 2.293s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:26:57 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-0df9e6ec-bc90-40e7-b4ea-bb273073be03 tempest-CreateVolumesFromSnapshotTest-515199839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:26:57 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-0df9e6ec-bc90-40e7-b4ea-bb273073be03 tempest-CreateVolumesFromSnapshotTest-515199839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:26:57 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-0df9e6ec-bc90-40e7-b4ea-bb273073be03 tempest-CreateVolumesFromSnapshotTest-515199839 None] Creating offline snapshot 7760f401-c4e6-4b35-9ea1-06e56e61bd57 of volume ae551dac-23ee-48c5-88ef-0b6d6df6742e {{(pid=86512) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 18:26:57 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[0904fa1a-3868-47e7-b38e-64e436dd14b3]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:26:57 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-0df9e6ec-bc90-40e7-b4ea-bb273073be03 tempest-CreateVolumesFromSnapshotTest-515199839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ae551dac-23ee-48c5-88ef-0b6d6df6742e {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:26:57 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-d7fef3fe-f4a8-45f2-839b-eb21c84d358c tempest-VolumesDeleteCascade-158504705 None] Created reservations ['489e959c-46c3-4569-ae55-545a786d9b2c', '49047469-7b08-461e-8d2b-25ad6e6a28f1', '3bda9c5e-61e1-48d3-8f68-1f055228b563', 'f519d5fd-fa92-4450-a4d2-7580c9371827'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:26:57 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-d7fef3fe-f4a8-45f2-839b-eb21c84d358c tempest-VolumesDeleteCascade-158504705 None] Delete snapshot completed successfully. Sep 29 18:26:57 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-d7fef3fe-f4a8-45f2-839b-eb21c84d358c tempest-VolumesDeleteCascade-158504705 None] Lock "cinder-0abe0f77-2d67-417b-a861-fb704b4719b6-delete_snapshot" released by "delete_snapshot" :: held 2.648s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:26:57 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-d7fef3fe-f4a8-45f2-839b-eb21c84d358c tempest-VolumesDeleteCascade-158504705 None] Acquiring lock "cinder-c77318bd-0324-47ba-9824-577fa5aa531a-delete_snapshot" by "delete_snapshot" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:26:57 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-d7fef3fe-f4a8-45f2-839b-eb21c84d358c tempest-VolumesDeleteCascade-158504705 None] Lock "cinder-c77318bd-0324-47ba-9824-577fa5aa531a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.046s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:26:58 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-d7fef3fe-f4a8-45f2-839b-eb21c84d358c tempest-VolumesDeleteCascade-158504705 None] Acquiring lock "cinder-quobyte-11d5f1ae-8fe8-4425-a5d6-de66ff8fc974" by "delete_snapshot" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:26:58 devstack sudo[99022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ae551dac-23ee-48c5-88ef-0b6d6df6742e Sep 29 18:26:58 devstack sudo[99022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:26:58 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-d7fef3fe-f4a8-45f2-839b-eb21c84d358c tempest-VolumesDeleteCascade-158504705 None] Lock "cinder-quobyte-11d5f1ae-8fe8-4425-a5d6-de66ff8fc974" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:26:58 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-d7fef3fe-f4a8-45f2-839b-eb21c84d358c tempest-VolumesDeleteCascade-158504705 None] Acquiring lock "cinder-quobyte-c77318bd-0324-47ba-9824-577fa5aa531a" by "_delete_snapshot" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:26:58 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-d7fef3fe-f4a8-45f2-839b-eb21c84d358c tempest-VolumesDeleteCascade-158504705 None] Lock "cinder-quobyte-c77318bd-0324-47ba-9824-577fa5aa531a" acquired by "_delete_snapshot" :: waited 0.043s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:26:58 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-d7fef3fe-f4a8-45f2-839b-eb21c84d358c tempest-VolumesDeleteCascade-158504705 None] Deleting offline snapshot c77318bd-0324-47ba-9824-577fa5aa531a of volume 11d5f1ae-8fe8-4425-a5d6-de66ff8fc974 {{(pid=86512) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 18:26:58 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-d7fef3fe-f4a8-45f2-839b-eb21c84d358c tempest-VolumesDeleteCascade-158504705 None] snapshot_file for this snap is: volume-11d5f1ae-8fe8-4425-a5d6-de66ff8fc974.c77318bd-0324-47ba-9824-577fa5aa531a {{(pid=86512) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 18:26:58 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[a41d7cfb-d73d-4679-8e6d-b6b57ce3df5d]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:26:58 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-d7fef3fe-f4a8-45f2-839b-eb21c84d358c tempest-VolumesDeleteCascade-158504705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-11d5f1ae-8fe8-4425-a5d6-de66ff8fc974.c77318bd-0324-47ba-9824-577fa5aa531a {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:26:58 devstack sudo[99040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-11d5f1ae-8fe8-4425-a5d6-de66ff8fc974.c77318bd-0324-47ba-9824-577fa5aa531a Sep 29 18:26:58 devstack sudo[99040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:26:58 devstack sudo[99022]: pam_unix(sudo:session): session closed for user root Sep 29 18:26:58 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-0df9e6ec-bc90-40e7-b4ea-bb273073be03 tempest-CreateVolumesFromSnapshotTest-515199839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ae551dac-23ee-48c5-88ef-0b6d6df6742e" returned: 0 in 0.903s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:26:58 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-0df9e6ec-bc90-40e7-b4ea-bb273073be03 tempest-CreateVolumesFromSnapshotTest-515199839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ae551dac-23ee-48c5-88ef-0b6d6df6742e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ae551dac-23ee-48c5-88ef-0b6d6df6742e.7760f401-c4e6-4b35-9ea1-06e56e61bd57 1G {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:26:58 devstack sudo[99061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ae551dac-23ee-48c5-88ef-0b6d6df6742e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ae551dac-23ee-48c5-88ef-0b6d6df6742e.7760f401-c4e6-4b35-9ea1-06e56e61bd57 1G Sep 29 18:26:58 devstack sudo[99061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:26:58 devstack sudo[99040]: pam_unix(sudo:session): session closed for user root Sep 29 18:26:58 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-d7fef3fe-f4a8-45f2-839b-eb21c84d358c tempest-VolumesDeleteCascade-158504705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-11d5f1ae-8fe8-4425-a5d6-de66ff8fc974.c77318bd-0324-47ba-9824-577fa5aa531a" returned: 0 in 0.586s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:26:58 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-d7fef3fe-f4a8-45f2-839b-eb21c84d358c tempest-VolumesDeleteCascade-158504705 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-11d5f1ae-8fe8-4425-a5d6-de66ff8fc974(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86512) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 18:26:58 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1e60d5b-372d-4f4d-bdd0-6f9017e25e59]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:26:58 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-d7fef3fe-f4a8-45f2-839b-eb21c84d358c tempest-VolumesDeleteCascade-158504705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-11d5f1ae-8fe8-4425-a5d6-de66ff8fc974 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:26:58 devstack sudo[99069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-11d5f1ae-8fe8-4425-a5d6-de66ff8fc974 Sep 29 18:26:58 devstack sudo[99069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:26:59 devstack sudo[99061]: pam_unix(sudo:session): session closed for user root Sep 29 18:26:59 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-0df9e6ec-bc90-40e7-b4ea-bb273073be03 tempest-CreateVolumesFromSnapshotTest-515199839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ae551dac-23ee-48c5-88ef-0b6d6df6742e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ae551dac-23ee-48c5-88ef-0b6d6df6742e.7760f401-c4e6-4b35-9ea1-06e56e61bd57 1G" returned: 0 in 0.622s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:26:59 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-0df9e6ec-bc90-40e7-b4ea-bb273073be03 tempest-CreateVolumesFromSnapshotTest-515199839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae551dac-23ee-48c5-88ef-0b6d6df6742e -F qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ae551dac-23ee-48c5-88ef-0b6d6df6742e.7760f401-c4e6-4b35-9ea1-06e56e61bd57 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:26:59 devstack sudo[99069]: pam_unix(sudo:session): session closed for user root Sep 29 18:26:59 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-d7fef3fe-f4a8-45f2-839b-eb21c84d358c tempest-VolumesDeleteCascade-158504705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-11d5f1ae-8fe8-4425-a5d6-de66ff8fc974" returned: 0 in 0.500s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:26:59 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-d7fef3fe-f4a8-45f2-839b-eb21c84d358c tempest-VolumesDeleteCascade-158504705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-11d5f1ae-8fe8-4425-a5d6-de66ff8fc974.c77318bd-0324-47ba-9824-577fa5aa531a {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:26:59 devstack sudo[99089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae551dac-23ee-48c5-88ef-0b6d6df6742e -F qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ae551dac-23ee-48c5-88ef-0b6d6df6742e.7760f401-c4e6-4b35-9ea1-06e56e61bd57 Sep 29 18:26:59 devstack sudo[99089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:26:59 devstack sudo[99090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-11d5f1ae-8fe8-4425-a5d6-de66ff8fc974.c77318bd-0324-47ba-9824-577fa5aa531a Sep 29 18:26:59 devstack sudo[99090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:26:59 devstack sudo[99089]: pam_unix(sudo:session): session closed for user root Sep 29 18:26:59 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-0df9e6ec-bc90-40e7-b4ea-bb273073be03 tempest-CreateVolumesFromSnapshotTest-515199839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae551dac-23ee-48c5-88ef-0b6d6df6742e -F qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ae551dac-23ee-48c5-88ef-0b6d6df6742e.7760f401-c4e6-4b35-9ea1-06e56e61bd57" returned: 0 in 0.490s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:26:59 devstack cinder-volume[86512]: WARNING cinder.volume.drivers.remotefs [None req-0df9e6ec-bc90-40e7-b4ea-bb273073be03 tempest-CreateVolumesFromSnapshotTest-515199839 None] /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ae551dac-23ee-48c5-88ef-0b6d6df6742e.7760f401-c4e6-4b35-9ea1-06e56e61bd57 is being set with open permissions: ugo+rw Sep 29 18:26:59 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-0df9e6ec-bc90-40e7-b4ea-bb273073be03 tempest-CreateVolumesFromSnapshotTest-515199839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ae551dac-23ee-48c5-88ef-0b6d6df6742e.7760f401-c4e6-4b35-9ea1-06e56e61bd57 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:26:59 devstack sudo[99090]: pam_unix(sudo:session): session closed for user root Sep 29 18:26:59 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-d7fef3fe-f4a8-45f2-839b-eb21c84d358c tempest-VolumesDeleteCascade-158504705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-11d5f1ae-8fe8-4425-a5d6-de66ff8fc974.c77318bd-0324-47ba-9824-577fa5aa531a" returned: 0 in 0.521s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:26:59 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-d7fef3fe-f4a8-45f2-839b-eb21c84d358c tempest-VolumesDeleteCascade-158504705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-11d5f1ae-8fe8-4425-a5d6-de66ff8fc974.c77318bd-0324-47ba-9824-577fa5aa531a {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:26:59 devstack sudo[99099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ae551dac-23ee-48c5-88ef-0b6d6df6742e.7760f401-c4e6-4b35-9ea1-06e56e61bd57 Sep 29 18:26:59 devstack sudo[99099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:26:59 devstack sudo[99100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-11d5f1ae-8fe8-4425-a5d6-de66ff8fc974.c77318bd-0324-47ba-9824-577fa5aa531a Sep 29 18:26:59 devstack sudo[99100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:27:00 devstack sudo[99099]: pam_unix(sudo:session): session closed for user root Sep 29 18:27:00 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-0df9e6ec-bc90-40e7-b4ea-bb273073be03 tempest-CreateVolumesFromSnapshotTest-515199839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ae551dac-23ee-48c5-88ef-0b6d6df6742e.7760f401-c4e6-4b35-9ea1-06e56e61bd57" returned: 0 in 0.436s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:27:00 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-0df9e6ec-bc90-40e7-b4ea-bb273073be03 tempest-CreateVolumesFromSnapshotTest-515199839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ae551dac-23ee-48c5-88ef-0b6d6df6742e.info {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:27:00 devstack sudo[99107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ae551dac-23ee-48c5-88ef-0b6d6df6742e.info Sep 29 18:27:00 devstack sudo[99107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:27:00 devstack sudo[99100]: pam_unix(sudo:session): session closed for user root Sep 29 18:27:00 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-d7fef3fe-f4a8-45f2-839b-eb21c84d358c tempest-VolumesDeleteCascade-158504705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-11d5f1ae-8fe8-4425-a5d6-de66ff8fc974.c77318bd-0324-47ba-9824-577fa5aa531a" returned: 0 in 0.507s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:27:00 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-d7fef3fe-f4a8-45f2-839b-eb21c84d358c tempest-VolumesDeleteCascade-158504705 None] Lock "cinder-quobyte-c77318bd-0324-47ba-9824-577fa5aa531a" released by "_delete_snapshot" :: held 2.336s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:27:00 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-d7fef3fe-f4a8-45f2-839b-eb21c84d358c tempest-VolumesDeleteCascade-158504705 None] Lock "cinder-quobyte-11d5f1ae-8fe8-4425-a5d6-de66ff8fc974" released by "delete_snapshot" :: held 2.399s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:27:00 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-d7fef3fe-f4a8-45f2-839b-eb21c84d358c tempest-VolumesDeleteCascade-158504705 None] Created reservations ['7794be40-a1dc-49bf-a9b2-b4763e09c8e1', '9971810c-ad9a-4e71-b959-2eda86e953f5', '4aa99f5a-0047-41e2-8324-0d14ccb1d108', 'db1853ef-4ed9-4436-a36b-e8bf635b5b47'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:27:00 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-d7fef3fe-f4a8-45f2-839b-eb21c84d358c tempest-VolumesDeleteCascade-158504705 None] Delete snapshot completed successfully. Sep 29 18:27:00 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-d7fef3fe-f4a8-45f2-839b-eb21c84d358c tempest-VolumesDeleteCascade-158504705 None] Lock "cinder-c77318bd-0324-47ba-9824-577fa5aa531a-delete_snapshot" released by "delete_snapshot" :: held 2.691s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:27:00 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d7fef3fe-f4a8-45f2-839b-eb21c84d358c tempest-VolumesDeleteCascade-158504705 None] Snapshots deleted, issuing volume delete {{(pid=86512) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 29 18:27:00 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-d7fef3fe-f4a8-45f2-839b-eb21c84d358c tempest-VolumesDeleteCascade-158504705 None] Acquiring lock "cinder-quobyte-11d5f1ae-8fe8-4425-a5d6-de66ff8fc974" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:27:00 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-d7fef3fe-f4a8-45f2-839b-eb21c84d358c tempest-VolumesDeleteCascade-158504705 None] Lock "cinder-quobyte-11d5f1ae-8fe8-4425-a5d6-de66ff8fc974" acquired by "delete_volume" :: waited 0.047s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:27:00 devstack sudo[99107]: pam_unix(sudo:session): session closed for user root Sep 29 18:27:00 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-0df9e6ec-bc90-40e7-b4ea-bb273073be03 tempest-CreateVolumesFromSnapshotTest-515199839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ae551dac-23ee-48c5-88ef-0b6d6df6742e.info" returned: 0 in 0.532s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:27:00 devstack cinder-volume[86512]: WARNING cinder.volume.drivers.remotefs [None req-0df9e6ec-bc90-40e7-b4ea-bb273073be03 tempest-CreateVolumesFromSnapshotTest-515199839 None] /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ae551dac-23ee-48c5-88ef-0b6d6df6742e.info is being set with open permissions: ugo+rw Sep 29 18:27:00 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-0df9e6ec-bc90-40e7-b4ea-bb273073be03 tempest-CreateVolumesFromSnapshotTest-515199839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ae551dac-23ee-48c5-88ef-0b6d6df6742e.info {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:27:00 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[7346f374-c70b-4731-9673-bcc64e9ebb98]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:27:00 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-d7fef3fe-f4a8-45f2-839b-eb21c84d358c tempest-VolumesDeleteCascade-158504705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-11d5f1ae-8fe8-4425-a5d6-de66ff8fc974 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:27:00 devstack sudo[99110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ae551dac-23ee-48c5-88ef-0b6d6df6742e.info Sep 29 18:27:00 devstack sudo[99110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:27:01 devstack sudo[99111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-11d5f1ae-8fe8-4425-a5d6-de66ff8fc974 Sep 29 18:27:01 devstack sudo[99111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:27:01 devstack sudo[99110]: pam_unix(sudo:session): session closed for user root Sep 29 18:27:01 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-0df9e6ec-bc90-40e7-b4ea-bb273073be03 tempest-CreateVolumesFromSnapshotTest-515199839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ae551dac-23ee-48c5-88ef-0b6d6df6742e.info" returned: 0 in 0.422s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:27:01 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-0df9e6ec-bc90-40e7-b4ea-bb273073be03 tempest-CreateVolumesFromSnapshotTest-515199839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.625s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:27:01 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-0df9e6ec-bc90-40e7-b4ea-bb273073be03 tempest-CreateVolumesFromSnapshotTest-515199839 None] Create snapshot completed successfully Sep 29 18:27:01 devstack sudo[99111]: pam_unix(sudo:session): session closed for user root Sep 29 18:27:01 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-d7fef3fe-f4a8-45f2-839b-eb21c84d358c tempest-VolumesDeleteCascade-158504705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-11d5f1ae-8fe8-4425-a5d6-de66ff8fc974" returned: 0 in 0.520s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:27:01 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-d7fef3fe-f4a8-45f2-839b-eb21c84d358c tempest-VolumesDeleteCascade-158504705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-11d5f1ae-8fe8-4425-a5d6-de66ff8fc974 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:27:01 devstack sudo[99119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-11d5f1ae-8fe8-4425-a5d6-de66ff8fc974 Sep 29 18:27:01 devstack sudo[99119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:27:01 devstack sudo[99119]: pam_unix(sudo:session): session closed for user root Sep 29 18:27:01 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-d7fef3fe-f4a8-45f2-839b-eb21c84d358c tempest-VolumesDeleteCascade-158504705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-11d5f1ae-8fe8-4425-a5d6-de66ff8fc974" returned: 0 in 0.287s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:27:01 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-d7fef3fe-f4a8-45f2-839b-eb21c84d358c tempest-VolumesDeleteCascade-158504705 None] Lock "cinder-quobyte-11d5f1ae-8fe8-4425-a5d6-de66ff8fc974" released by "delete_volume" :: held 0.975s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:27:01 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-d7fef3fe-f4a8-45f2-839b-eb21c84d358c tempest-VolumesDeleteCascade-158504705 None] Created reservations ['089bc6eb-8d1f-48ea-b679-c479155aba08', '66730377-5165-4c92-8611-2d927fb5dd3a', '0f267a84-4c2b-43c9-815e-23decea5780d', '40870a26-b9f0-4a03-81f1-a19c9716ae32'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:27:01 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-d7fef3fe-f4a8-45f2-839b-eb21c84d358c tempest-VolumesDeleteCascade-158504705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:27:01 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-d7fef3fe-f4a8-45f2-839b-eb21c84d358c tempest-VolumesDeleteCascade-158504705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:27:01 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-d7fef3fe-f4a8-45f2-839b-eb21c84d358c tempest-VolumesDeleteCascade-158504705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:27:01 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-d7fef3fe-f4a8-45f2-839b-eb21c84d358c tempest-VolumesDeleteCascade-158504705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:27:01 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-d7fef3fe-f4a8-45f2-839b-eb21c84d358c tempest-VolumesDeleteCascade-158504705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:27:01 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-d7fef3fe-f4a8-45f2-839b-eb21c84d358c tempest-VolumesDeleteCascade-158504705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:27:02 devstack sudo[99122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:27:02 devstack sudo[99122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:27:02 devstack sudo[99122]: pam_unix(sudo:session): session closed for user root Sep 29 18:27:02 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-d7fef3fe-f4a8-45f2-839b-eb21c84d358c tempest-VolumesDeleteCascade-158504705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.591s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:27:02 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-d7fef3fe-f4a8-45f2-839b-eb21c84d358c tempest-VolumesDeleteCascade-158504705 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:27:02 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-d7fef3fe-f4a8-45f2-839b-eb21c84d358c tempest-VolumesDeleteCascade-158504705 None] Deleted volume successfully. Sep 29 18:27:02 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-d7fef3fe-f4a8-45f2-839b-eb21c84d358c tempest-VolumesDeleteCascade-158504705 None] Lock "cinder-11d5f1ae-8fe8-4425-a5d6-de66ff8fc974-delete_volume" released by "delete_volume" :: held 7.449s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:27:02 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9b39738-4fb0-4a56-98b2-0f6bfcb729b9 tempest-CreateVolumesFromSnapshotTest-515199839 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86512) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:27:02 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-e9b39738-4fb0-4a56-98b2-0f6bfcb729b9 tempest-CreateVolumesFromSnapshotTest-515199839 None] Flow 'volume_create_manager' (12406c99-5eef-4e14-bfb0-1aef375c09e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:27:02 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-e9b39738-4fb0-4a56-98b2-0f6bfcb729b9 tempest-CreateVolumesFromSnapshotTest-515199839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d90d447c-3313-457b-9958-bb8759ca734d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:27:02 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-e9b39738-4fb0-4a56-98b2-0f6bfcb729b9 tempest-CreateVolumesFromSnapshotTest-515199839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d90d447c-3313-457b-9958-bb8759ca734d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:27:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2017861601',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5433d225-988b-4ddc-9a8c-d345d9532cba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42352513d13b49d384ad0ddab561ad2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:27:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:27:03Z,use_quota=True,user_id='d79db4b811bb4b208581b32dd39a2685',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:27:02 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-e9b39738-4fb0-4a56-98b2-0f6bfcb729b9 tempest-CreateVolumesFromSnapshotTest-515199839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (090d85e1-46c5-4cfc-b4ec-4193e80a26c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:27:02 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-e9b39738-4fb0-4a56-98b2-0f6bfcb729b9 tempest-CreateVolumesFromSnapshotTest-515199839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (090d85e1-46c5-4cfc-b4ec-4193e80a26c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:27:03 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-e9b39738-4fb0-4a56-98b2-0f6bfcb729b9 tempest-CreateVolumesFromSnapshotTest-515199839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f71b9b49-ef30-4ca9-ab5f-233b9fe4049c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:27:03 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-e9b39738-4fb0-4a56-98b2-0f6bfcb729b9 tempest-CreateVolumesFromSnapshotTest-515199839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f71b9b49-ef30-4ca9-ab5f-233b9fe4049c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5433d225-988b-4ddc-9a8c-d345d9532cba', 'volume_name': 'volume-5433d225-988b-4ddc-9a8c-d345d9532cba', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:27:03 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-e9b39738-4fb0-4a56-98b2-0f6bfcb729b9 tempest-CreateVolumesFromSnapshotTest-515199839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5d82f6b-6239-43fc-8978-46413568f87c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:27:03 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-e9b39738-4fb0-4a56-98b2-0f6bfcb729b9 tempest-CreateVolumesFromSnapshotTest-515199839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5d82f6b-6239-43fc-8978-46413568f87c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:27:03 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-e9b39738-4fb0-4a56-98b2-0f6bfcb729b9 tempest-CreateVolumesFromSnapshotTest-515199839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92d32b79-84f7-4220-a039-f492e3a8dc47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:27:03 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-e9b39738-4fb0-4a56-98b2-0f6bfcb729b9 tempest-CreateVolumesFromSnapshotTest-515199839 None] Volume 5433d225-988b-4ddc-9a8c-d345d9532cba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5433d225-988b-4ddc-9a8c-d345d9532cba', 'volume_size': 1} Sep 29 18:27:03 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-e9b39738-4fb0-4a56-98b2-0f6bfcb729b9 tempest-CreateVolumesFromSnapshotTest-515199839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:27:03 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-e9b39738-4fb0-4a56-98b2-0f6bfcb729b9 tempest-CreateVolumesFromSnapshotTest-515199839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:27:03 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-e9b39738-4fb0-4a56-98b2-0f6bfcb729b9 tempest-CreateVolumesFromSnapshotTest-515199839 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:27:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2017861601',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5433d225-988b-4ddc-9a8c-d345d9532cba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42352513d13b49d384ad0ddab561ad2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:27:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:27:03Z,use_quota=True,user_id='d79db4b811bb4b208581b32dd39a2685',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)}" {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:27:03 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-e9b39738-4fb0-4a56-98b2-0f6bfcb729b9 tempest-CreateVolumesFromSnapshotTest-515199839 None] Creating volume 5433d225-988b-4ddc-9a8c-d345d9532cba {{(pid=86512) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:27:03 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-e9b39738-4fb0-4a56-98b2-0f6bfcb729b9 tempest-CreateVolumesFromSnapshotTest-515199839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:27:03 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-e9b39738-4fb0-4a56-98b2-0f6bfcb729b9 tempest-CreateVolumesFromSnapshotTest-515199839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:27:03 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-e9b39738-4fb0-4a56-98b2-0f6bfcb729b9 tempest-CreateVolumesFromSnapshotTest-515199839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:27:03 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-e9b39738-4fb0-4a56-98b2-0f6bfcb729b9 tempest-CreateVolumesFromSnapshotTest-515199839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:27:03 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-e9b39738-4fb0-4a56-98b2-0f6bfcb729b9 tempest-CreateVolumesFromSnapshotTest-515199839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:27:03 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-e9b39738-4fb0-4a56-98b2-0f6bfcb729b9 tempest-CreateVolumesFromSnapshotTest-515199839 None] Selected osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 as target Quobyte volume. {{(pid=86512) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:27:03 devstack cinder-volume[86512]: INFO cinder.volume.drivers.remotefs [None req-e9b39738-4fb0-4a56-98b2-0f6bfcb729b9 tempest-CreateVolumesFromSnapshotTest-515199839 None] casted to osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 Sep 29 18:27:03 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-e9b39738-4fb0-4a56-98b2-0f6bfcb729b9 tempest-CreateVolumesFromSnapshotTest-515199839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-5433d225-988b-4ddc-9a8c-d345d9532cba 1073741824 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:27:03 devstack sudo[99126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-5433d225-988b-4ddc-9a8c-d345d9532cba 1073741824 Sep 29 18:27:03 devstack sudo[99126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:27:03 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-d62543bf-663e-4b5e-aabc-e66371c74eb6 tempest-CreateVolumesFromSnapshotTest-515199839 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86512) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:27:03 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d62543bf-663e-4b5e-aabc-e66371c74eb6 tempest-CreateVolumesFromSnapshotTest-515199839 None] Flow 'volume_create_manager' (946a4e62-7a61-469a-8b51-1f4112d71816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:27:03 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d62543bf-663e-4b5e-aabc-e66371c74eb6 tempest-CreateVolumesFromSnapshotTest-515199839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a18cf375-ccad-4fa2-b870-d454c969ea27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:27:03 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d62543bf-663e-4b5e-aabc-e66371c74eb6 tempest-CreateVolumesFromSnapshotTest-515199839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a18cf375-ccad-4fa2-b870-d454c969ea27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:27:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1472310733',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=800618d4-01b8-4770-9760-7b971a75abc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42352513d13b49d384ad0ddab561ad2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:27:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:27:03Z,use_quota=True,user_id='d79db4b811bb4b208581b32dd39a2685',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:27:03 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d62543bf-663e-4b5e-aabc-e66371c74eb6 tempest-CreateVolumesFromSnapshotTest-515199839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03dbf78a-7c12-40f0-98c7-00c6ef19aa08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:27:03 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d62543bf-663e-4b5e-aabc-e66371c74eb6 tempest-CreateVolumesFromSnapshotTest-515199839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03dbf78a-7c12-40f0-98c7-00c6ef19aa08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:27:03 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d62543bf-663e-4b5e-aabc-e66371c74eb6 tempest-CreateVolumesFromSnapshotTest-515199839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c3ef49e-e1f3-44c7-8009-aff4088dd15d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:27:03 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d62543bf-663e-4b5e-aabc-e66371c74eb6 tempest-CreateVolumesFromSnapshotTest-515199839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c3ef49e-e1f3-44c7-8009-aff4088dd15d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '800618d4-01b8-4770-9760-7b971a75abc3', 'volume_name': 'volume-800618d4-01b8-4770-9760-7b971a75abc3', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:27:03 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d62543bf-663e-4b5e-aabc-e66371c74eb6 tempest-CreateVolumesFromSnapshotTest-515199839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4add0462-5b3b-49ab-bb24-f96ec6caf835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:27:03 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d62543bf-663e-4b5e-aabc-e66371c74eb6 tempest-CreateVolumesFromSnapshotTest-515199839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4add0462-5b3b-49ab-bb24-f96ec6caf835) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:27:03 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d62543bf-663e-4b5e-aabc-e66371c74eb6 tempest-CreateVolumesFromSnapshotTest-515199839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52b26a4e-e120-4458-af8d-6b63a7a2f488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:27:03 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-d62543bf-663e-4b5e-aabc-e66371c74eb6 tempest-CreateVolumesFromSnapshotTest-515199839 None] Volume 800618d4-01b8-4770-9760-7b971a75abc3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-800618d4-01b8-4770-9760-7b971a75abc3', 'volume_size': 1} Sep 29 18:27:03 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-d62543bf-663e-4b5e-aabc-e66371c74eb6 tempest-CreateVolumesFromSnapshotTest-515199839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:27:04 devstack sudo[99126]: pam_unix(sudo:session): session closed for user root Sep 29 18:27:04 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-e9b39738-4fb0-4a56-98b2-0f6bfcb729b9 tempest-CreateVolumesFromSnapshotTest-515199839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-5433d225-988b-4ddc-9a8c-d345d9532cba 1073741824" returned: 0 in 1.028s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:27:04 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-e9b39738-4fb0-4a56-98b2-0f6bfcb729b9 tempest-CreateVolumesFromSnapshotTest-515199839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-5433d225-988b-4ddc-9a8c-d345d9532cba {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:27:04 devstack sudo[99134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-5433d225-988b-4ddc-9a8c-d345d9532cba Sep 29 18:27:04 devstack sudo[99134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:27:04 devstack sudo[99134]: pam_unix(sudo:session): session closed for user root Sep 29 18:27:04 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-e9b39738-4fb0-4a56-98b2-0f6bfcb729b9 tempest-CreateVolumesFromSnapshotTest-515199839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-5433d225-988b-4ddc-9a8c-d345d9532cba" returned: 0 in 0.344s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:27:04 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-e9b39738-4fb0-4a56-98b2-0f6bfcb729b9 tempest-CreateVolumesFromSnapshotTest-515199839 None] <== create_volume: return (1446ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'} {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:27:04 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-e9b39738-4fb0-4a56-98b2-0f6bfcb729b9 tempest-CreateVolumesFromSnapshotTest-515199839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.452s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:27:04 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-d62543bf-663e-4b5e-aabc-e66371c74eb6 tempest-CreateVolumesFromSnapshotTest-515199839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.860s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:27:04 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-d62543bf-663e-4b5e-aabc-e66371c74eb6 tempest-CreateVolumesFromSnapshotTest-515199839 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:27:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1472310733',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=800618d4-01b8-4770-9760-7b971a75abc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42352513d13b49d384ad0ddab561ad2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:27:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:27:03Z,use_quota=True,user_id='d79db4b811bb4b208581b32dd39a2685',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)}" {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:27:04 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-d62543bf-663e-4b5e-aabc-e66371c74eb6 tempest-CreateVolumesFromSnapshotTest-515199839 None] Creating volume 800618d4-01b8-4770-9760-7b971a75abc3 {{(pid=86512) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:27:04 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-d62543bf-663e-4b5e-aabc-e66371c74eb6 tempest-CreateVolumesFromSnapshotTest-515199839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:27:04 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-d62543bf-663e-4b5e-aabc-e66371c74eb6 tempest-CreateVolumesFromSnapshotTest-515199839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:27:04 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-d62543bf-663e-4b5e-aabc-e66371c74eb6 tempest-CreateVolumesFromSnapshotTest-515199839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:27:04 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-d62543bf-663e-4b5e-aabc-e66371c74eb6 tempest-CreateVolumesFromSnapshotTest-515199839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:27:04 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-d62543bf-663e-4b5e-aabc-e66371c74eb6 tempest-CreateVolumesFromSnapshotTest-515199839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:27:04 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-d62543bf-663e-4b5e-aabc-e66371c74eb6 tempest-CreateVolumesFromSnapshotTest-515199839 None] Selected osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 as target Quobyte volume. {{(pid=86512) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:27:04 devstack cinder-volume[86512]: INFO cinder.volume.drivers.remotefs [None req-d62543bf-663e-4b5e-aabc-e66371c74eb6 tempest-CreateVolumesFromSnapshotTest-515199839 None] casted to osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 Sep 29 18:27:04 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-d62543bf-663e-4b5e-aabc-e66371c74eb6 tempest-CreateVolumesFromSnapshotTest-515199839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-800618d4-01b8-4770-9760-7b971a75abc3 1073741824 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:27:04 devstack sudo[99138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-800618d4-01b8-4770-9760-7b971a75abc3 1073741824 Sep 29 18:27:04 devstack sudo[99138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:27:04 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-e9b39738-4fb0-4a56-98b2-0f6bfcb729b9 tempest-CreateVolumesFromSnapshotTest-515199839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92d32b79-84f7-4220-a039-f492e3a8dc47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5433d225-988b-4ddc-9a8c-d345d9532cba', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:27:04 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-e9b39738-4fb0-4a56-98b2-0f6bfcb729b9 tempest-CreateVolumesFromSnapshotTest-515199839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2eb0b908-c59d-48d4-af2a-ecfa9b2d9fcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:27:04 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd4d65d1-a83a-4c6d-a157-c536e489f7bf tempest-VolumesDeleteCascade-158504705 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86512) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:27:04 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-fd4d65d1-a83a-4c6d-a157-c536e489f7bf tempest-VolumesDeleteCascade-158504705 None] Flow 'volume_create_manager' (bcba5582-3964-4c8b-a63f-abe8fa788a0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:27:04 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-fd4d65d1-a83a-4c6d-a157-c536e489f7bf tempest-VolumesDeleteCascade-158504705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8a4170d-4445-403f-a442-3d6a1608ab97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:27:04 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-e9b39738-4fb0-4a56-98b2-0f6bfcb729b9 tempest-CreateVolumesFromSnapshotTest-515199839 None] Volume volume-5433d225-988b-4ddc-9a8c-d345d9532cba (5433d225-988b-4ddc-9a8c-d345d9532cba): created successfully Sep 29 18:27:04 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-e9b39738-4fb0-4a56-98b2-0f6bfcb729b9 tempest-CreateVolumesFromSnapshotTest-515199839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2eb0b908-c59d-48d4-af2a-ecfa9b2d9fcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:27:04 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-e9b39738-4fb0-4a56-98b2-0f6bfcb729b9 tempest-CreateVolumesFromSnapshotTest-515199839 None] Flow 'volume_create_manager' (12406c99-5eef-4e14-bfb0-1aef375c09e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:27:04 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-fd4d65d1-a83a-4c6d-a157-c536e489f7bf tempest-VolumesDeleteCascade-158504705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8a4170d-4445-403f-a442-3d6a1608ab97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:27:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2099937943',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25b251a0-c66d-496e-8c61-8b291af027f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='770f4f6aa0164efb80a3486ba3336f27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:27:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:27:04Z,use_quota=True,user_id='ad8c28a474f747ac82720337dd0cac9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:27:04 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-fd4d65d1-a83a-4c6d-a157-c536e489f7bf tempest-VolumesDeleteCascade-158504705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be19e0f6-4a75-401b-889d-ffa896998af2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:27:04 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-fd4d65d1-a83a-4c6d-a157-c536e489f7bf tempest-VolumesDeleteCascade-158504705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be19e0f6-4a75-401b-889d-ffa896998af2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:27:04 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-fd4d65d1-a83a-4c6d-a157-c536e489f7bf tempest-VolumesDeleteCascade-158504705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d8fa3fe-3279-4970-a34a-6d107e0773aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:27:04 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-fd4d65d1-a83a-4c6d-a157-c536e489f7bf tempest-VolumesDeleteCascade-158504705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d8fa3fe-3279-4970-a34a-6d107e0773aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25b251a0-c66d-496e-8c61-8b291af027f7', 'volume_name': 'volume-25b251a0-c66d-496e-8c61-8b291af027f7', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:27:04 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-fd4d65d1-a83a-4c6d-a157-c536e489f7bf tempest-VolumesDeleteCascade-158504705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c39d40c9-578d-44fd-bdab-700c936c45fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:27:04 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-fd4d65d1-a83a-4c6d-a157-c536e489f7bf tempest-VolumesDeleteCascade-158504705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c39d40c9-578d-44fd-bdab-700c936c45fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:27:04 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-fd4d65d1-a83a-4c6d-a157-c536e489f7bf tempest-VolumesDeleteCascade-158504705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (915510d4-db0f-4106-8e12-63beee263f48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:27:04 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-fd4d65d1-a83a-4c6d-a157-c536e489f7bf tempest-VolumesDeleteCascade-158504705 None] Volume 25b251a0-c66d-496e-8c61-8b291af027f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25b251a0-c66d-496e-8c61-8b291af027f7', 'volume_size': 1} Sep 29 18:27:04 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-fd4d65d1-a83a-4c6d-a157-c536e489f7bf tempest-VolumesDeleteCascade-158504705 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:27:04 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-e9b39738-4fb0-4a56-98b2-0f6bfcb729b9 tempest-CreateVolumesFromSnapshotTest-515199839 None] Created volume successfully. Sep 29 18:27:04 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-92a15f2d-cd28-4f29-a615-7ed4dc0d5ee5 tempest-CreateVolumesFromSnapshotTest-515199839 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86512) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:27:04 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-92a15f2d-cd28-4f29-a615-7ed4dc0d5ee5 tempest-CreateVolumesFromSnapshotTest-515199839 None] Flow 'volume_create_manager' (e3726f98-d2ad-4e85-aeca-c2640e7fce1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:27:04 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-92a15f2d-cd28-4f29-a615-7ed4dc0d5ee5 tempest-CreateVolumesFromSnapshotTest-515199839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a149c20-ebee-4547-93b3-fd92d964a50e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:27:04 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-92a15f2d-cd28-4f29-a615-7ed4dc0d5ee5 tempest-CreateVolumesFromSnapshotTest-515199839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a149c20-ebee-4547-93b3-fd92d964a50e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:27:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-470362522',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44f25ae5-37c2-42e7-8c03-6fece125ca57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42352513d13b49d384ad0ddab561ad2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:27:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:27:05Z,use_quota=True,user_id='d79db4b811bb4b208581b32dd39a2685',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:27:04 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-92a15f2d-cd28-4f29-a615-7ed4dc0d5ee5 tempest-CreateVolumesFromSnapshotTest-515199839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a04ec42b-d087-462f-98eb-5ffc569cf742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:27:04 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-92a15f2d-cd28-4f29-a615-7ed4dc0d5ee5 tempest-CreateVolumesFromSnapshotTest-515199839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a04ec42b-d087-462f-98eb-5ffc569cf742) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:27:04 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-92a15f2d-cd28-4f29-a615-7ed4dc0d5ee5 tempest-CreateVolumesFromSnapshotTest-515199839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0691fef4-a13b-49bb-be99-475f55ca62ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:27:04 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-92a15f2d-cd28-4f29-a615-7ed4dc0d5ee5 tempest-CreateVolumesFromSnapshotTest-515199839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0691fef4-a13b-49bb-be99-475f55ca62ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44f25ae5-37c2-42e7-8c03-6fece125ca57', 'volume_name': 'volume-44f25ae5-37c2-42e7-8c03-6fece125ca57', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:27:05 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-92a15f2d-cd28-4f29-a615-7ed4dc0d5ee5 tempest-CreateVolumesFromSnapshotTest-515199839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0d09e37-06ff-49ae-a95b-b38d71885599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:27:05 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-92a15f2d-cd28-4f29-a615-7ed4dc0d5ee5 tempest-CreateVolumesFromSnapshotTest-515199839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0d09e37-06ff-49ae-a95b-b38d71885599) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:27:05 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-92a15f2d-cd28-4f29-a615-7ed4dc0d5ee5 tempest-CreateVolumesFromSnapshotTest-515199839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58dbcbfd-2878-4c3b-a185-d2b686d3c222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:27:05 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-92a15f2d-cd28-4f29-a615-7ed4dc0d5ee5 tempest-CreateVolumesFromSnapshotTest-515199839 None] Volume 44f25ae5-37c2-42e7-8c03-6fece125ca57: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44f25ae5-37c2-42e7-8c03-6fece125ca57', 'volume_size': 1} Sep 29 18:27:05 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-92a15f2d-cd28-4f29-a615-7ed4dc0d5ee5 tempest-CreateVolumesFromSnapshotTest-515199839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:27:05 devstack sudo[99138]: pam_unix(sudo:session): session closed for user root Sep 29 18:27:05 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-d62543bf-663e-4b5e-aabc-e66371c74eb6 tempest-CreateVolumesFromSnapshotTest-515199839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-800618d4-01b8-4770-9760-7b971a75abc3 1073741824" returned: 0 in 0.975s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:27:05 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-dfb9e217-6164-4f9c-938e-d00e43fe3f16 tempest-CreateVolumesFromSnapshotTest-515199839 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86512) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:27:05 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-dfb9e217-6164-4f9c-938e-d00e43fe3f16 tempest-CreateVolumesFromSnapshotTest-515199839 None] Flow 'volume_create_manager' (7228f129-5751-4ed7-a5af-1d14a4f8467d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:27:05 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-dfb9e217-6164-4f9c-938e-d00e43fe3f16 tempest-CreateVolumesFromSnapshotTest-515199839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3352a3cf-1d0f-4636-9fad-45cb9f456aaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:27:05 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-dfb9e217-6164-4f9c-938e-d00e43fe3f16 tempest-CreateVolumesFromSnapshotTest-515199839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3352a3cf-1d0f-4636-9fad-45cb9f456aaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:27:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-302346041',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=163427b7-e897-4b61-af17-55a46b3e023e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42352513d13b49d384ad0ddab561ad2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:27:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:27:05Z,use_quota=True,user_id='d79db4b811bb4b208581b32dd39a2685',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:27:05 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-dfb9e217-6164-4f9c-938e-d00e43fe3f16 tempest-CreateVolumesFromSnapshotTest-515199839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f8db95c-e33b-4cd5-a07d-2195f914858b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:27:05 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-dfb9e217-6164-4f9c-938e-d00e43fe3f16 tempest-CreateVolumesFromSnapshotTest-515199839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f8db95c-e33b-4cd5-a07d-2195f914858b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:27:05 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-dfb9e217-6164-4f9c-938e-d00e43fe3f16 tempest-CreateVolumesFromSnapshotTest-515199839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6acc2608-1743-4bb4-acba-e919bdb15df1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:27:05 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-dfb9e217-6164-4f9c-938e-d00e43fe3f16 tempest-CreateVolumesFromSnapshotTest-515199839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6acc2608-1743-4bb4-acba-e919bdb15df1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '163427b7-e897-4b61-af17-55a46b3e023e', 'volume_name': 'volume-163427b7-e897-4b61-af17-55a46b3e023e', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:27:05 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-dfb9e217-6164-4f9c-938e-d00e43fe3f16 tempest-CreateVolumesFromSnapshotTest-515199839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd64857f-8fb0-4fc7-b6d2-e415881ce0c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:27:05 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-dfb9e217-6164-4f9c-938e-d00e43fe3f16 tempest-CreateVolumesFromSnapshotTest-515199839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd64857f-8fb0-4fc7-b6d2-e415881ce0c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:27:05 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-dfb9e217-6164-4f9c-938e-d00e43fe3f16 tempest-CreateVolumesFromSnapshotTest-515199839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3eb2d703-be3b-4025-b5cd-12eaa6ac08b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:27:05 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-dfb9e217-6164-4f9c-938e-d00e43fe3f16 tempest-CreateVolumesFromSnapshotTest-515199839 None] Volume 163427b7-e897-4b61-af17-55a46b3e023e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-163427b7-e897-4b61-af17-55a46b3e023e', 'volume_size': 1} Sep 29 18:27:05 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-dfb9e217-6164-4f9c-938e-d00e43fe3f16 tempest-CreateVolumesFromSnapshotTest-515199839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:27:05 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-d62543bf-663e-4b5e-aabc-e66371c74eb6 tempest-CreateVolumesFromSnapshotTest-515199839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-800618d4-01b8-4770-9760-7b971a75abc3 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:27:05 devstack sudo[99144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-800618d4-01b8-4770-9760-7b971a75abc3 Sep 29 18:27:05 devstack sudo[99144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:27:05 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b87327d-2768-43ed-ab2f-e916472867eb tempest-CreateVolumesFromSnapshotTest-515199839 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86512) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:27:05 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-9b87327d-2768-43ed-ab2f-e916472867eb tempest-CreateVolumesFromSnapshotTest-515199839 None] Flow 'volume_create_manager' (6a1e1813-75c0-44bc-acdd-561ffec96cd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:27:05 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-9b87327d-2768-43ed-ab2f-e916472867eb tempest-CreateVolumesFromSnapshotTest-515199839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f2d2846-f410-4581-9388-508b5898c2d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:27:05 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-9b87327d-2768-43ed-ab2f-e916472867eb tempest-CreateVolumesFromSnapshotTest-515199839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f2d2846-f410-4581-9388-508b5898c2d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:27:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1910802938',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1639e659-7e4e-4e74-a695-ff8ac9218a1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42352513d13b49d384ad0ddab561ad2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:27:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:27:06Z,use_quota=True,user_id='d79db4b811bb4b208581b32dd39a2685',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:27:05 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-9b87327d-2768-43ed-ab2f-e916472867eb tempest-CreateVolumesFromSnapshotTest-515199839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d1b98fe-0fd6-4fff-a996-a9d8e3597062) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:27:05 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-9b87327d-2768-43ed-ab2f-e916472867eb tempest-CreateVolumesFromSnapshotTest-515199839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d1b98fe-0fd6-4fff-a996-a9d8e3597062) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:27:05 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-9b87327d-2768-43ed-ab2f-e916472867eb tempest-CreateVolumesFromSnapshotTest-515199839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (612b6799-9920-471b-8a92-edcbb2039033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:27:05 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-9b87327d-2768-43ed-ab2f-e916472867eb tempest-CreateVolumesFromSnapshotTest-515199839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (612b6799-9920-471b-8a92-edcbb2039033) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1639e659-7e4e-4e74-a695-ff8ac9218a1d', 'volume_name': 'volume-1639e659-7e4e-4e74-a695-ff8ac9218a1d', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:27:05 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-9b87327d-2768-43ed-ab2f-e916472867eb tempest-CreateVolumesFromSnapshotTest-515199839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea9b4dbc-5a6e-4cda-b982-94a0f628972c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:27:05 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-9b87327d-2768-43ed-ab2f-e916472867eb tempest-CreateVolumesFromSnapshotTest-515199839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea9b4dbc-5a6e-4cda-b982-94a0f628972c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:27:05 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-9b87327d-2768-43ed-ab2f-e916472867eb tempest-CreateVolumesFromSnapshotTest-515199839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6684166-29c8-46f7-968c-35cada6072bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:27:05 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-9b87327d-2768-43ed-ab2f-e916472867eb tempest-CreateVolumesFromSnapshotTest-515199839 None] Volume 1639e659-7e4e-4e74-a695-ff8ac9218a1d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1639e659-7e4e-4e74-a695-ff8ac9218a1d', 'volume_size': 1} Sep 29 18:27:05 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-9b87327d-2768-43ed-ab2f-e916472867eb tempest-CreateVolumesFromSnapshotTest-515199839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:27:06 devstack sudo[99144]: pam_unix(sudo:session): session closed for user root Sep 29 18:27:06 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-d62543bf-663e-4b5e-aabc-e66371c74eb6 tempest-CreateVolumesFromSnapshotTest-515199839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-800618d4-01b8-4770-9760-7b971a75abc3" returned: 0 in 0.337s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:27:06 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-d62543bf-663e-4b5e-aabc-e66371c74eb6 tempest-CreateVolumesFromSnapshotTest-515199839 None] <== create_volume: return (1554ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'} {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:27:06 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-d62543bf-663e-4b5e-aabc-e66371c74eb6 tempest-CreateVolumesFromSnapshotTest-515199839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.558s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:27:06 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-fd4d65d1-a83a-4c6d-a157-c536e489f7bf tempest-VolumesDeleteCascade-158504705 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.268s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:27:06 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-fd4d65d1-a83a-4c6d-a157-c536e489f7bf tempest-VolumesDeleteCascade-158504705 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:27:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2099937943',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25b251a0-c66d-496e-8c61-8b291af027f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='770f4f6aa0164efb80a3486ba3336f27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:27:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:27:04Z,use_quota=True,user_id='ad8c28a474f747ac82720337dd0cac9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)}" {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:27:06 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-fd4d65d1-a83a-4c6d-a157-c536e489f7bf tempest-VolumesDeleteCascade-158504705 None] Creating volume 25b251a0-c66d-496e-8c61-8b291af027f7 {{(pid=86512) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:27:06 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-fd4d65d1-a83a-4c6d-a157-c536e489f7bf tempest-VolumesDeleteCascade-158504705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:27:06 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-fd4d65d1-a83a-4c6d-a157-c536e489f7bf tempest-VolumesDeleteCascade-158504705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:27:06 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-fd4d65d1-a83a-4c6d-a157-c536e489f7bf tempest-VolumesDeleteCascade-158504705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:27:06 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-fd4d65d1-a83a-4c6d-a157-c536e489f7bf tempest-VolumesDeleteCascade-158504705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:27:06 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-fd4d65d1-a83a-4c6d-a157-c536e489f7bf tempest-VolumesDeleteCascade-158504705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:27:06 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-fd4d65d1-a83a-4c6d-a157-c536e489f7bf tempest-VolumesDeleteCascade-158504705 None] Selected osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 as target Quobyte volume. {{(pid=86512) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:27:06 devstack cinder-volume[86512]: INFO cinder.volume.drivers.remotefs [None req-fd4d65d1-a83a-4c6d-a157-c536e489f7bf tempest-VolumesDeleteCascade-158504705 None] casted to osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 Sep 29 18:27:06 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-fd4d65d1-a83a-4c6d-a157-c536e489f7bf tempest-VolumesDeleteCascade-158504705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-25b251a0-c66d-496e-8c61-8b291af027f7 1073741824 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:27:06 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d62543bf-663e-4b5e-aabc-e66371c74eb6 tempest-CreateVolumesFromSnapshotTest-515199839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52b26a4e-e120-4458-af8d-6b63a7a2f488) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-800618d4-01b8-4770-9760-7b971a75abc3', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:27:06 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d62543bf-663e-4b5e-aabc-e66371c74eb6 tempest-CreateVolumesFromSnapshotTest-515199839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03bc0d14-1dc9-4032-8cb5-1e8e989efca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:27:06 devstack sudo[99147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-25b251a0-c66d-496e-8c61-8b291af027f7 1073741824 Sep 29 18:27:06 devstack sudo[99147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:27:06 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-d62543bf-663e-4b5e-aabc-e66371c74eb6 tempest-CreateVolumesFromSnapshotTest-515199839 None] Volume volume-800618d4-01b8-4770-9760-7b971a75abc3 (800618d4-01b8-4770-9760-7b971a75abc3): created successfully Sep 29 18:27:06 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d62543bf-663e-4b5e-aabc-e66371c74eb6 tempest-CreateVolumesFromSnapshotTest-515199839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03bc0d14-1dc9-4032-8cb5-1e8e989efca8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:27:06 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d62543bf-663e-4b5e-aabc-e66371c74eb6 tempest-CreateVolumesFromSnapshotTest-515199839 None] Flow 'volume_create_manager' (946a4e62-7a61-469a-8b51-1f4112d71816) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:27:06 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-d62543bf-663e-4b5e-aabc-e66371c74eb6 tempest-CreateVolumesFromSnapshotTest-515199839 None] Created volume successfully. Sep 29 18:27:06 devstack sudo[99147]: pam_unix(sudo:session): session closed for user root Sep 29 18:27:06 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-fd4d65d1-a83a-4c6d-a157-c536e489f7bf tempest-VolumesDeleteCascade-158504705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-25b251a0-c66d-496e-8c61-8b291af027f7 1073741824" returned: 0 in 0.506s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:27:06 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-fd4d65d1-a83a-4c6d-a157-c536e489f7bf tempest-VolumesDeleteCascade-158504705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-25b251a0-c66d-496e-8c61-8b291af027f7 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:27:06 devstack sudo[99153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-25b251a0-c66d-496e-8c61-8b291af027f7 Sep 29 18:27:06 devstack sudo[99153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:27:06 devstack sudo[99153]: pam_unix(sudo:session): session closed for user root Sep 29 18:27:06 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-fd4d65d1-a83a-4c6d-a157-c536e489f7bf tempest-VolumesDeleteCascade-158504705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-25b251a0-c66d-496e-8c61-8b291af027f7" returned: 0 in 0.351s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:27:06 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-fd4d65d1-a83a-4c6d-a157-c536e489f7bf tempest-VolumesDeleteCascade-158504705 None] <== create_volume: return (911ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'} {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:27:06 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-fd4d65d1-a83a-4c6d-a157-c536e489f7bf tempest-VolumesDeleteCascade-158504705 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.914s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:27:06 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-92a15f2d-cd28-4f29-a615-7ed4dc0d5ee5 tempest-CreateVolumesFromSnapshotTest-515199839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.960s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:27:06 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-92a15f2d-cd28-4f29-a615-7ed4dc0d5ee5 tempest-CreateVolumesFromSnapshotTest-515199839 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:27:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-470362522',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44f25ae5-37c2-42e7-8c03-6fece125ca57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42352513d13b49d384ad0ddab561ad2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:27:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:27:05Z,use_quota=True,user_id='d79db4b811bb4b208581b32dd39a2685',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)}" {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:27:06 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-92a15f2d-cd28-4f29-a615-7ed4dc0d5ee5 tempest-CreateVolumesFromSnapshotTest-515199839 None] Creating volume 44f25ae5-37c2-42e7-8c03-6fece125ca57 {{(pid=86512) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:27:06 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-92a15f2d-cd28-4f29-a615-7ed4dc0d5ee5 tempest-CreateVolumesFromSnapshotTest-515199839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:27:06 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-92a15f2d-cd28-4f29-a615-7ed4dc0d5ee5 tempest-CreateVolumesFromSnapshotTest-515199839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:27:06 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-92a15f2d-cd28-4f29-a615-7ed4dc0d5ee5 tempest-CreateVolumesFromSnapshotTest-515199839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:27:06 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-92a15f2d-cd28-4f29-a615-7ed4dc0d5ee5 tempest-CreateVolumesFromSnapshotTest-515199839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:27:06 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-92a15f2d-cd28-4f29-a615-7ed4dc0d5ee5 tempest-CreateVolumesFromSnapshotTest-515199839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:27:06 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-92a15f2d-cd28-4f29-a615-7ed4dc0d5ee5 tempest-CreateVolumesFromSnapshotTest-515199839 None] Selected osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 as target Quobyte volume. {{(pid=86512) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:27:06 devstack cinder-volume[86512]: INFO cinder.volume.drivers.remotefs [None req-92a15f2d-cd28-4f29-a615-7ed4dc0d5ee5 tempest-CreateVolumesFromSnapshotTest-515199839 None] casted to osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 Sep 29 18:27:06 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-92a15f2d-cd28-4f29-a615-7ed4dc0d5ee5 tempest-CreateVolumesFromSnapshotTest-515199839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-44f25ae5-37c2-42e7-8c03-6fece125ca57 1073741824 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:27:07 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-fd4d65d1-a83a-4c6d-a157-c536e489f7bf tempest-VolumesDeleteCascade-158504705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (915510d4-db0f-4106-8e12-63beee263f48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25b251a0-c66d-496e-8c61-8b291af027f7', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:27:07 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-fd4d65d1-a83a-4c6d-a157-c536e489f7bf tempest-VolumesDeleteCascade-158504705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e47c87d-5a7d-46aa-903f-58eabf036ee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:27:07 devstack sudo[99156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-44f25ae5-37c2-42e7-8c03-6fece125ca57 1073741824 Sep 29 18:27:07 devstack sudo[99156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:27:07 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-fd4d65d1-a83a-4c6d-a157-c536e489f7bf tempest-VolumesDeleteCascade-158504705 None] Volume volume-25b251a0-c66d-496e-8c61-8b291af027f7 (25b251a0-c66d-496e-8c61-8b291af027f7): created successfully Sep 29 18:27:07 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-fd4d65d1-a83a-4c6d-a157-c536e489f7bf tempest-VolumesDeleteCascade-158504705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e47c87d-5a7d-46aa-903f-58eabf036ee0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:27:07 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-fd4d65d1-a83a-4c6d-a157-c536e489f7bf tempest-VolumesDeleteCascade-158504705 None] Flow 'volume_create_manager' (bcba5582-3964-4c8b-a63f-abe8fa788a0a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:27:07 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-fd4d65d1-a83a-4c6d-a157-c536e489f7bf tempest-VolumesDeleteCascade-158504705 None] Created volume successfully. Sep 29 18:27:07 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7b23f98-a3ca-476f-b424-f1ebafa3c817 tempest-AbsoluteLimitsTests-228554029 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86512) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:27:07 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d7b23f98-a3ca-476f-b424-f1ebafa3c817 tempest-AbsoluteLimitsTests-228554029 None] Flow 'volume_create_manager' (07679671-2250-4581-a3f6-f3ba97051d0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:27:07 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d7b23f98-a3ca-476f-b424-f1ebafa3c817 tempest-AbsoluteLimitsTests-228554029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36c0a942-37d5-42d2-b566-6239881e1def) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:27:07 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d7b23f98-a3ca-476f-b424-f1ebafa3c817 tempest-AbsoluteLimitsTests-228554029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36c0a942-37d5-42d2-b566-6239881e1def) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:27:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-528942665',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7ef2e30-ce7e-4d7d-8df1-d0ffbfa28739,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a89440a0cab4257aa378b317aa66e23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:27:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:27:07Z,use_quota=True,user_id='030d842505994d20b82fa525e73986d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:27:07 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d7b23f98-a3ca-476f-b424-f1ebafa3c817 tempest-AbsoluteLimitsTests-228554029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06d3c579-a328-4373-bb76-d0c4cf2a0550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:27:07 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d7b23f98-a3ca-476f-b424-f1ebafa3c817 tempest-AbsoluteLimitsTests-228554029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06d3c579-a328-4373-bb76-d0c4cf2a0550) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:27:07 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d7b23f98-a3ca-476f-b424-f1ebafa3c817 tempest-AbsoluteLimitsTests-228554029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4c10dc6-3ef3-4b93-82e2-7ecb45e229e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:27:07 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d7b23f98-a3ca-476f-b424-f1ebafa3c817 tempest-AbsoluteLimitsTests-228554029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4c10dc6-3ef3-4b93-82e2-7ecb45e229e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7ef2e30-ce7e-4d7d-8df1-d0ffbfa28739', 'volume_name': 'volume-a7ef2e30-ce7e-4d7d-8df1-d0ffbfa28739', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:27:07 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d7b23f98-a3ca-476f-b424-f1ebafa3c817 tempest-AbsoluteLimitsTests-228554029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dea9353c-8e6a-4926-af9d-57b69212f0cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:27:07 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d7b23f98-a3ca-476f-b424-f1ebafa3c817 tempest-AbsoluteLimitsTests-228554029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dea9353c-8e6a-4926-af9d-57b69212f0cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:27:07 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d7b23f98-a3ca-476f-b424-f1ebafa3c817 tempest-AbsoluteLimitsTests-228554029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b93f767e-b283-467d-85f2-ffe991fa8139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:27:07 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-d7b23f98-a3ca-476f-b424-f1ebafa3c817 tempest-AbsoluteLimitsTests-228554029 None] Volume a7ef2e30-ce7e-4d7d-8df1-d0ffbfa28739: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7ef2e30-ce7e-4d7d-8df1-d0ffbfa28739', 'volume_size': 1} Sep 29 18:27:07 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-d7b23f98-a3ca-476f-b424-f1ebafa3c817 tempest-AbsoluteLimitsTests-228554029 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:27:07 devstack sudo[99156]: pam_unix(sudo:session): session closed for user root Sep 29 18:27:07 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-92a15f2d-cd28-4f29-a615-7ed4dc0d5ee5 tempest-CreateVolumesFromSnapshotTest-515199839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-44f25ae5-37c2-42e7-8c03-6fece125ca57 1073741824" returned: 0 in 0.504s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:27:07 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-92a15f2d-cd28-4f29-a615-7ed4dc0d5ee5 tempest-CreateVolumesFromSnapshotTest-515199839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-44f25ae5-37c2-42e7-8c03-6fece125ca57 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:27:07 devstack sudo[99162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-44f25ae5-37c2-42e7-8c03-6fece125ca57 Sep 29 18:27:07 devstack sudo[99162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:27:07 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-a4514e6c-7a26-45d2-911d-02b89d4a47cd tempest-VolumesDeleteCascade-158504705 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:27:07 devstack sudo[99162]: pam_unix(sudo:session): session closed for user root Sep 29 18:27:07 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-92a15f2d-cd28-4f29-a615-7ed4dc0d5ee5 tempest-CreateVolumesFromSnapshotTest-515199839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-44f25ae5-37c2-42e7-8c03-6fece125ca57" returned: 0 in 0.306s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:27:07 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-92a15f2d-cd28-4f29-a615-7ed4dc0d5ee5 tempest-CreateVolumesFromSnapshotTest-515199839 None] <== create_volume: return (864ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'} {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:27:07 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-92a15f2d-cd28-4f29-a615-7ed4dc0d5ee5 tempest-CreateVolumesFromSnapshotTest-515199839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.867s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:27:07 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-dfb9e217-6164-4f9c-938e-d00e43fe3f16 tempest-CreateVolumesFromSnapshotTest-515199839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.155s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:27:07 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-dfb9e217-6164-4f9c-938e-d00e43fe3f16 tempest-CreateVolumesFromSnapshotTest-515199839 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:27:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-302346041',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=163427b7-e897-4b61-af17-55a46b3e023e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42352513d13b49d384ad0ddab561ad2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:27:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:27:05Z,use_quota=True,user_id='d79db4b811bb4b208581b32dd39a2685',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)}" {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:27:07 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-dfb9e217-6164-4f9c-938e-d00e43fe3f16 tempest-CreateVolumesFromSnapshotTest-515199839 None] Creating volume 163427b7-e897-4b61-af17-55a46b3e023e {{(pid=86512) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:27:07 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-dfb9e217-6164-4f9c-938e-d00e43fe3f16 tempest-CreateVolumesFromSnapshotTest-515199839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:27:07 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-dfb9e217-6164-4f9c-938e-d00e43fe3f16 tempest-CreateVolumesFromSnapshotTest-515199839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:27:07 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-dfb9e217-6164-4f9c-938e-d00e43fe3f16 tempest-CreateVolumesFromSnapshotTest-515199839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:27:07 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-dfb9e217-6164-4f9c-938e-d00e43fe3f16 tempest-CreateVolumesFromSnapshotTest-515199839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:27:07 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-dfb9e217-6164-4f9c-938e-d00e43fe3f16 tempest-CreateVolumesFromSnapshotTest-515199839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:27:07 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-dfb9e217-6164-4f9c-938e-d00e43fe3f16 tempest-CreateVolumesFromSnapshotTest-515199839 None] Selected osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 as target Quobyte volume. {{(pid=86512) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:27:07 devstack cinder-volume[86512]: INFO cinder.volume.drivers.remotefs [None req-dfb9e217-6164-4f9c-938e-d00e43fe3f16 tempest-CreateVolumesFromSnapshotTest-515199839 None] casted to osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 Sep 29 18:27:07 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-dfb9e217-6164-4f9c-938e-d00e43fe3f16 tempest-CreateVolumesFromSnapshotTest-515199839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-163427b7-e897-4b61-af17-55a46b3e023e 1073741824 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:27:07 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-92a15f2d-cd28-4f29-a615-7ed4dc0d5ee5 tempest-CreateVolumesFromSnapshotTest-515199839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58dbcbfd-2878-4c3b-a185-d2b686d3c222) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44f25ae5-37c2-42e7-8c03-6fece125ca57', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:27:07 devstack sudo[99165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-163427b7-e897-4b61-af17-55a46b3e023e 1073741824 Sep 29 18:27:07 devstack sudo[99165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:27:07 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-92a15f2d-cd28-4f29-a615-7ed4dc0d5ee5 tempest-CreateVolumesFromSnapshotTest-515199839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b1477bf-dcc3-4600-9fd8-7b11936b140c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:27:07 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-92a15f2d-cd28-4f29-a615-7ed4dc0d5ee5 tempest-CreateVolumesFromSnapshotTest-515199839 None] Volume volume-44f25ae5-37c2-42e7-8c03-6fece125ca57 (44f25ae5-37c2-42e7-8c03-6fece125ca57): created successfully Sep 29 18:27:07 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-92a15f2d-cd28-4f29-a615-7ed4dc0d5ee5 tempest-CreateVolumesFromSnapshotTest-515199839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b1477bf-dcc3-4600-9fd8-7b11936b140c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:27:07 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-92a15f2d-cd28-4f29-a615-7ed4dc0d5ee5 tempest-CreateVolumesFromSnapshotTest-515199839 None] Flow 'volume_create_manager' (e3726f98-d2ad-4e85-aeca-c2640e7fce1c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:27:07 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-92a15f2d-cd28-4f29-a615-7ed4dc0d5ee5 tempest-CreateVolumesFromSnapshotTest-515199839 None] Created volume successfully. Sep 29 18:27:08 devstack sudo[99165]: pam_unix(sudo:session): session closed for user root Sep 29 18:27:08 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-dfb9e217-6164-4f9c-938e-d00e43fe3f16 tempest-CreateVolumesFromSnapshotTest-515199839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-163427b7-e897-4b61-af17-55a46b3e023e 1073741824" returned: 0 in 0.458s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:27:08 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-dfb9e217-6164-4f9c-938e-d00e43fe3f16 tempest-CreateVolumesFromSnapshotTest-515199839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-163427b7-e897-4b61-af17-55a46b3e023e {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:27:08 devstack sudo[99170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-163427b7-e897-4b61-af17-55a46b3e023e Sep 29 18:27:08 devstack sudo[99170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:27:08 devstack sudo[99170]: pam_unix(sudo:session): session closed for user root Sep 29 18:27:08 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-dfb9e217-6164-4f9c-938e-d00e43fe3f16 tempest-CreateVolumesFromSnapshotTest-515199839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-163427b7-e897-4b61-af17-55a46b3e023e" returned: 0 in 0.248s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:27:08 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-dfb9e217-6164-4f9c-938e-d00e43fe3f16 tempest-CreateVolumesFromSnapshotTest-515199839 None] <== create_volume: return (749ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'} {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:27:08 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-dfb9e217-6164-4f9c-938e-d00e43fe3f16 tempest-CreateVolumesFromSnapshotTest-515199839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.752s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:27:08 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-9b87327d-2768-43ed-ab2f-e916472867eb tempest-CreateVolumesFromSnapshotTest-515199839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.683s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:27:08 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-9b87327d-2768-43ed-ab2f-e916472867eb tempest-CreateVolumesFromSnapshotTest-515199839 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:27:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1910802938',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1639e659-7e4e-4e74-a695-ff8ac9218a1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42352513d13b49d384ad0ddab561ad2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:27:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:27:06Z,use_quota=True,user_id='d79db4b811bb4b208581b32dd39a2685',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)}" {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:27:08 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-9b87327d-2768-43ed-ab2f-e916472867eb tempest-CreateVolumesFromSnapshotTest-515199839 None] Creating volume 1639e659-7e4e-4e74-a695-ff8ac9218a1d {{(pid=86512) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:27:08 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-9b87327d-2768-43ed-ab2f-e916472867eb tempest-CreateVolumesFromSnapshotTest-515199839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:27:08 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-9b87327d-2768-43ed-ab2f-e916472867eb tempest-CreateVolumesFromSnapshotTest-515199839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:27:08 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-9b87327d-2768-43ed-ab2f-e916472867eb tempest-CreateVolumesFromSnapshotTest-515199839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:27:08 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-9b87327d-2768-43ed-ab2f-e916472867eb tempest-CreateVolumesFromSnapshotTest-515199839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:27:08 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-9b87327d-2768-43ed-ab2f-e916472867eb tempest-CreateVolumesFromSnapshotTest-515199839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:27:08 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-9b87327d-2768-43ed-ab2f-e916472867eb tempest-CreateVolumesFromSnapshotTest-515199839 None] Selected osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 as target Quobyte volume. {{(pid=86512) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:27:08 devstack cinder-volume[86512]: INFO cinder.volume.drivers.remotefs [None req-9b87327d-2768-43ed-ab2f-e916472867eb tempest-CreateVolumesFromSnapshotTest-515199839 None] casted to osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 Sep 29 18:27:08 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-9b87327d-2768-43ed-ab2f-e916472867eb tempest-CreateVolumesFromSnapshotTest-515199839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-1639e659-7e4e-4e74-a695-ff8ac9218a1d 1073741824 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:27:08 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-dfb9e217-6164-4f9c-938e-d00e43fe3f16 tempest-CreateVolumesFromSnapshotTest-515199839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3eb2d703-be3b-4025-b5cd-12eaa6ac08b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-163427b7-e897-4b61-af17-55a46b3e023e', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:27:08 devstack sudo[99173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-1639e659-7e4e-4e74-a695-ff8ac9218a1d 1073741824 Sep 29 18:27:08 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-dfb9e217-6164-4f9c-938e-d00e43fe3f16 tempest-CreateVolumesFromSnapshotTest-515199839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6b42207-bdb0-417e-8a1a-debaf2416691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:27:08 devstack sudo[99173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:27:08 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-dfb9e217-6164-4f9c-938e-d00e43fe3f16 tempest-CreateVolumesFromSnapshotTest-515199839 None] Volume volume-163427b7-e897-4b61-af17-55a46b3e023e (163427b7-e897-4b61-af17-55a46b3e023e): created successfully Sep 29 18:27:08 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-dfb9e217-6164-4f9c-938e-d00e43fe3f16 tempest-CreateVolumesFromSnapshotTest-515199839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6b42207-bdb0-417e-8a1a-debaf2416691) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:27:08 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-dfb9e217-6164-4f9c-938e-d00e43fe3f16 tempest-CreateVolumesFromSnapshotTest-515199839 None] Flow 'volume_create_manager' (7228f129-5751-4ed7-a5af-1d14a4f8467d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:27:08 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-dfb9e217-6164-4f9c-938e-d00e43fe3f16 tempest-CreateVolumesFromSnapshotTest-515199839 None] Created volume successfully. Sep 29 18:27:09 devstack sudo[99173]: pam_unix(sudo:session): session closed for user root Sep 29 18:27:09 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-9b87327d-2768-43ed-ab2f-e916472867eb tempest-CreateVolumesFromSnapshotTest-515199839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-1639e659-7e4e-4e74-a695-ff8ac9218a1d 1073741824" returned: 0 in 0.453s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:27:09 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-9b87327d-2768-43ed-ab2f-e916472867eb tempest-CreateVolumesFromSnapshotTest-515199839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-1639e659-7e4e-4e74-a695-ff8ac9218a1d {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:27:09 devstack sudo[99178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-1639e659-7e4e-4e74-a695-ff8ac9218a1d Sep 29 18:27:09 devstack sudo[99178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:27:09 devstack sudo[99178]: pam_unix(sudo:session): session closed for user root Sep 29 18:27:09 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-9b87327d-2768-43ed-ab2f-e916472867eb tempest-CreateVolumesFromSnapshotTest-515199839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-1639e659-7e4e-4e74-a695-ff8ac9218a1d" returned: 0 in 0.276s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:27:09 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-9b87327d-2768-43ed-ab2f-e916472867eb tempest-CreateVolumesFromSnapshotTest-515199839 None] <== create_volume: return (793ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'} {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:27:09 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-9b87327d-2768-43ed-ab2f-e916472867eb tempest-CreateVolumesFromSnapshotTest-515199839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.799s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:27:09 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-d7b23f98-a3ca-476f-b424-f1ebafa3c817 tempest-AbsoluteLimitsTests-228554029 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.214s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:27:09 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-d7b23f98-a3ca-476f-b424-f1ebafa3c817 tempest-AbsoluteLimitsTests-228554029 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:27:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-528942665',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7ef2e30-ce7e-4d7d-8df1-d0ffbfa28739,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a89440a0cab4257aa378b317aa66e23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:27:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:27:07Z,use_quota=True,user_id='030d842505994d20b82fa525e73986d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)}" {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:27:09 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-d7b23f98-a3ca-476f-b424-f1ebafa3c817 tempest-AbsoluteLimitsTests-228554029 None] Creating volume a7ef2e30-ce7e-4d7d-8df1-d0ffbfa28739 {{(pid=86512) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:27:09 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-d7b23f98-a3ca-476f-b424-f1ebafa3c817 tempest-AbsoluteLimitsTests-228554029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:27:09 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-d7b23f98-a3ca-476f-b424-f1ebafa3c817 tempest-AbsoluteLimitsTests-228554029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:27:09 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-d7b23f98-a3ca-476f-b424-f1ebafa3c817 tempest-AbsoluteLimitsTests-228554029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:27:09 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-d7b23f98-a3ca-476f-b424-f1ebafa3c817 tempest-AbsoluteLimitsTests-228554029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:27:09 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-d7b23f98-a3ca-476f-b424-f1ebafa3c817 tempest-AbsoluteLimitsTests-228554029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:27:09 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-d7b23f98-a3ca-476f-b424-f1ebafa3c817 tempest-AbsoluteLimitsTests-228554029 None] Selected osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 as target Quobyte volume. {{(pid=86512) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:27:09 devstack cinder-volume[86512]: INFO cinder.volume.drivers.remotefs [None req-d7b23f98-a3ca-476f-b424-f1ebafa3c817 tempest-AbsoluteLimitsTests-228554029 None] casted to osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 Sep 29 18:27:09 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-d7b23f98-a3ca-476f-b424-f1ebafa3c817 tempest-AbsoluteLimitsTests-228554029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a7ef2e30-ce7e-4d7d-8df1-d0ffbfa28739 1073741824 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:27:09 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-9b87327d-2768-43ed-ab2f-e916472867eb tempest-CreateVolumesFromSnapshotTest-515199839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6684166-29c8-46f7-968c-35cada6072bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1639e659-7e4e-4e74-a695-ff8ac9218a1d', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:27:09 devstack sudo[99181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a7ef2e30-ce7e-4d7d-8df1-d0ffbfa28739 1073741824 Sep 29 18:27:09 devstack sudo[99181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:27:09 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-9b87327d-2768-43ed-ab2f-e916472867eb tempest-CreateVolumesFromSnapshotTest-515199839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7ed11c4-6c1d-456f-89ce-7c76702617f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:27:09 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-9b87327d-2768-43ed-ab2f-e916472867eb tempest-CreateVolumesFromSnapshotTest-515199839 None] Volume volume-1639e659-7e4e-4e74-a695-ff8ac9218a1d (1639e659-7e4e-4e74-a695-ff8ac9218a1d): created successfully Sep 29 18:27:09 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-9b87327d-2768-43ed-ab2f-e916472867eb tempest-CreateVolumesFromSnapshotTest-515199839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7ed11c4-6c1d-456f-89ce-7c76702617f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:27:09 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-9b87327d-2768-43ed-ab2f-e916472867eb tempest-CreateVolumesFromSnapshotTest-515199839 None] Flow 'volume_create_manager' (6a1e1813-75c0-44bc-acdd-561ffec96cd1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:27:09 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-9b87327d-2768-43ed-ab2f-e916472867eb tempest-CreateVolumesFromSnapshotTest-515199839 None] Created volume successfully. Sep 29 18:27:09 devstack sudo[99181]: pam_unix(sudo:session): session closed for user root Sep 29 18:27:09 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-d7b23f98-a3ca-476f-b424-f1ebafa3c817 tempest-AbsoluteLimitsTests-228554029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a7ef2e30-ce7e-4d7d-8df1-d0ffbfa28739 1073741824" returned: 0 in 0.431s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:27:09 devstack cinder-volume[86512]: DEBUG dbcounter [-] [86512] Writing DB stats cinder:SELECT=171,cinder:UPDATE=212,cinder:INSERT=53,cinder:DELETE=17 {{(pid=86512) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 18:27:09 devstack cinder-volume[86512]: DEBUG dbcounter [-] [86512] Writing DB stats cinder:SELECT=153,cinder:UPDATE=188,cinder:INSERT=61,cinder:DELETE=21 {{(pid=86512) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 18:27:09 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-d7b23f98-a3ca-476f-b424-f1ebafa3c817 tempest-AbsoluteLimitsTests-228554029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a7ef2e30-ce7e-4d7d-8df1-d0ffbfa28739 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:27:09 devstack sudo[99186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a7ef2e30-ce7e-4d7d-8df1-d0ffbfa28739 Sep 29 18:27:09 devstack sudo[99186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:27:10 devstack sudo[99186]: pam_unix(sudo:session): session closed for user root Sep 29 18:27:10 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-d7b23f98-a3ca-476f-b424-f1ebafa3c817 tempest-AbsoluteLimitsTests-228554029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a7ef2e30-ce7e-4d7d-8df1-d0ffbfa28739" returned: 0 in 0.269s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:27:10 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-d7b23f98-a3ca-476f-b424-f1ebafa3c817 tempest-AbsoluteLimitsTests-228554029 None] <== create_volume: return (755ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'} {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:27:10 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-d7b23f98-a3ca-476f-b424-f1ebafa3c817 tempest-AbsoluteLimitsTests-228554029 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.760s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:27:10 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-a4514e6c-7a26-45d2-911d-02b89d4a47cd tempest-VolumesDeleteCascade-158504705 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.440s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:27:10 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d7b23f98-a3ca-476f-b424-f1ebafa3c817 tempest-AbsoluteLimitsTests-228554029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b93f767e-b283-467d-85f2-ffe991fa8139) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7ef2e30-ce7e-4d7d-8df1-d0ffbfa28739', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:27:10 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d7b23f98-a3ca-476f-b424-f1ebafa3c817 tempest-AbsoluteLimitsTests-228554029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a30ba2a-c1b7-4f2e-aa8f-9799b145fa83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:27:10 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-a4514e6c-7a26-45d2-911d-02b89d4a47cd tempest-VolumesDeleteCascade-158504705 None] Creating offline snapshot b90a4d0e-7521-49c2-b81a-643ff7115fc6 of volume 25b251a0-c66d-496e-8c61-8b291af027f7 {{(pid=86512) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 18:27:10 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-d7b23f98-a3ca-476f-b424-f1ebafa3c817 tempest-AbsoluteLimitsTests-228554029 None] Volume volume-a7ef2e30-ce7e-4d7d-8df1-d0ffbfa28739 (a7ef2e30-ce7e-4d7d-8df1-d0ffbfa28739): created successfully Sep 29 18:27:10 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d7b23f98-a3ca-476f-b424-f1ebafa3c817 tempest-AbsoluteLimitsTests-228554029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a30ba2a-c1b7-4f2e-aa8f-9799b145fa83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:27:10 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d7b23f98-a3ca-476f-b424-f1ebafa3c817 tempest-AbsoluteLimitsTests-228554029 None] Flow 'volume_create_manager' (07679671-2250-4581-a3f6-f3ba97051d0c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:27:10 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa2ac09c-bb26-40d4-a70f-4be3b3f2a3aa]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:27:10 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a4514e6c-7a26-45d2-911d-02b89d4a47cd tempest-VolumesDeleteCascade-158504705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-25b251a0-c66d-496e-8c61-8b291af027f7 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:27:10 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-d7b23f98-a3ca-476f-b424-f1ebafa3c817 tempest-AbsoluteLimitsTests-228554029 None] Created volume successfully. Sep 29 18:27:10 devstack sudo[99189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-25b251a0-c66d-496e-8c61-8b291af027f7 Sep 29 18:27:10 devstack sudo[99189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:27:10 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-e891ddf0-0f70-42f8-95fd-ac92d6d72f95 tempest-CreateVolumesFromSnapshotTest-515199839 None] Acquiring lock "cinder-1639e659-7e4e-4e74-a695-ff8ac9218a1d-delete_volume" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:27:10 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-e891ddf0-0f70-42f8-95fd-ac92d6d72f95 tempest-CreateVolumesFromSnapshotTest-515199839 None] Lock "cinder-1639e659-7e4e-4e74-a695-ff8ac9218a1d-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:27:10 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-e891ddf0-0f70-42f8-95fd-ac92d6d72f95 tempest-CreateVolumesFromSnapshotTest-515199839 None] Acquiring lock "cinder-quobyte-1639e659-7e4e-4e74-a695-ff8ac9218a1d" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:27:10 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-e891ddf0-0f70-42f8-95fd-ac92d6d72f95 tempest-CreateVolumesFromSnapshotTest-515199839 None] Lock "cinder-quobyte-1639e659-7e4e-4e74-a695-ff8ac9218a1d" acquired by "delete_volume" :: waited 0.021s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:27:10 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[c59597e2-8943-4d0c-b258-74671c3ce5ba]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:27:10 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-e891ddf0-0f70-42f8-95fd-ac92d6d72f95 tempest-CreateVolumesFromSnapshotTest-515199839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-1639e659-7e4e-4e74-a695-ff8ac9218a1d {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:27:10 devstack sudo[99191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-1639e659-7e4e-4e74-a695-ff8ac9218a1d Sep 29 18:27:10 devstack sudo[99191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:27:10 devstack sudo[99189]: pam_unix(sudo:session): session closed for user root Sep 29 18:27:10 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a4514e6c-7a26-45d2-911d-02b89d4a47cd tempest-VolumesDeleteCascade-158504705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-25b251a0-c66d-496e-8c61-8b291af027f7" returned: 0 in 0.477s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:27:10 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a4514e6c-7a26-45d2-911d-02b89d4a47cd tempest-VolumesDeleteCascade-158504705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-25b251a0-c66d-496e-8c61-8b291af027f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-25b251a0-c66d-496e-8c61-8b291af027f7.b90a4d0e-7521-49c2-b81a-643ff7115fc6 1G {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:27:10 devstack sudo[99196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-25b251a0-c66d-496e-8c61-8b291af027f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-25b251a0-c66d-496e-8c61-8b291af027f7.b90a4d0e-7521-49c2-b81a-643ff7115fc6 1G Sep 29 18:27:10 devstack sudo[99196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:27:10 devstack sudo[99191]: pam_unix(sudo:session): session closed for user root Sep 29 18:27:10 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-e891ddf0-0f70-42f8-95fd-ac92d6d72f95 tempest-CreateVolumesFromSnapshotTest-515199839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-1639e659-7e4e-4e74-a695-ff8ac9218a1d" returned: 0 in 0.407s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:27:10 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-e891ddf0-0f70-42f8-95fd-ac92d6d72f95 tempest-CreateVolumesFromSnapshotTest-515199839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-1639e659-7e4e-4e74-a695-ff8ac9218a1d {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:27:10 devstack sudo[99201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-1639e659-7e4e-4e74-a695-ff8ac9218a1d Sep 29 18:27:10 devstack sudo[99201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:27:11 devstack sudo[99196]: pam_unix(sudo:session): session closed for user root Sep 29 18:27:11 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a4514e6c-7a26-45d2-911d-02b89d4a47cd tempest-VolumesDeleteCascade-158504705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-25b251a0-c66d-496e-8c61-8b291af027f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-25b251a0-c66d-496e-8c61-8b291af027f7.b90a4d0e-7521-49c2-b81a-643ff7115fc6 1G" returned: 0 in 0.424s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:27:11 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a4514e6c-7a26-45d2-911d-02b89d4a47cd tempest-VolumesDeleteCascade-158504705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-25b251a0-c66d-496e-8c61-8b291af027f7 -F qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-25b251a0-c66d-496e-8c61-8b291af027f7.b90a4d0e-7521-49c2-b81a-643ff7115fc6 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:27:11 devstack sudo[99206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-25b251a0-c66d-496e-8c61-8b291af027f7 -F qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-25b251a0-c66d-496e-8c61-8b291af027f7.b90a4d0e-7521-49c2-b81a-643ff7115fc6 Sep 29 18:27:11 devstack sudo[99206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:27:11 devstack sudo[99201]: pam_unix(sudo:session): session closed for user root Sep 29 18:27:11 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-e891ddf0-0f70-42f8-95fd-ac92d6d72f95 tempest-CreateVolumesFromSnapshotTest-515199839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-1639e659-7e4e-4e74-a695-ff8ac9218a1d" returned: 0 in 0.336s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:27:11 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-e891ddf0-0f70-42f8-95fd-ac92d6d72f95 tempest-CreateVolumesFromSnapshotTest-515199839 None] Lock "cinder-quobyte-1639e659-7e4e-4e74-a695-ff8ac9218a1d" released by "delete_volume" :: held 0.805s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:27:11 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-e891ddf0-0f70-42f8-95fd-ac92d6d72f95 tempest-CreateVolumesFromSnapshotTest-515199839 None] Created reservations ['2fbc938e-d5d7-45df-851c-56eacc8a4e91', '8beeec26-fab0-4835-91a5-ddfab8d129ab', '84f6c0e7-1ba1-4496-963b-bc980feb7e07', 'a7f9c5a7-638a-4cc7-b45d-4ecc3f6e7f1e'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:27:11 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-e891ddf0-0f70-42f8-95fd-ac92d6d72f95 tempest-CreateVolumesFromSnapshotTest-515199839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:27:11 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-e891ddf0-0f70-42f8-95fd-ac92d6d72f95 tempest-CreateVolumesFromSnapshotTest-515199839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:27:11 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-e891ddf0-0f70-42f8-95fd-ac92d6d72f95 tempest-CreateVolumesFromSnapshotTest-515199839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:27:11 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-e891ddf0-0f70-42f8-95fd-ac92d6d72f95 tempest-CreateVolumesFromSnapshotTest-515199839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:27:11 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-e891ddf0-0f70-42f8-95fd-ac92d6d72f95 tempest-CreateVolumesFromSnapshotTest-515199839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:27:11 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-e891ddf0-0f70-42f8-95fd-ac92d6d72f95 tempest-CreateVolumesFromSnapshotTest-515199839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:27:11 devstack sudo[99211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:27:11 devstack sudo[99211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:27:11 devstack sudo[99206]: pam_unix(sudo:session): session closed for user root Sep 29 18:27:11 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a4514e6c-7a26-45d2-911d-02b89d4a47cd tempest-VolumesDeleteCascade-158504705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-25b251a0-c66d-496e-8c61-8b291af027f7 -F qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-25b251a0-c66d-496e-8c61-8b291af027f7.b90a4d0e-7521-49c2-b81a-643ff7115fc6" returned: 0 in 0.435s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:27:11 devstack cinder-volume[86512]: WARNING cinder.volume.drivers.remotefs [None req-a4514e6c-7a26-45d2-911d-02b89d4a47cd tempest-VolumesDeleteCascade-158504705 None] /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-25b251a0-c66d-496e-8c61-8b291af027f7.b90a4d0e-7521-49c2-b81a-643ff7115fc6 is being set with open permissions: ugo+rw Sep 29 18:27:11 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a4514e6c-7a26-45d2-911d-02b89d4a47cd tempest-VolumesDeleteCascade-158504705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-25b251a0-c66d-496e-8c61-8b291af027f7.b90a4d0e-7521-49c2-b81a-643ff7115fc6 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:27:11 devstack sudo[99214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-25b251a0-c66d-496e-8c61-8b291af027f7.b90a4d0e-7521-49c2-b81a-643ff7115fc6 Sep 29 18:27:11 devstack sudo[99214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:27:11 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-312f7d0c-ccc1-4d0c-bff9-99ba224feb61 tempest-AbsoluteLimitsTests-228554029 None] Acquiring lock "cinder-a7ef2e30-ce7e-4d7d-8df1-d0ffbfa28739-delete_volume" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:27:11 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-312f7d0c-ccc1-4d0c-bff9-99ba224feb61 tempest-AbsoluteLimitsTests-228554029 None] Lock "cinder-a7ef2e30-ce7e-4d7d-8df1-d0ffbfa28739-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:27:11 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-4e35ac78-b6bf-4efc-98a7-0787d059e151 tempest-CreateVolumesFromSnapshotTest-515199839 None] Acquiring lock "cinder-163427b7-e897-4b61-af17-55a46b3e023e-delete_volume" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:27:11 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-312f7d0c-ccc1-4d0c-bff9-99ba224feb61 tempest-AbsoluteLimitsTests-228554029 None] Acquiring lock "cinder-quobyte-a7ef2e30-ce7e-4d7d-8df1-d0ffbfa28739" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:27:11 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-4e35ac78-b6bf-4efc-98a7-0787d059e151 tempest-CreateVolumesFromSnapshotTest-515199839 None] Lock "cinder-163427b7-e897-4b61-af17-55a46b3e023e-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:27:11 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-312f7d0c-ccc1-4d0c-bff9-99ba224feb61 tempest-AbsoluteLimitsTests-228554029 None] Lock "cinder-quobyte-a7ef2e30-ce7e-4d7d-8df1-d0ffbfa28739" acquired by "delete_volume" :: waited 0.064s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:27:11 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f40dc25-504d-4d08-8659-36eb5d6ab3ea]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:27:11 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-312f7d0c-ccc1-4d0c-bff9-99ba224feb61 tempest-AbsoluteLimitsTests-228554029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a7ef2e30-ce7e-4d7d-8df1-d0ffbfa28739 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:27:11 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-4e35ac78-b6bf-4efc-98a7-0787d059e151 tempest-CreateVolumesFromSnapshotTest-515199839 None] Acquiring lock "cinder-quobyte-163427b7-e897-4b61-af17-55a46b3e023e" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:27:11 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-4e35ac78-b6bf-4efc-98a7-0787d059e151 tempest-CreateVolumesFromSnapshotTest-515199839 None] Lock "cinder-quobyte-163427b7-e897-4b61-af17-55a46b3e023e" acquired by "delete_volume" :: waited 0.025s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:27:11 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0898e8e-7dbf-4426-937c-bdd31a68a030]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:27:11 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-4e35ac78-b6bf-4efc-98a7-0787d059e151 tempest-CreateVolumesFromSnapshotTest-515199839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-163427b7-e897-4b61-af17-55a46b3e023e {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:27:11 devstack sudo[99211]: pam_unix(sudo:session): session closed for user root Sep 29 18:27:11 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-e891ddf0-0f70-42f8-95fd-ac92d6d72f95 tempest-CreateVolumesFromSnapshotTest-515199839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.488s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:27:11 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-e891ddf0-0f70-42f8-95fd-ac92d6d72f95 tempest-CreateVolumesFromSnapshotTest-515199839 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:27:12 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-e891ddf0-0f70-42f8-95fd-ac92d6d72f95 tempest-CreateVolumesFromSnapshotTest-515199839 None] Deleted volume successfully. Sep 29 18:27:12 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-e891ddf0-0f70-42f8-95fd-ac92d6d72f95 tempest-CreateVolumesFromSnapshotTest-515199839 None] Lock "cinder-1639e659-7e4e-4e74-a695-ff8ac9218a1d-delete_volume" released by "delete_volume" :: held 1.614s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:27:12 devstack sudo[99216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a7ef2e30-ce7e-4d7d-8df1-d0ffbfa28739 Sep 29 18:27:12 devstack sudo[99216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:27:12 devstack sudo[99218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-163427b7-e897-4b61-af17-55a46b3e023e Sep 29 18:27:12 devstack sudo[99218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:27:12 devstack sudo[99214]: pam_unix(sudo:session): session closed for user root Sep 29 18:27:12 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a4514e6c-7a26-45d2-911d-02b89d4a47cd tempest-VolumesDeleteCascade-158504705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-25b251a0-c66d-496e-8c61-8b291af027f7.b90a4d0e-7521-49c2-b81a-643ff7115fc6" returned: 0 in 0.532s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:27:12 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a4514e6c-7a26-45d2-911d-02b89d4a47cd tempest-VolumesDeleteCascade-158504705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-25b251a0-c66d-496e-8c61-8b291af027f7.info {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:27:12 devstack sudo[99222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-25b251a0-c66d-496e-8c61-8b291af027f7.info Sep 29 18:27:12 devstack sudo[99222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:27:12 devstack sudo[99218]: pam_unix(sudo:session): session closed for user root Sep 29 18:27:12 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-4e35ac78-b6bf-4efc-98a7-0787d059e151 tempest-CreateVolumesFromSnapshotTest-515199839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-163427b7-e897-4b61-af17-55a46b3e023e" returned: 0 in 0.450s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:27:12 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-4e35ac78-b6bf-4efc-98a7-0787d059e151 tempest-CreateVolumesFromSnapshotTest-515199839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-163427b7-e897-4b61-af17-55a46b3e023e {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:27:12 devstack sudo[99216]: pam_unix(sudo:session): session closed for user root Sep 29 18:27:12 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-312f7d0c-ccc1-4d0c-bff9-99ba224feb61 tempest-AbsoluteLimitsTests-228554029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a7ef2e30-ce7e-4d7d-8df1-d0ffbfa28739" returned: 0 in 0.565s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:27:12 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-312f7d0c-ccc1-4d0c-bff9-99ba224feb61 tempest-AbsoluteLimitsTests-228554029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a7ef2e30-ce7e-4d7d-8df1-d0ffbfa28739 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:27:12 devstack sudo[99231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-163427b7-e897-4b61-af17-55a46b3e023e Sep 29 18:27:12 devstack sudo[99231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:27:12 devstack sudo[99232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a7ef2e30-ce7e-4d7d-8df1-d0ffbfa28739 Sep 29 18:27:12 devstack sudo[99232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:27:12 devstack sudo[99222]: pam_unix(sudo:session): session closed for user root Sep 29 18:27:12 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a4514e6c-7a26-45d2-911d-02b89d4a47cd tempest-VolumesDeleteCascade-158504705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-25b251a0-c66d-496e-8c61-8b291af027f7.info" returned: 0 in 0.332s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:27:12 devstack cinder-volume[86512]: WARNING cinder.volume.drivers.remotefs [None req-a4514e6c-7a26-45d2-911d-02b89d4a47cd tempest-VolumesDeleteCascade-158504705 None] /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-25b251a0-c66d-496e-8c61-8b291af027f7.info is being set with open permissions: ugo+rw Sep 29 18:27:12 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a4514e6c-7a26-45d2-911d-02b89d4a47cd tempest-VolumesDeleteCascade-158504705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-25b251a0-c66d-496e-8c61-8b291af027f7.info {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:27:12 devstack sudo[99235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-25b251a0-c66d-496e-8c61-8b291af027f7.info Sep 29 18:27:12 devstack sudo[99235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:27:12 devstack sudo[99231]: pam_unix(sudo:session): session closed for user root Sep 29 18:27:12 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-4e35ac78-b6bf-4efc-98a7-0787d059e151 tempest-CreateVolumesFromSnapshotTest-515199839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-163427b7-e897-4b61-af17-55a46b3e023e" returned: 0 in 0.325s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:27:12 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-4e35ac78-b6bf-4efc-98a7-0787d059e151 tempest-CreateVolumesFromSnapshotTest-515199839 None] Lock "cinder-quobyte-163427b7-e897-4b61-af17-55a46b3e023e" released by "delete_volume" :: held 0.832s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:27:12 devstack sudo[99232]: pam_unix(sudo:session): session closed for user root Sep 29 18:27:12 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-312f7d0c-ccc1-4d0c-bff9-99ba224feb61 tempest-AbsoluteLimitsTests-228554029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a7ef2e30-ce7e-4d7d-8df1-d0ffbfa28739" returned: 0 in 0.359s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:27:12 devstack sudo[99235]: pam_unix(sudo:session): session closed for user root Sep 29 18:27:12 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a4514e6c-7a26-45d2-911d-02b89d4a47cd tempest-VolumesDeleteCascade-158504705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-25b251a0-c66d-496e-8c61-8b291af027f7.info" returned: 0 in 0.311s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:27:12 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-a4514e6c-7a26-45d2-911d-02b89d4a47cd tempest-VolumesDeleteCascade-158504705 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.645s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:27:12 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-312f7d0c-ccc1-4d0c-bff9-99ba224feb61 tempest-AbsoluteLimitsTests-228554029 None] Lock "cinder-quobyte-a7ef2e30-ce7e-4d7d-8df1-d0ffbfa28739" released by "delete_volume" :: held 1.040s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:27:12 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-a4514e6c-7a26-45d2-911d-02b89d4a47cd tempest-VolumesDeleteCascade-158504705 None] Create snapshot completed successfully Sep 29 18:27:12 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-4e35ac78-b6bf-4efc-98a7-0787d059e151 tempest-CreateVolumesFromSnapshotTest-515199839 None] Created reservations ['5c834f65-2c51-486a-b20f-28fdc4429a55', 'd85099fa-2c1c-4881-bf40-62b5d4f992fd', '3cabfc93-3379-4820-938d-83a80300cd91', '5e09ab67-73e3-44f1-bfa6-7ae76132c637'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:27:12 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-312f7d0c-ccc1-4d0c-bff9-99ba224feb61 tempest-AbsoluteLimitsTests-228554029 None] Created reservations ['d69195a1-163b-4d39-8696-16990f10c4cd', '13c49a16-e40d-455f-909e-bd1ed730c744', '176aa1be-6101-4d18-b60a-19172e873131', '3875841d-d9d0-4853-9b6d-58a89bab2f92'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:27:13 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-4e35ac78-b6bf-4efc-98a7-0787d059e151 tempest-CreateVolumesFromSnapshotTest-515199839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:27:13 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-4e35ac78-b6bf-4efc-98a7-0787d059e151 tempest-CreateVolumesFromSnapshotTest-515199839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:27:13 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-4e35ac78-b6bf-4efc-98a7-0787d059e151 tempest-CreateVolumesFromSnapshotTest-515199839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:27:13 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-4e35ac78-b6bf-4efc-98a7-0787d059e151 tempest-CreateVolumesFromSnapshotTest-515199839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:27:13 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-4e35ac78-b6bf-4efc-98a7-0787d059e151 tempest-CreateVolumesFromSnapshotTest-515199839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:27:13 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-4e35ac78-b6bf-4efc-98a7-0787d059e151 tempest-CreateVolumesFromSnapshotTest-515199839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:27:13 devstack sudo[99262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:27:13 devstack sudo[99262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:27:13 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-312f7d0c-ccc1-4d0c-bff9-99ba224feb61 tempest-AbsoluteLimitsTests-228554029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:27:13 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-312f7d0c-ccc1-4d0c-bff9-99ba224feb61 tempest-AbsoluteLimitsTests-228554029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:27:13 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-312f7d0c-ccc1-4d0c-bff9-99ba224feb61 tempest-AbsoluteLimitsTests-228554029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:27:13 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-312f7d0c-ccc1-4d0c-bff9-99ba224feb61 tempest-AbsoluteLimitsTests-228554029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:27:13 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-312f7d0c-ccc1-4d0c-bff9-99ba224feb61 tempest-AbsoluteLimitsTests-228554029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:27:13 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-312f7d0c-ccc1-4d0c-bff9-99ba224feb61 tempest-AbsoluteLimitsTests-228554029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:27:13 devstack sudo[99264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:27:13 devstack sudo[99264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:27:13 devstack sudo[99262]: pam_unix(sudo:session): session closed for user root Sep 29 18:27:13 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-4e35ac78-b6bf-4efc-98a7-0787d059e151 tempest-CreateVolumesFromSnapshotTest-515199839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.282s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:27:13 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-4e35ac78-b6bf-4efc-98a7-0787d059e151 tempest-CreateVolumesFromSnapshotTest-515199839 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:27:13 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-4e35ac78-b6bf-4efc-98a7-0787d059e151 tempest-CreateVolumesFromSnapshotTest-515199839 None] Deleted volume successfully. Sep 29 18:27:13 devstack sudo[99264]: pam_unix(sudo:session): session closed for user root Sep 29 18:27:13 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-312f7d0c-ccc1-4d0c-bff9-99ba224feb61 tempest-AbsoluteLimitsTests-228554029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.297s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:27:13 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-312f7d0c-ccc1-4d0c-bff9-99ba224feb61 tempest-AbsoluteLimitsTests-228554029 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:27:13 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-312f7d0c-ccc1-4d0c-bff9-99ba224feb61 tempest-AbsoluteLimitsTests-228554029 None] Deleted volume successfully. Sep 29 18:27:13 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-4e35ac78-b6bf-4efc-98a7-0787d059e151 tempest-CreateVolumesFromSnapshotTest-515199839 None] Lock "cinder-163427b7-e897-4b61-af17-55a46b3e023e-delete_volume" released by "delete_volume" :: held 1.699s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:27:13 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-312f7d0c-ccc1-4d0c-bff9-99ba224feb61 tempest-AbsoluteLimitsTests-228554029 None] Lock "cinder-a7ef2e30-ce7e-4d7d-8df1-d0ffbfa28739-delete_volume" released by "delete_volume" :: held 1.778s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:27:13 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-739559f0-7a94-40db-98c3-17beed3635fa tempest-VolumesDeleteCascade-158504705 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86512) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:27:13 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-739559f0-7a94-40db-98c3-17beed3635fa tempest-VolumesDeleteCascade-158504705 None] Flow 'volume_create_manager' (de9ef269-bb0b-4486-a0ec-0379192e9e4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:27:13 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-739559f0-7a94-40db-98c3-17beed3635fa tempest-VolumesDeleteCascade-158504705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f553fecb-101f-4a3a-8c22-ae662d130809) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:27:13 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-739559f0-7a94-40db-98c3-17beed3635fa tempest-VolumesDeleteCascade-158504705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f553fecb-101f-4a3a-8c22-ae662d130809) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:27:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-280377831',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6e2e7e4-52ba-4efd-9ecc-93f36a910ef9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='770f4f6aa0164efb80a3486ba3336f27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:27:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b90a4d0e-7521-49c2-b81a-643ff7115fc6,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:27:14Z,use_quota=True,user_id='ad8c28a474f747ac82720337dd0cac9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:27:13 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-739559f0-7a94-40db-98c3-17beed3635fa tempest-VolumesDeleteCascade-158504705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1473cd8-a936-46fe-a7b7-c8f3052b76c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:27:13 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-739559f0-7a94-40db-98c3-17beed3635fa tempest-VolumesDeleteCascade-158504705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1473cd8-a936-46fe-a7b7-c8f3052b76c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:27:13 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-739559f0-7a94-40db-98c3-17beed3635fa tempest-VolumesDeleteCascade-158504705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0736e4e-fdbc-4ffd-b69e-6919f907d5d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:27:13 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-739559f0-7a94-40db-98c3-17beed3635fa tempest-VolumesDeleteCascade-158504705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0736e4e-fdbc-4ffd-b69e-6919f907d5d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f6e2e7e4-52ba-4efd-9ecc-93f36a910ef9', 'volume_name': 'volume-f6e2e7e4-52ba-4efd-9ecc-93f36a910ef9', 'volume_size': 1, 'snapshot_id': 'b90a4d0e-7521-49c2-b81a-643ff7115fc6'}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:27:13 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-739559f0-7a94-40db-98c3-17beed3635fa tempest-VolumesDeleteCascade-158504705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e4199d2-5658-4982-b4bb-f963f3f3a774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:27:13 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-739559f0-7a94-40db-98c3-17beed3635fa tempest-VolumesDeleteCascade-158504705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e4199d2-5658-4982-b4bb-f963f3f3a774) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:27:13 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-739559f0-7a94-40db-98c3-17beed3635fa tempest-VolumesDeleteCascade-158504705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a76041da-4ff2-4fd1-a11a-a6a79a6971fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:27:13 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-739559f0-7a94-40db-98c3-17beed3635fa tempest-VolumesDeleteCascade-158504705 None] Volume f6e2e7e4-52ba-4efd-9ecc-93f36a910ef9: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f6e2e7e4-52ba-4efd-9ecc-93f36a910ef9', 'volume_size': 1, 'snapshot_id': 'b90a4d0e-7521-49c2-b81a-643ff7115fc6'} Sep 29 18:27:13 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-739559f0-7a94-40db-98c3-17beed3635fa tempest-VolumesDeleteCascade-158504705 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:27:13 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-739559f0-7a94-40db-98c3-17beed3635fa tempest-VolumesDeleteCascade-158504705 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:27:13 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-739559f0-7a94-40db-98c3-17beed3635fa tempest-VolumesDeleteCascade-158504705 None] Acquiring lock "cinder-quobyte-b90a4d0e-7521-49c2-b81a-643ff7115fc6-f6e2e7e4-52ba-4efd-9ecc-93f36a910ef9" by "_create_volume_from_snapshot" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:27:13 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-739559f0-7a94-40db-98c3-17beed3635fa tempest-VolumesDeleteCascade-158504705 None] Lock "cinder-quobyte-b90a4d0e-7521-49c2-b81a-643ff7115fc6-f6e2e7e4-52ba-4efd-9ecc-93f36a910ef9" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:27:13 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-739559f0-7a94-40db-98c3-17beed3635fa tempest-VolumesDeleteCascade-158504705 None] Creating volume f6e2e7e4-52ba-4efd-9ecc-93f36a910ef9 from snapshot b90a4d0e-7521-49c2-b81a-643ff7115fc6 {{(pid=86512) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 29 18:27:13 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-739559f0-7a94-40db-98c3-17beed3635fa tempest-VolumesDeleteCascade-158504705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:27:13 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-739559f0-7a94-40db-98c3-17beed3635fa tempest-VolumesDeleteCascade-158504705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:27:13 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-739559f0-7a94-40db-98c3-17beed3635fa tempest-VolumesDeleteCascade-158504705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:27:13 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-739559f0-7a94-40db-98c3-17beed3635fa tempest-VolumesDeleteCascade-158504705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:27:13 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-739559f0-7a94-40db-98c3-17beed3635fa tempest-VolumesDeleteCascade-158504705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:27:13 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-739559f0-7a94-40db-98c3-17beed3635fa tempest-VolumesDeleteCascade-158504705 None] Selected osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 as target Quobyte volume. {{(pid=86512) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:27:13 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-739559f0-7a94-40db-98c3-17beed3635fa tempest-VolumesDeleteCascade-158504705 None] Acquiring lock "cinder-quobyte-f6e2e7e4-52ba-4efd-9ecc-93f36a910ef9" by "_copy_volume_from_snapshot" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:27:13 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-739559f0-7a94-40db-98c3-17beed3635fa tempest-VolumesDeleteCascade-158504705 None] Lock "cinder-quobyte-f6e2e7e4-52ba-4efd-9ecc-93f36a910ef9" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:27:13 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-739559f0-7a94-40db-98c3-17beed3635fa tempest-VolumesDeleteCascade-158504705 None] snapshot: b90a4d0e-7521-49c2-b81a-643ff7115fc6, volume: f6e2e7e4-52ba-4efd-9ecc-93f36a910ef9, {{(pid=86512) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 29 18:27:13 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-739559f0-7a94-40db-98c3-17beed3635fa tempest-VolumesDeleteCascade-158504705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:27:13 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-739559f0-7a94-40db-98c3-17beed3635fa tempest-VolumesDeleteCascade-158504705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:27:13 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-739559f0-7a94-40db-98c3-17beed3635fa tempest-VolumesDeleteCascade-158504705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:27:13 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-739559f0-7a94-40db-98c3-17beed3635fa tempest-VolumesDeleteCascade-158504705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:27:13 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-739559f0-7a94-40db-98c3-17beed3635fa tempest-VolumesDeleteCascade-158504705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:27:13 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[1121c01f-fc09-43a1-aa9a-926637a57c35]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:27:13 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-739559f0-7a94-40db-98c3-17beed3635fa tempest-VolumesDeleteCascade-158504705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-25b251a0-c66d-496e-8c61-8b291af027f7.b90a4d0e-7521-49c2-b81a-643ff7115fc6 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:27:13 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-a1a19e73-174b-4d67-8bdd-1e98fe527e37 tempest-CreateVolumesFromSnapshotTest-515199839 None] Acquiring lock "cinder-44f25ae5-37c2-42e7-8c03-6fece125ca57-delete_volume" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:27:13 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-a1a19e73-174b-4d67-8bdd-1e98fe527e37 tempest-CreateVolumesFromSnapshotTest-515199839 None] Lock "cinder-44f25ae5-37c2-42e7-8c03-6fece125ca57-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:27:14 devstack sudo[99269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-25b251a0-c66d-496e-8c61-8b291af027f7.b90a4d0e-7521-49c2-b81a-643ff7115fc6 Sep 29 18:27:14 devstack sudo[99269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:27:14 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-a1a19e73-174b-4d67-8bdd-1e98fe527e37 tempest-CreateVolumesFromSnapshotTest-515199839 None] Acquiring lock "cinder-quobyte-44f25ae5-37c2-42e7-8c03-6fece125ca57" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:27:14 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-a1a19e73-174b-4d67-8bdd-1e98fe527e37 tempest-CreateVolumesFromSnapshotTest-515199839 None] Lock "cinder-quobyte-44f25ae5-37c2-42e7-8c03-6fece125ca57" acquired by "delete_volume" :: waited 0.016s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:27:14 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2bd7552-40d2-43e1-af67-d04beb139ceb]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:27:14 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a1a19e73-174b-4d67-8bdd-1e98fe527e37 tempest-CreateVolumesFromSnapshotTest-515199839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-44f25ae5-37c2-42e7-8c03-6fece125ca57 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:27:14 devstack sudo[99271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-44f25ae5-37c2-42e7-8c03-6fece125ca57 Sep 29 18:27:14 devstack sudo[99271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:27:14 devstack sudo[99269]: pam_unix(sudo:session): session closed for user root Sep 29 18:27:14 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-739559f0-7a94-40db-98c3-17beed3635fa tempest-VolumesDeleteCascade-158504705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-25b251a0-c66d-496e-8c61-8b291af027f7.b90a4d0e-7521-49c2-b81a-643ff7115fc6" returned: 0 in 0.412s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:27:14 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-739559f0-7a94-40db-98c3-17beed3635fa tempest-VolumesDeleteCascade-158504705 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-25b251a0-c66d-496e-8c61-8b291af027f7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86512) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 18:27:14 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[b10e6d35-251b-4437-8d40-378b17460182]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:27:14 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-739559f0-7a94-40db-98c3-17beed3635fa tempest-VolumesDeleteCascade-158504705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-25b251a0-c66d-496e-8c61-8b291af027f7 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:27:14 devstack sudo[99276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-25b251a0-c66d-496e-8c61-8b291af027f7 Sep 29 18:27:14 devstack sudo[99276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:27:14 devstack sudo[99271]: pam_unix(sudo:session): session closed for user root Sep 29 18:27:14 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a1a19e73-174b-4d67-8bdd-1e98fe527e37 tempest-CreateVolumesFromSnapshotTest-515199839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-44f25ae5-37c2-42e7-8c03-6fece125ca57" returned: 0 in 0.432s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:27:14 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a1a19e73-174b-4d67-8bdd-1e98fe527e37 tempest-CreateVolumesFromSnapshotTest-515199839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-44f25ae5-37c2-42e7-8c03-6fece125ca57 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:27:14 devstack sudo[99281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-44f25ae5-37c2-42e7-8c03-6fece125ca57 Sep 29 18:27:14 devstack sudo[99281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:27:14 devstack sudo[99276]: pam_unix(sudo:session): session closed for user root Sep 29 18:27:14 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-739559f0-7a94-40db-98c3-17beed3635fa tempest-VolumesDeleteCascade-158504705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-25b251a0-c66d-496e-8c61-8b291af027f7" returned: 0 in 0.420s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:27:14 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-739559f0-7a94-40db-98c3-17beed3635fa tempest-VolumesDeleteCascade-158504705 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-25b251a0-c66d-496e-8c61-8b291af027f7 {{(pid=86512) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 29 18:27:14 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-739559f0-7a94-40db-98c3-17beed3635fa tempest-VolumesDeleteCascade-158504705 None] Creating direct copy from snapshot {{(pid=86512) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 29 18:27:14 devstack cinder-volume[86512]: DEBUG cinder.utils [None req-739559f0-7a94-40db-98c3-17beed3635fa tempest-VolumesDeleteCascade-158504705 None] Path /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-f6e2e7e4-52ba-4efd-9ecc-93f36a910ef9 not found in is_blk_device check {{(pid=86512) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 29 18:27:14 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-739559f0-7a94-40db-98c3-17beed3635fa tempest-VolumesDeleteCascade-158504705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-25b251a0-c66d-496e-8c61-8b291af027f7 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-f6e2e7e4-52ba-4efd-9ecc-93f36a910ef9 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:27:14 devstack sudo[99288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-25b251a0-c66d-496e-8c61-8b291af027f7 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-f6e2e7e4-52ba-4efd-9ecc-93f36a910ef9 Sep 29 18:27:14 devstack sudo[99288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:27:14 devstack sudo[99281]: pam_unix(sudo:session): session closed for user root Sep 29 18:27:14 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a1a19e73-174b-4d67-8bdd-1e98fe527e37 tempest-CreateVolumesFromSnapshotTest-515199839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-44f25ae5-37c2-42e7-8c03-6fece125ca57" returned: 0 in 0.306s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:27:14 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-a1a19e73-174b-4d67-8bdd-1e98fe527e37 tempest-CreateVolumesFromSnapshotTest-515199839 None] Lock "cinder-quobyte-44f25ae5-37c2-42e7-8c03-6fece125ca57" released by "delete_volume" :: held 0.802s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:27:14 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-a1a19e73-174b-4d67-8bdd-1e98fe527e37 tempest-CreateVolumesFromSnapshotTest-515199839 None] Created reservations ['78ed44cb-4c28-4ef0-90cf-b35ff483966e', 'b5288af8-dfbc-4bef-979e-846ab3551cb8', '4cef5c6c-3b69-4442-b44d-aa907de8ad5a', '4984aa12-060e-40d7-98e7-b35dc5047cd2'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:27:14 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-a1a19e73-174b-4d67-8bdd-1e98fe527e37 tempest-CreateVolumesFromSnapshotTest-515199839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:27:14 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-a1a19e73-174b-4d67-8bdd-1e98fe527e37 tempest-CreateVolumesFromSnapshotTest-515199839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:27:14 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-a1a19e73-174b-4d67-8bdd-1e98fe527e37 tempest-CreateVolumesFromSnapshotTest-515199839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:27:14 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-a1a19e73-174b-4d67-8bdd-1e98fe527e37 tempest-CreateVolumesFromSnapshotTest-515199839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:27:14 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-a1a19e73-174b-4d67-8bdd-1e98fe527e37 tempest-CreateVolumesFromSnapshotTest-515199839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:27:14 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a1a19e73-174b-4d67-8bdd-1e98fe527e37 tempest-CreateVolumesFromSnapshotTest-515199839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:27:15 devstack sudo[99290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:27:15 devstack sudo[99290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:27:15 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-fa8d2124-709b-4255-9f36-7952d4a26932 tempest-CreateVolumesFromSnapshotTest-515199839 None] Acquiring lock "cinder-800618d4-01b8-4770-9760-7b971a75abc3-delete_volume" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:27:15 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-fa8d2124-709b-4255-9f36-7952d4a26932 tempest-CreateVolumesFromSnapshotTest-515199839 None] Lock "cinder-800618d4-01b8-4770-9760-7b971a75abc3-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:27:15 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-fa8d2124-709b-4255-9f36-7952d4a26932 tempest-CreateVolumesFromSnapshotTest-515199839 None] Acquiring lock "cinder-quobyte-800618d4-01b8-4770-9760-7b971a75abc3" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:27:15 devstack sudo[99290]: pam_unix(sudo:session): session closed for user root Sep 29 18:27:15 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a1a19e73-174b-4d67-8bdd-1e98fe527e37 tempest-CreateVolumesFromSnapshotTest-515199839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.337s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:27:15 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-a1a19e73-174b-4d67-8bdd-1e98fe527e37 tempest-CreateVolumesFromSnapshotTest-515199839 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:27:15 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-fa8d2124-709b-4255-9f36-7952d4a26932 tempest-CreateVolumesFromSnapshotTest-515199839 None] Lock "cinder-quobyte-800618d4-01b8-4770-9760-7b971a75abc3" acquired by "delete_volume" :: waited 0.023s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:27:15 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-a1a19e73-174b-4d67-8bdd-1e98fe527e37 tempest-CreateVolumesFromSnapshotTest-515199839 None] Deleted volume successfully. Sep 29 18:27:15 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[d57f53d7-86d9-4f6c-bfd7-058b1b070f90]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:27:15 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-fa8d2124-709b-4255-9f36-7952d4a26932 tempest-CreateVolumesFromSnapshotTest-515199839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-800618d4-01b8-4770-9760-7b971a75abc3 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:27:15 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-a1a19e73-174b-4d67-8bdd-1e98fe527e37 tempest-CreateVolumesFromSnapshotTest-515199839 None] Lock "cinder-44f25ae5-37c2-42e7-8c03-6fece125ca57-delete_volume" released by "delete_volume" :: held 1.416s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:27:15 devstack sudo[99304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-800618d4-01b8-4770-9760-7b971a75abc3 Sep 29 18:27:15 devstack sudo[99304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:27:15 devstack sudo[99304]: pam_unix(sudo:session): session closed for user root Sep 29 18:27:15 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-fa8d2124-709b-4255-9f36-7952d4a26932 tempest-CreateVolumesFromSnapshotTest-515199839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-800618d4-01b8-4770-9760-7b971a75abc3" returned: 0 in 0.600s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:27:15 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-fa8d2124-709b-4255-9f36-7952d4a26932 tempest-CreateVolumesFromSnapshotTest-515199839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-800618d4-01b8-4770-9760-7b971a75abc3 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:27:16 devstack sudo[99310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-800618d4-01b8-4770-9760-7b971a75abc3 Sep 29 18:27:16 devstack sudo[99310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:27:16 devstack sudo[99310]: pam_unix(sudo:session): session closed for user root Sep 29 18:27:16 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-fa8d2124-709b-4255-9f36-7952d4a26932 tempest-CreateVolumesFromSnapshotTest-515199839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-800618d4-01b8-4770-9760-7b971a75abc3" returned: 0 in 0.524s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:27:16 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-fa8d2124-709b-4255-9f36-7952d4a26932 tempest-CreateVolumesFromSnapshotTest-515199839 None] Lock "cinder-quobyte-800618d4-01b8-4770-9760-7b971a75abc3" released by "delete_volume" :: held 1.222s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:27:16 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-fa8d2124-709b-4255-9f36-7952d4a26932 tempest-CreateVolumesFromSnapshotTest-515199839 None] Created reservations ['136e1ddc-faff-46da-baaf-c60719494700', '71dd6df5-ba61-46f8-864f-f9c7af2d6bcf', 'fef349a3-e9d0-4772-b912-2ba4200082e1', 'cecc95d8-6d5c-45cb-9bc3-d9ba05fa9686'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:27:16 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-fa8d2124-709b-4255-9f36-7952d4a26932 tempest-CreateVolumesFromSnapshotTest-515199839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:27:16 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-fa8d2124-709b-4255-9f36-7952d4a26932 tempest-CreateVolumesFromSnapshotTest-515199839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:27:16 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-fa8d2124-709b-4255-9f36-7952d4a26932 tempest-CreateVolumesFromSnapshotTest-515199839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:27:16 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-fa8d2124-709b-4255-9f36-7952d4a26932 tempest-CreateVolumesFromSnapshotTest-515199839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:27:16 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-fa8d2124-709b-4255-9f36-7952d4a26932 tempest-CreateVolumesFromSnapshotTest-515199839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:27:16 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-fa8d2124-709b-4255-9f36-7952d4a26932 tempest-CreateVolumesFromSnapshotTest-515199839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:27:16 devstack sudo[99315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:27:16 devstack sudo[99315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:27:17 devstack sudo[99315]: pam_unix(sudo:session): session closed for user root Sep 29 18:27:17 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-fa8d2124-709b-4255-9f36-7952d4a26932 tempest-CreateVolumesFromSnapshotTest-515199839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.488s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:27:17 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-fa8d2124-709b-4255-9f36-7952d4a26932 tempest-CreateVolumesFromSnapshotTest-515199839 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:27:17 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-fa8d2124-709b-4255-9f36-7952d4a26932 tempest-CreateVolumesFromSnapshotTest-515199839 None] Deleted volume successfully. Sep 29 18:27:17 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-fa8d2124-709b-4255-9f36-7952d4a26932 tempest-CreateVolumesFromSnapshotTest-515199839 None] Lock "cinder-800618d4-01b8-4770-9760-7b971a75abc3-delete_volume" released by "delete_volume" :: held 2.126s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:27:17 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-014be34a-2d7c-44d6-a5de-e1ee30bed066 tempest-CreateVolumesFromSnapshotTest-515199839 None] Acquiring lock "cinder-5433d225-988b-4ddc-9a8c-d345d9532cba-delete_volume" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:27:17 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-014be34a-2d7c-44d6-a5de-e1ee30bed066 tempest-CreateVolumesFromSnapshotTest-515199839 None] Lock "cinder-5433d225-988b-4ddc-9a8c-d345d9532cba-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:27:17 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-014be34a-2d7c-44d6-a5de-e1ee30bed066 tempest-CreateVolumesFromSnapshotTest-515199839 None] Acquiring lock "cinder-quobyte-5433d225-988b-4ddc-9a8c-d345d9532cba" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:27:17 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-014be34a-2d7c-44d6-a5de-e1ee30bed066 tempest-CreateVolumesFromSnapshotTest-515199839 None] Lock "cinder-quobyte-5433d225-988b-4ddc-9a8c-d345d9532cba" acquired by "delete_volume" :: waited 0.025s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:27:17 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cf3c5b1-5afc-4c2a-b5e1-80df04cb5088]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:27:17 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-014be34a-2d7c-44d6-a5de-e1ee30bed066 tempest-CreateVolumesFromSnapshotTest-515199839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-5433d225-988b-4ddc-9a8c-d345d9532cba {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:27:18 devstack sudo[99318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-5433d225-988b-4ddc-9a8c-d345d9532cba Sep 29 18:27:18 devstack sudo[99318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:27:18 devstack sudo[99318]: pam_unix(sudo:session): session closed for user root Sep 29 18:27:18 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-014be34a-2d7c-44d6-a5de-e1ee30bed066 tempest-CreateVolumesFromSnapshotTest-515199839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-5433d225-988b-4ddc-9a8c-d345d9532cba" returned: 0 in 0.699s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:27:18 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-014be34a-2d7c-44d6-a5de-e1ee30bed066 tempest-CreateVolumesFromSnapshotTest-515199839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-5433d225-988b-4ddc-9a8c-d345d9532cba {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:27:18 devstack sudo[99323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-5433d225-988b-4ddc-9a8c-d345d9532cba Sep 29 18:27:18 devstack sudo[99323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:27:19 devstack sudo[99323]: pam_unix(sudo:session): session closed for user root Sep 29 18:27:19 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-014be34a-2d7c-44d6-a5de-e1ee30bed066 tempest-CreateVolumesFromSnapshotTest-515199839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-5433d225-988b-4ddc-9a8c-d345d9532cba" returned: 0 in 0.531s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:27:19 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-014be34a-2d7c-44d6-a5de-e1ee30bed066 tempest-CreateVolumesFromSnapshotTest-515199839 None] Lock "cinder-quobyte-5433d225-988b-4ddc-9a8c-d345d9532cba" released by "delete_volume" :: held 1.326s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:27:19 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-014be34a-2d7c-44d6-a5de-e1ee30bed066 tempest-CreateVolumesFromSnapshotTest-515199839 None] Created reservations ['85263b37-0beb-46dd-9d91-d88d4ba12f51', 'e5341d06-87d4-454f-80f8-081401ed9e8a', '2a730df2-0e86-4ed2-9887-dd3eee5f232b', 'd316c484-20d0-458e-853f-5f699eaa8fcf'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:27:19 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-014be34a-2d7c-44d6-a5de-e1ee30bed066 tempest-CreateVolumesFromSnapshotTest-515199839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:27:19 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-014be34a-2d7c-44d6-a5de-e1ee30bed066 tempest-CreateVolumesFromSnapshotTest-515199839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:27:19 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-014be34a-2d7c-44d6-a5de-e1ee30bed066 tempest-CreateVolumesFromSnapshotTest-515199839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:27:19 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-014be34a-2d7c-44d6-a5de-e1ee30bed066 tempest-CreateVolumesFromSnapshotTest-515199839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:27:19 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-014be34a-2d7c-44d6-a5de-e1ee30bed066 tempest-CreateVolumesFromSnapshotTest-515199839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:27:19 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-014be34a-2d7c-44d6-a5de-e1ee30bed066 tempest-CreateVolumesFromSnapshotTest-515199839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:27:19 devstack sudo[99326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:27:19 devstack sudo[99326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:27:19 devstack sudo[99326]: pam_unix(sudo:session): session closed for user root Sep 29 18:27:19 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-014be34a-2d7c-44d6-a5de-e1ee30bed066 tempest-CreateVolumesFromSnapshotTest-515199839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.515s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:27:19 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-014be34a-2d7c-44d6-a5de-e1ee30bed066 tempest-CreateVolumesFromSnapshotTest-515199839 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:27:19 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-014be34a-2d7c-44d6-a5de-e1ee30bed066 tempest-CreateVolumesFromSnapshotTest-515199839 None] Deleted volume successfully. Sep 29 18:27:20 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-014be34a-2d7c-44d6-a5de-e1ee30bed066 tempest-CreateVolumesFromSnapshotTest-515199839 None] Lock "cinder-5433d225-988b-4ddc-9a8c-d345d9532cba-delete_volume" released by "delete_volume" :: held 2.369s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:27:20 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-9f4a307a-8b27-4261-9d4a-0f09e28c9dd6 tempest-CreateVolumesFromSnapshotTest-515199839 None] Acquiring lock "cinder-7760f401-c4e6-4b35-9ea1-06e56e61bd57-delete_snapshot" by "delete_snapshot" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:27:20 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-9f4a307a-8b27-4261-9d4a-0f09e28c9dd6 tempest-CreateVolumesFromSnapshotTest-515199839 None] Lock "cinder-7760f401-c4e6-4b35-9ea1-06e56e61bd57-delete_snapshot" acquired by "delete_snapshot" :: waited 0.048s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:27:20 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-9f4a307a-8b27-4261-9d4a-0f09e28c9dd6 tempest-CreateVolumesFromSnapshotTest-515199839 None] Acquiring lock "cinder-quobyte-ae551dac-23ee-48c5-88ef-0b6d6df6742e" by "delete_snapshot" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:27:20 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-9f4a307a-8b27-4261-9d4a-0f09e28c9dd6 tempest-CreateVolumesFromSnapshotTest-515199839 None] Lock "cinder-quobyte-ae551dac-23ee-48c5-88ef-0b6d6df6742e" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:27:20 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-9f4a307a-8b27-4261-9d4a-0f09e28c9dd6 tempest-CreateVolumesFromSnapshotTest-515199839 None] Acquiring lock "cinder-quobyte-7760f401-c4e6-4b35-9ea1-06e56e61bd57" by "_delete_snapshot" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:27:20 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-9f4a307a-8b27-4261-9d4a-0f09e28c9dd6 tempest-CreateVolumesFromSnapshotTest-515199839 None] Lock "cinder-quobyte-7760f401-c4e6-4b35-9ea1-06e56e61bd57" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:27:20 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-9f4a307a-8b27-4261-9d4a-0f09e28c9dd6 tempest-CreateVolumesFromSnapshotTest-515199839 None] Deleting offline snapshot 7760f401-c4e6-4b35-9ea1-06e56e61bd57 of volume ae551dac-23ee-48c5-88ef-0b6d6df6742e {{(pid=86512) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 18:27:20 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-9f4a307a-8b27-4261-9d4a-0f09e28c9dd6 tempest-CreateVolumesFromSnapshotTest-515199839 None] snapshot_file for this snap is: volume-ae551dac-23ee-48c5-88ef-0b6d6df6742e.7760f401-c4e6-4b35-9ea1-06e56e61bd57 {{(pid=86512) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 18:27:20 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5c902f1-c902-42c0-a989-9379c5cb89d4]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:27:20 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-9f4a307a-8b27-4261-9d4a-0f09e28c9dd6 tempest-CreateVolumesFromSnapshotTest-515199839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ae551dac-23ee-48c5-88ef-0b6d6df6742e.7760f401-c4e6-4b35-9ea1-06e56e61bd57 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:27:20 devstack sudo[99329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ae551dac-23ee-48c5-88ef-0b6d6df6742e.7760f401-c4e6-4b35-9ea1-06e56e61bd57 Sep 29 18:27:20 devstack sudo[99329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:27:21 devstack sudo[99329]: pam_unix(sudo:session): session closed for user root Sep 29 18:27:21 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-9f4a307a-8b27-4261-9d4a-0f09e28c9dd6 tempest-CreateVolumesFromSnapshotTest-515199839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ae551dac-23ee-48c5-88ef-0b6d6df6742e.7760f401-c4e6-4b35-9ea1-06e56e61bd57" returned: 0 in 0.817s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:27:21 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-9f4a307a-8b27-4261-9d4a-0f09e28c9dd6 tempest-CreateVolumesFromSnapshotTest-515199839 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ae551dac-23ee-48c5-88ef-0b6d6df6742e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86512) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 18:27:21 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[2702875e-c5a5-4d16-9ab0-35f2e6c2f2cb]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:27:21 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-9f4a307a-8b27-4261-9d4a-0f09e28c9dd6 tempest-CreateVolumesFromSnapshotTest-515199839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ae551dac-23ee-48c5-88ef-0b6d6df6742e {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:27:21 devstack sudo[99335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ae551dac-23ee-48c5-88ef-0b6d6df6742e Sep 29 18:27:21 devstack sudo[99335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:27:22 devstack sudo[99335]: pam_unix(sudo:session): session closed for user root Sep 29 18:27:22 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-9f4a307a-8b27-4261-9d4a-0f09e28c9dd6 tempest-CreateVolumesFromSnapshotTest-515199839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ae551dac-23ee-48c5-88ef-0b6d6df6742e" returned: 0 in 0.847s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:27:22 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-9f4a307a-8b27-4261-9d4a-0f09e28c9dd6 tempest-CreateVolumesFromSnapshotTest-515199839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ae551dac-23ee-48c5-88ef-0b6d6df6742e.7760f401-c4e6-4b35-9ea1-06e56e61bd57 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:27:22 devstack sudo[99340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ae551dac-23ee-48c5-88ef-0b6d6df6742e.7760f401-c4e6-4b35-9ea1-06e56e61bd57 Sep 29 18:27:22 devstack sudo[99340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:27:23 devstack sudo[99340]: pam_unix(sudo:session): session closed for user root Sep 29 18:27:23 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-9f4a307a-8b27-4261-9d4a-0f09e28c9dd6 tempest-CreateVolumesFromSnapshotTest-515199839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ae551dac-23ee-48c5-88ef-0b6d6df6742e.7760f401-c4e6-4b35-9ea1-06e56e61bd57" returned: 0 in 0.890s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:27:23 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-9f4a307a-8b27-4261-9d4a-0f09e28c9dd6 tempest-CreateVolumesFromSnapshotTest-515199839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ae551dac-23ee-48c5-88ef-0b6d6df6742e.7760f401-c4e6-4b35-9ea1-06e56e61bd57 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:27:23 devstack sudo[99345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ae551dac-23ee-48c5-88ef-0b6d6df6742e.7760f401-c4e6-4b35-9ea1-06e56e61bd57 Sep 29 18:27:23 devstack sudo[99345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:27:23 devstack sudo[99288]: pam_unix(sudo:session): session closed for user root Sep 29 18:27:23 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-739559f0-7a94-40db-98c3-17beed3635fa tempest-VolumesDeleteCascade-158504705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-25b251a0-c66d-496e-8c61-8b291af027f7 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-f6e2e7e4-52ba-4efd-9ecc-93f36a910ef9" returned: 0 in 8.589s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:27:23 devstack cinder-volume[86512]: DEBUG cinder.image.image_utils [None req-739559f0-7a94-40db-98c3-17beed3635fa tempest-VolumesDeleteCascade-158504705 None] Image conversion details: src /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-25b251a0-c66d-496e-8c61-8b291af027f7, size 1024.00 MB, duration 8.59 sec, destination /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-f6e2e7e4-52ba-4efd-9ecc-93f36a910ef9 {{(pid=86512) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 29 18:27:23 devstack cinder-volume[86512]: INFO cinder.image.image_utils [None req-739559f0-7a94-40db-98c3-17beed3635fa tempest-VolumesDeleteCascade-158504705 None] Converted 1024.00 MB image at 119.19 MB/s Sep 29 18:27:23 devstack cinder-volume[86512]: WARNING cinder.volume.drivers.remotefs [None req-739559f0-7a94-40db-98c3-17beed3635fa tempest-VolumesDeleteCascade-158504705 None] /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-f6e2e7e4-52ba-4efd-9ecc-93f36a910ef9 is being set with open permissions: ugo+rw Sep 29 18:27:23 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-739559f0-7a94-40db-98c3-17beed3635fa tempest-VolumesDeleteCascade-158504705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-f6e2e7e4-52ba-4efd-9ecc-93f36a910ef9 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:27:23 devstack sudo[99347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-f6e2e7e4-52ba-4efd-9ecc-93f36a910ef9 Sep 29 18:27:23 devstack sudo[99347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:27:23 devstack sudo[99345]: pam_unix(sudo:session): session closed for user root Sep 29 18:27:23 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-9f4a307a-8b27-4261-9d4a-0f09e28c9dd6 tempest-CreateVolumesFromSnapshotTest-515199839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ae551dac-23ee-48c5-88ef-0b6d6df6742e.7760f401-c4e6-4b35-9ea1-06e56e61bd57" returned: 0 in 0.501s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:27:23 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-9f4a307a-8b27-4261-9d4a-0f09e28c9dd6 tempest-CreateVolumesFromSnapshotTest-515199839 None] Lock "cinder-quobyte-7760f401-c4e6-4b35-9ea1-06e56e61bd57" released by "_delete_snapshot" :: held 3.303s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:27:23 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-9f4a307a-8b27-4261-9d4a-0f09e28c9dd6 tempest-CreateVolumesFromSnapshotTest-515199839 None] Lock "cinder-quobyte-ae551dac-23ee-48c5-88ef-0b6d6df6742e" released by "delete_snapshot" :: held 3.338s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:27:23 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-9f4a307a-8b27-4261-9d4a-0f09e28c9dd6 tempest-CreateVolumesFromSnapshotTest-515199839 None] Created reservations ['bab3ecf4-c8d9-4f6c-a43c-1d5cc9117636', 'ae41bb89-57c8-4a54-a527-75431484571f', 'db5f321b-e0c2-43df-87d4-0cccba2ad756', '159defd6-adf6-4881-bdd9-020e445aa540'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:27:23 devstack sudo[99347]: pam_unix(sudo:session): session closed for user root Sep 29 18:27:23 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-739559f0-7a94-40db-98c3-17beed3635fa tempest-VolumesDeleteCascade-158504705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-f6e2e7e4-52ba-4efd-9ecc-93f36a910ef9" returned: 0 in 0.321s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:27:23 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-739559f0-7a94-40db-98c3-17beed3635fa tempest-VolumesDeleteCascade-158504705 None] Lock "cinder-quobyte-f6e2e7e4-52ba-4efd-9ecc-93f36a910ef9" released by "_copy_volume_from_snapshot" :: held 9.851s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:27:23 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-9f4a307a-8b27-4261-9d4a-0f09e28c9dd6 tempest-CreateVolumesFromSnapshotTest-515199839 None] Delete snapshot completed successfully. Sep 29 18:27:23 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-9f4a307a-8b27-4261-9d4a-0f09e28c9dd6 tempest-CreateVolumesFromSnapshotTest-515199839 None] Lock "cinder-7760f401-c4e6-4b35-9ea1-06e56e61bd57-delete_snapshot" released by "delete_snapshot" :: held 3.558s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:27:23 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-739559f0-7a94-40db-98c3-17beed3635fa tempest-VolumesDeleteCascade-158504705 None] Lock "cinder-quobyte-b90a4d0e-7521-49c2-b81a-643ff7115fc6-f6e2e7e4-52ba-4efd-9ecc-93f36a910ef9" released by "_create_volume_from_snapshot" :: held 9.941s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:27:23 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-739559f0-7a94-40db-98c3-17beed3635fa tempest-VolumesDeleteCascade-158504705 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.962s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:27:23 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-739559f0-7a94-40db-98c3-17beed3635fa tempest-VolumesDeleteCascade-158504705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a76041da-4ff2-4fd1-a11a-a6a79a6971fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6e2e7e4-52ba-4efd-9ecc-93f36a910ef9', 'volume_size': 1, 'snapshot_id': 'b90a4d0e-7521-49c2-b81a-643ff7115fc6'}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:27:23 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-739559f0-7a94-40db-98c3-17beed3635fa tempest-VolumesDeleteCascade-158504705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bca9e9a5-fd89-4e3b-9a1d-d087bafe3021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:27:23 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-739559f0-7a94-40db-98c3-17beed3635fa tempest-VolumesDeleteCascade-158504705 None] Volume volume-f6e2e7e4-52ba-4efd-9ecc-93f36a910ef9 (f6e2e7e4-52ba-4efd-9ecc-93f36a910ef9): created successfully Sep 29 18:27:23 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-739559f0-7a94-40db-98c3-17beed3635fa tempest-VolumesDeleteCascade-158504705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bca9e9a5-fd89-4e3b-9a1d-d087bafe3021) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:27:23 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-739559f0-7a94-40db-98c3-17beed3635fa tempest-VolumesDeleteCascade-158504705 None] Flow 'volume_create_manager' (de9ef269-bb0b-4486-a0ec-0379192e9e4b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:27:23 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-739559f0-7a94-40db-98c3-17beed3635fa tempest-VolumesDeleteCascade-158504705 None] Created volume successfully. Sep 29 18:27:24 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-bacc5be7-3b20-489e-bd22-ecc8f36c9d89 tempest-CreateVolumesFromSnapshotTest-515199839 None] Acquiring lock "cinder-ae551dac-23ee-48c5-88ef-0b6d6df6742e-delete_volume" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:27:24 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-bacc5be7-3b20-489e-bd22-ecc8f36c9d89 tempest-CreateVolumesFromSnapshotTest-515199839 None] Lock "cinder-ae551dac-23ee-48c5-88ef-0b6d6df6742e-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:27:24 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-bacc5be7-3b20-489e-bd22-ecc8f36c9d89 tempest-CreateVolumesFromSnapshotTest-515199839 None] Acquiring lock "cinder-quobyte-ae551dac-23ee-48c5-88ef-0b6d6df6742e" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:27:24 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-bacc5be7-3b20-489e-bd22-ecc8f36c9d89 tempest-CreateVolumesFromSnapshotTest-515199839 None] Lock "cinder-quobyte-ae551dac-23ee-48c5-88ef-0b6d6df6742e" acquired by "delete_volume" :: waited 0.032s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:27:24 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8f761b6-6a79-434d-ac76-a0656f8c2560]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:27:24 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-bacc5be7-3b20-489e-bd22-ecc8f36c9d89 tempest-CreateVolumesFromSnapshotTest-515199839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ae551dac-23ee-48c5-88ef-0b6d6df6742e {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:27:24 devstack sudo[99354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ae551dac-23ee-48c5-88ef-0b6d6df6742e Sep 29 18:27:24 devstack sudo[99354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:27:24 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c4e3473-f655-4353-8f5f-849657ad2163 tempest-VolumesTransfersTest-1110618009 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86512) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:27:24 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-2c4e3473-f655-4353-8f5f-849657ad2163 tempest-VolumesTransfersTest-1110618009 None] Flow 'volume_create_manager' (2fbeb8ee-afea-4e2d-ad0f-601a445dedc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:27:24 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-2c4e3473-f655-4353-8f5f-849657ad2163 tempest-VolumesTransfersTest-1110618009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fe6da12-3a77-4f85-b518-804c5d5cffea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:27:24 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-2c4e3473-f655-4353-8f5f-849657ad2163 tempest-VolumesTransfersTest-1110618009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fe6da12-3a77-4f85-b518-804c5d5cffea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:27:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-171145448',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22e1a887-333c-47f2-b1af-bd527f9138c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ea6710b09e04f48be29990bb8327aca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:27:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:27:25Z,use_quota=True,user_id='f9bd6f970831407fa0448f2e4eb669e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:27:24 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-2c4e3473-f655-4353-8f5f-849657ad2163 tempest-VolumesTransfersTest-1110618009 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efba6e09-8fe1-44ca-bbf0-9cf5f5a7c908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:27:24 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-2c4e3473-f655-4353-8f5f-849657ad2163 tempest-VolumesTransfersTest-1110618009 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efba6e09-8fe1-44ca-bbf0-9cf5f5a7c908) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:27:24 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-2c4e3473-f655-4353-8f5f-849657ad2163 tempest-VolumesTransfersTest-1110618009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ffc19b5-5c0c-4cf5-91bd-7baa11de3016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:27:24 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-2c4e3473-f655-4353-8f5f-849657ad2163 tempest-VolumesTransfersTest-1110618009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ffc19b5-5c0c-4cf5-91bd-7baa11de3016) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22e1a887-333c-47f2-b1af-bd527f9138c1', 'volume_name': 'volume-22e1a887-333c-47f2-b1af-bd527f9138c1', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:27:24 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-2c4e3473-f655-4353-8f5f-849657ad2163 tempest-VolumesTransfersTest-1110618009 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be5381ff-263a-4d5a-b75d-ed41dab1577d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:27:25 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-2c4e3473-f655-4353-8f5f-849657ad2163 tempest-VolumesTransfersTest-1110618009 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be5381ff-263a-4d5a-b75d-ed41dab1577d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:27:25 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-2c4e3473-f655-4353-8f5f-849657ad2163 tempest-VolumesTransfersTest-1110618009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8b12f28-2e7c-4bab-a924-a75bf74c91d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:27:25 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-2c4e3473-f655-4353-8f5f-849657ad2163 tempest-VolumesTransfersTest-1110618009 None] Volume 22e1a887-333c-47f2-b1af-bd527f9138c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22e1a887-333c-47f2-b1af-bd527f9138c1', 'volume_size': 1} Sep 29 18:27:25 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-2c4e3473-f655-4353-8f5f-849657ad2163 tempest-VolumesTransfersTest-1110618009 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:27:25 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-2c4e3473-f655-4353-8f5f-849657ad2163 tempest-VolumesTransfersTest-1110618009 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:27:25 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-2c4e3473-f655-4353-8f5f-849657ad2163 tempest-VolumesTransfersTest-1110618009 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:27:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-171145448',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22e1a887-333c-47f2-b1af-bd527f9138c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ea6710b09e04f48be29990bb8327aca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:27:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:27:25Z,use_quota=True,user_id='f9bd6f970831407fa0448f2e4eb669e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)}" {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:27:25 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-2c4e3473-f655-4353-8f5f-849657ad2163 tempest-VolumesTransfersTest-1110618009 None] Creating volume 22e1a887-333c-47f2-b1af-bd527f9138c1 {{(pid=86512) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:27:25 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-2c4e3473-f655-4353-8f5f-849657ad2163 tempest-VolumesTransfersTest-1110618009 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:27:25 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-2c4e3473-f655-4353-8f5f-849657ad2163 tempest-VolumesTransfersTest-1110618009 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:27:25 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-2c4e3473-f655-4353-8f5f-849657ad2163 tempest-VolumesTransfersTest-1110618009 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:27:25 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-2c4e3473-f655-4353-8f5f-849657ad2163 tempest-VolumesTransfersTest-1110618009 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:27:25 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-2c4e3473-f655-4353-8f5f-849657ad2163 tempest-VolumesTransfersTest-1110618009 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:27:25 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-2c4e3473-f655-4353-8f5f-849657ad2163 tempest-VolumesTransfersTest-1110618009 None] Selected osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 as target Quobyte volume. {{(pid=86512) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:27:25 devstack cinder-volume[86512]: INFO cinder.volume.drivers.remotefs [None req-2c4e3473-f655-4353-8f5f-849657ad2163 tempest-VolumesTransfersTest-1110618009 None] casted to osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 Sep 29 18:27:25 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-2c4e3473-f655-4353-8f5f-849657ad2163 tempest-VolumesTransfersTest-1110618009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-22e1a887-333c-47f2-b1af-bd527f9138c1 1073741824 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:27:25 devstack sudo[99356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-22e1a887-333c-47f2-b1af-bd527f9138c1 1073741824 Sep 29 18:27:25 devstack sudo[99356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:27:25 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-6765b2e0-7811-415b-9ee2-045a90c0299f tempest-VolumesDeleteCascade-158504705 None] Acquiring lock "cinder-25b251a0-c66d-496e-8c61-8b291af027f7-delete_volume" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:27:25 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-6765b2e0-7811-415b-9ee2-045a90c0299f tempest-VolumesDeleteCascade-158504705 None] Lock "cinder-25b251a0-c66d-496e-8c61-8b291af027f7-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:27:25 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-6765b2e0-7811-415b-9ee2-045a90c0299f tempest-VolumesDeleteCascade-158504705 None] Performing cascade delete. {{(pid=86512) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 29 18:27:25 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-6765b2e0-7811-415b-9ee2-045a90c0299f tempest-VolumesDeleteCascade-158504705 None] Acquiring lock "cinder-b90a4d0e-7521-49c2-b81a-643ff7115fc6-delete_snapshot" by "delete_snapshot" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:27:25 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-6765b2e0-7811-415b-9ee2-045a90c0299f tempest-VolumesDeleteCascade-158504705 None] Lock "cinder-b90a4d0e-7521-49c2-b81a-643ff7115fc6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:27:25 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-6765b2e0-7811-415b-9ee2-045a90c0299f tempest-VolumesDeleteCascade-158504705 None] Acquiring lock "cinder-quobyte-25b251a0-c66d-496e-8c61-8b291af027f7" by "delete_snapshot" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:27:25 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-6765b2e0-7811-415b-9ee2-045a90c0299f tempest-VolumesDeleteCascade-158504705 None] Lock "cinder-quobyte-25b251a0-c66d-496e-8c61-8b291af027f7" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:27:25 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-6765b2e0-7811-415b-9ee2-045a90c0299f tempest-VolumesDeleteCascade-158504705 None] Acquiring lock "cinder-quobyte-b90a4d0e-7521-49c2-b81a-643ff7115fc6" by "_delete_snapshot" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:27:25 devstack sudo[99354]: pam_unix(sudo:session): session closed for user root Sep 29 18:27:25 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-bacc5be7-3b20-489e-bd22-ecc8f36c9d89 tempest-CreateVolumesFromSnapshotTest-515199839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ae551dac-23ee-48c5-88ef-0b6d6df6742e" returned: 0 in 0.460s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:27:25 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-bacc5be7-3b20-489e-bd22-ecc8f36c9d89 tempest-CreateVolumesFromSnapshotTest-515199839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ae551dac-23ee-48c5-88ef-0b6d6df6742e {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:27:25 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-6765b2e0-7811-415b-9ee2-045a90c0299f tempest-VolumesDeleteCascade-158504705 None] Lock "cinder-quobyte-b90a4d0e-7521-49c2-b81a-643ff7115fc6" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:27:25 devstack sudo[99362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ae551dac-23ee-48c5-88ef-0b6d6df6742e Sep 29 18:27:25 devstack sudo[99362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:27:25 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-6765b2e0-7811-415b-9ee2-045a90c0299f tempest-VolumesDeleteCascade-158504705 None] Deleting offline snapshot b90a4d0e-7521-49c2-b81a-643ff7115fc6 of volume 25b251a0-c66d-496e-8c61-8b291af027f7 {{(pid=86512) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 18:27:25 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-6765b2e0-7811-415b-9ee2-045a90c0299f tempest-VolumesDeleteCascade-158504705 None] snapshot_file for this snap is: volume-25b251a0-c66d-496e-8c61-8b291af027f7.b90a4d0e-7521-49c2-b81a-643ff7115fc6 {{(pid=86512) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 18:27:25 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a3df4d1-7d00-414d-aaf1-b7a5fc548c84]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:27:25 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-6765b2e0-7811-415b-9ee2-045a90c0299f tempest-VolumesDeleteCascade-158504705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-25b251a0-c66d-496e-8c61-8b291af027f7.b90a4d0e-7521-49c2-b81a-643ff7115fc6 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:27:25 devstack sudo[99366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-25b251a0-c66d-496e-8c61-8b291af027f7.b90a4d0e-7521-49c2-b81a-643ff7115fc6 Sep 29 18:27:25 devstack sudo[99366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:27:25 devstack sudo[99356]: pam_unix(sudo:session): session closed for user root Sep 29 18:27:25 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-2c4e3473-f655-4353-8f5f-849657ad2163 tempest-VolumesTransfersTest-1110618009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-22e1a887-333c-47f2-b1af-bd527f9138c1 1073741824" returned: 0 in 0.492s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:27:25 devstack sudo[99362]: pam_unix(sudo:session): session closed for user root Sep 29 18:27:25 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-bacc5be7-3b20-489e-bd22-ecc8f36c9d89 tempest-CreateVolumesFromSnapshotTest-515199839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ae551dac-23ee-48c5-88ef-0b6d6df6742e" returned: 0 in 0.275s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:27:25 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-bacc5be7-3b20-489e-bd22-ecc8f36c9d89 tempest-CreateVolumesFromSnapshotTest-515199839 None] Lock "cinder-quobyte-ae551dac-23ee-48c5-88ef-0b6d6df6742e" released by "delete_volume" :: held 0.808s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:27:25 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-2c4e3473-f655-4353-8f5f-849657ad2163 tempest-VolumesTransfersTest-1110618009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-22e1a887-333c-47f2-b1af-bd527f9138c1 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:27:25 devstack sudo[99371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-22e1a887-333c-47f2-b1af-bd527f9138c1 Sep 29 18:27:25 devstack sudo[99371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:27:25 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-bacc5be7-3b20-489e-bd22-ecc8f36c9d89 tempest-CreateVolumesFromSnapshotTest-515199839 None] Created reservations ['c9124e94-4e1d-4e48-b4c1-6c3732623969', '8aa7c94d-0956-4fd3-9f38-1e0140f73f0c', '2281f5cd-d600-4f31-9c7b-09b240ecd3de', 'ea8d906a-dc56-4ba1-96e4-dedacea259aa'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:27:25 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-bacc5be7-3b20-489e-bd22-ecc8f36c9d89 tempest-CreateVolumesFromSnapshotTest-515199839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:27:25 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-bacc5be7-3b20-489e-bd22-ecc8f36c9d89 tempest-CreateVolumesFromSnapshotTest-515199839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:27:25 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-bacc5be7-3b20-489e-bd22-ecc8f36c9d89 tempest-CreateVolumesFromSnapshotTest-515199839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:27:25 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-bacc5be7-3b20-489e-bd22-ecc8f36c9d89 tempest-CreateVolumesFromSnapshotTest-515199839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:27:25 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-bacc5be7-3b20-489e-bd22-ecc8f36c9d89 tempest-CreateVolumesFromSnapshotTest-515199839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:27:25 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-bacc5be7-3b20-489e-bd22-ecc8f36c9d89 tempest-CreateVolumesFromSnapshotTest-515199839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:27:25 devstack sudo[99366]: pam_unix(sudo:session): session closed for user root Sep 29 18:27:25 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-6765b2e0-7811-415b-9ee2-045a90c0299f tempest-VolumesDeleteCascade-158504705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-25b251a0-c66d-496e-8c61-8b291af027f7.b90a4d0e-7521-49c2-b81a-643ff7115fc6" returned: 0 in 0.453s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:27:25 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-6765b2e0-7811-415b-9ee2-045a90c0299f tempest-VolumesDeleteCascade-158504705 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-25b251a0-c66d-496e-8c61-8b291af027f7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86512) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 18:27:25 devstack sudo[99376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:27:25 devstack sudo[99376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:27:25 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[944079be-915a-4bb8-8c82-9236a523ff02]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:27:25 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-6765b2e0-7811-415b-9ee2-045a90c0299f tempest-VolumesDeleteCascade-158504705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-25b251a0-c66d-496e-8c61-8b291af027f7 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:27:25 devstack sudo[99371]: pam_unix(sudo:session): session closed for user root Sep 29 18:27:25 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-2c4e3473-f655-4353-8f5f-849657ad2163 tempest-VolumesTransfersTest-1110618009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-22e1a887-333c-47f2-b1af-bd527f9138c1" returned: 0 in 0.319s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:27:25 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-2c4e3473-f655-4353-8f5f-849657ad2163 tempest-VolumesTransfersTest-1110618009 None] <== create_volume: return (880ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'} {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:27:25 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-2c4e3473-f655-4353-8f5f-849657ad2163 tempest-VolumesTransfersTest-1110618009 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.884s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:27:25 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-2c4e3473-f655-4353-8f5f-849657ad2163 tempest-VolumesTransfersTest-1110618009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8b12f28-2e7c-4bab-a924-a75bf74c91d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22e1a887-333c-47f2-b1af-bd527f9138c1', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:27:25 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-2c4e3473-f655-4353-8f5f-849657ad2163 tempest-VolumesTransfersTest-1110618009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ff83938-fe0b-4721-8d8f-6a2f5af5ff04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:27:25 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-2c4e3473-f655-4353-8f5f-849657ad2163 tempest-VolumesTransfersTest-1110618009 None] Volume volume-22e1a887-333c-47f2-b1af-bd527f9138c1 (22e1a887-333c-47f2-b1af-bd527f9138c1): created successfully Sep 29 18:27:25 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-2c4e3473-f655-4353-8f5f-849657ad2163 tempest-VolumesTransfersTest-1110618009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ff83938-fe0b-4721-8d8f-6a2f5af5ff04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:27:25 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-2c4e3473-f655-4353-8f5f-849657ad2163 tempest-VolumesTransfersTest-1110618009 None] Flow 'volume_create_manager' (2fbeb8ee-afea-4e2d-ad0f-601a445dedc5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:27:25 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-2c4e3473-f655-4353-8f5f-849657ad2163 tempest-VolumesTransfersTest-1110618009 None] Created volume successfully. Sep 29 18:27:26 devstack sudo[99379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-25b251a0-c66d-496e-8c61-8b291af027f7 Sep 29 18:27:26 devstack sudo[99379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:27:26 devstack sudo[99376]: pam_unix(sudo:session): session closed for user root Sep 29 18:27:26 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-bacc5be7-3b20-489e-bd22-ecc8f36c9d89 tempest-CreateVolumesFromSnapshotTest-515199839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.349s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:27:26 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-bacc5be7-3b20-489e-bd22-ecc8f36c9d89 tempest-CreateVolumesFromSnapshotTest-515199839 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:27:26 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-bacc5be7-3b20-489e-bd22-ecc8f36c9d89 tempest-CreateVolumesFromSnapshotTest-515199839 None] Deleted volume successfully. Sep 29 18:27:26 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-bacc5be7-3b20-489e-bd22-ecc8f36c9d89 tempest-CreateVolumesFromSnapshotTest-515199839 None] Lock "cinder-ae551dac-23ee-48c5-88ef-0b6d6df6742e-delete_volume" released by "delete_volume" :: held 1.478s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:27:26 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-d127c259-8691-4803-9b31-ed69f807b850 tempest-AttachVolumeNegativeTest-1588161148 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86512) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:27:26 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d127c259-8691-4803-9b31-ed69f807b850 tempest-AttachVolumeNegativeTest-1588161148 None] Flow 'volume_create_manager' (3194671f-3694-41bc-8c0d-6bca0ab5e364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:27:26 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d127c259-8691-4803-9b31-ed69f807b850 tempest-AttachVolumeNegativeTest-1588161148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b5bccb9-7d24-4e73-b9ef-8cee3b1f352d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:27:26 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d127c259-8691-4803-9b31-ed69f807b850 tempest-AttachVolumeNegativeTest-1588161148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b5bccb9-7d24-4e73-b9ef-8cee3b1f352d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:27:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-507859133',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b901a0e-81bf-4d2a-8348-a6d5fb751073,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05c82caa4fd348afbec7a526cbb20e18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:27:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:27:26Z,use_quota=True,user_id='64e1943d04f742059dd82e9c24eeaec0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:27:26 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d127c259-8691-4803-9b31-ed69f807b850 tempest-AttachVolumeNegativeTest-1588161148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09f7b651-78aa-4f80-8d21-b801fab1132d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:27:26 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d127c259-8691-4803-9b31-ed69f807b850 tempest-AttachVolumeNegativeTest-1588161148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09f7b651-78aa-4f80-8d21-b801fab1132d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:27:26 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d127c259-8691-4803-9b31-ed69f807b850 tempest-AttachVolumeNegativeTest-1588161148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01fdc0cb-9181-4993-bdff-632a861615a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:27:26 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d127c259-8691-4803-9b31-ed69f807b850 tempest-AttachVolumeNegativeTest-1588161148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01fdc0cb-9181-4993-bdff-632a861615a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b901a0e-81bf-4d2a-8348-a6d5fb751073', 'volume_name': 'volume-5b901a0e-81bf-4d2a-8348-a6d5fb751073', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:27:26 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d127c259-8691-4803-9b31-ed69f807b850 tempest-AttachVolumeNegativeTest-1588161148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33a98130-eaf5-420e-8e59-a7be52c1fece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:27:26 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d127c259-8691-4803-9b31-ed69f807b850 tempest-AttachVolumeNegativeTest-1588161148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33a98130-eaf5-420e-8e59-a7be52c1fece) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:27:26 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d127c259-8691-4803-9b31-ed69f807b850 tempest-AttachVolumeNegativeTest-1588161148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c1e97d8-880e-4902-ab24-b1cc2ef0cf93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:27:26 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-d127c259-8691-4803-9b31-ed69f807b850 tempest-AttachVolumeNegativeTest-1588161148 None] Volume 5b901a0e-81bf-4d2a-8348-a6d5fb751073: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b901a0e-81bf-4d2a-8348-a6d5fb751073', 'volume_size': 1} Sep 29 18:27:26 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-d127c259-8691-4803-9b31-ed69f807b850 tempest-AttachVolumeNegativeTest-1588161148 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:27:26 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-d127c259-8691-4803-9b31-ed69f807b850 tempest-AttachVolumeNegativeTest-1588161148 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:27:26 devstack sudo[99379]: pam_unix(sudo:session): session closed for user root Sep 29 18:27:26 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-d127c259-8691-4803-9b31-ed69f807b850 tempest-AttachVolumeNegativeTest-1588161148 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:27:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-507859133',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b901a0e-81bf-4d2a-8348-a6d5fb751073,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05c82caa4fd348afbec7a526cbb20e18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:27:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:27:26Z,use_quota=True,user_id='64e1943d04f742059dd82e9c24eeaec0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)}" {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:27:26 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-d127c259-8691-4803-9b31-ed69f807b850 tempest-AttachVolumeNegativeTest-1588161148 None] Creating volume 5b901a0e-81bf-4d2a-8348-a6d5fb751073 {{(pid=86512) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:27:26 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-d127c259-8691-4803-9b31-ed69f807b850 tempest-AttachVolumeNegativeTest-1588161148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:27:26 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-d127c259-8691-4803-9b31-ed69f807b850 tempest-AttachVolumeNegativeTest-1588161148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:27:26 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-d127c259-8691-4803-9b31-ed69f807b850 tempest-AttachVolumeNegativeTest-1588161148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:27:26 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-d127c259-8691-4803-9b31-ed69f807b850 tempest-AttachVolumeNegativeTest-1588161148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:27:26 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-d127c259-8691-4803-9b31-ed69f807b850 tempest-AttachVolumeNegativeTest-1588161148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:27:26 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-d127c259-8691-4803-9b31-ed69f807b850 tempest-AttachVolumeNegativeTest-1588161148 None] Selected osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 as target Quobyte volume. {{(pid=86512) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:27:26 devstack cinder-volume[86512]: INFO cinder.volume.drivers.remotefs [None req-d127c259-8691-4803-9b31-ed69f807b850 tempest-AttachVolumeNegativeTest-1588161148 None] casted to osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 Sep 29 18:27:26 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-d127c259-8691-4803-9b31-ed69f807b850 tempest-AttachVolumeNegativeTest-1588161148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-5b901a0e-81bf-4d2a-8348-a6d5fb751073 1073741824 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:27:26 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-6765b2e0-7811-415b-9ee2-045a90c0299f tempest-VolumesDeleteCascade-158504705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-25b251a0-c66d-496e-8c61-8b291af027f7" returned: 0 in 0.708s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:27:26 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-6765b2e0-7811-415b-9ee2-045a90c0299f tempest-VolumesDeleteCascade-158504705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-25b251a0-c66d-496e-8c61-8b291af027f7.b90a4d0e-7521-49c2-b81a-643ff7115fc6 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:27:26 devstack sudo[99385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-5b901a0e-81bf-4d2a-8348-a6d5fb751073 1073741824 Sep 29 18:27:26 devstack sudo[99385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:27:26 devstack sudo[99386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-25b251a0-c66d-496e-8c61-8b291af027f7.b90a4d0e-7521-49c2-b81a-643ff7115fc6 Sep 29 18:27:26 devstack sudo[99386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:27:26 devstack sudo[99386]: pam_unix(sudo:session): session closed for user root Sep 29 18:27:26 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-6765b2e0-7811-415b-9ee2-045a90c0299f tempest-VolumesDeleteCascade-158504705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-25b251a0-c66d-496e-8c61-8b291af027f7.b90a4d0e-7521-49c2-b81a-643ff7115fc6" returned: 0 in 0.392s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:27:26 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-6765b2e0-7811-415b-9ee2-045a90c0299f tempest-VolumesDeleteCascade-158504705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-25b251a0-c66d-496e-8c61-8b291af027f7.b90a4d0e-7521-49c2-b81a-643ff7115fc6 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:27:26 devstack sudo[99396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-25b251a0-c66d-496e-8c61-8b291af027f7.b90a4d0e-7521-49c2-b81a-643ff7115fc6 Sep 29 18:27:26 devstack sudo[99396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:27:27 devstack sudo[99385]: pam_unix(sudo:session): session closed for user root Sep 29 18:27:27 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-d127c259-8691-4803-9b31-ed69f807b850 tempest-AttachVolumeNegativeTest-1588161148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-5b901a0e-81bf-4d2a-8348-a6d5fb751073 1073741824" returned: 0 in 0.547s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:27:27 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-d127c259-8691-4803-9b31-ed69f807b850 tempest-AttachVolumeNegativeTest-1588161148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-5b901a0e-81bf-4d2a-8348-a6d5fb751073 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:27:27 devstack sudo[99398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-5b901a0e-81bf-4d2a-8348-a6d5fb751073 Sep 29 18:27:27 devstack sudo[99398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:27:27 devstack sudo[99396]: pam_unix(sudo:session): session closed for user root Sep 29 18:27:27 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-6765b2e0-7811-415b-9ee2-045a90c0299f tempest-VolumesDeleteCascade-158504705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-25b251a0-c66d-496e-8c61-8b291af027f7.b90a4d0e-7521-49c2-b81a-643ff7115fc6" returned: 0 in 0.320s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:27:27 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-6765b2e0-7811-415b-9ee2-045a90c0299f tempest-VolumesDeleteCascade-158504705 None] Lock "cinder-quobyte-b90a4d0e-7521-49c2-b81a-643ff7115fc6" released by "_delete_snapshot" :: held 2.042s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:27:27 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-6765b2e0-7811-415b-9ee2-045a90c0299f tempest-VolumesDeleteCascade-158504705 None] Lock "cinder-quobyte-25b251a0-c66d-496e-8c61-8b291af027f7" released by "delete_snapshot" :: held 2.097s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:27:27 devstack sudo[99398]: pam_unix(sudo:session): session closed for user root Sep 29 18:27:27 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-6765b2e0-7811-415b-9ee2-045a90c0299f tempest-VolumesDeleteCascade-158504705 None] Created reservations ['3436355d-8aac-47b9-8d80-6af0ee863852', '54fcf7d2-c8c1-440b-9f64-7c999b5895fe', 'c5c528ad-d77c-4ebc-8d0c-fcf87f0dca2d', 'abaab510-14a3-4e23-a9b2-e286f85ec491'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:27:27 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-d127c259-8691-4803-9b31-ed69f807b850 tempest-AttachVolumeNegativeTest-1588161148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-5b901a0e-81bf-4d2a-8348-a6d5fb751073" returned: 0 in 0.372s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:27:27 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-d127c259-8691-4803-9b31-ed69f807b850 tempest-AttachVolumeNegativeTest-1588161148 None] <== create_volume: return (971ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'} {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:27:27 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-d127c259-8691-4803-9b31-ed69f807b850 tempest-AttachVolumeNegativeTest-1588161148 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.974s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:27:27 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d127c259-8691-4803-9b31-ed69f807b850 tempest-AttachVolumeNegativeTest-1588161148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c1e97d8-880e-4902-ab24-b1cc2ef0cf93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b901a0e-81bf-4d2a-8348-a6d5fb751073', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:27:27 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d127c259-8691-4803-9b31-ed69f807b850 tempest-AttachVolumeNegativeTest-1588161148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb8edbc9-5e23-4e90-949c-99f0de000d18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:27:27 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-d127c259-8691-4803-9b31-ed69f807b850 tempest-AttachVolumeNegativeTest-1588161148 None] Volume volume-5b901a0e-81bf-4d2a-8348-a6d5fb751073 (5b901a0e-81bf-4d2a-8348-a6d5fb751073): created successfully Sep 29 18:27:27 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d127c259-8691-4803-9b31-ed69f807b850 tempest-AttachVolumeNegativeTest-1588161148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb8edbc9-5e23-4e90-949c-99f0de000d18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:27:27 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d127c259-8691-4803-9b31-ed69f807b850 tempest-AttachVolumeNegativeTest-1588161148 None] Flow 'volume_create_manager' (3194671f-3694-41bc-8c0d-6bca0ab5e364) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:27:27 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-d127c259-8691-4803-9b31-ed69f807b850 tempest-AttachVolumeNegativeTest-1588161148 None] Created volume successfully. Sep 29 18:27:27 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-6765b2e0-7811-415b-9ee2-045a90c0299f tempest-VolumesDeleteCascade-158504705 None] Delete snapshot completed successfully. Sep 29 18:27:27 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-6765b2e0-7811-415b-9ee2-045a90c0299f tempest-VolumesDeleteCascade-158504705 None] Lock "cinder-b90a4d0e-7521-49c2-b81a-643ff7115fc6-delete_snapshot" released by "delete_snapshot" :: held 2.417s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:27:27 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-6765b2e0-7811-415b-9ee2-045a90c0299f tempest-VolumesDeleteCascade-158504705 None] Snapshots deleted, issuing volume delete {{(pid=86512) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 29 18:27:27 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-6765b2e0-7811-415b-9ee2-045a90c0299f tempest-VolumesDeleteCascade-158504705 None] Acquiring lock "cinder-quobyte-25b251a0-c66d-496e-8c61-8b291af027f7" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:27:27 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-6765b2e0-7811-415b-9ee2-045a90c0299f tempest-VolumesDeleteCascade-158504705 None] Lock "cinder-quobyte-25b251a0-c66d-496e-8c61-8b291af027f7" acquired by "delete_volume" :: waited 0.023s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:27:27 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f554abd-18f4-48e8-9a89-f079b06d879b]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:27:27 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-6765b2e0-7811-415b-9ee2-045a90c0299f tempest-VolumesDeleteCascade-158504705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-25b251a0-c66d-496e-8c61-8b291af027f7 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:27:27 devstack sudo[99402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-25b251a0-c66d-496e-8c61-8b291af027f7 Sep 29 18:27:27 devstack sudo[99402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:27:28 devstack sudo[99402]: pam_unix(sudo:session): session closed for user root Sep 29 18:27:28 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-6765b2e0-7811-415b-9ee2-045a90c0299f tempest-VolumesDeleteCascade-158504705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-25b251a0-c66d-496e-8c61-8b291af027f7" returned: 0 in 0.439s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:27:28 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-6765b2e0-7811-415b-9ee2-045a90c0299f tempest-VolumesDeleteCascade-158504705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-25b251a0-c66d-496e-8c61-8b291af027f7 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:27:28 devstack sudo[99407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-25b251a0-c66d-496e-8c61-8b291af027f7 Sep 29 18:27:28 devstack sudo[99407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:27:28 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-6fc7aa78-012b-4916-a17c-d7087854ae07 tempest-VolumesTransfersTest-1946728016 None] Transfer volume completed successfully. Sep 29 18:27:28 devstack sudo[99407]: pam_unix(sudo:session): session closed for user root Sep 29 18:27:28 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-6765b2e0-7811-415b-9ee2-045a90c0299f tempest-VolumesDeleteCascade-158504705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-25b251a0-c66d-496e-8c61-8b291af027f7" returned: 0 in 0.360s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:27:28 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-6765b2e0-7811-415b-9ee2-045a90c0299f tempest-VolumesDeleteCascade-158504705 None] Lock "cinder-quobyte-25b251a0-c66d-496e-8c61-8b291af027f7" released by "delete_volume" :: held 0.910s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:27:28 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-6765b2e0-7811-415b-9ee2-045a90c0299f tempest-VolumesDeleteCascade-158504705 None] Created reservations ['1d709910-1ec9-42d4-968c-e14dc7e4b504', 'fd927397-0d54-4865-9223-3ba691e150e2', 'b0744c92-e959-4615-bd5e-20e1ade580fa', 'b6f52ea6-f373-45d9-8408-03da3eb318ef'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:27:28 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-6765b2e0-7811-415b-9ee2-045a90c0299f tempest-VolumesDeleteCascade-158504705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:27:28 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-6765b2e0-7811-415b-9ee2-045a90c0299f tempest-VolumesDeleteCascade-158504705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:27:28 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-6765b2e0-7811-415b-9ee2-045a90c0299f tempest-VolumesDeleteCascade-158504705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:27:28 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-6765b2e0-7811-415b-9ee2-045a90c0299f tempest-VolumesDeleteCascade-158504705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:27:28 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-6765b2e0-7811-415b-9ee2-045a90c0299f tempest-VolumesDeleteCascade-158504705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:27:28 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-6765b2e0-7811-415b-9ee2-045a90c0299f tempest-VolumesDeleteCascade-158504705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:27:28 devstack sudo[99410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:27:28 devstack sudo[99410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:27:28 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-ddf42d5e-27aa-4d63-b344-54a7e2f4fd6b tempest-VolumesTransfersTest-1462359548 None] Acquiring lock "cinder-22e1a887-333c-47f2-b1af-bd527f9138c1-delete_volume" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:27:29 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-ddf42d5e-27aa-4d63-b344-54a7e2f4fd6b tempest-VolumesTransfersTest-1462359548 None] Lock "cinder-22e1a887-333c-47f2-b1af-bd527f9138c1-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:27:29 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-ddf42d5e-27aa-4d63-b344-54a7e2f4fd6b tempest-VolumesTransfersTest-1462359548 None] Acquiring lock "cinder-quobyte-22e1a887-333c-47f2-b1af-bd527f9138c1" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:27:29 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-ddf42d5e-27aa-4d63-b344-54a7e2f4fd6b tempest-VolumesTransfersTest-1462359548 None] Lock "cinder-quobyte-22e1a887-333c-47f2-b1af-bd527f9138c1" acquired by "delete_volume" :: waited 0.028s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:27:29 devstack sudo[99410]: pam_unix(sudo:session): session closed for user root Sep 29 18:27:29 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-6765b2e0-7811-415b-9ee2-045a90c0299f tempest-VolumesDeleteCascade-158504705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.388s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:27:29 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-6765b2e0-7811-415b-9ee2-045a90c0299f tempest-VolumesDeleteCascade-158504705 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:27:29 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-6765b2e0-7811-415b-9ee2-045a90c0299f tempest-VolumesDeleteCascade-158504705 None] Deleted volume successfully. Sep 29 18:27:29 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0517d7a-e881-4bd6-991a-b4007d3c1268]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:27:29 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-ddf42d5e-27aa-4d63-b344-54a7e2f4fd6b tempest-VolumesTransfersTest-1462359548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-22e1a887-333c-47f2-b1af-bd527f9138c1 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:27:29 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-6765b2e0-7811-415b-9ee2-045a90c0299f tempest-VolumesDeleteCascade-158504705 None] Lock "cinder-25b251a0-c66d-496e-8c61-8b291af027f7-delete_volume" released by "delete_volume" :: held 4.061s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:27:29 devstack sudo[99416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-22e1a887-333c-47f2-b1af-bd527f9138c1 Sep 29 18:27:29 devstack sudo[99416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:27:29 devstack sudo[99416]: pam_unix(sudo:session): session closed for user root Sep 29 18:27:29 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-ddf42d5e-27aa-4d63-b344-54a7e2f4fd6b tempest-VolumesTransfersTest-1462359548 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-22e1a887-333c-47f2-b1af-bd527f9138c1" returned: 0 in 0.497s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:27:29 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-ddf42d5e-27aa-4d63-b344-54a7e2f4fd6b tempest-VolumesTransfersTest-1462359548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-22e1a887-333c-47f2-b1af-bd527f9138c1 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:27:29 devstack sudo[99428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-22e1a887-333c-47f2-b1af-bd527f9138c1 Sep 29 18:27:29 devstack sudo[99428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:27:29 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-da17f349-9737-41cd-a4b8-82800ba9909a tempest-VolumesDeleteCascade-158504705 None] Acquiring lock "cinder-f6e2e7e4-52ba-4efd-9ecc-93f36a910ef9-delete_volume" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:27:29 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-da17f349-9737-41cd-a4b8-82800ba9909a tempest-VolumesDeleteCascade-158504705 None] Lock "cinder-f6e2e7e4-52ba-4efd-9ecc-93f36a910ef9-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:27:29 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-da17f349-9737-41cd-a4b8-82800ba9909a tempest-VolumesDeleteCascade-158504705 None] Acquiring lock "cinder-quobyte-f6e2e7e4-52ba-4efd-9ecc-93f36a910ef9" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:27:29 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [req-be483c76-a1ef-40c3-ac11-cccca39b8167 req-6349fbbe-153c-4d0a-8c13-d2f442a9def6 tempest-AttachVolumeNegativeTest-1588161148 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:27:29 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [req-be483c76-a1ef-40c3-ac11-cccca39b8167 req-6349fbbe-153c-4d0a-8c13-d2f442a9def6 tempest-AttachVolumeNegativeTest-1588161148 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:27:29 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-da17f349-9737-41cd-a4b8-82800ba9909a tempest-VolumesDeleteCascade-158504705 None] Lock "cinder-quobyte-f6e2e7e4-52ba-4efd-9ecc-93f36a910ef9" acquired by "delete_volume" :: waited 0.029s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:27:29 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [req-be483c76-a1ef-40c3-ac11-cccca39b8167 req-6349fbbe-153c-4d0a-8c13-d2f442a9def6 tempest-AttachVolumeNegativeTest-1588161148 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.034s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:27:29 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4a9af2d-b541-4f68-884b-6ed53914ad1a]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:27:29 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-da17f349-9737-41cd-a4b8-82800ba9909a tempest-VolumesDeleteCascade-158504705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-f6e2e7e4-52ba-4efd-9ecc-93f36a910ef9 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:27:29 devstack sudo[99428]: pam_unix(sudo:session): session closed for user root Sep 29 18:27:29 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-ddf42d5e-27aa-4d63-b344-54a7e2f4fd6b tempest-VolumesTransfersTest-1462359548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-22e1a887-333c-47f2-b1af-bd527f9138c1" returned: 0 in 0.285s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:27:29 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [req-be483c76-a1ef-40c3-ac11-cccca39b8167 req-6349fbbe-153c-4d0a-8c13-d2f442a9def6 tempest-AttachVolumeNegativeTest-1588161148 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883', 'name': 'volume-5b901a0e-81bf-4d2a-8348-a6d5fb751073', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '524eb27d-5c61-451e-9536-94b5e64e3afd', 'enforce_multipath': True} {{(pid=86512) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 29 18:27:29 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-ddf42d5e-27aa-4d63-b344-54a7e2f4fd6b tempest-VolumesTransfersTest-1462359548 None] Lock "cinder-quobyte-22e1a887-333c-47f2-b1af-bd527f9138c1" released by "delete_volume" :: held 0.860s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:27:30 devstack sudo[99432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-f6e2e7e4-52ba-4efd-9ecc-93f36a910ef9 Sep 29 18:27:30 devstack sudo[99432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:27:30 devstack cinder-volume[86512]: INFO cinder.volume.manager [req-be483c76-a1ef-40c3-ac11-cccca39b8167 req-6349fbbe-153c-4d0a-8c13-d2f442a9def6 tempest-AttachVolumeNegativeTest-1588161148 None] attachment_update completed successfully. Sep 29 18:27:30 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-ddf42d5e-27aa-4d63-b344-54a7e2f4fd6b tempest-VolumesTransfersTest-1462359548 None] Created reservations ['1d0bf397-9627-454f-a56e-cac80f019156', 'ac296a0a-cf12-4436-8863-b00b211f6525', 'c05c8624-06d9-4faf-8266-1b8ecd923c3d', '4247d65a-5666-4f6f-b952-3051d4942256'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:27:30 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-ddf42d5e-27aa-4d63-b344-54a7e2f4fd6b tempest-VolumesTransfersTest-1462359548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:27:30 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-ddf42d5e-27aa-4d63-b344-54a7e2f4fd6b tempest-VolumesTransfersTest-1462359548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:27:30 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-ddf42d5e-27aa-4d63-b344-54a7e2f4fd6b tempest-VolumesTransfersTest-1462359548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:27:30 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-ddf42d5e-27aa-4d63-b344-54a7e2f4fd6b tempest-VolumesTransfersTest-1462359548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:27:30 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-ddf42d5e-27aa-4d63-b344-54a7e2f4fd6b tempest-VolumesTransfersTest-1462359548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:27:30 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-ddf42d5e-27aa-4d63-b344-54a7e2f4fd6b tempest-VolumesTransfersTest-1462359548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:27:30 devstack sudo[99456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:27:30 devstack sudo[99456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:27:30 devstack sudo[99432]: pam_unix(sudo:session): session closed for user root Sep 29 18:27:30 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-da17f349-9737-41cd-a4b8-82800ba9909a tempest-VolumesDeleteCascade-158504705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-f6e2e7e4-52ba-4efd-9ecc-93f36a910ef9" returned: 0 in 0.464s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:27:30 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-da17f349-9737-41cd-a4b8-82800ba9909a tempest-VolumesDeleteCascade-158504705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-f6e2e7e4-52ba-4efd-9ecc-93f36a910ef9 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:27:30 devstack sudo[99537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-f6e2e7e4-52ba-4efd-9ecc-93f36a910ef9 Sep 29 18:27:30 devstack sudo[99537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:27:30 devstack sudo[99456]: pam_unix(sudo:session): session closed for user root Sep 29 18:27:30 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-ddf42d5e-27aa-4d63-b344-54a7e2f4fd6b tempest-VolumesTransfersTest-1462359548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.403s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:27:30 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-ddf42d5e-27aa-4d63-b344-54a7e2f4fd6b tempest-VolumesTransfersTest-1462359548 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:27:30 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-ddf42d5e-27aa-4d63-b344-54a7e2f4fd6b tempest-VolumesTransfersTest-1462359548 None] Deleted volume successfully. Sep 29 18:27:30 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-ddf42d5e-27aa-4d63-b344-54a7e2f4fd6b tempest-VolumesTransfersTest-1462359548 None] Lock "cinder-22e1a887-333c-47f2-b1af-bd527f9138c1-delete_volume" released by "delete_volume" :: held 1.681s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:27:30 devstack sudo[99537]: pam_unix(sudo:session): session closed for user root Sep 29 18:27:30 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-da17f349-9737-41cd-a4b8-82800ba9909a tempest-VolumesDeleteCascade-158504705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-f6e2e7e4-52ba-4efd-9ecc-93f36a910ef9" returned: 0 in 0.529s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:27:30 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-da17f349-9737-41cd-a4b8-82800ba9909a tempest-VolumesDeleteCascade-158504705 None] Lock "cinder-quobyte-f6e2e7e4-52ba-4efd-9ecc-93f36a910ef9" released by "delete_volume" :: held 1.052s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:27:31 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-da17f349-9737-41cd-a4b8-82800ba9909a tempest-VolumesDeleteCascade-158504705 None] Created reservations ['306d9e68-2032-4fea-b5ac-b45f513310fe', 'cdfdd974-f7d6-42ea-bfee-609ceab1bd46', '391fecba-da68-49e4-9768-f6efa1a1bb3e', '07375af4-46cf-4c8a-98a5-225a201d7c78'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:27:31 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfe31e5f-3661-483e-8507-a144f9aa7eb0 tempest-VolumesTransfersTest-1110618009 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86512) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:27:31 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-cfe31e5f-3661-483e-8507-a144f9aa7eb0 tempest-VolumesTransfersTest-1110618009 None] Flow 'volume_create_manager' (4f1d62f4-0841-4cd9-88a7-0b68701b10b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:27:31 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-cfe31e5f-3661-483e-8507-a144f9aa7eb0 tempest-VolumesTransfersTest-1110618009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5963377-39c5-4642-902d-32d9c38054ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:27:31 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-cfe31e5f-3661-483e-8507-a144f9aa7eb0 tempest-VolumesTransfersTest-1110618009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5963377-39c5-4642-902d-32d9c38054ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:27:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1357512585',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a949b4f-d7db-4bb4-b978-263d547ff111,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ea6710b09e04f48be29990bb8327aca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:27:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:27:31Z,use_quota=True,user_id='f9bd6f970831407fa0448f2e4eb669e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:27:31 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-cfe31e5f-3661-483e-8507-a144f9aa7eb0 tempest-VolumesTransfersTest-1110618009 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f14fd93-f18e-4720-8c99-cdf8b001f0f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:27:31 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-cfe31e5f-3661-483e-8507-a144f9aa7eb0 tempest-VolumesTransfersTest-1110618009 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f14fd93-f18e-4720-8c99-cdf8b001f0f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:27:31 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-cfe31e5f-3661-483e-8507-a144f9aa7eb0 tempest-VolumesTransfersTest-1110618009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8eacd067-34a8-43f5-bf15-cb846f795b85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:27:31 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-cfe31e5f-3661-483e-8507-a144f9aa7eb0 tempest-VolumesTransfersTest-1110618009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8eacd067-34a8-43f5-bf15-cb846f795b85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a949b4f-d7db-4bb4-b978-263d547ff111', 'volume_name': 'volume-4a949b4f-d7db-4bb4-b978-263d547ff111', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:27:31 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-cfe31e5f-3661-483e-8507-a144f9aa7eb0 tempest-VolumesTransfersTest-1110618009 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5691228-5da3-4b67-9307-ad2174cef6a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:27:31 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-cfe31e5f-3661-483e-8507-a144f9aa7eb0 tempest-VolumesTransfersTest-1110618009 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5691228-5da3-4b67-9307-ad2174cef6a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:27:31 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-cfe31e5f-3661-483e-8507-a144f9aa7eb0 tempest-VolumesTransfersTest-1110618009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3c97036-5d49-4b8a-9d17-d6ce73fc1750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:27:31 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-cfe31e5f-3661-483e-8507-a144f9aa7eb0 tempest-VolumesTransfersTest-1110618009 None] Volume 4a949b4f-d7db-4bb4-b978-263d547ff111: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a949b4f-d7db-4bb4-b978-263d547ff111', 'volume_size': 1} Sep 29 18:27:31 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-cfe31e5f-3661-483e-8507-a144f9aa7eb0 tempest-VolumesTransfersTest-1110618009 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:27:31 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-cfe31e5f-3661-483e-8507-a144f9aa7eb0 tempest-VolumesTransfersTest-1110618009 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:27:31 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-cfe31e5f-3661-483e-8507-a144f9aa7eb0 tempest-VolumesTransfersTest-1110618009 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:27:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1357512585',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a949b4f-d7db-4bb4-b978-263d547ff111,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ea6710b09e04f48be29990bb8327aca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:27:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:27:31Z,use_quota=True,user_id='f9bd6f970831407fa0448f2e4eb669e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)}" {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:27:31 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-cfe31e5f-3661-483e-8507-a144f9aa7eb0 tempest-VolumesTransfersTest-1110618009 None] Creating volume 4a949b4f-d7db-4bb4-b978-263d547ff111 {{(pid=86512) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:27:31 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-cfe31e5f-3661-483e-8507-a144f9aa7eb0 tempest-VolumesTransfersTest-1110618009 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:27:31 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-cfe31e5f-3661-483e-8507-a144f9aa7eb0 tempest-VolumesTransfersTest-1110618009 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:27:31 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-cfe31e5f-3661-483e-8507-a144f9aa7eb0 tempest-VolumesTransfersTest-1110618009 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:27:31 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-cfe31e5f-3661-483e-8507-a144f9aa7eb0 tempest-VolumesTransfersTest-1110618009 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:27:31 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-cfe31e5f-3661-483e-8507-a144f9aa7eb0 tempest-VolumesTransfersTest-1110618009 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:27:31 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-cfe31e5f-3661-483e-8507-a144f9aa7eb0 tempest-VolumesTransfersTest-1110618009 None] Selected osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 as target Quobyte volume. {{(pid=86512) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:27:31 devstack cinder-volume[86512]: INFO cinder.volume.drivers.remotefs [None req-cfe31e5f-3661-483e-8507-a144f9aa7eb0 tempest-VolumesTransfersTest-1110618009 None] casted to osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 Sep 29 18:27:31 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-cfe31e5f-3661-483e-8507-a144f9aa7eb0 tempest-VolumesTransfersTest-1110618009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-4a949b4f-d7db-4bb4-b978-263d547ff111 1073741824 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:27:31 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-da17f349-9737-41cd-a4b8-82800ba9909a tempest-VolumesDeleteCascade-158504705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:27:31 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-da17f349-9737-41cd-a4b8-82800ba9909a tempest-VolumesDeleteCascade-158504705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:27:31 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-da17f349-9737-41cd-a4b8-82800ba9909a tempest-VolumesDeleteCascade-158504705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:27:31 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-da17f349-9737-41cd-a4b8-82800ba9909a tempest-VolumesDeleteCascade-158504705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:27:31 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-da17f349-9737-41cd-a4b8-82800ba9909a tempest-VolumesDeleteCascade-158504705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:27:31 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-da17f349-9737-41cd-a4b8-82800ba9909a tempest-VolumesDeleteCascade-158504705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:27:31 devstack sudo[99861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-4a949b4f-d7db-4bb4-b978-263d547ff111 1073741824 Sep 29 18:27:31 devstack sudo[99861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:27:31 devstack sudo[99862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:27:31 devstack sudo[99862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:27:31 devstack sudo[99862]: pam_unix(sudo:session): session closed for user root Sep 29 18:27:31 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-da17f349-9737-41cd-a4b8-82800ba9909a tempest-VolumesDeleteCascade-158504705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.320s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:27:31 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-da17f349-9737-41cd-a4b8-82800ba9909a tempest-VolumesDeleteCascade-158504705 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:27:31 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-da17f349-9737-41cd-a4b8-82800ba9909a tempest-VolumesDeleteCascade-158504705 None] Deleted volume successfully. Sep 29 18:27:31 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-da17f349-9737-41cd-a4b8-82800ba9909a tempest-VolumesDeleteCascade-158504705 None] Lock "cinder-f6e2e7e4-52ba-4efd-9ecc-93f36a910ef9-delete_volume" released by "delete_volume" :: held 1.856s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:27:31 devstack sudo[99861]: pam_unix(sudo:session): session closed for user root Sep 29 18:27:31 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-cfe31e5f-3661-483e-8507-a144f9aa7eb0 tempest-VolumesTransfersTest-1110618009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-4a949b4f-d7db-4bb4-b978-263d547ff111 1073741824" returned: 0 in 0.548s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:27:31 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-cfe31e5f-3661-483e-8507-a144f9aa7eb0 tempest-VolumesTransfersTest-1110618009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-4a949b4f-d7db-4bb4-b978-263d547ff111 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:27:31 devstack sudo[99870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-4a949b4f-d7db-4bb4-b978-263d547ff111 Sep 29 18:27:31 devstack sudo[99870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:27:32 devstack sudo[99870]: pam_unix(sudo:session): session closed for user root Sep 29 18:27:32 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-cfe31e5f-3661-483e-8507-a144f9aa7eb0 tempest-VolumesTransfersTest-1110618009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-4a949b4f-d7db-4bb4-b978-263d547ff111" returned: 0 in 0.280s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:27:32 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-cfe31e5f-3661-483e-8507-a144f9aa7eb0 tempest-VolumesTransfersTest-1110618009 None] <== create_volume: return (872ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'} {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:27:32 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-cfe31e5f-3661-483e-8507-a144f9aa7eb0 tempest-VolumesTransfersTest-1110618009 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.874s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:27:32 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-cfe31e5f-3661-483e-8507-a144f9aa7eb0 tempest-VolumesTransfersTest-1110618009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3c97036-5d49-4b8a-9d17-d6ce73fc1750) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a949b4f-d7db-4bb4-b978-263d547ff111', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:27:32 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-cfe31e5f-3661-483e-8507-a144f9aa7eb0 tempest-VolumesTransfersTest-1110618009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66534afa-c57d-4596-babb-679831d14e71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:27:32 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-cfe31e5f-3661-483e-8507-a144f9aa7eb0 tempest-VolumesTransfersTest-1110618009 None] Volume volume-4a949b4f-d7db-4bb4-b978-263d547ff111 (4a949b4f-d7db-4bb4-b978-263d547ff111): created successfully Sep 29 18:27:32 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-cfe31e5f-3661-483e-8507-a144f9aa7eb0 tempest-VolumesTransfersTest-1110618009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66534afa-c57d-4596-babb-679831d14e71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:27:32 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-cfe31e5f-3661-483e-8507-a144f9aa7eb0 tempest-VolumesTransfersTest-1110618009 None] Flow 'volume_create_manager' (4f1d62f4-0841-4cd9-88a7-0b68701b10b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:27:32 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-cfe31e5f-3661-483e-8507-a144f9aa7eb0 tempest-VolumesTransfersTest-1110618009 None] Created volume successfully. Sep 29 18:27:32 devstack cinder-volume[86512]: INFO cinder.volume.manager [req-a3637bed-f278-4c75-b8f0-d75db0552679 req-85446032-e338-4424-a45e-a3ac1079ef9f tempest-AttachVolumeNegativeTest-1588161148 None] Terminate volume connection completed successfully. Sep 29 18:27:32 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [req-a3637bed-f278-4c75-b8f0-d75db0552679 req-85446032-e338-4424-a45e-a3ac1079ef9f tempest-AttachVolumeNegativeTest-1588161148 None] Deleting attachment 524eb27d-5c61-451e-9536-94b5e64e3afd. {{(pid=86512) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 29 18:27:33 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-51c639c3-9945-4afe-a462-ca27fc93f7be tempest-VolumeImageDependencyTests-1991530828 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86512) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:27:33 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-51c639c3-9945-4afe-a462-ca27fc93f7be tempest-VolumeImageDependencyTests-1991530828 None] Flow 'volume_create_manager' (edde8e13-53c5-466b-bd60-58a2047d82a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:27:33 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-51c639c3-9945-4afe-a462-ca27fc93f7be tempest-VolumeImageDependencyTests-1991530828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d28800f-718d-467e-b472-b27f2ea7d0cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:27:33 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-51c639c3-9945-4afe-a462-ca27fc93f7be tempest-VolumeImageDependencyTests-1991530828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d28800f-718d-467e-b472-b27f2ea7d0cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:27:33Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7561a209-5e81-4dc9-9fdb-939e07e7df16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbfabf17bc304107b8d572d02f427ea6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:27:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:27:33Z,use_quota=True,user_id='9f25e2e466834a31bafcd4fa966e4642',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:27:33 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-51c639c3-9945-4afe-a462-ca27fc93f7be tempest-VolumeImageDependencyTests-1991530828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (946453cb-ca96-42ae-9b82-6792074e762b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:27:33 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-51c639c3-9945-4afe-a462-ca27fc93f7be tempest-VolumeImageDependencyTests-1991530828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (946453cb-ca96-42ae-9b82-6792074e762b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:27:33 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-51c639c3-9945-4afe-a462-ca27fc93f7be tempest-VolumeImageDependencyTests-1991530828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7612c76e-3948-48d3-b791-63b50e09de5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:27:33 devstack cinder-volume[86512]: DEBUG cinder.image.glance [None req-51c639c3-9945-4afe-a462-ca27fc93f7be tempest-VolumeImageDependencyTests-1991530828 None] Creating Keystone auth plugin from conf {{(pid=86512) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 29 18:27:33 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-842b4900-938e-4900-bd7f-7a9cb7216d25 tempest-VolumesTransfersTest-1462359548 None] Acquiring lock "cinder-4a949b4f-d7db-4bb4-b978-263d547ff111-delete_volume" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:27:33 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-842b4900-938e-4900-bd7f-7a9cb7216d25 tempest-VolumesTransfersTest-1462359548 None] Lock "cinder-4a949b4f-d7db-4bb4-b978-263d547ff111-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:27:34 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-842b4900-938e-4900-bd7f-7a9cb7216d25 tempest-VolumesTransfersTest-1462359548 None] Acquiring lock "cinder-quobyte-4a949b4f-d7db-4bb4-b978-263d547ff111" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:27:34 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-842b4900-938e-4900-bd7f-7a9cb7216d25 tempest-VolumesTransfersTest-1462359548 None] Lock "cinder-quobyte-4a949b4f-d7db-4bb4-b978-263d547ff111" acquired by "delete_volume" :: waited 0.025s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:27:34 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-51c639c3-9945-4afe-a462-ca27fc93f7be tempest-VolumeImageDependencyTests-1991530828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7612c76e-3948-48d3-b791-63b50e09de5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7561a209-5e81-4dc9-9fdb-939e07e7df16', 'volume_name': 'volume-7561a209-5e81-4dc9-9fdb-939e07e7df16', 'volume_size': 1, 'image_id': '11b1b9af-21a5-461d-9de4-4b2fd22e1a47', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/11b1b9af-21a5-461d-9de4-4b2fd22e1a47', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7adbcc80ca12514be174f5e2d1c1f7c3', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'cbfabf17bc304107b8d572d02f427ea6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2671a162c3697c3cbd0d34a07cedd0e1adad5462aa577254a3dcc829e3992c88a06866acde9c24b9323e031054b0cff6bf035956382d7a7eeaf9156d1d9df095', 'id': '11b1b9af-21a5-461d-9de4-4b2fd22e1a47', 'created_at': datetime.datetime(2026, 9, 29, 16, 27, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 16, 27, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/11b1b9af-21a5-461d-9de4-4b2fd22e1a47/file', 'properties': {}}, 'image_service': }' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:27:34 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-51c639c3-9945-4afe-a462-ca27fc93f7be tempest-VolumeImageDependencyTests-1991530828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc825fdf-b9a4-4ffd-9b6d-79ed8e05cd29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:27:34 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-51c639c3-9945-4afe-a462-ca27fc93f7be tempest-VolumeImageDependencyTests-1991530828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc825fdf-b9a4-4ffd-9b6d-79ed8e05cd29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:27:34 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-51c639c3-9945-4afe-a462-ca27fc93f7be tempest-VolumeImageDependencyTests-1991530828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21b4f4bb-7db3-44d9-bbc7-634bb823ab29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:27:34 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-51c639c3-9945-4afe-a462-ca27fc93f7be tempest-VolumeImageDependencyTests-1991530828 None] Volume 7561a209-5e81-4dc9-9fdb-939e07e7df16: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7561a209-5e81-4dc9-9fdb-939e07e7df16', 'volume_size': 1, 'image_id': '11b1b9af-21a5-461d-9de4-4b2fd22e1a47', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/11b1b9af-21a5-461d-9de4-4b2fd22e1a47', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7adbcc80ca12514be174f5e2d1c1f7c3', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'cbfabf17bc304107b8d572d02f427ea6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2671a162c3697c3cbd0d34a07cedd0e1adad5462aa577254a3dcc829e3992c88a06866acde9c24b9323e031054b0cff6bf035956382d7a7eeaf9156d1d9df095', 'id': '11b1b9af-21a5-461d-9de4-4b2fd22e1a47', 'created_at': datetime.datetime(2026, 9, 29, 16, 27, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 16, 27, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/11b1b9af-21a5-461d-9de4-4b2fd22e1a47/file', 'properties': {}}, 'image_service': } Sep 29 18:27:34 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-51c639c3-9945-4afe-a462-ca27fc93f7be tempest-VolumeImageDependencyTests-1991530828 None] Trying to clone 7561a209-5e81-4dc9-9fdb-939e07e7df16 from image 11b1b9af-21a5-461d-9de4-4b2fd22e1a47 at location (None, [{'url': 'file:///opt/stack/data/glance/images/11b1b9af-21a5-461d-9de4-4b2fd22e1a47', 'metadata': {}}]). {{(pid=86512) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 29 18:27:34 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[878c0668-492c-4ea0-8336-475dc999df66]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:27:34 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-842b4900-938e-4900-bd7f-7a9cb7216d25 tempest-VolumesTransfersTest-1462359548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-4a949b4f-d7db-4bb4-b978-263d547ff111 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:27:34 devstack sudo[99913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-4a949b4f-d7db-4bb4-b978-263d547ff111 Sep 29 18:27:34 devstack sudo[99913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:27:34 devstack cinder-volume[86512]: DEBUG cinder.image.image_utils [None req-51c639c3-9945-4afe-a462-ca27fc93f7be tempest-VolumeImageDependencyTests-1991530828 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_11b1b9af-21a5-461d-9de4-4b2fd22e1a47_kf_yb0wedevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86512) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 29 18:27:34 devstack cinder-volume[86512]: INFO cinder.image.image_utils [None req-51c639c3-9945-4afe-a462-ca27fc93f7be tempest-VolumeImageDependencyTests-1991530828 None] Image download 0.00 MB at 0.00 MB/s Sep 29 18:27:34 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d037d10-a9e6-4cbd-811b-44f971278aaa]: (4, 'raw') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:27:34 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-51c639c3-9945-4afe-a462-ca27fc93f7be tempest-VolumeImageDependencyTests-1991530828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_11b1b9af-21a5-461d-9de4-4b2fd22e1a47_kf_yb0wedevstack@QuobyteHD {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:27:34 devstack sudo[99927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_11b1b9af-21a5-461d-9de4-4b2fd22e1a47_kf_yb0wedevstack@QuobyteHD Sep 29 18:27:34 devstack sudo[99927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:27:34 devstack sudo[99913]: pam_unix(sudo:session): session closed for user root Sep 29 18:27:34 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-842b4900-938e-4900-bd7f-7a9cb7216d25 tempest-VolumesTransfersTest-1462359548 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-4a949b4f-d7db-4bb4-b978-263d547ff111" returned: 0 in 0.659s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:27:34 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-842b4900-938e-4900-bd7f-7a9cb7216d25 tempest-VolumesTransfersTest-1462359548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-4a949b4f-d7db-4bb4-b978-263d547ff111 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:27:34 devstack sudo[99941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-4a949b4f-d7db-4bb4-b978-263d547ff111 Sep 29 18:27:34 devstack sudo[99941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:27:35 devstack sudo[99927]: pam_unix(sudo:session): session closed for user root Sep 29 18:27:35 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-51c639c3-9945-4afe-a462-ca27fc93f7be tempest-VolumeImageDependencyTests-1991530828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_11b1b9af-21a5-461d-9de4-4b2fd22e1a47_kf_yb0wedevstack@QuobyteHD" returned: 0 in 0.583s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:27:35 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-51c639c3-9945-4afe-a462-ca27fc93f7be tempest-VolumeImageDependencyTests-1991530828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_11b1b9af-21a5-461d-9de4-4b2fd22e1a47_kf_yb0wedevstack@QuobyteHD {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:27:35 devstack sudo[99941]: pam_unix(sudo:session): session closed for user root Sep 29 18:27:35 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-842b4900-938e-4900-bd7f-7a9cb7216d25 tempest-VolumesTransfersTest-1462359548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-4a949b4f-d7db-4bb4-b978-263d547ff111" returned: 0 in 0.324s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:27:35 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-842b4900-938e-4900-bd7f-7a9cb7216d25 tempest-VolumesTransfersTest-1462359548 None] Lock "cinder-quobyte-4a949b4f-d7db-4bb4-b978-263d547ff111" released by "delete_volume" :: held 1.078s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:27:35 devstack sudo[99947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_11b1b9af-21a5-461d-9de4-4b2fd22e1a47_kf_yb0wedevstack@QuobyteHD Sep 29 18:27:35 devstack sudo[99947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:27:35 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-842b4900-938e-4900-bd7f-7a9cb7216d25 tempest-VolumesTransfersTest-1462359548 None] Created reservations ['7d84f970-cab3-4e56-ad16-11e7c46fc425', 'cef6cec2-437a-494c-8781-d1ff439b3c96', '3f049c72-d5b5-4192-903e-ed472bdd92cf', '13b02f63-247e-401f-80cf-7b6bc581f0a6'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:27:35 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-842b4900-938e-4900-bd7f-7a9cb7216d25 tempest-VolumesTransfersTest-1462359548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:27:35 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-842b4900-938e-4900-bd7f-7a9cb7216d25 tempest-VolumesTransfersTest-1462359548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:27:35 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-842b4900-938e-4900-bd7f-7a9cb7216d25 tempest-VolumesTransfersTest-1462359548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:27:35 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-842b4900-938e-4900-bd7f-7a9cb7216d25 tempest-VolumesTransfersTest-1462359548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:27:35 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-842b4900-938e-4900-bd7f-7a9cb7216d25 tempest-VolumesTransfersTest-1462359548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:27:35 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-842b4900-938e-4900-bd7f-7a9cb7216d25 tempest-VolumesTransfersTest-1462359548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:27:35 devstack sudo[99949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:27:35 devstack sudo[99949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:27:35 devstack sudo[99947]: pam_unix(sudo:session): session closed for user root Sep 29 18:27:35 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-51c639c3-9945-4afe-a462-ca27fc93f7be tempest-VolumeImageDependencyTests-1991530828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_11b1b9af-21a5-461d-9de4-4b2fd22e1a47_kf_yb0wedevstack@QuobyteHD" returned: 1 in 0.498s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:27:35 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-51c639c3-9945-4afe-a462-ca27fc93f7be tempest-VolumeImageDependencyTests-1991530828 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_11b1b9af-21a5-461d-9de4-4b2fd22e1a47_kf_yb0wedevstack@QuobyteHD' failed. Not Retrying. {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 29 18:27:35 devstack cinder-volume[86512]: DEBUG cinder.image.image_utils [None req-51c639c3-9945-4afe-a462-ca27fc93f7be tempest-VolumeImageDependencyTests-1991530828 None] Temporary image 11b1b9af-21a5-461d-9de4-4b2fd22e1a47 is fetched for user 9f25e2e466834a31bafcd4fa966e4642. {{(pid=86512) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 29 18:27:35 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[7685acc3-86c5-404a-b655-c413ddc3e132]: (4, 'raw') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:27:35 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-51c639c3-9945-4afe-a462-ca27fc93f7be tempest-VolumeImageDependencyTests-1991530828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_11b1b9af-21a5-461d-9de4-4b2fd22e1a47_kf_yb0wedevstack@QuobyteHD {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:27:35 devstack sudo[99949]: pam_unix(sudo:session): session closed for user root Sep 29 18:27:35 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-842b4900-938e-4900-bd7f-7a9cb7216d25 tempest-VolumesTransfersTest-1462359548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.466s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:27:35 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-842b4900-938e-4900-bd7f-7a9cb7216d25 tempest-VolumesTransfersTest-1462359548 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:27:35 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-842b4900-938e-4900-bd7f-7a9cb7216d25 tempest-VolumesTransfersTest-1462359548 None] Deleted volume successfully. Sep 29 18:27:35 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-842b4900-938e-4900-bd7f-7a9cb7216d25 tempest-VolumesTransfersTest-1462359548 None] Lock "cinder-4a949b4f-d7db-4bb4-b978-263d547ff111-delete_volume" released by "delete_volume" :: held 1.965s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:27:35 devstack sudo[99956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_11b1b9af-21a5-461d-9de4-4b2fd22e1a47_kf_yb0wedevstack@QuobyteHD Sep 29 18:27:35 devstack sudo[99956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:27:36 devstack sudo[99956]: pam_unix(sudo:session): session closed for user root Sep 29 18:27:36 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-51c639c3-9945-4afe-a462-ca27fc93f7be tempest-VolumeImageDependencyTests-1991530828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_11b1b9af-21a5-461d-9de4-4b2fd22e1a47_kf_yb0wedevstack@QuobyteHD" returned: 0 in 0.537s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:27:36 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-51c639c3-9945-4afe-a462-ca27fc93f7be tempest-VolumeImageDependencyTests-1991530828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_11b1b9af-21a5-461d-9de4-4b2fd22e1a47_kf_yb0wedevstack@QuobyteHD {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:27:36 devstack sudo[99962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_11b1b9af-21a5-461d-9de4-4b2fd22e1a47_kf_yb0wedevstack@QuobyteHD Sep 29 18:27:36 devstack sudo[99962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:27:36 devstack sudo[99962]: pam_unix(sudo:session): session closed for user root Sep 29 18:27:36 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-51c639c3-9945-4afe-a462-ca27fc93f7be tempest-VolumeImageDependencyTests-1991530828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_11b1b9af-21a5-461d-9de4-4b2fd22e1a47_kf_yb0wedevstack@QuobyteHD" returned: 1 in 0.477s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:27:36 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-51c639c3-9945-4afe-a462-ca27fc93f7be tempest-VolumeImageDependencyTests-1991530828 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_11b1b9af-21a5-461d-9de4-4b2fd22e1a47_kf_yb0wedevstack@QuobyteHD' failed. Not Retrying. {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 29 18:27:36 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-51c639c3-9945-4afe-a462-ca27fc93f7be tempest-VolumeImageDependencyTests-1991530828 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:27:36 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-51c639c3-9945-4afe-a462-ca27fc93f7be tempest-VolumeImageDependencyTests-1991530828 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:27:36 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-51c639c3-9945-4afe-a462-ca27fc93f7be tempest-VolumeImageDependencyTests-1991530828 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:27:33Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7561a209-5e81-4dc9-9fdb-939e07e7df16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbfabf17bc304107b8d572d02f427ea6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:27:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:27:33Z,use_quota=True,user_id='9f25e2e466834a31bafcd4fa966e4642',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)}" {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:27:36 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-51c639c3-9945-4afe-a462-ca27fc93f7be tempest-VolumeImageDependencyTests-1991530828 None] Creating volume 7561a209-5e81-4dc9-9fdb-939e07e7df16 {{(pid=86512) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:27:36 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-51c639c3-9945-4afe-a462-ca27fc93f7be tempest-VolumeImageDependencyTests-1991530828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:27:36 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-51c639c3-9945-4afe-a462-ca27fc93f7be tempest-VolumeImageDependencyTests-1991530828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:27:36 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-51c639c3-9945-4afe-a462-ca27fc93f7be tempest-VolumeImageDependencyTests-1991530828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:27:36 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-51c639c3-9945-4afe-a462-ca27fc93f7be tempest-VolumeImageDependencyTests-1991530828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:27:36 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-51c639c3-9945-4afe-a462-ca27fc93f7be tempest-VolumeImageDependencyTests-1991530828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:27:36 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-51c639c3-9945-4afe-a462-ca27fc93f7be tempest-VolumeImageDependencyTests-1991530828 None] Selected osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 as target Quobyte volume. {{(pid=86512) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:27:36 devstack cinder-volume[86512]: INFO cinder.volume.drivers.remotefs [None req-51c639c3-9945-4afe-a462-ca27fc93f7be tempest-VolumeImageDependencyTests-1991530828 None] casted to osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 Sep 29 18:27:36 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-51c639c3-9945-4afe-a462-ca27fc93f7be tempest-VolumeImageDependencyTests-1991530828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7561a209-5e81-4dc9-9fdb-939e07e7df16 1073741824 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:27:36 devstack sudo[99967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7561a209-5e81-4dc9-9fdb-939e07e7df16 1073741824 Sep 29 18:27:36 devstack sudo[99967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:27:37 devstack sudo[99967]: pam_unix(sudo:session): session closed for user root Sep 29 18:27:37 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-51c639c3-9945-4afe-a462-ca27fc93f7be tempest-VolumeImageDependencyTests-1991530828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7561a209-5e81-4dc9-9fdb-939e07e7df16 1073741824" returned: 0 in 0.554s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:27:37 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-51c639c3-9945-4afe-a462-ca27fc93f7be tempest-VolumeImageDependencyTests-1991530828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7561a209-5e81-4dc9-9fdb-939e07e7df16 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:27:37 devstack sudo[99973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7561a209-5e81-4dc9-9fdb-939e07e7df16 Sep 29 18:27:37 devstack sudo[99973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:27:37 devstack sudo[99973]: pam_unix(sudo:session): session closed for user root Sep 29 18:27:37 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-51c639c3-9945-4afe-a462-ca27fc93f7be tempest-VolumeImageDependencyTests-1991530828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7561a209-5e81-4dc9-9fdb-939e07e7df16" returned: 0 in 0.375s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:27:37 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-51c639c3-9945-4afe-a462-ca27fc93f7be tempest-VolumeImageDependencyTests-1991530828 None] <== create_volume: return (1004ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'} {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:27:37 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-51c639c3-9945-4afe-a462-ca27fc93f7be tempest-VolumeImageDependencyTests-1991530828 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.007s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:27:37 devstack cinder-volume[86512]: DEBUG cinder.volume.volume_utils [None req-51c639c3-9945-4afe-a462-ca27fc93f7be tempest-VolumeImageDependencyTests-1991530828 None] Attempting download of 11b1b9af-21a5-461d-9de4-4b2fd22e1a47 ((None, [{'url': 'file:///opt/stack/data/glance/images/11b1b9af-21a5-461d-9de4-4b2fd22e1a47', 'metadata': {}}])) to volume 7561a209-5e81-4dc9-9fdb-939e07e7df16. {{(pid=86512) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 29 18:27:37 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[49f6cf70-1b9e-46e7-9543-af544ad66196]: (4, 'raw') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:27:37 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-51c639c3-9945-4afe-a462-ca27fc93f7be tempest-VolumeImageDependencyTests-1991530828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_11b1b9af-21a5-461d-9de4-4b2fd22e1a47_9jpob5l1 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:27:37 devstack sudo[99976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_11b1b9af-21a5-461d-9de4-4b2fd22e1a47_9jpob5l1 Sep 29 18:27:37 devstack sudo[99976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:27:38 devstack sudo[99976]: pam_unix(sudo:session): session closed for user root Sep 29 18:27:38 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-51c639c3-9945-4afe-a462-ca27fc93f7be tempest-VolumeImageDependencyTests-1991530828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_11b1b9af-21a5-461d-9de4-4b2fd22e1a47_9jpob5l1" returned: 0 in 0.366s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:27:38 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-51c639c3-9945-4afe-a462-ca27fc93f7be tempest-VolumeImageDependencyTests-1991530828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_11b1b9af-21a5-461d-9de4-4b2fd22e1a47_9jpob5l1 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:27:38 devstack sudo[99980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_11b1b9af-21a5-461d-9de4-4b2fd22e1a47_9jpob5l1 Sep 29 18:27:38 devstack sudo[99980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:27:38 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-e16d26e2-086d-4cf7-9f81-86d2d1ed56bf tempest-AttachVolumeNegativeTest-1588161148 None] Acquiring lock "cinder-5b901a0e-81bf-4d2a-8348-a6d5fb751073-delete_volume" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:27:38 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-e16d26e2-086d-4cf7-9f81-86d2d1ed56bf tempest-AttachVolumeNegativeTest-1588161148 None] Lock "cinder-5b901a0e-81bf-4d2a-8348-a6d5fb751073-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:27:38 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-e16d26e2-086d-4cf7-9f81-86d2d1ed56bf tempest-AttachVolumeNegativeTest-1588161148 None] Acquiring lock "cinder-quobyte-5b901a0e-81bf-4d2a-8348-a6d5fb751073" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:27:38 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-e16d26e2-086d-4cf7-9f81-86d2d1ed56bf tempest-AttachVolumeNegativeTest-1588161148 None] Lock "cinder-quobyte-5b901a0e-81bf-4d2a-8348-a6d5fb751073" acquired by "delete_volume" :: waited 0.017s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:27:38 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[e68818c4-4558-4fd5-a005-0ad09c3df220]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:27:38 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-e16d26e2-086d-4cf7-9f81-86d2d1ed56bf tempest-AttachVolumeNegativeTest-1588161148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-5b901a0e-81bf-4d2a-8348-a6d5fb751073 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:27:38 devstack sudo[99980]: pam_unix(sudo:session): session closed for user root Sep 29 18:27:38 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-51c639c3-9945-4afe-a462-ca27fc93f7be tempest-VolumeImageDependencyTests-1991530828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_11b1b9af-21a5-461d-9de4-4b2fd22e1a47_9jpob5l1" returned: 1 in 0.436s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:27:38 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-51c639c3-9945-4afe-a462-ca27fc93f7be tempest-VolumeImageDependencyTests-1991530828 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_11b1b9af-21a5-461d-9de4-4b2fd22e1a47_9jpob5l1' failed. Not Retrying. {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 29 18:27:38 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d8133ed-aa50-4bc6-9309-20f91707bb6e]: (4, 'raw') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:27:38 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-51c639c3-9945-4afe-a462-ca27fc93f7be tempest-VolumeImageDependencyTests-1991530828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_11b1b9af-21a5-461d-9de4-4b2fd22e1a47_kf_yb0wedevstack@QuobyteHD {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:27:38 devstack sudo[99982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-5b901a0e-81bf-4d2a-8348-a6d5fb751073 Sep 29 18:27:38 devstack sudo[99982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:27:38 devstack sudo[99985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_11b1b9af-21a5-461d-9de4-4b2fd22e1a47_kf_yb0wedevstack@QuobyteHD Sep 29 18:27:38 devstack sudo[99985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:27:39 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5474be2-9e92-4a88-bf03-3ba817f84253 tempest-VolumesMetadataTest-2062245974 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86512) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:27:39 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-f5474be2-9e92-4a88-bf03-3ba817f84253 tempest-VolumesMetadataTest-2062245974 None] Flow 'volume_create_manager' (9812aa1b-34ed-49f0-a196-33a6999dc430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:27:39 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-f5474be2-9e92-4a88-bf03-3ba817f84253 tempest-VolumesMetadataTest-2062245974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e9dbf0f-452b-4165-b667-7f4d2a8fa512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:27:39 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-f5474be2-9e92-4a88-bf03-3ba817f84253 tempest-VolumesMetadataTest-2062245974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e9dbf0f-452b-4165-b667-7f4d2a8fa512) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:27:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-609446931',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=803c1f80-75e5-4570-8939-d3ed614af63a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccade9b6176d41d48437a409d24256a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:27:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:27:39Z,use_quota=True,user_id='82801c0368344550b04b560ee1c50418',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:27:39 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-f5474be2-9e92-4a88-bf03-3ba817f84253 tempest-VolumesMetadataTest-2062245974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e68c1c8-211a-45c1-b841-eb6b465fbf70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:27:39 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-f5474be2-9e92-4a88-bf03-3ba817f84253 tempest-VolumesMetadataTest-2062245974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e68c1c8-211a-45c1-b841-eb6b465fbf70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:27:39 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-f5474be2-9e92-4a88-bf03-3ba817f84253 tempest-VolumesMetadataTest-2062245974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b2fdf03-b49d-4bd4-9233-d8a148603744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:27:39 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-f5474be2-9e92-4a88-bf03-3ba817f84253 tempest-VolumesMetadataTest-2062245974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b2fdf03-b49d-4bd4-9233-d8a148603744) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '803c1f80-75e5-4570-8939-d3ed614af63a', 'volume_name': 'volume-803c1f80-75e5-4570-8939-d3ed614af63a', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:27:39 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-f5474be2-9e92-4a88-bf03-3ba817f84253 tempest-VolumesMetadataTest-2062245974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6414c1d5-8089-41fd-83ee-43fe951fc129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:27:39 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-f5474be2-9e92-4a88-bf03-3ba817f84253 tempest-VolumesMetadataTest-2062245974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6414c1d5-8089-41fd-83ee-43fe951fc129) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:27:39 devstack sudo[99985]: pam_unix(sudo:session): session closed for user root Sep 29 18:27:39 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-f5474be2-9e92-4a88-bf03-3ba817f84253 tempest-VolumesMetadataTest-2062245974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77343f86-0755-4147-932d-d53d9b7a7a5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:27:39 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-f5474be2-9e92-4a88-bf03-3ba817f84253 tempest-VolumesMetadataTest-2062245974 None] Volume 803c1f80-75e5-4570-8939-d3ed614af63a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-803c1f80-75e5-4570-8939-d3ed614af63a', 'volume_size': 1} Sep 29 18:27:39 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-f5474be2-9e92-4a88-bf03-3ba817f84253 tempest-VolumesMetadataTest-2062245974 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:27:39 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-f5474be2-9e92-4a88-bf03-3ba817f84253 tempest-VolumesMetadataTest-2062245974 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:27:39 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-f5474be2-9e92-4a88-bf03-3ba817f84253 tempest-VolumesMetadataTest-2062245974 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:27:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-609446931',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=803c1f80-75e5-4570-8939-d3ed614af63a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccade9b6176d41d48437a409d24256a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:27:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:27:39Z,use_quota=True,user_id='82801c0368344550b04b560ee1c50418',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)}" {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:27:39 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-f5474be2-9e92-4a88-bf03-3ba817f84253 tempest-VolumesMetadataTest-2062245974 None] Creating volume 803c1f80-75e5-4570-8939-d3ed614af63a {{(pid=86512) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:27:39 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-f5474be2-9e92-4a88-bf03-3ba817f84253 tempest-VolumesMetadataTest-2062245974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:27:39 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-f5474be2-9e92-4a88-bf03-3ba817f84253 tempest-VolumesMetadataTest-2062245974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:27:39 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-f5474be2-9e92-4a88-bf03-3ba817f84253 tempest-VolumesMetadataTest-2062245974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:27:39 devstack sudo[99982]: pam_unix(sudo:session): session closed for user root Sep 29 18:27:39 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-f5474be2-9e92-4a88-bf03-3ba817f84253 tempest-VolumesMetadataTest-2062245974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:27:39 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-f5474be2-9e92-4a88-bf03-3ba817f84253 tempest-VolumesMetadataTest-2062245974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:27:39 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-f5474be2-9e92-4a88-bf03-3ba817f84253 tempest-VolumesMetadataTest-2062245974 None] Selected osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 as target Quobyte volume. {{(pid=86512) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:27:39 devstack cinder-volume[86512]: INFO cinder.volume.drivers.remotefs [None req-f5474be2-9e92-4a88-bf03-3ba817f84253 tempest-VolumesMetadataTest-2062245974 None] casted to osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 Sep 29 18:27:39 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-f5474be2-9e92-4a88-bf03-3ba817f84253 tempest-VolumesMetadataTest-2062245974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-803c1f80-75e5-4570-8939-d3ed614af63a 1073741824 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:27:39 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-51c639c3-9945-4afe-a462-ca27fc93f7be tempest-VolumeImageDependencyTests-1991530828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_11b1b9af-21a5-461d-9de4-4b2fd22e1a47_kf_yb0wedevstack@QuobyteHD" returned: 0 in 0.486s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:27:39 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-51c639c3-9945-4afe-a462-ca27fc93f7be tempest-VolumeImageDependencyTests-1991530828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_11b1b9af-21a5-461d-9de4-4b2fd22e1a47_kf_yb0wedevstack@QuobyteHD {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:27:39 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-e16d26e2-086d-4cf7-9f81-86d2d1ed56bf tempest-AttachVolumeNegativeTest-1588161148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-5b901a0e-81bf-4d2a-8348-a6d5fb751073" returned: 0 in 0.585s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:27:39 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-e16d26e2-086d-4cf7-9f81-86d2d1ed56bf tempest-AttachVolumeNegativeTest-1588161148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-5b901a0e-81bf-4d2a-8348-a6d5fb751073 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:27:39 devstack sudo[99993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-803c1f80-75e5-4570-8939-d3ed614af63a 1073741824 Sep 29 18:27:39 devstack sudo[99993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:27:39 devstack sudo[99996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-5b901a0e-81bf-4d2a-8348-a6d5fb751073 Sep 29 18:27:39 devstack sudo[99996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:27:39 devstack sudo[99994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_11b1b9af-21a5-461d-9de4-4b2fd22e1a47_kf_yb0wedevstack@QuobyteHD Sep 29 18:27:39 devstack sudo[99994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:27:39 devstack sudo[99996]: pam_unix(sudo:session): session closed for user root Sep 29 18:27:39 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-e16d26e2-086d-4cf7-9f81-86d2d1ed56bf tempest-AttachVolumeNegativeTest-1588161148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-5b901a0e-81bf-4d2a-8348-a6d5fb751073" returned: 0 in 0.322s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:27:39 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-e16d26e2-086d-4cf7-9f81-86d2d1ed56bf tempest-AttachVolumeNegativeTest-1588161148 None] Lock "cinder-quobyte-5b901a0e-81bf-4d2a-8348-a6d5fb751073" released by "delete_volume" :: held 0.960s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:27:39 devstack sudo[99994]: pam_unix(sudo:session): session closed for user root Sep 29 18:27:39 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-51c639c3-9945-4afe-a462-ca27fc93f7be tempest-VolumeImageDependencyTests-1991530828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_11b1b9af-21a5-461d-9de4-4b2fd22e1a47_kf_yb0wedevstack@QuobyteHD" returned: 1 in 0.408s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:27:39 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-51c639c3-9945-4afe-a462-ca27fc93f7be tempest-VolumeImageDependencyTests-1991530828 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_11b1b9af-21a5-461d-9de4-4b2fd22e1a47_kf_yb0wedevstack@QuobyteHD' failed. Not Retrying. {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 29 18:27:39 devstack cinder-volume[86512]: DEBUG cinder.image.image_utils [None req-51c639c3-9945-4afe-a462-ca27fc93f7be tempest-VolumeImageDependencyTests-1991530828 None] 11b1b9af-21a5-461d-9de4-4b2fd22e1a47 was raw, converting to qcow2 {{(pid=86512) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 29 18:27:39 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-51c639c3-9945-4afe-a462-ca27fc93f7be tempest-VolumeImageDependencyTests-1991530828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_11b1b9af-21a5-461d-9de4-4b2fd22e1a47_kf_yb0wedevstack@QuobyteHD /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7561a209-5e81-4dc9-9fdb-939e07e7df16 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:27:39 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-e16d26e2-086d-4cf7-9f81-86d2d1ed56bf tempest-AttachVolumeNegativeTest-1588161148 None] Created reservations ['21a1c393-b261-43b1-9f7f-20939e831519', 'b3e47cc3-5a6c-4ddf-ae9b-6855c32b9807', 'f4a9160a-fb97-4550-aa28-8b031ec64707', '2bee8bd4-7f40-42bc-bb67-7badeb732efc'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:27:39 devstack sudo[100006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_11b1b9af-21a5-461d-9de4-4b2fd22e1a47_kf_yb0wedevstack@QuobyteHD /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7561a209-5e81-4dc9-9fdb-939e07e7df16 Sep 29 18:27:39 devstack sudo[100006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:27:39 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-e16d26e2-086d-4cf7-9f81-86d2d1ed56bf tempest-AttachVolumeNegativeTest-1588161148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:27:39 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-e16d26e2-086d-4cf7-9f81-86d2d1ed56bf tempest-AttachVolumeNegativeTest-1588161148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:27:39 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-e16d26e2-086d-4cf7-9f81-86d2d1ed56bf tempest-AttachVolumeNegativeTest-1588161148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:27:39 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-e16d26e2-086d-4cf7-9f81-86d2d1ed56bf tempest-AttachVolumeNegativeTest-1588161148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:27:39 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-e16d26e2-086d-4cf7-9f81-86d2d1ed56bf tempest-AttachVolumeNegativeTest-1588161148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:27:39 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-e16d26e2-086d-4cf7-9f81-86d2d1ed56bf tempest-AttachVolumeNegativeTest-1588161148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:27:39 devstack sudo[100009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:27:39 devstack sudo[100009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:27:39 devstack sudo[99993]: pam_unix(sudo:session): session closed for user root Sep 29 18:27:39 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-f5474be2-9e92-4a88-bf03-3ba817f84253 tempest-VolumesMetadataTest-2062245974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-803c1f80-75e5-4570-8939-d3ed614af63a 1073741824" returned: 0 in 0.644s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:27:39 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-f5474be2-9e92-4a88-bf03-3ba817f84253 tempest-VolumesMetadataTest-2062245974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-803c1f80-75e5-4570-8939-d3ed614af63a {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:27:39 devstack sudo[100011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-803c1f80-75e5-4570-8939-d3ed614af63a Sep 29 18:27:39 devstack sudo[100011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:27:40 devstack sudo[100009]: pam_unix(sudo:session): session closed for user root Sep 29 18:27:40 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-e16d26e2-086d-4cf7-9f81-86d2d1ed56bf tempest-AttachVolumeNegativeTest-1588161148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.321s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:27:40 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-e16d26e2-086d-4cf7-9f81-86d2d1ed56bf tempest-AttachVolumeNegativeTest-1588161148 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:27:40 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-e16d26e2-086d-4cf7-9f81-86d2d1ed56bf tempest-AttachVolumeNegativeTest-1588161148 None] Deleted volume successfully. Sep 29 18:27:40 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-e16d26e2-086d-4cf7-9f81-86d2d1ed56bf tempest-AttachVolumeNegativeTest-1588161148 None] Lock "cinder-5b901a0e-81bf-4d2a-8348-a6d5fb751073-delete_volume" released by "delete_volume" :: held 1.603s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:27:40 devstack sudo[100011]: pam_unix(sudo:session): session closed for user root Sep 29 18:27:40 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-f5474be2-9e92-4a88-bf03-3ba817f84253 tempest-VolumesMetadataTest-2062245974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-803c1f80-75e5-4570-8939-d3ed614af63a" returned: 0 in 0.316s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:27:40 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-f5474be2-9e92-4a88-bf03-3ba817f84253 tempest-VolumesMetadataTest-2062245974 None] <== create_volume: return (1009ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'} {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:27:40 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-f5474be2-9e92-4a88-bf03-3ba817f84253 tempest-VolumesMetadataTest-2062245974 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.011s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:27:40 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-f5474be2-9e92-4a88-bf03-3ba817f84253 tempest-VolumesMetadataTest-2062245974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77343f86-0755-4147-932d-d53d9b7a7a5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-803c1f80-75e5-4570-8939-d3ed614af63a', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:27:40 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-f5474be2-9e92-4a88-bf03-3ba817f84253 tempest-VolumesMetadataTest-2062245974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57f65610-64fa-4a2d-8d95-c819ed0d6edb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:27:40 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-f5474be2-9e92-4a88-bf03-3ba817f84253 tempest-VolumesMetadataTest-2062245974 None] Volume volume-803c1f80-75e5-4570-8939-d3ed614af63a (803c1f80-75e5-4570-8939-d3ed614af63a): created successfully Sep 29 18:27:40 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-f5474be2-9e92-4a88-bf03-3ba817f84253 tempest-VolumesMetadataTest-2062245974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57f65610-64fa-4a2d-8d95-c819ed0d6edb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:27:40 devstack sudo[100006]: pam_unix(sudo:session): session closed for user root Sep 29 18:27:40 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-f5474be2-9e92-4a88-bf03-3ba817f84253 tempest-VolumesMetadataTest-2062245974 None] Flow 'volume_create_manager' (9812aa1b-34ed-49f0-a196-33a6999dc430) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:27:40 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-51c639c3-9945-4afe-a462-ca27fc93f7be tempest-VolumeImageDependencyTests-1991530828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_11b1b9af-21a5-461d-9de4-4b2fd22e1a47_kf_yb0wedevstack@QuobyteHD /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7561a209-5e81-4dc9-9fdb-939e07e7df16" returned: 0 in 0.618s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:27:40 devstack cinder-volume[86512]: DEBUG cinder.image.image_utils [None req-51c639c3-9945-4afe-a462-ca27fc93f7be tempest-VolumeImageDependencyTests-1991530828 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_11b1b9af-21a5-461d-9de4-4b2fd22e1a47_kf_yb0wedevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7561a209-5e81-4dc9-9fdb-939e07e7df16 {{(pid=86512) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 29 18:27:40 devstack cinder-volume[86512]: INFO cinder.image.image_utils [None req-51c639c3-9945-4afe-a462-ca27fc93f7be tempest-VolumeImageDependencyTests-1991530828 None] Converted 0.00 MB image at 0.00 MB/s Sep 29 18:27:40 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-51c639c3-9945-4afe-a462-ca27fc93f7be tempest-VolumeImageDependencyTests-1991530828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7561a209-5e81-4dc9-9fdb-939e07e7df16 1G {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:27:40 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-f5474be2-9e92-4a88-bf03-3ba817f84253 tempest-VolumesMetadataTest-2062245974 None] Created volume successfully. Sep 29 18:27:40 devstack sudo[100018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7561a209-5e81-4dc9-9fdb-939e07e7df16 1G Sep 29 18:27:40 devstack sudo[100018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:27:40 devstack sudo[100018]: pam_unix(sudo:session): session closed for user root Sep 29 18:27:40 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-51c639c3-9945-4afe-a462-ca27fc93f7be tempest-VolumeImageDependencyTests-1991530828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7561a209-5e81-4dc9-9fdb-939e07e7df16 1G" returned: 0 in 0.344s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:27:40 devstack cinder-volume[86512]: DEBUG cinder.volume.volume_utils [None req-51c639c3-9945-4afe-a462-ca27fc93f7be tempest-VolumeImageDependencyTests-1991530828 None] Downloaded image 11b1b9af-21a5-461d-9de4-4b2fd22e1a47 ((None, [{'url': 'file:///opt/stack/data/glance/images/11b1b9af-21a5-461d-9de4-4b2fd22e1a47', 'metadata': {}}])) to volume 7561a209-5e81-4dc9-9fdb-939e07e7df16 successfully. {{(pid=86512) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 29 18:27:40 devstack cinder-volume[86512]: DEBUG cinder.image.image_utils [None req-51c639c3-9945-4afe-a462-ca27fc93f7be tempest-VolumeImageDependencyTests-1991530828 None] Temporary image 11b1b9af-21a5-461d-9de4-4b2fd22e1a47 for user 9f25e2e466834a31bafcd4fa966e4642 is deleted. {{(pid=86512) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 29 18:27:40 devstack cinder-volume[86512]: DEBUG cinder.volume.volume_utils [None req-51c639c3-9945-4afe-a462-ca27fc93f7be tempest-VolumeImageDependencyTests-1991530828 None] Marking volume 7561a209-5e81-4dc9-9fdb-939e07e7df16 as bootable. {{(pid=86512) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 29 18:27:40 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-51c639c3-9945-4afe-a462-ca27fc93f7be tempest-VolumeImageDependencyTests-1991530828 None] Copying metadata from image 11b1b9af-21a5-461d-9de4-4b2fd22e1a47 to 7561a209-5e81-4dc9-9fdb-939e07e7df16. {{(pid=86512) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 29 18:27:40 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-51c639c3-9945-4afe-a462-ca27fc93f7be tempest-VolumeImageDependencyTests-1991530828 None] Creating volume glance metadata for volume 7561a209-5e81-4dc9-9fdb-939e07e7df16 backed by image 11b1b9af-21a5-461d-9de4-4b2fd22e1a47 with: {'image_id': '11b1b9af-21a5-461d-9de4-4b2fd22e1a47', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '7adbcc80ca12514be174f5e2d1c1f7c3', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86512) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 29 18:27:40 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-51c639c3-9945-4afe-a462-ca27fc93f7be tempest-VolumeImageDependencyTests-1991530828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21b4f4bb-7db3-44d9-bbc7-634bb823ab29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7561a209-5e81-4dc9-9fdb-939e07e7df16', 'volume_size': 1, 'image_id': '11b1b9af-21a5-461d-9de4-4b2fd22e1a47', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/11b1b9af-21a5-461d-9de4-4b2fd22e1a47', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7adbcc80ca12514be174f5e2d1c1f7c3', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'cbfabf17bc304107b8d572d02f427ea6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2671a162c3697c3cbd0d34a07cedd0e1adad5462aa577254a3dcc829e3992c88a06866acde9c24b9323e031054b0cff6bf035956382d7a7eeaf9156d1d9df095', 'id': '11b1b9af-21a5-461d-9de4-4b2fd22e1a47', 'created_at': datetime.datetime(2026, 9, 29, 16, 27, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 16, 27, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/11b1b9af-21a5-461d-9de4-4b2fd22e1a47/file', 'properties': {}}, 'image_service': }' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:27:40 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-51c639c3-9945-4afe-a462-ca27fc93f7be tempest-VolumeImageDependencyTests-1991530828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13d31953-8e9e-44e2-ba03-6b0f028e803c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:27:40 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-51c639c3-9945-4afe-a462-ca27fc93f7be tempest-VolumeImageDependencyTests-1991530828 None] Volume volume-7561a209-5e81-4dc9-9fdb-939e07e7df16 (7561a209-5e81-4dc9-9fdb-939e07e7df16): created successfully Sep 29 18:27:40 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-51c639c3-9945-4afe-a462-ca27fc93f7be tempest-VolumeImageDependencyTests-1991530828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13d31953-8e9e-44e2-ba03-6b0f028e803c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:27:40 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-51c639c3-9945-4afe-a462-ca27fc93f7be tempest-VolumeImageDependencyTests-1991530828 None] Flow 'volume_create_manager' (edde8e13-53c5-466b-bd60-58a2047d82a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:27:40 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-51c639c3-9945-4afe-a462-ca27fc93f7be tempest-VolumeImageDependencyTests-1991530828 None] Created volume successfully. Sep 29 18:27:40 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-bb34565c-1923-4d4c-a8ce-aa354f938cce tempest-AttachVolumeNegativeTest-1588161148 None] Acquiring lock "cinder-5de338e3-f797-4f6e-a646-5fc0ca18c6b4-delete_volume" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:27:40 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-bb34565c-1923-4d4c-a8ce-aa354f938cce tempest-AttachVolumeNegativeTest-1588161148 None] Lock "cinder-5de338e3-f797-4f6e-a646-5fc0ca18c6b4-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:27:40 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-bb34565c-1923-4d4c-a8ce-aa354f938cce tempest-AttachVolumeNegativeTest-1588161148 None] Acquiring lock "cinder-quobyte-5de338e3-f797-4f6e-a646-5fc0ca18c6b4" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:27:40 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-bb34565c-1923-4d4c-a8ce-aa354f938cce tempest-AttachVolumeNegativeTest-1588161148 None] Lock "cinder-quobyte-5de338e3-f797-4f6e-a646-5fc0ca18c6b4" acquired by "delete_volume" :: waited 0.028s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:27:41 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[09324179-2f14-4eb2-9ce4-f846c1e4f628]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:27:41 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-bb34565c-1923-4d4c-a8ce-aa354f938cce tempest-AttachVolumeNegativeTest-1588161148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-5de338e3-f797-4f6e-a646-5fc0ca18c6b4 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:27:41 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-797a0ecd-ea65-4745-83f6-0ea33d3f63d5 tempest-VolumeImageDependencyTests-1991530828 None] Acquiring lock "cinder-7561a209-5e81-4dc9-9fdb-939e07e7df16-delete_volume" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:27:41 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-797a0ecd-ea65-4745-83f6-0ea33d3f63d5 tempest-VolumeImageDependencyTests-1991530828 None] Lock "cinder-7561a209-5e81-4dc9-9fdb-939e07e7df16-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:27:41 devstack sudo[100024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-5de338e3-f797-4f6e-a646-5fc0ca18c6b4 Sep 29 18:27:41 devstack sudo[100024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:27:41 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-797a0ecd-ea65-4745-83f6-0ea33d3f63d5 tempest-VolumeImageDependencyTests-1991530828 None] Acquiring lock "cinder-quobyte-7561a209-5e81-4dc9-9fdb-939e07e7df16" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:27:41 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-797a0ecd-ea65-4745-83f6-0ea33d3f63d5 tempest-VolumeImageDependencyTests-1991530828 None] Lock "cinder-quobyte-7561a209-5e81-4dc9-9fdb-939e07e7df16" acquired by "delete_volume" :: waited 0.020s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:27:41 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[d87b22ea-a13f-4ac5-83ff-afd4d2a41109]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:27:41 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-797a0ecd-ea65-4745-83f6-0ea33d3f63d5 tempest-VolumeImageDependencyTests-1991530828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7561a209-5e81-4dc9-9fdb-939e07e7df16 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:27:41 devstack sudo[100026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7561a209-5e81-4dc9-9fdb-939e07e7df16 Sep 29 18:27:41 devstack sudo[100026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:27:41 devstack sudo[100024]: pam_unix(sudo:session): session closed for user root Sep 29 18:27:41 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-bb34565c-1923-4d4c-a8ce-aa354f938cce tempest-AttachVolumeNegativeTest-1588161148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-5de338e3-f797-4f6e-a646-5fc0ca18c6b4" returned: 0 in 0.509s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:27:41 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-bb34565c-1923-4d4c-a8ce-aa354f938cce tempest-AttachVolumeNegativeTest-1588161148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-5de338e3-f797-4f6e-a646-5fc0ca18c6b4 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:27:41 devstack sudo[100031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-5de338e3-f797-4f6e-a646-5fc0ca18c6b4 Sep 29 18:27:41 devstack sudo[100031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:27:41 devstack sudo[100026]: pam_unix(sudo:session): session closed for user root Sep 29 18:27:41 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-797a0ecd-ea65-4745-83f6-0ea33d3f63d5 tempest-VolumeImageDependencyTests-1991530828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7561a209-5e81-4dc9-9fdb-939e07e7df16" returned: 0 in 0.467s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:27:41 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-797a0ecd-ea65-4745-83f6-0ea33d3f63d5 tempest-VolumeImageDependencyTests-1991530828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7561a209-5e81-4dc9-9fdb-939e07e7df16 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:27:41 devstack sudo[100036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7561a209-5e81-4dc9-9fdb-939e07e7df16 Sep 29 18:27:41 devstack sudo[100036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:27:41 devstack sudo[100031]: pam_unix(sudo:session): session closed for user root Sep 29 18:27:41 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-bb34565c-1923-4d4c-a8ce-aa354f938cce tempest-AttachVolumeNegativeTest-1588161148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-5de338e3-f797-4f6e-a646-5fc0ca18c6b4" returned: 0 in 0.330s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:27:41 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-bb34565c-1923-4d4c-a8ce-aa354f938cce tempest-AttachVolumeNegativeTest-1588161148 None] Lock "cinder-quobyte-5de338e3-f797-4f6e-a646-5fc0ca18c6b4" released by "delete_volume" :: held 0.929s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:27:41 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-bb34565c-1923-4d4c-a8ce-aa354f938cce tempest-AttachVolumeNegativeTest-1588161148 None] Created reservations ['f12296f5-bb6e-4e65-a9b5-ab508733fcfb', 'a846d1be-8600-4770-aae6-4da71c2c7a14', 'b1847d39-8b43-424f-a34b-e1b198ac6f73', '8559fb4f-6146-4cba-a2ff-0db1af9238cd'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:27:42 devstack sudo[100036]: pam_unix(sudo:session): session closed for user root Sep 29 18:27:42 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-797a0ecd-ea65-4745-83f6-0ea33d3f63d5 tempest-VolumeImageDependencyTests-1991530828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7561a209-5e81-4dc9-9fdb-939e07e7df16" returned: 0 in 0.324s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:27:42 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-797a0ecd-ea65-4745-83f6-0ea33d3f63d5 tempest-VolumeImageDependencyTests-1991530828 None] Lock "cinder-quobyte-7561a209-5e81-4dc9-9fdb-939e07e7df16" released by "delete_volume" :: held 0.865s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:27:42 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-bb34565c-1923-4d4c-a8ce-aa354f938cce tempest-AttachVolumeNegativeTest-1588161148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:27:42 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-bb34565c-1923-4d4c-a8ce-aa354f938cce tempest-AttachVolumeNegativeTest-1588161148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:27:42 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-bb34565c-1923-4d4c-a8ce-aa354f938cce tempest-AttachVolumeNegativeTest-1588161148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:27:42 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-bb34565c-1923-4d4c-a8ce-aa354f938cce tempest-AttachVolumeNegativeTest-1588161148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:27:42 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-bb34565c-1923-4d4c-a8ce-aa354f938cce tempest-AttachVolumeNegativeTest-1588161148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:27:42 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-bb34565c-1923-4d4c-a8ce-aa354f938cce tempest-AttachVolumeNegativeTest-1588161148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:27:42 devstack sudo[100040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:27:42 devstack sudo[100040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:27:42 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-797a0ecd-ea65-4745-83f6-0ea33d3f63d5 tempest-VolumeImageDependencyTests-1991530828 None] Created reservations ['cac306f8-5935-4d77-9b9b-0e22e78a4b36', '96fd1173-a9c8-4820-a758-6d87ee996ffd', 'ebb9c182-ea97-461d-87e8-d23077aa4da0', '8fc2817f-b5c6-4bdd-9018-40b7ff747e13'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:27:42 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-797a0ecd-ea65-4745-83f6-0ea33d3f63d5 tempest-VolumeImageDependencyTests-1991530828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:27:42 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-797a0ecd-ea65-4745-83f6-0ea33d3f63d5 tempest-VolumeImageDependencyTests-1991530828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:27:42 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-797a0ecd-ea65-4745-83f6-0ea33d3f63d5 tempest-VolumeImageDependencyTests-1991530828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:27:42 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-797a0ecd-ea65-4745-83f6-0ea33d3f63d5 tempest-VolumeImageDependencyTests-1991530828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:27:42 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-797a0ecd-ea65-4745-83f6-0ea33d3f63d5 tempest-VolumeImageDependencyTests-1991530828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:27:42 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-797a0ecd-ea65-4745-83f6-0ea33d3f63d5 tempest-VolumeImageDependencyTests-1991530828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:27:42 devstack sudo[100042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:27:42 devstack sudo[100042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:27:42 devstack sudo[100040]: pam_unix(sudo:session): session closed for user root Sep 29 18:27:42 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-bb34565c-1923-4d4c-a8ce-aa354f938cce tempest-AttachVolumeNegativeTest-1588161148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.395s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:27:42 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-bb34565c-1923-4d4c-a8ce-aa354f938cce tempest-AttachVolumeNegativeTest-1588161148 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:27:42 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-bb34565c-1923-4d4c-a8ce-aa354f938cce tempest-AttachVolumeNegativeTest-1588161148 None] Deleted volume successfully. Sep 29 18:27:42 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-bb34565c-1923-4d4c-a8ce-aa354f938cce tempest-AttachVolumeNegativeTest-1588161148 None] Lock "cinder-5de338e3-f797-4f6e-a646-5fc0ca18c6b4-delete_volume" released by "delete_volume" :: held 1.648s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:27:42 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-8b9176ac-4f90-4190-9b51-0930db0c3d8f tempest-VolumesMetadataTest-2062245974 None] Acquiring lock "cinder-803c1f80-75e5-4570-8939-d3ed614af63a-delete_volume" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:27:42 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-8b9176ac-4f90-4190-9b51-0930db0c3d8f tempest-VolumesMetadataTest-2062245974 None] Lock "cinder-803c1f80-75e5-4570-8939-d3ed614af63a-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:27:42 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-8b9176ac-4f90-4190-9b51-0930db0c3d8f tempest-VolumesMetadataTest-2062245974 None] Acquiring lock "cinder-quobyte-803c1f80-75e5-4570-8939-d3ed614af63a" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:27:42 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-8b9176ac-4f90-4190-9b51-0930db0c3d8f tempest-VolumesMetadataTest-2062245974 None] Lock "cinder-quobyte-803c1f80-75e5-4570-8939-d3ed614af63a" acquired by "delete_volume" :: waited 0.028s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:27:42 devstack sudo[100042]: pam_unix(sudo:session): session closed for user root Sep 29 18:27:42 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc2ed778-3378-4a7d-a0c9-dd0e97c2522a]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:27:42 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-8b9176ac-4f90-4190-9b51-0930db0c3d8f tempest-VolumesMetadataTest-2062245974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-803c1f80-75e5-4570-8939-d3ed614af63a {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:27:42 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-797a0ecd-ea65-4745-83f6-0ea33d3f63d5 tempest-VolumeImageDependencyTests-1991530828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.499s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:27:42 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-797a0ecd-ea65-4745-83f6-0ea33d3f63d5 tempest-VolumeImageDependencyTests-1991530828 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:27:42 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-797a0ecd-ea65-4745-83f6-0ea33d3f63d5 tempest-VolumeImageDependencyTests-1991530828 None] Deleted volume successfully. Sep 29 18:27:42 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-797a0ecd-ea65-4745-83f6-0ea33d3f63d5 tempest-VolumeImageDependencyTests-1991530828 None] Lock "cinder-7561a209-5e81-4dc9-9fdb-939e07e7df16-delete_volume" released by "delete_volume" :: held 1.650s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:27:42 devstack sudo[100046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-803c1f80-75e5-4570-8939-d3ed614af63a Sep 29 18:27:42 devstack sudo[100046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:27:43 devstack sudo[100046]: pam_unix(sudo:session): session closed for user root Sep 29 18:27:43 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-8b9176ac-4f90-4190-9b51-0930db0c3d8f tempest-VolumesMetadataTest-2062245974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-803c1f80-75e5-4570-8939-d3ed614af63a" returned: 0 in 0.493s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:27:43 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-8b9176ac-4f90-4190-9b51-0930db0c3d8f tempest-VolumesMetadataTest-2062245974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-803c1f80-75e5-4570-8939-d3ed614af63a {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:27:43 devstack sudo[100085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-803c1f80-75e5-4570-8939-d3ed614af63a Sep 29 18:27:43 devstack sudo[100085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:27:43 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-a5f5a181-2502-44b6-b615-bac8f72bc03f tempest-AttachVolumeNegativeTest-1588161148 None] Acquiring lock "cinder-e8c56791-d854-4764-838a-c21804e199af-delete_volume" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:27:43 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-a5f5a181-2502-44b6-b615-bac8f72bc03f tempest-AttachVolumeNegativeTest-1588161148 None] Lock "cinder-e8c56791-d854-4764-838a-c21804e199af-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:27:43 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-a5f5a181-2502-44b6-b615-bac8f72bc03f tempest-AttachVolumeNegativeTest-1588161148 None] Acquiring lock "cinder-quobyte-e8c56791-d854-4764-838a-c21804e199af" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:27:43 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-a5f5a181-2502-44b6-b615-bac8f72bc03f tempest-AttachVolumeNegativeTest-1588161148 None] Lock "cinder-quobyte-e8c56791-d854-4764-838a-c21804e199af" acquired by "delete_volume" :: waited 0.031s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:27:43 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[a574dde2-8190-4881-b23a-d9efa36db4b5]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:27:43 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a5f5a181-2502-44b6-b615-bac8f72bc03f tempest-AttachVolumeNegativeTest-1588161148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e8c56791-d854-4764-838a-c21804e199af {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:27:43 devstack sudo[100085]: pam_unix(sudo:session): session closed for user root Sep 29 18:27:43 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-8b9176ac-4f90-4190-9b51-0930db0c3d8f tempest-VolumesMetadataTest-2062245974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-803c1f80-75e5-4570-8939-d3ed614af63a" returned: 0 in 0.425s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:27:43 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-8b9176ac-4f90-4190-9b51-0930db0c3d8f tempest-VolumesMetadataTest-2062245974 None] Lock "cinder-quobyte-803c1f80-75e5-4570-8939-d3ed614af63a" released by "delete_volume" :: held 0.989s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:27:43 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-8b9176ac-4f90-4190-9b51-0930db0c3d8f tempest-VolumesMetadataTest-2062245974 None] Created reservations ['0b0de355-328e-4d37-9daf-f8dc0ef458f8', '6df5709d-2322-463a-9e60-1e0f2e528643', 'c14ba7a3-754a-4b24-a846-4247f70fdf05', '57ddc888-ac4f-4beb-9154-b3f732679c32'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:27:43 devstack sudo[100089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e8c56791-d854-4764-838a-c21804e199af Sep 29 18:27:43 devstack sudo[100089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:27:43 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-8b9176ac-4f90-4190-9b51-0930db0c3d8f tempest-VolumesMetadataTest-2062245974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:27:43 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-8b9176ac-4f90-4190-9b51-0930db0c3d8f tempest-VolumesMetadataTest-2062245974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:27:43 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-8b9176ac-4f90-4190-9b51-0930db0c3d8f tempest-VolumesMetadataTest-2062245974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:27:43 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-8b9176ac-4f90-4190-9b51-0930db0c3d8f tempest-VolumesMetadataTest-2062245974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:27:43 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-8b9176ac-4f90-4190-9b51-0930db0c3d8f tempest-VolumesMetadataTest-2062245974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:27:43 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-8b9176ac-4f90-4190-9b51-0930db0c3d8f tempest-VolumesMetadataTest-2062245974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:27:43 devstack sudo[100093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:27:43 devstack sudo[100093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:27:44 devstack sudo[100089]: pam_unix(sudo:session): session closed for user root Sep 29 18:27:44 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a5f5a181-2502-44b6-b615-bac8f72bc03f tempest-AttachVolumeNegativeTest-1588161148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e8c56791-d854-4764-838a-c21804e199af" returned: 0 in 0.548s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:27:44 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a5f5a181-2502-44b6-b615-bac8f72bc03f tempest-AttachVolumeNegativeTest-1588161148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e8c56791-d854-4764-838a-c21804e199af {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:27:44 devstack sudo[100099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e8c56791-d854-4764-838a-c21804e199af Sep 29 18:27:44 devstack sudo[100099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:27:44 devstack sudo[100093]: pam_unix(sudo:session): session closed for user root Sep 29 18:27:44 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-8b9176ac-4f90-4190-9b51-0930db0c3d8f tempest-VolumesMetadataTest-2062245974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.361s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:27:44 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-8b9176ac-4f90-4190-9b51-0930db0c3d8f tempest-VolumesMetadataTest-2062245974 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:27:44 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-8b9176ac-4f90-4190-9b51-0930db0c3d8f tempest-VolumesMetadataTest-2062245974 None] Deleted volume successfully. Sep 29 18:27:44 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-8b9176ac-4f90-4190-9b51-0930db0c3d8f tempest-VolumesMetadataTest-2062245974 None] Lock "cinder-803c1f80-75e5-4570-8939-d3ed614af63a-delete_volume" released by "delete_volume" :: held 1.664s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:27:44 devstack sudo[100099]: pam_unix(sudo:session): session closed for user root Sep 29 18:27:44 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a5f5a181-2502-44b6-b615-bac8f72bc03f tempest-AttachVolumeNegativeTest-1588161148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e8c56791-d854-4764-838a-c21804e199af" returned: 0 in 0.295s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:27:44 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-a5f5a181-2502-44b6-b615-bac8f72bc03f tempest-AttachVolumeNegativeTest-1588161148 None] Lock "cinder-quobyte-e8c56791-d854-4764-838a-c21804e199af" released by "delete_volume" :: held 0.905s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:27:44 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-a5f5a181-2502-44b6-b615-bac8f72bc03f tempest-AttachVolumeNegativeTest-1588161148 None] Created reservations ['dc28631c-2908-4414-a036-1ea65baa2201', '52f2667f-b97d-4005-8fd0-bfe50c4eb92c', '88f6f8d9-b965-40f7-b630-9b1eab4dc9c2', 'a8494681-41db-4c4b-b431-1fd804521f55'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:27:44 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-a5f5a181-2502-44b6-b615-bac8f72bc03f tempest-AttachVolumeNegativeTest-1588161148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:27:44 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-a5f5a181-2502-44b6-b615-bac8f72bc03f tempest-AttachVolumeNegativeTest-1588161148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:27:44 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-a5f5a181-2502-44b6-b615-bac8f72bc03f tempest-AttachVolumeNegativeTest-1588161148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:27:44 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-a5f5a181-2502-44b6-b615-bac8f72bc03f tempest-AttachVolumeNegativeTest-1588161148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:27:44 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-a5f5a181-2502-44b6-b615-bac8f72bc03f tempest-AttachVolumeNegativeTest-1588161148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:27:44 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a5f5a181-2502-44b6-b615-bac8f72bc03f tempest-AttachVolumeNegativeTest-1588161148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:27:44 devstack sudo[100103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:27:44 devstack sudo[100103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:27:44 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-fda8bce1-8309-4505-84c5-b4491fbadbd2 tempest-VolumesGetTest-329956023 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86512) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:27:44 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-fda8bce1-8309-4505-84c5-b4491fbadbd2 tempest-VolumesGetTest-329956023 None] Flow 'volume_create_manager' (05465315-c05c-4654-b9c0-0dcb25b5d64a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:27:44 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-fda8bce1-8309-4505-84c5-b4491fbadbd2 tempest-VolumesGetTest-329956023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ee8a303-3fe2-4f58-937d-5b6be011867b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:27:45 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-fda8bce1-8309-4505-84c5-b4491fbadbd2 tempest-VolumesGetTest-329956023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ee8a303-3fe2-4f58-937d-5b6be011867b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:27:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1905995984',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6619482f-fc68-41f2-922a-007a40effc4d,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='123ca1c819ab4c939d34d15531ec218c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:27:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:27:45Z,use_quota=True,user_id='d4b8a389e95e4820826e3c19485b4a7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:27:45 devstack sudo[100103]: pam_unix(sudo:session): session closed for user root Sep 29 18:27:45 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-fda8bce1-8309-4505-84c5-b4491fbadbd2 tempest-VolumesGetTest-329956023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de443c38-b316-4178-8c02-9be97615f4ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:27:45 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-fda8bce1-8309-4505-84c5-b4491fbadbd2 tempest-VolumesGetTest-329956023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de443c38-b316-4178-8c02-9be97615f4ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:27:45 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-fda8bce1-8309-4505-84c5-b4491fbadbd2 tempest-VolumesGetTest-329956023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (915b3af0-0edf-4b48-ac6a-5a5c259aae2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:27:45 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-fda8bce1-8309-4505-84c5-b4491fbadbd2 tempest-VolumesGetTest-329956023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (915b3af0-0edf-4b48-ac6a-5a5c259aae2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6619482f-fc68-41f2-922a-007a40effc4d', 'volume_name': 'volume-6619482f-fc68-41f2-922a-007a40effc4d', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:27:45 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-fda8bce1-8309-4505-84c5-b4491fbadbd2 tempest-VolumesGetTest-329956023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (383f2007-196c-45a6-a824-3d21a2479878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:27:45 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-fda8bce1-8309-4505-84c5-b4491fbadbd2 tempest-VolumesGetTest-329956023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (383f2007-196c-45a6-a824-3d21a2479878) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:27:45 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-fda8bce1-8309-4505-84c5-b4491fbadbd2 tempest-VolumesGetTest-329956023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7f6dbc9-12ed-450c-9a7d-13ae2dd79f02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:27:45 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-fda8bce1-8309-4505-84c5-b4491fbadbd2 tempest-VolumesGetTest-329956023 None] Volume 6619482f-fc68-41f2-922a-007a40effc4d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6619482f-fc68-41f2-922a-007a40effc4d', 'volume_size': 1} Sep 29 18:27:45 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-fda8bce1-8309-4505-84c5-b4491fbadbd2 tempest-VolumesGetTest-329956023 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:27:45 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-fda8bce1-8309-4505-84c5-b4491fbadbd2 tempest-VolumesGetTest-329956023 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:27:45 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-fda8bce1-8309-4505-84c5-b4491fbadbd2 tempest-VolumesGetTest-329956023 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:27:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1905995984',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6619482f-fc68-41f2-922a-007a40effc4d,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='123ca1c819ab4c939d34d15531ec218c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:27:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:27:45Z,use_quota=True,user_id='d4b8a389e95e4820826e3c19485b4a7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)}" {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:27:45 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-fda8bce1-8309-4505-84c5-b4491fbadbd2 tempest-VolumesGetTest-329956023 None] Creating volume 6619482f-fc68-41f2-922a-007a40effc4d {{(pid=86512) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:27:45 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-fda8bce1-8309-4505-84c5-b4491fbadbd2 tempest-VolumesGetTest-329956023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:27:45 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-fda8bce1-8309-4505-84c5-b4491fbadbd2 tempest-VolumesGetTest-329956023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:27:45 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-fda8bce1-8309-4505-84c5-b4491fbadbd2 tempest-VolumesGetTest-329956023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:27:45 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-fda8bce1-8309-4505-84c5-b4491fbadbd2 tempest-VolumesGetTest-329956023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:27:45 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-fda8bce1-8309-4505-84c5-b4491fbadbd2 tempest-VolumesGetTest-329956023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:27:45 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-fda8bce1-8309-4505-84c5-b4491fbadbd2 tempest-VolumesGetTest-329956023 None] Selected osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 as target Quobyte volume. {{(pid=86512) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:27:45 devstack cinder-volume[86512]: INFO cinder.volume.drivers.remotefs [None req-fda8bce1-8309-4505-84c5-b4491fbadbd2 tempest-VolumesGetTest-329956023 None] casted to osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 Sep 29 18:27:45 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-fda8bce1-8309-4505-84c5-b4491fbadbd2 tempest-VolumesGetTest-329956023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-6619482f-fc68-41f2-922a-007a40effc4d 1073741824 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:27:45 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a5f5a181-2502-44b6-b615-bac8f72bc03f tempest-AttachVolumeNegativeTest-1588161148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.457s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:27:45 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-a5f5a181-2502-44b6-b615-bac8f72bc03f tempest-AttachVolumeNegativeTest-1588161148 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:27:45 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-a5f5a181-2502-44b6-b615-bac8f72bc03f tempest-AttachVolumeNegativeTest-1588161148 None] Deleted volume successfully. Sep 29 18:27:45 devstack sudo[100106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-6619482f-fc68-41f2-922a-007a40effc4d 1073741824 Sep 29 18:27:45 devstack sudo[100106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:27:45 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-a5f5a181-2502-44b6-b615-bac8f72bc03f tempest-AttachVolumeNegativeTest-1588161148 None] Lock "cinder-e8c56791-d854-4764-838a-c21804e199af-delete_volume" released by "delete_volume" :: held 1.673s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:27:45 devstack sudo[100106]: pam_unix(sudo:session): session closed for user root Sep 29 18:27:45 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-fda8bce1-8309-4505-84c5-b4491fbadbd2 tempest-VolumesGetTest-329956023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-6619482f-fc68-41f2-922a-007a40effc4d 1073741824" returned: 0 in 0.624s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:27:45 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-fda8bce1-8309-4505-84c5-b4491fbadbd2 tempest-VolumesGetTest-329956023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-6619482f-fc68-41f2-922a-007a40effc4d {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:27:45 devstack sudo[100112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-6619482f-fc68-41f2-922a-007a40effc4d Sep 29 18:27:45 devstack sudo[100112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:27:46 devstack sudo[100112]: pam_unix(sudo:session): session closed for user root Sep 29 18:27:46 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-fda8bce1-8309-4505-84c5-b4491fbadbd2 tempest-VolumesGetTest-329956023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-6619482f-fc68-41f2-922a-007a40effc4d" returned: 0 in 0.319s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:27:46 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-fda8bce1-8309-4505-84c5-b4491fbadbd2 tempest-VolumesGetTest-329956023 None] <== create_volume: return (1019ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'} {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:27:46 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-fda8bce1-8309-4505-84c5-b4491fbadbd2 tempest-VolumesGetTest-329956023 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.022s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:27:46 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-fda8bce1-8309-4505-84c5-b4491fbadbd2 tempest-VolumesGetTest-329956023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7f6dbc9-12ed-450c-9a7d-13ae2dd79f02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6619482f-fc68-41f2-922a-007a40effc4d', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:27:46 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-fda8bce1-8309-4505-84c5-b4491fbadbd2 tempest-VolumesGetTest-329956023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cba42f87-5437-4b86-adba-eba8d3757f82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:27:46 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-fda8bce1-8309-4505-84c5-b4491fbadbd2 tempest-VolumesGetTest-329956023 None] Volume volume-6619482f-fc68-41f2-922a-007a40effc4d (6619482f-fc68-41f2-922a-007a40effc4d): created successfully Sep 29 18:27:46 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-fda8bce1-8309-4505-84c5-b4491fbadbd2 tempest-VolumesGetTest-329956023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cba42f87-5437-4b86-adba-eba8d3757f82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:27:46 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-fda8bce1-8309-4505-84c5-b4491fbadbd2 tempest-VolumesGetTest-329956023 None] Flow 'volume_create_manager' (05465315-c05c-4654-b9c0-0dcb25b5d64a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:27:46 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-fda8bce1-8309-4505-84c5-b4491fbadbd2 tempest-VolumesGetTest-329956023 None] Created volume successfully. Sep 29 18:27:48 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-eff93e1f-f4c1-4af4-a504-a24830fb6b43 tempest-ProjectReaderTests-1407326406 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86512) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:27:48 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-eff93e1f-f4c1-4af4-a504-a24830fb6b43 tempest-ProjectReaderTests-1407326406 None] Flow 'volume_create_manager' (7b1e7542-df8b-4a6e-828e-08b3d0e86b21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:27:48 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-eff93e1f-f4c1-4af4-a504-a24830fb6b43 tempest-ProjectReaderTests-1407326406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c69174c8-4bab-4951-9a6f-0257b0fb69ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:27:48 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-eff93e1f-f4c1-4af4-a504-a24830fb6b43 tempest-ProjectReaderTests-1407326406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c69174c8-4bab-4951-9a6f-0257b0fb69ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:27:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-538122320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbe18e97-2dde-49f9-b3ba-ffa238b6e6f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37030a2d8ef342a2bdf695a2d1b4070c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:27:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:27:48Z,use_quota=True,user_id='e7ce51fe312c45ffb8522e903e573610',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:27:48 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-eff93e1f-f4c1-4af4-a504-a24830fb6b43 tempest-ProjectReaderTests-1407326406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f22eb92-c81b-474e-a0bb-e166aa63e000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:27:48 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-eff93e1f-f4c1-4af4-a504-a24830fb6b43 tempest-ProjectReaderTests-1407326406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f22eb92-c81b-474e-a0bb-e166aa63e000) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:27:48 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-eff93e1f-f4c1-4af4-a504-a24830fb6b43 tempest-ProjectReaderTests-1407326406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71b69787-f663-45a6-81e7-db5fe6c43a1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:27:48 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-eff93e1f-f4c1-4af4-a504-a24830fb6b43 tempest-ProjectReaderTests-1407326406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71b69787-f663-45a6-81e7-db5fe6c43a1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cbe18e97-2dde-49f9-b3ba-ffa238b6e6f4', 'volume_name': 'volume-cbe18e97-2dde-49f9-b3ba-ffa238b6e6f4', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:27:48 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-eff93e1f-f4c1-4af4-a504-a24830fb6b43 tempest-ProjectReaderTests-1407326406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a59bc7f-2c14-4336-b741-b5840d4b2332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:27:48 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-eff93e1f-f4c1-4af4-a504-a24830fb6b43 tempest-ProjectReaderTests-1407326406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a59bc7f-2c14-4336-b741-b5840d4b2332) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:27:48 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-eff93e1f-f4c1-4af4-a504-a24830fb6b43 tempest-ProjectReaderTests-1407326406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcbbef72-4c1a-4eaa-9829-e87a64e99375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:27:48 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-eff93e1f-f4c1-4af4-a504-a24830fb6b43 tempest-ProjectReaderTests-1407326406 None] Volume cbe18e97-2dde-49f9-b3ba-ffa238b6e6f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cbe18e97-2dde-49f9-b3ba-ffa238b6e6f4', 'volume_size': 1} Sep 29 18:27:48 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-eff93e1f-f4c1-4af4-a504-a24830fb6b43 tempest-ProjectReaderTests-1407326406 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:27:48 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-eff93e1f-f4c1-4af4-a504-a24830fb6b43 tempest-ProjectReaderTests-1407326406 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:27:48 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-eff93e1f-f4c1-4af4-a504-a24830fb6b43 tempest-ProjectReaderTests-1407326406 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:27:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-538122320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbe18e97-2dde-49f9-b3ba-ffa238b6e6f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37030a2d8ef342a2bdf695a2d1b4070c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:27:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:27:48Z,use_quota=True,user_id='e7ce51fe312c45ffb8522e903e573610',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)}" {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:27:48 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-eff93e1f-f4c1-4af4-a504-a24830fb6b43 tempest-ProjectReaderTests-1407326406 None] Creating volume cbe18e97-2dde-49f9-b3ba-ffa238b6e6f4 {{(pid=86512) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:27:48 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-eff93e1f-f4c1-4af4-a504-a24830fb6b43 tempest-ProjectReaderTests-1407326406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:27:48 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-eff93e1f-f4c1-4af4-a504-a24830fb6b43 tempest-ProjectReaderTests-1407326406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:27:48 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-eff93e1f-f4c1-4af4-a504-a24830fb6b43 tempest-ProjectReaderTests-1407326406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:27:48 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-eff93e1f-f4c1-4af4-a504-a24830fb6b43 tempest-ProjectReaderTests-1407326406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:27:48 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-eff93e1f-f4c1-4af4-a504-a24830fb6b43 tempest-ProjectReaderTests-1407326406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:27:48 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-eff93e1f-f4c1-4af4-a504-a24830fb6b43 tempest-ProjectReaderTests-1407326406 None] Selected osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 as target Quobyte volume. {{(pid=86512) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:27:48 devstack cinder-volume[86512]: INFO cinder.volume.drivers.remotefs [None req-eff93e1f-f4c1-4af4-a504-a24830fb6b43 tempest-ProjectReaderTests-1407326406 None] casted to osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 Sep 29 18:27:48 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-eff93e1f-f4c1-4af4-a504-a24830fb6b43 tempest-ProjectReaderTests-1407326406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-cbe18e97-2dde-49f9-b3ba-ffa238b6e6f4 1073741824 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:27:48 devstack sudo[100117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-cbe18e97-2dde-49f9-b3ba-ffa238b6e6f4 1073741824 Sep 29 18:27:48 devstack sudo[100117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:27:48 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-d107ab37-a6fe-4a83-83f7-0494d2467431 tempest-VolumesGetTest-329956023 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86512) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:27:48 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d107ab37-a6fe-4a83-83f7-0494d2467431 tempest-VolumesGetTest-329956023 None] Flow 'volume_create_manager' (7668ec87-e064-4565-8eb4-2438591dda93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:27:48 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d107ab37-a6fe-4a83-83f7-0494d2467431 tempest-VolumesGetTest-329956023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7fc98d8-7db7-45c3-b96e-deb0f34499e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:27:48 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d107ab37-a6fe-4a83-83f7-0494d2467431 tempest-VolumesGetTest-329956023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7fc98d8-7db7-45c3-b96e-deb0f34499e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:27:48Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-868074489',display_name='tempest-VolumesGetTest-Volume-872887406',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae799204-4972-4597-8962-afa3c3fcf4c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='123ca1c819ab4c939d34d15531ec218c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:27:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:27:48Z,use_quota=True,user_id='d4b8a389e95e4820826e3c19485b4a7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:27:48 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d107ab37-a6fe-4a83-83f7-0494d2467431 tempest-VolumesGetTest-329956023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (992bc880-c701-463e-a4d1-1c099880c524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:27:48 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d107ab37-a6fe-4a83-83f7-0494d2467431 tempest-VolumesGetTest-329956023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (992bc880-c701-463e-a4d1-1c099880c524) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:27:48 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d107ab37-a6fe-4a83-83f7-0494d2467431 tempest-VolumesGetTest-329956023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c7bfdab-0220-44f9-b332-7c71cab4df8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:27:48 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d107ab37-a6fe-4a83-83f7-0494d2467431 tempest-VolumesGetTest-329956023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c7bfdab-0220-44f9-b332-7c71cab4df8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae799204-4972-4597-8962-afa3c3fcf4c9', 'volume_name': 'volume-ae799204-4972-4597-8962-afa3c3fcf4c9', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:27:48 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d107ab37-a6fe-4a83-83f7-0494d2467431 tempest-VolumesGetTest-329956023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b96d4df-01cc-4faa-a893-dceba688a77a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:27:48 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d107ab37-a6fe-4a83-83f7-0494d2467431 tempest-VolumesGetTest-329956023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b96d4df-01cc-4faa-a893-dceba688a77a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:27:48 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d107ab37-a6fe-4a83-83f7-0494d2467431 tempest-VolumesGetTest-329956023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a57f1887-e508-4d38-8013-fba387de4a9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:27:48 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-d107ab37-a6fe-4a83-83f7-0494d2467431 tempest-VolumesGetTest-329956023 None] Volume ae799204-4972-4597-8962-afa3c3fcf4c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae799204-4972-4597-8962-afa3c3fcf4c9', 'volume_size': 1} Sep 29 18:27:48 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-d107ab37-a6fe-4a83-83f7-0494d2467431 tempest-VolumesGetTest-329956023 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:27:48 devstack sudo[100117]: pam_unix(sudo:session): session closed for user root Sep 29 18:27:48 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-eff93e1f-f4c1-4af4-a504-a24830fb6b43 tempest-ProjectReaderTests-1407326406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-cbe18e97-2dde-49f9-b3ba-ffa238b6e6f4 1073741824" returned: 0 in 0.520s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:27:48 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-eff93e1f-f4c1-4af4-a504-a24830fb6b43 tempest-ProjectReaderTests-1407326406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-cbe18e97-2dde-49f9-b3ba-ffa238b6e6f4 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:27:49 devstack sudo[100124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-cbe18e97-2dde-49f9-b3ba-ffa238b6e6f4 Sep 29 18:27:49 devstack sudo[100124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:27:49 devstack sudo[100124]: pam_unix(sudo:session): session closed for user root Sep 29 18:27:49 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-eff93e1f-f4c1-4af4-a504-a24830fb6b43 tempest-ProjectReaderTests-1407326406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-cbe18e97-2dde-49f9-b3ba-ffa238b6e6f4" returned: 0 in 0.380s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:27:49 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-eff93e1f-f4c1-4af4-a504-a24830fb6b43 tempest-ProjectReaderTests-1407326406 None] <== create_volume: return (949ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'} {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:27:49 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-eff93e1f-f4c1-4af4-a504-a24830fb6b43 tempest-ProjectReaderTests-1407326406 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.952s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:27:49 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-d107ab37-a6fe-4a83-83f7-0494d2467431 tempest-VolumesGetTest-329956023 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.820s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:27:49 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-d107ab37-a6fe-4a83-83f7-0494d2467431 tempest-VolumesGetTest-329956023 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:27:48Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-868074489',display_name='tempest-VolumesGetTest-Volume-872887406',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae799204-4972-4597-8962-afa3c3fcf4c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='123ca1c819ab4c939d34d15531ec218c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:27:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:27:48Z,use_quota=True,user_id='d4b8a389e95e4820826e3c19485b4a7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)}" {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:27:49 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-d107ab37-a6fe-4a83-83f7-0494d2467431 tempest-VolumesGetTest-329956023 None] Creating volume ae799204-4972-4597-8962-afa3c3fcf4c9 {{(pid=86512) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:27:49 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-d107ab37-a6fe-4a83-83f7-0494d2467431 tempest-VolumesGetTest-329956023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:27:49 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-d107ab37-a6fe-4a83-83f7-0494d2467431 tempest-VolumesGetTest-329956023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:27:49 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-d107ab37-a6fe-4a83-83f7-0494d2467431 tempest-VolumesGetTest-329956023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:27:49 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-d107ab37-a6fe-4a83-83f7-0494d2467431 tempest-VolumesGetTest-329956023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:27:49 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-d107ab37-a6fe-4a83-83f7-0494d2467431 tempest-VolumesGetTest-329956023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:27:49 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-d107ab37-a6fe-4a83-83f7-0494d2467431 tempest-VolumesGetTest-329956023 None] Selected osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 as target Quobyte volume. {{(pid=86512) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:27:49 devstack cinder-volume[86512]: INFO cinder.volume.drivers.remotefs [None req-d107ab37-a6fe-4a83-83f7-0494d2467431 tempest-VolumesGetTest-329956023 None] casted to osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 Sep 29 18:27:49 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-d107ab37-a6fe-4a83-83f7-0494d2467431 tempest-VolumesGetTest-329956023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ae799204-4972-4597-8962-afa3c3fcf4c9 1073741824 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:27:49 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-eff93e1f-f4c1-4af4-a504-a24830fb6b43 tempest-ProjectReaderTests-1407326406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcbbef72-4c1a-4eaa-9829-e87a64e99375) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cbe18e97-2dde-49f9-b3ba-ffa238b6e6f4', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:27:49 devstack sudo[100127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ae799204-4972-4597-8962-afa3c3fcf4c9 1073741824 Sep 29 18:27:49 devstack sudo[100127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:27:49 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-eff93e1f-f4c1-4af4-a504-a24830fb6b43 tempest-ProjectReaderTests-1407326406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0331e1ad-bccd-4a23-8bea-a5634a7aff87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:27:49 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-eff93e1f-f4c1-4af4-a504-a24830fb6b43 tempest-ProjectReaderTests-1407326406 None] Volume volume-cbe18e97-2dde-49f9-b3ba-ffa238b6e6f4 (cbe18e97-2dde-49f9-b3ba-ffa238b6e6f4): created successfully Sep 29 18:27:49 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-eff93e1f-f4c1-4af4-a504-a24830fb6b43 tempest-ProjectReaderTests-1407326406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0331e1ad-bccd-4a23-8bea-a5634a7aff87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:27:49 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-eff93e1f-f4c1-4af4-a504-a24830fb6b43 tempest-ProjectReaderTests-1407326406 None] Flow 'volume_create_manager' (7b1e7542-df8b-4a6e-828e-08b3d0e86b21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:27:49 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-eff93e1f-f4c1-4af4-a504-a24830fb6b43 tempest-ProjectReaderTests-1407326406 None] Created volume successfully. Sep 29 18:27:50 devstack sudo[100127]: pam_unix(sudo:session): session closed for user root Sep 29 18:27:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-d107ab37-a6fe-4a83-83f7-0494d2467431 tempest-VolumesGetTest-329956023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ae799204-4972-4597-8962-afa3c3fcf4c9 1073741824" returned: 0 in 0.661s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:27:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-d107ab37-a6fe-4a83-83f7-0494d2467431 tempest-VolumesGetTest-329956023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ae799204-4972-4597-8962-afa3c3fcf4c9 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:27:50 devstack sudo[100133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ae799204-4972-4597-8962-afa3c3fcf4c9 Sep 29 18:27:50 devstack sudo[100133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:27:50 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-689786bb-923c-4884-8f10-9152ef9435e5 tempest-ProjectReaderTests-1407326406 None] Acquiring lock "cinder-cbe18e97-2dde-49f9-b3ba-ffa238b6e6f4-delete_volume" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:27:50 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-689786bb-923c-4884-8f10-9152ef9435e5 tempest-ProjectReaderTests-1407326406 None] Lock "cinder-cbe18e97-2dde-49f9-b3ba-ffa238b6e6f4-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:27:50 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-689786bb-923c-4884-8f10-9152ef9435e5 tempest-ProjectReaderTests-1407326406 None] Acquiring lock "cinder-quobyte-cbe18e97-2dde-49f9-b3ba-ffa238b6e6f4" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:27:50 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-689786bb-923c-4884-8f10-9152ef9435e5 tempest-ProjectReaderTests-1407326406 None] Lock "cinder-quobyte-cbe18e97-2dde-49f9-b3ba-ffa238b6e6f4" acquired by "delete_volume" :: waited 0.017s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:27:50 devstack sudo[100133]: pam_unix(sudo:session): session closed for user root Sep 29 18:27:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-d107ab37-a6fe-4a83-83f7-0494d2467431 tempest-VolumesGetTest-329956023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ae799204-4972-4597-8962-afa3c3fcf4c9" returned: 0 in 0.413s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:27:50 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-d107ab37-a6fe-4a83-83f7-0494d2467431 tempest-VolumesGetTest-329956023 None] <== create_volume: return (1129ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'} {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:27:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-d107ab37-a6fe-4a83-83f7-0494d2467431 tempest-VolumesGetTest-329956023 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.133s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:27:50 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[7260c6ff-5f84-47e0-b945-2924ff8d6c41]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:27:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-689786bb-923c-4884-8f10-9152ef9435e5 tempest-ProjectReaderTests-1407326406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-cbe18e97-2dde-49f9-b3ba-ffa238b6e6f4 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:27:50 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d107ab37-a6fe-4a83-83f7-0494d2467431 tempest-VolumesGetTest-329956023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a57f1887-e508-4d38-8013-fba387de4a9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae799204-4972-4597-8962-afa3c3fcf4c9', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:27:50 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d107ab37-a6fe-4a83-83f7-0494d2467431 tempest-VolumesGetTest-329956023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6aaa4e58-3bf9-4c9d-bddf-41f037589491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:27:50 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-d107ab37-a6fe-4a83-83f7-0494d2467431 tempest-VolumesGetTest-329956023 None] Volume volume-ae799204-4972-4597-8962-afa3c3fcf4c9 (ae799204-4972-4597-8962-afa3c3fcf4c9): created successfully Sep 29 18:27:50 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d107ab37-a6fe-4a83-83f7-0494d2467431 tempest-VolumesGetTest-329956023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6aaa4e58-3bf9-4c9d-bddf-41f037589491) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:27:50 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d107ab37-a6fe-4a83-83f7-0494d2467431 tempest-VolumesGetTest-329956023 None] Flow 'volume_create_manager' (7668ec87-e064-4565-8eb4-2438591dda93) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:27:50 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-d107ab37-a6fe-4a83-83f7-0494d2467431 tempest-VolumesGetTest-329956023 None] Created volume successfully. Sep 29 18:27:50 devstack cinder-volume[86512]: DEBUG oslo_service.periodic_task [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86512) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 18:27:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:27:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:27:50 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:27:50 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:27:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:27:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:27:50 devstack sudo[100137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-cbe18e97-2dde-49f9-b3ba-ffa238b6e6f4 Sep 29 18:27:50 devstack sudo[100137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:27:50 devstack sudo[100138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:27:50 devstack sudo[100138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:27:50 devstack sudo[100137]: pam_unix(sudo:session): session closed for user root Sep 29 18:27:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-689786bb-923c-4884-8f10-9152ef9435e5 tempest-ProjectReaderTests-1407326406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-cbe18e97-2dde-49f9-b3ba-ffa238b6e6f4" returned: 0 in 0.447s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:27:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-689786bb-923c-4884-8f10-9152ef9435e5 tempest-ProjectReaderTests-1407326406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-cbe18e97-2dde-49f9-b3ba-ffa238b6e6f4 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:27:50 devstack sudo[100138]: pam_unix(sudo:session): session closed for user root Sep 29 18:27:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.334s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:27:50 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:27:50 devstack cinder-volume[86512]: DEBUG oslo_service.periodic_task [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Running periodic task VolumeManager._thread_info {{(pid=86512) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 18:27:50 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] thread count: 28 {{(pid=86512) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 29 18:27:50 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] thread info: [<_MainThread(MainThread, started 135593654804608)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86512) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 29 18:27:50 devstack sudo[100145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-cbe18e97-2dde-49f9-b3ba-ffa238b6e6f4 Sep 29 18:27:50 devstack sudo[100145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:27:51 devstack sudo[100145]: pam_unix(sudo:session): session closed for user root Sep 29 18:27:51 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-689786bb-923c-4884-8f10-9152ef9435e5 tempest-ProjectReaderTests-1407326406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-cbe18e97-2dde-49f9-b3ba-ffa238b6e6f4" returned: 0 in 0.290s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:27:51 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-689786bb-923c-4884-8f10-9152ef9435e5 tempest-ProjectReaderTests-1407326406 None] Lock "cinder-quobyte-cbe18e97-2dde-49f9-b3ba-ffa238b6e6f4" released by "delete_volume" :: held 0.795s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:27:51 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-689786bb-923c-4884-8f10-9152ef9435e5 tempest-ProjectReaderTests-1407326406 None] Created reservations ['841a11a8-f23e-4af1-9e6a-1f1a781f225c', '18654e21-c546-41d2-b15c-97c501f4c5a6', '63825838-f16a-4c2a-bfd9-bc88e835e5f9', 'b2d5ab78-88ab-4673-af13-3a7691d0e12d'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:27:51 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-689786bb-923c-4884-8f10-9152ef9435e5 tempest-ProjectReaderTests-1407326406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:27:51 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-689786bb-923c-4884-8f10-9152ef9435e5 tempest-ProjectReaderTests-1407326406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:27:51 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-689786bb-923c-4884-8f10-9152ef9435e5 tempest-ProjectReaderTests-1407326406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:27:51 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-689786bb-923c-4884-8f10-9152ef9435e5 tempest-ProjectReaderTests-1407326406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:27:51 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-689786bb-923c-4884-8f10-9152ef9435e5 tempest-ProjectReaderTests-1407326406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:27:51 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-689786bb-923c-4884-8f10-9152ef9435e5 tempest-ProjectReaderTests-1407326406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:27:51 devstack sudo[100148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:27:51 devstack sudo[100148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:27:51 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-7aba0c61-86fd-4089-9b14-41af873d26ee tempest-VolumesGetTest-329956023 None] Acquiring lock "cinder-ae799204-4972-4597-8962-afa3c3fcf4c9-delete_volume" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:27:51 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-7aba0c61-86fd-4089-9b14-41af873d26ee tempest-VolumesGetTest-329956023 None] Lock "cinder-ae799204-4972-4597-8962-afa3c3fcf4c9-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:27:51 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-7aba0c61-86fd-4089-9b14-41af873d26ee tempest-VolumesGetTest-329956023 None] Acquiring lock "cinder-quobyte-ae799204-4972-4597-8962-afa3c3fcf4c9" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:27:51 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-7aba0c61-86fd-4089-9b14-41af873d26ee tempest-VolumesGetTest-329956023 None] Lock "cinder-quobyte-ae799204-4972-4597-8962-afa3c3fcf4c9" acquired by "delete_volume" :: waited 0.019s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:27:51 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[491b57e3-aff3-4e6f-8feb-ddd193d15a39]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:27:51 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-7aba0c61-86fd-4089-9b14-41af873d26ee tempest-VolumesGetTest-329956023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ae799204-4972-4597-8962-afa3c3fcf4c9 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:27:51 devstack sudo[100148]: pam_unix(sudo:session): session closed for user root Sep 29 18:27:51 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-689786bb-923c-4884-8f10-9152ef9435e5 tempest-ProjectReaderTests-1407326406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.467s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:27:51 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-689786bb-923c-4884-8f10-9152ef9435e5 tempest-ProjectReaderTests-1407326406 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:27:51 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-689786bb-923c-4884-8f10-9152ef9435e5 tempest-ProjectReaderTests-1407326406 None] Deleted volume successfully. Sep 29 18:27:51 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-689786bb-923c-4884-8f10-9152ef9435e5 tempest-ProjectReaderTests-1407326406 None] Lock "cinder-cbe18e97-2dde-49f9-b3ba-ffa238b6e6f4-delete_volume" released by "delete_volume" :: held 1.549s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:27:51 devstack sudo[100150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ae799204-4972-4597-8962-afa3c3fcf4c9 Sep 29 18:27:51 devstack sudo[100150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:27:52 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-615e3d78-6f28-430b-b84e-75d5f786919d tempest-VolumesTransfersV357Test-166835440 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86512) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:27:52 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-615e3d78-6f28-430b-b84e-75d5f786919d tempest-VolumesTransfersV357Test-166835440 None] Flow 'volume_create_manager' (84832028-b43e-4978-89fd-f68eb5a49eef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:27:52 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-615e3d78-6f28-430b-b84e-75d5f786919d tempest-VolumesTransfersV357Test-166835440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (640344dc-4e82-4215-a7c4-f9a5e074dd63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:27:52 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-615e3d78-6f28-430b-b84e-75d5f786919d tempest-VolumesTransfersV357Test-166835440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (640344dc-4e82-4215-a7c4-f9a5e074dd63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:27:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-261660977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1638bd98-4f06-4a89-aa14-84199f790a58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b17ca724a6a44d39d895ba0c057af81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:27:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:27:52Z,use_quota=True,user_id='cc9180bd47174855a37e7360806a2ee7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:27:52 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-615e3d78-6f28-430b-b84e-75d5f786919d tempest-VolumesTransfersV357Test-166835440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d40b042-f43b-4299-89a7-31a267ad4cd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:27:52 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-615e3d78-6f28-430b-b84e-75d5f786919d tempest-VolumesTransfersV357Test-166835440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d40b042-f43b-4299-89a7-31a267ad4cd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:27:52 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-615e3d78-6f28-430b-b84e-75d5f786919d tempest-VolumesTransfersV357Test-166835440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cfe4eaf-be8b-438b-87c0-5e75e2fb7cfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:27:52 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-615e3d78-6f28-430b-b84e-75d5f786919d tempest-VolumesTransfersV357Test-166835440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cfe4eaf-be8b-438b-87c0-5e75e2fb7cfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1638bd98-4f06-4a89-aa14-84199f790a58', 'volume_name': 'volume-1638bd98-4f06-4a89-aa14-84199f790a58', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:27:52 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-615e3d78-6f28-430b-b84e-75d5f786919d tempest-VolumesTransfersV357Test-166835440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (172eb3c5-29d7-4be7-927d-94150f0d5b64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:27:52 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-615e3d78-6f28-430b-b84e-75d5f786919d tempest-VolumesTransfersV357Test-166835440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (172eb3c5-29d7-4be7-927d-94150f0d5b64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:27:52 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-615e3d78-6f28-430b-b84e-75d5f786919d tempest-VolumesTransfersV357Test-166835440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4762e782-54f7-443c-a778-02940eefd7f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:27:52 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-615e3d78-6f28-430b-b84e-75d5f786919d tempest-VolumesTransfersV357Test-166835440 None] Volume 1638bd98-4f06-4a89-aa14-84199f790a58: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1638bd98-4f06-4a89-aa14-84199f790a58', 'volume_size': 1} Sep 29 18:27:52 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-615e3d78-6f28-430b-b84e-75d5f786919d tempest-VolumesTransfersV357Test-166835440 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:27:52 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-615e3d78-6f28-430b-b84e-75d5f786919d tempest-VolumesTransfersV357Test-166835440 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:27:52 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-615e3d78-6f28-430b-b84e-75d5f786919d tempest-VolumesTransfersV357Test-166835440 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:27:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-261660977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1638bd98-4f06-4a89-aa14-84199f790a58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b17ca724a6a44d39d895ba0c057af81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:27:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:27:52Z,use_quota=True,user_id='cc9180bd47174855a37e7360806a2ee7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)}" {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:27:52 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-615e3d78-6f28-430b-b84e-75d5f786919d tempest-VolumesTransfersV357Test-166835440 None] Creating volume 1638bd98-4f06-4a89-aa14-84199f790a58 {{(pid=86512) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:27:52 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-615e3d78-6f28-430b-b84e-75d5f786919d tempest-VolumesTransfersV357Test-166835440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:27:52 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-615e3d78-6f28-430b-b84e-75d5f786919d tempest-VolumesTransfersV357Test-166835440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:27:52 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-615e3d78-6f28-430b-b84e-75d5f786919d tempest-VolumesTransfersV357Test-166835440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:27:52 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-615e3d78-6f28-430b-b84e-75d5f786919d tempest-VolumesTransfersV357Test-166835440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:27:52 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-615e3d78-6f28-430b-b84e-75d5f786919d tempest-VolumesTransfersV357Test-166835440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:27:52 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-615e3d78-6f28-430b-b84e-75d5f786919d tempest-VolumesTransfersV357Test-166835440 None] Selected osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 as target Quobyte volume. {{(pid=86512) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:27:52 devstack cinder-volume[86512]: INFO cinder.volume.drivers.remotefs [None req-615e3d78-6f28-430b-b84e-75d5f786919d tempest-VolumesTransfersV357Test-166835440 None] casted to osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 Sep 29 18:27:52 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-615e3d78-6f28-430b-b84e-75d5f786919d tempest-VolumesTransfersV357Test-166835440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-1638bd98-4f06-4a89-aa14-84199f790a58 1073741824 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:27:52 devstack sudo[100153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-1638bd98-4f06-4a89-aa14-84199f790a58 1073741824 Sep 29 18:27:52 devstack sudo[100153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:27:52 devstack sudo[100150]: pam_unix(sudo:session): session closed for user root Sep 29 18:27:52 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-7aba0c61-86fd-4089-9b14-41af873d26ee tempest-VolumesGetTest-329956023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ae799204-4972-4597-8962-afa3c3fcf4c9" returned: 0 in 0.559s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:27:52 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-7aba0c61-86fd-4089-9b14-41af873d26ee tempest-VolumesGetTest-329956023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ae799204-4972-4597-8962-afa3c3fcf4c9 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:27:52 devstack sudo[100158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ae799204-4972-4597-8962-afa3c3fcf4c9 Sep 29 18:27:52 devstack sudo[100158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:27:52 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-b03dff78-03ca-4f23-acba-723b578e67cb tempest-ProjectReaderTests-1407326406 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86512) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:27:52 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-b03dff78-03ca-4f23-acba-723b578e67cb tempest-ProjectReaderTests-1407326406 None] Flow 'volume_create_manager' (fd1d1e92-e770-4688-9ae9-bbd45b9fc9a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:27:52 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-b03dff78-03ca-4f23-acba-723b578e67cb tempest-ProjectReaderTests-1407326406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6183387-53b6-44e1-9fc6-33a4a90c7f62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:27:52 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-b03dff78-03ca-4f23-acba-723b578e67cb tempest-ProjectReaderTests-1407326406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6183387-53b6-44e1-9fc6-33a4a90c7f62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:27:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1691777674',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf28aa17-b936-43ae-8553-6c9621bf99b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37030a2d8ef342a2bdf695a2d1b4070c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:27:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:27:52Z,use_quota=True,user_id='e7ce51fe312c45ffb8522e903e573610',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:27:52 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-b03dff78-03ca-4f23-acba-723b578e67cb tempest-ProjectReaderTests-1407326406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (caf06e45-ae93-44df-9527-0d2661bbf832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:27:52 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-b03dff78-03ca-4f23-acba-723b578e67cb tempest-ProjectReaderTests-1407326406 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (caf06e45-ae93-44df-9527-0d2661bbf832) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:27:52 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-b03dff78-03ca-4f23-acba-723b578e67cb tempest-ProjectReaderTests-1407326406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fce8134-b898-4bd5-9ea2-ffcc934ab09e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:27:52 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-b03dff78-03ca-4f23-acba-723b578e67cb tempest-ProjectReaderTests-1407326406 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fce8134-b898-4bd5-9ea2-ffcc934ab09e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf28aa17-b936-43ae-8553-6c9621bf99b2', 'volume_name': 'volume-bf28aa17-b936-43ae-8553-6c9621bf99b2', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:27:52 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-b03dff78-03ca-4f23-acba-723b578e67cb tempest-ProjectReaderTests-1407326406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b76c5b18-4c78-40c1-9292-660d3644ae4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:27:52 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-b03dff78-03ca-4f23-acba-723b578e67cb tempest-ProjectReaderTests-1407326406 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b76c5b18-4c78-40c1-9292-660d3644ae4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:27:52 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-b03dff78-03ca-4f23-acba-723b578e67cb tempest-ProjectReaderTests-1407326406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83d75696-80fc-4df2-8322-e5a2370fdeec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:27:52 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-b03dff78-03ca-4f23-acba-723b578e67cb tempest-ProjectReaderTests-1407326406 None] Volume bf28aa17-b936-43ae-8553-6c9621bf99b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf28aa17-b936-43ae-8553-6c9621bf99b2', 'volume_size': 1} Sep 29 18:27:52 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-b03dff78-03ca-4f23-acba-723b578e67cb tempest-ProjectReaderTests-1407326406 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:27:52 devstack sudo[100158]: pam_unix(sudo:session): session closed for user root Sep 29 18:27:52 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-7aba0c61-86fd-4089-9b14-41af873d26ee tempest-VolumesGetTest-329956023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ae799204-4972-4597-8962-afa3c3fcf4c9" returned: 0 in 0.297s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:27:52 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-7aba0c61-86fd-4089-9b14-41af873d26ee tempest-VolumesGetTest-329956023 None] Lock "cinder-quobyte-ae799204-4972-4597-8962-afa3c3fcf4c9" released by "delete_volume" :: held 0.957s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:27:52 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-7aba0c61-86fd-4089-9b14-41af873d26ee tempest-VolumesGetTest-329956023 None] Created reservations ['c4df371b-5ed6-4c15-b87a-2a470a33b02f', '79a9553a-9895-4be1-9189-4227dfd932e3', 'cf18b2a2-20c6-475f-abc0-3b5088667f56', 'affd06f9-8c0e-460c-bcd6-4d3ebbcb5d2d'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:27:52 devstack sudo[100153]: pam_unix(sudo:session): session closed for user root Sep 29 18:27:52 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-615e3d78-6f28-430b-b84e-75d5f786919d tempest-VolumesTransfersV357Test-166835440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-1638bd98-4f06-4a89-aa14-84199f790a58 1073741824" returned: 0 in 0.575s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:27:52 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-615e3d78-6f28-430b-b84e-75d5f786919d tempest-VolumesTransfersV357Test-166835440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-1638bd98-4f06-4a89-aa14-84199f790a58 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:27:52 devstack sudo[100165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-1638bd98-4f06-4a89-aa14-84199f790a58 Sep 29 18:27:52 devstack sudo[100165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:27:52 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-7aba0c61-86fd-4089-9b14-41af873d26ee tempest-VolumesGetTest-329956023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:27:52 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-7aba0c61-86fd-4089-9b14-41af873d26ee tempest-VolumesGetTest-329956023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:27:52 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-7aba0c61-86fd-4089-9b14-41af873d26ee tempest-VolumesGetTest-329956023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:27:52 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-7aba0c61-86fd-4089-9b14-41af873d26ee tempest-VolumesGetTest-329956023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:27:52 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-7aba0c61-86fd-4089-9b14-41af873d26ee tempest-VolumesGetTest-329956023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:27:52 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-7aba0c61-86fd-4089-9b14-41af873d26ee tempest-VolumesGetTest-329956023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:27:52 devstack sudo[100167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:27:52 devstack sudo[100167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:27:53 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-60dc8dd3-aac7-4f99-b9b7-f29e7a4e862a tempest-VolumesGetTest-329956023 None] Acquiring lock "cinder-6619482f-fc68-41f2-922a-007a40effc4d-delete_volume" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:27:53 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-60dc8dd3-aac7-4f99-b9b7-f29e7a4e862a tempest-VolumesGetTest-329956023 None] Lock "cinder-6619482f-fc68-41f2-922a-007a40effc4d-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:27:53 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-60dc8dd3-aac7-4f99-b9b7-f29e7a4e862a tempest-VolumesGetTest-329956023 None] Acquiring lock "cinder-quobyte-6619482f-fc68-41f2-922a-007a40effc4d" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:27:53 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-60dc8dd3-aac7-4f99-b9b7-f29e7a4e862a tempest-VolumesGetTest-329956023 None] Lock "cinder-quobyte-6619482f-fc68-41f2-922a-007a40effc4d" acquired by "delete_volume" :: waited 0.024s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:27:53 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f4d8578-5972-4519-a5eb-48c9798fcce5]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:27:53 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-60dc8dd3-aac7-4f99-b9b7-f29e7a4e862a tempest-VolumesGetTest-329956023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-6619482f-fc68-41f2-922a-007a40effc4d {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:27:53 devstack sudo[100167]: pam_unix(sudo:session): session closed for user root Sep 29 18:27:53 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-7aba0c61-86fd-4089-9b14-41af873d26ee tempest-VolumesGetTest-329956023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.311s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:27:53 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-7aba0c61-86fd-4089-9b14-41af873d26ee tempest-VolumesGetTest-329956023 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:27:53 devstack sudo[100165]: pam_unix(sudo:session): session closed for user root Sep 29 18:27:53 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-615e3d78-6f28-430b-b84e-75d5f786919d tempest-VolumesTransfersV357Test-166835440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-1638bd98-4f06-4a89-aa14-84199f790a58" returned: 0 in 0.405s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:27:53 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-615e3d78-6f28-430b-b84e-75d5f786919d tempest-VolumesTransfersV357Test-166835440 None] <== create_volume: return (1054ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'} {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:27:53 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-615e3d78-6f28-430b-b84e-75d5f786919d tempest-VolumesTransfersV357Test-166835440 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.059s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:27:53 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-7aba0c61-86fd-4089-9b14-41af873d26ee tempest-VolumesGetTest-329956023 None] Deleted volume successfully. Sep 29 18:27:53 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-b03dff78-03ca-4f23-acba-723b578e67cb tempest-ProjectReaderTests-1407326406 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.728s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:27:53 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-b03dff78-03ca-4f23-acba-723b578e67cb tempest-ProjectReaderTests-1407326406 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:27:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1691777674',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf28aa17-b936-43ae-8553-6c9621bf99b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37030a2d8ef342a2bdf695a2d1b4070c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:27:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:27:52Z,use_quota=True,user_id='e7ce51fe312c45ffb8522e903e573610',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)}" {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:27:53 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-b03dff78-03ca-4f23-acba-723b578e67cb tempest-ProjectReaderTests-1407326406 None] Creating volume bf28aa17-b936-43ae-8553-6c9621bf99b2 {{(pid=86512) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:27:53 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-b03dff78-03ca-4f23-acba-723b578e67cb tempest-ProjectReaderTests-1407326406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:27:53 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-b03dff78-03ca-4f23-acba-723b578e67cb tempest-ProjectReaderTests-1407326406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:27:53 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-b03dff78-03ca-4f23-acba-723b578e67cb tempest-ProjectReaderTests-1407326406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:27:53 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-b03dff78-03ca-4f23-acba-723b578e67cb tempest-ProjectReaderTests-1407326406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:27:53 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-b03dff78-03ca-4f23-acba-723b578e67cb tempest-ProjectReaderTests-1407326406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:27:53 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-b03dff78-03ca-4f23-acba-723b578e67cb tempest-ProjectReaderTests-1407326406 None] Selected osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 as target Quobyte volume. {{(pid=86512) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:27:53 devstack cinder-volume[86512]: INFO cinder.volume.drivers.remotefs [None req-b03dff78-03ca-4f23-acba-723b578e67cb tempest-ProjectReaderTests-1407326406 None] casted to osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 Sep 29 18:27:53 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-b03dff78-03ca-4f23-acba-723b578e67cb tempest-ProjectReaderTests-1407326406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-bf28aa17-b936-43ae-8553-6c9621bf99b2 1073741824 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:27:53 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-615e3d78-6f28-430b-b84e-75d5f786919d tempest-VolumesTransfersV357Test-166835440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4762e782-54f7-443c-a778-02940eefd7f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1638bd98-4f06-4a89-aa14-84199f790a58', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:27:53 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-615e3d78-6f28-430b-b84e-75d5f786919d tempest-VolumesTransfersV357Test-166835440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd574cc1-238b-4dd7-8401-71947657685a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:27:53 devstack sudo[100172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-bf28aa17-b936-43ae-8553-6c9621bf99b2 1073741824 Sep 29 18:27:53 devstack sudo[100172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:27:53 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-615e3d78-6f28-430b-b84e-75d5f786919d tempest-VolumesTransfersV357Test-166835440 None] Volume volume-1638bd98-4f06-4a89-aa14-84199f790a58 (1638bd98-4f06-4a89-aa14-84199f790a58): created successfully Sep 29 18:27:53 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-615e3d78-6f28-430b-b84e-75d5f786919d tempest-VolumesTransfersV357Test-166835440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd574cc1-238b-4dd7-8401-71947657685a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:27:53 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-615e3d78-6f28-430b-b84e-75d5f786919d tempest-VolumesTransfersV357Test-166835440 None] Flow 'volume_create_manager' (84832028-b43e-4978-89fd-f68eb5a49eef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:27:53 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-7aba0c61-86fd-4089-9b14-41af873d26ee tempest-VolumesGetTest-329956023 None] Lock "cinder-ae799204-4972-4597-8962-afa3c3fcf4c9-delete_volume" released by "delete_volume" :: held 1.691s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:27:53 devstack sudo[100171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-6619482f-fc68-41f2-922a-007a40effc4d Sep 29 18:27:53 devstack sudo[100171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:27:53 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-615e3d78-6f28-430b-b84e-75d5f786919d tempest-VolumesTransfersV357Test-166835440 None] Created volume successfully. Sep 29 18:27:53 devstack sudo[100171]: pam_unix(sudo:session): session closed for user root Sep 29 18:27:53 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-60dc8dd3-aac7-4f99-b9b7-f29e7a4e862a tempest-VolumesGetTest-329956023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-6619482f-fc68-41f2-922a-007a40effc4d" returned: 0 in 0.452s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:27:53 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-60dc8dd3-aac7-4f99-b9b7-f29e7a4e862a tempest-VolumesGetTest-329956023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-6619482f-fc68-41f2-922a-007a40effc4d {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:27:53 devstack sudo[100183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-6619482f-fc68-41f2-922a-007a40effc4d Sep 29 18:27:53 devstack sudo[100183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:27:53 devstack sudo[100172]: pam_unix(sudo:session): session closed for user root Sep 29 18:27:53 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-b03dff78-03ca-4f23-acba-723b578e67cb tempest-ProjectReaderTests-1407326406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-bf28aa17-b936-43ae-8553-6c9621bf99b2 1073741824" returned: 0 in 0.538s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:27:53 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-b03dff78-03ca-4f23-acba-723b578e67cb tempest-ProjectReaderTests-1407326406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-bf28aa17-b936-43ae-8553-6c9621bf99b2 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:27:53 devstack sudo[100185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-bf28aa17-b936-43ae-8553-6c9621bf99b2 Sep 29 18:27:53 devstack sudo[100185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:27:53 devstack sudo[100183]: pam_unix(sudo:session): session closed for user root Sep 29 18:27:53 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-60dc8dd3-aac7-4f99-b9b7-f29e7a4e862a tempest-VolumesGetTest-329956023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-6619482f-fc68-41f2-922a-007a40effc4d" returned: 0 in 0.262s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:27:53 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-60dc8dd3-aac7-4f99-b9b7-f29e7a4e862a tempest-VolumesGetTest-329956023 None] Lock "cinder-quobyte-6619482f-fc68-41f2-922a-007a40effc4d" released by "delete_volume" :: held 0.772s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:27:53 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-60dc8dd3-aac7-4f99-b9b7-f29e7a4e862a tempest-VolumesGetTest-329956023 None] Created reservations ['ba82ccbd-dbf8-4545-84b5-418c5b3b50a8', 'e8799b0c-e924-4ee9-b5ef-ac0baaa1add5', '84c4c281-8ef6-40d1-ba83-f1357c0828d4', '159a3558-fec0-40c4-9bee-6e0bbb627bd2'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:27:54 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-60dc8dd3-aac7-4f99-b9b7-f29e7a4e862a tempest-VolumesGetTest-329956023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:27:54 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-60dc8dd3-aac7-4f99-b9b7-f29e7a4e862a tempest-VolumesGetTest-329956023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:27:54 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-60dc8dd3-aac7-4f99-b9b7-f29e7a4e862a tempest-VolumesGetTest-329956023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:27:54 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-60dc8dd3-aac7-4f99-b9b7-f29e7a4e862a tempest-VolumesGetTest-329956023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:27:54 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-60dc8dd3-aac7-4f99-b9b7-f29e7a4e862a tempest-VolumesGetTest-329956023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:27:54 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-60dc8dd3-aac7-4f99-b9b7-f29e7a4e862a tempest-VolumesGetTest-329956023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:27:54 devstack sudo[100189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:27:54 devstack sudo[100189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:27:54 devstack sudo[100185]: pam_unix(sudo:session): session closed for user root Sep 29 18:27:54 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-b03dff78-03ca-4f23-acba-723b578e67cb tempest-ProjectReaderTests-1407326406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-bf28aa17-b936-43ae-8553-6c9621bf99b2" returned: 0 in 0.291s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:27:54 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-b03dff78-03ca-4f23-acba-723b578e67cb tempest-ProjectReaderTests-1407326406 None] <== create_volume: return (884ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'} {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:27:54 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-b03dff78-03ca-4f23-acba-723b578e67cb tempest-ProjectReaderTests-1407326406 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.887s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:27:54 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-b03dff78-03ca-4f23-acba-723b578e67cb tempest-ProjectReaderTests-1407326406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83d75696-80fc-4df2-8322-e5a2370fdeec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf28aa17-b936-43ae-8553-6c9621bf99b2', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:27:54 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-b03dff78-03ca-4f23-acba-723b578e67cb tempest-ProjectReaderTests-1407326406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86efe145-ec49-4fec-ab47-7f194b16f74c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:27:54 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-b03dff78-03ca-4f23-acba-723b578e67cb tempest-ProjectReaderTests-1407326406 None] Volume volume-bf28aa17-b936-43ae-8553-6c9621bf99b2 (bf28aa17-b936-43ae-8553-6c9621bf99b2): created successfully Sep 29 18:27:54 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-b03dff78-03ca-4f23-acba-723b578e67cb tempest-ProjectReaderTests-1407326406 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86efe145-ec49-4fec-ab47-7f194b16f74c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:27:54 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-b03dff78-03ca-4f23-acba-723b578e67cb tempest-ProjectReaderTests-1407326406 None] Flow 'volume_create_manager' (fd1d1e92-e770-4688-9ae9-bbd45b9fc9a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:27:54 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-b03dff78-03ca-4f23-acba-723b578e67cb tempest-ProjectReaderTests-1407326406 None] Created volume successfully. Sep 29 18:27:54 devstack sudo[100189]: pam_unix(sudo:session): session closed for user root Sep 29 18:27:54 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-60dc8dd3-aac7-4f99-b9b7-f29e7a4e862a tempest-VolumesGetTest-329956023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.360s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:27:54 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-60dc8dd3-aac7-4f99-b9b7-f29e7a4e862a tempest-VolumesGetTest-329956023 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:27:54 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-60dc8dd3-aac7-4f99-b9b7-f29e7a4e862a tempest-VolumesGetTest-329956023 None] Deleted volume successfully. Sep 29 18:27:54 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-60dc8dd3-aac7-4f99-b9b7-f29e7a4e862a tempest-VolumesGetTest-329956023 None] Lock "cinder-6619482f-fc68-41f2-922a-007a40effc4d-delete_volume" released by "delete_volume" :: held 1.425s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:27:54 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-68307069-6aaa-4957-9106-643894cc2da6 tempest-VolumesGetTest-329956023 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86512) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:27:54 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-68307069-6aaa-4957-9106-643894cc2da6 tempest-VolumesGetTest-329956023 None] Flow 'volume_create_manager' (bbd0c2ee-1b6e-4a29-b4eb-0d6234ec8539) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:27:54 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-68307069-6aaa-4957-9106-643894cc2da6 tempest-VolumesGetTest-329956023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (991cf2de-2979-4815-8f8b-6e5f9b983255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:27:54 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-68307069-6aaa-4957-9106-643894cc2da6 tempest-VolumesGetTest-329956023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (991cf2de-2979-4815-8f8b-6e5f9b983255) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:27:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-795159776',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a307d519-1974-4ac1-8d2d-f0890bf2a944,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='123ca1c819ab4c939d34d15531ec218c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:27:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:27:55Z,use_quota=True,user_id='d4b8a389e95e4820826e3c19485b4a7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:27:54 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-68307069-6aaa-4957-9106-643894cc2da6 tempest-VolumesGetTest-329956023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c894c03-cbb2-4be3-9d34-37f2dbea052c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:27:54 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-68307069-6aaa-4957-9106-643894cc2da6 tempest-VolumesGetTest-329956023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c894c03-cbb2-4be3-9d34-37f2dbea052c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:27:54 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-68307069-6aaa-4957-9106-643894cc2da6 tempest-VolumesGetTest-329956023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b0e107c-725c-4a28-902e-366b4ed8c41c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:27:54 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-68307069-6aaa-4957-9106-643894cc2da6 tempest-VolumesGetTest-329956023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b0e107c-725c-4a28-902e-366b4ed8c41c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a307d519-1974-4ac1-8d2d-f0890bf2a944', 'volume_name': 'volume-a307d519-1974-4ac1-8d2d-f0890bf2a944', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:27:54 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-68307069-6aaa-4957-9106-643894cc2da6 tempest-VolumesGetTest-329956023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ce63ed6-cf6d-4bbd-9781-fde89de42ae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:27:54 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-68307069-6aaa-4957-9106-643894cc2da6 tempest-VolumesGetTest-329956023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ce63ed6-cf6d-4bbd-9781-fde89de42ae3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:27:54 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-68307069-6aaa-4957-9106-643894cc2da6 tempest-VolumesGetTest-329956023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77b58490-908c-4874-96dc-9de566c751bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:27:54 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-68307069-6aaa-4957-9106-643894cc2da6 tempest-VolumesGetTest-329956023 None] Volume a307d519-1974-4ac1-8d2d-f0890bf2a944: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a307d519-1974-4ac1-8d2d-f0890bf2a944', 'volume_size': 1} Sep 29 18:27:54 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-68307069-6aaa-4957-9106-643894cc2da6 tempest-VolumesGetTest-329956023 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:27:54 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-68307069-6aaa-4957-9106-643894cc2da6 tempest-VolumesGetTest-329956023 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:27:54 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-68307069-6aaa-4957-9106-643894cc2da6 tempest-VolumesGetTest-329956023 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:27:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-795159776',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a307d519-1974-4ac1-8d2d-f0890bf2a944,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='123ca1c819ab4c939d34d15531ec218c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:27:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:27:55Z,use_quota=True,user_id='d4b8a389e95e4820826e3c19485b4a7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)}" {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:27:54 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-68307069-6aaa-4957-9106-643894cc2da6 tempest-VolumesGetTest-329956023 None] Creating volume a307d519-1974-4ac1-8d2d-f0890bf2a944 {{(pid=86512) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:27:54 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-68307069-6aaa-4957-9106-643894cc2da6 tempest-VolumesGetTest-329956023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:27:54 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-68307069-6aaa-4957-9106-643894cc2da6 tempest-VolumesGetTest-329956023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:27:54 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-68307069-6aaa-4957-9106-643894cc2da6 tempest-VolumesGetTest-329956023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:27:54 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-68307069-6aaa-4957-9106-643894cc2da6 tempest-VolumesGetTest-329956023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:27:54 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-68307069-6aaa-4957-9106-643894cc2da6 tempest-VolumesGetTest-329956023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:27:54 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-68307069-6aaa-4957-9106-643894cc2da6 tempest-VolumesGetTest-329956023 None] Selected osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 as target Quobyte volume. {{(pid=86512) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:27:54 devstack cinder-volume[86512]: INFO cinder.volume.drivers.remotefs [None req-68307069-6aaa-4957-9106-643894cc2da6 tempest-VolumesGetTest-329956023 None] casted to osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 Sep 29 18:27:54 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-68307069-6aaa-4957-9106-643894cc2da6 tempest-VolumesGetTest-329956023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a307d519-1974-4ac1-8d2d-f0890bf2a944 1073741824 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:27:54 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-c26c31a9-037d-460b-b66e-eaccd33ee884 tempest-ProjectReaderTests-1407326406 None] Acquiring lock "cinder-bf28aa17-b936-43ae-8553-6c9621bf99b2-delete_volume" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:27:54 devstack sudo[100193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a307d519-1974-4ac1-8d2d-f0890bf2a944 1073741824 Sep 29 18:27:54 devstack sudo[100193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:27:54 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-c26c31a9-037d-460b-b66e-eaccd33ee884 tempest-ProjectReaderTests-1407326406 None] Lock "cinder-bf28aa17-b936-43ae-8553-6c9621bf99b2-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:27:55 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-c26c31a9-037d-460b-b66e-eaccd33ee884 tempest-ProjectReaderTests-1407326406 None] Acquiring lock "cinder-quobyte-bf28aa17-b936-43ae-8553-6c9621bf99b2" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:27:55 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-c26c31a9-037d-460b-b66e-eaccd33ee884 tempest-ProjectReaderTests-1407326406 None] Lock "cinder-quobyte-bf28aa17-b936-43ae-8553-6c9621bf99b2" acquired by "delete_volume" :: waited 0.022s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:27:55 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e960056-bd6a-41b8-8cff-0ee1cb1efd73]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:27:55 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-c26c31a9-037d-460b-b66e-eaccd33ee884 tempest-ProjectReaderTests-1407326406 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-bf28aa17-b936-43ae-8553-6c9621bf99b2 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:27:55 devstack sudo[100195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-bf28aa17-b936-43ae-8553-6c9621bf99b2 Sep 29 18:27:55 devstack sudo[100195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:27:55 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-0eaea213-7661-4962-9525-044567456ff2 tempest-VolumesTransfersV357Test-1987236996 None] Transfer volume completed successfully. Sep 29 18:27:55 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-41a9a1c5-f313-4bd5-9c9d-1ae2487d20c5 tempest-GroupsV314Test-111535998 None] Group tempest-GroupsV314Test-Group-973834833: creating Sep 29 18:27:55 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-41a9a1c5-f313-4bd5-9c9d-1ae2487d20c5 tempest-GroupsV314Test-111535998 None] Group tempest-GroupsV314Test-Group-973834833: created successfully Sep 29 18:27:55 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-41a9a1c5-f313-4bd5-9c9d-1ae2487d20c5 tempest-GroupsV314Test-111535998 None] Create group completed successfully. Sep 29 18:27:55 devstack sudo[100193]: pam_unix(sudo:session): session closed for user root Sep 29 18:27:55 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-68307069-6aaa-4957-9106-643894cc2da6 tempest-VolumesGetTest-329956023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a307d519-1974-4ac1-8d2d-f0890bf2a944 1073741824" returned: 0 in 0.614s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:27:55 devstack sudo[100195]: pam_unix(sudo:session): session closed for user root Sep 29 18:27:55 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-c26c31a9-037d-460b-b66e-eaccd33ee884 tempest-ProjectReaderTests-1407326406 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-bf28aa17-b936-43ae-8553-6c9621bf99b2" returned: 0 in 0.486s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:27:55 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-c26c31a9-037d-460b-b66e-eaccd33ee884 tempest-ProjectReaderTests-1407326406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-bf28aa17-b936-43ae-8553-6c9621bf99b2 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:27:55 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-68307069-6aaa-4957-9106-643894cc2da6 tempest-VolumesGetTest-329956023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a307d519-1974-4ac1-8d2d-f0890bf2a944 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:27:55 devstack sudo[100205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-bf28aa17-b936-43ae-8553-6c9621bf99b2 Sep 29 18:27:55 devstack sudo[100205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:27:55 devstack sudo[100206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a307d519-1974-4ac1-8d2d-f0890bf2a944 Sep 29 18:27:55 devstack sudo[100206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:27:55 devstack sudo[100206]: pam_unix(sudo:session): session closed for user root Sep 29 18:27:55 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-68307069-6aaa-4957-9106-643894cc2da6 tempest-VolumesGetTest-329956023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a307d519-1974-4ac1-8d2d-f0890bf2a944" returned: 0 in 0.276s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:27:55 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-68307069-6aaa-4957-9106-643894cc2da6 tempest-VolumesGetTest-329956023 None] <== create_volume: return (951ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'} {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:27:55 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-68307069-6aaa-4957-9106-643894cc2da6 tempest-VolumesGetTest-329956023 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.953s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:27:55 devstack sudo[100205]: pam_unix(sudo:session): session closed for user root Sep 29 18:27:55 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-68307069-6aaa-4957-9106-643894cc2da6 tempest-VolumesGetTest-329956023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77b58490-908c-4874-96dc-9de566c751bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a307d519-1974-4ac1-8d2d-f0890bf2a944', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:27:55 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-68307069-6aaa-4957-9106-643894cc2da6 tempest-VolumesGetTest-329956023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea161e84-aa8a-438f-9908-006913f2407f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:27:55 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-c26c31a9-037d-460b-b66e-eaccd33ee884 tempest-ProjectReaderTests-1407326406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-bf28aa17-b936-43ae-8553-6c9621bf99b2" returned: 0 in 0.311s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:27:55 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-c26c31a9-037d-460b-b66e-eaccd33ee884 tempest-ProjectReaderTests-1407326406 None] Lock "cinder-quobyte-bf28aa17-b936-43ae-8553-6c9621bf99b2" released by "delete_volume" :: held 0.861s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:27:55 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-68307069-6aaa-4957-9106-643894cc2da6 tempest-VolumesGetTest-329956023 None] Volume volume-a307d519-1974-4ac1-8d2d-f0890bf2a944 (a307d519-1974-4ac1-8d2d-f0890bf2a944): created successfully Sep 29 18:27:55 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-68307069-6aaa-4957-9106-643894cc2da6 tempest-VolumesGetTest-329956023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea161e84-aa8a-438f-9908-006913f2407f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:27:55 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-68307069-6aaa-4957-9106-643894cc2da6 tempest-VolumesGetTest-329956023 None] Flow 'volume_create_manager' (bbd0c2ee-1b6e-4a29-b4eb-0d6234ec8539) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:27:55 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-68307069-6aaa-4957-9106-643894cc2da6 tempest-VolumesGetTest-329956023 None] Created volume successfully. Sep 29 18:27:55 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-c26c31a9-037d-460b-b66e-eaccd33ee884 tempest-ProjectReaderTests-1407326406 None] Created reservations ['790e1a9d-42cc-46ce-8552-94fd3be041e2', '571c84ca-9a62-4a3c-920f-4e121a30bdd8', '234424c4-99f7-49f8-a59e-dff5dafabe85', '8e21282a-e2d9-4c64-a2a3-83e7ecaef84e'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:27:56 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-c26c31a9-037d-460b-b66e-eaccd33ee884 tempest-ProjectReaderTests-1407326406 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:27:56 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-c26c31a9-037d-460b-b66e-eaccd33ee884 tempest-ProjectReaderTests-1407326406 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:27:56 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-c26c31a9-037d-460b-b66e-eaccd33ee884 tempest-ProjectReaderTests-1407326406 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:27:56 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-c26c31a9-037d-460b-b66e-eaccd33ee884 tempest-ProjectReaderTests-1407326406 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:27:56 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-c26c31a9-037d-460b-b66e-eaccd33ee884 tempest-ProjectReaderTests-1407326406 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:27:56 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-c26c31a9-037d-460b-b66e-eaccd33ee884 tempest-ProjectReaderTests-1407326406 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:27:56 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-758e3a0c-ff6f-4883-a312-ab94dfffd1c8 tempest-VolumesTransfersV357Test-1380990303 None] Acquiring lock "cinder-1638bd98-4f06-4a89-aa14-84199f790a58-delete_volume" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:27:56 devstack sudo[100217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:27:56 devstack sudo[100217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:27:56 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-758e3a0c-ff6f-4883-a312-ab94dfffd1c8 tempest-VolumesTransfersV357Test-1380990303 None] Lock "cinder-1638bd98-4f06-4a89-aa14-84199f790a58-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:27:56 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-758e3a0c-ff6f-4883-a312-ab94dfffd1c8 tempest-VolumesTransfersV357Test-1380990303 None] Acquiring lock "cinder-quobyte-1638bd98-4f06-4a89-aa14-84199f790a58" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:27:56 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-758e3a0c-ff6f-4883-a312-ab94dfffd1c8 tempest-VolumesTransfersV357Test-1380990303 None] Lock "cinder-quobyte-1638bd98-4f06-4a89-aa14-84199f790a58" acquired by "delete_volume" :: waited 0.023s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:27:56 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff041921-60e2-4010-9481-af8f5d4b471a]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:27:56 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-758e3a0c-ff6f-4883-a312-ab94dfffd1c8 tempest-VolumesTransfersV357Test-1380990303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-1638bd98-4f06-4a89-aa14-84199f790a58 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:27:56 devstack sudo[100219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-1638bd98-4f06-4a89-aa14-84199f790a58 Sep 29 18:27:56 devstack sudo[100219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:27:56 devstack sudo[100217]: pam_unix(sudo:session): session closed for user root Sep 29 18:27:56 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-c26c31a9-037d-460b-b66e-eaccd33ee884 tempest-ProjectReaderTests-1407326406 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.272s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:27:56 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-c26c31a9-037d-460b-b66e-eaccd33ee884 tempest-ProjectReaderTests-1407326406 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:27:56 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-c26c31a9-037d-460b-b66e-eaccd33ee884 tempest-ProjectReaderTests-1407326406 None] Deleted volume successfully. Sep 29 18:27:56 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-c26c31a9-037d-460b-b66e-eaccd33ee884 tempest-ProjectReaderTests-1407326406 None] Lock "cinder-bf28aa17-b936-43ae-8553-6c9621bf99b2-delete_volume" released by "delete_volume" :: held 1.365s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:27:56 devstack sudo[100219]: pam_unix(sudo:session): session closed for user root Sep 29 18:27:56 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-758e3a0c-ff6f-4883-a312-ab94dfffd1c8 tempest-VolumesTransfersV357Test-1380990303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-1638bd98-4f06-4a89-aa14-84199f790a58" returned: 0 in 0.414s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:27:56 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-758e3a0c-ff6f-4883-a312-ab94dfffd1c8 tempest-VolumesTransfersV357Test-1380990303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-1638bd98-4f06-4a89-aa14-84199f790a58 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:27:56 devstack sudo[100225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-1638bd98-4f06-4a89-aa14-84199f790a58 Sep 29 18:27:56 devstack sudo[100225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:27:56 devstack sudo[100225]: pam_unix(sudo:session): session closed for user root Sep 29 18:27:56 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-758e3a0c-ff6f-4883-a312-ab94dfffd1c8 tempest-VolumesTransfersV357Test-1380990303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-1638bd98-4f06-4a89-aa14-84199f790a58" returned: 0 in 0.278s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:27:56 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-758e3a0c-ff6f-4883-a312-ab94dfffd1c8 tempest-VolumesTransfersV357Test-1380990303 None] Lock "cinder-quobyte-1638bd98-4f06-4a89-aa14-84199f790a58" released by "delete_volume" :: held 0.754s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:27:56 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-758e3a0c-ff6f-4883-a312-ab94dfffd1c8 tempest-VolumesTransfersV357Test-1380990303 None] Created reservations ['4500aedf-5c71-45cc-9637-c7e722f6b1d9', '315dcf6e-9691-4ce6-8591-cb4612d51577', 'b49bfcf4-ba44-4aee-a33b-62aac455995c', 'd42cb406-aad4-4be7-b5ed-55f7e8b1f64a'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:27:57 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-758e3a0c-ff6f-4883-a312-ab94dfffd1c8 tempest-VolumesTransfersV357Test-1380990303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:27:57 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-758e3a0c-ff6f-4883-a312-ab94dfffd1c8 tempest-VolumesTransfersV357Test-1380990303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:27:57 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-758e3a0c-ff6f-4883-a312-ab94dfffd1c8 tempest-VolumesTransfersV357Test-1380990303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:27:57 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-758e3a0c-ff6f-4883-a312-ab94dfffd1c8 tempest-VolumesTransfersV357Test-1380990303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:27:57 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-758e3a0c-ff6f-4883-a312-ab94dfffd1c8 tempest-VolumesTransfersV357Test-1380990303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:27:57 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-758e3a0c-ff6f-4883-a312-ab94dfffd1c8 tempest-VolumesTransfersV357Test-1380990303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:27:57 devstack sudo[100228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:27:57 devstack sudo[100228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:27:57 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-01f0a946-e60e-4f4f-8af9-a614d559c9d7 tempest-GroupsV314Test-111535998 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86512) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:27:57 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-01f0a946-e60e-4f4f-8af9-a614d559c9d7 tempest-GroupsV314Test-111535998 None] Flow 'volume_create_manager' (ac6c503c-5867-4e28-bc12-8737e9643fb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:27:57 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-01f0a946-e60e-4f4f-8af9-a614d559c9d7 tempest-GroupsV314Test-111535998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7fdb1cd-0ee3-4e3a-b54a-1f01033847c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:27:57 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-01f0a946-e60e-4f4f-8af9-a614d559c9d7 tempest-GroupsV314Test-111535998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7fdb1cd-0ee3-4e3a-b54a-1f01033847c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:27:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1123276484',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ae067326-99ad-46d6-a9b9-5b150c7af932,host='devstack@QuobyteHD#QuobyteHD',id=fbd993d0-1882-497f-bb62-defc4dd5de0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef715aec297c4be4b39aa767a6b1a671',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:27:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:27:57Z,use_quota=True,user_id='abe0bd8be32047f0a2cdc330b30d015d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3bac2111-d46d-432b-85db-19657d55b608),volume_type_id=3bac2111-d46d-432b-85db-19657d55b608)' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:27:57 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-01f0a946-e60e-4f4f-8af9-a614d559c9d7 tempest-GroupsV314Test-111535998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f43ee9b1-04d8-4c9c-9b5a-af5179c53b57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:27:57 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-01f0a946-e60e-4f4f-8af9-a614d559c9d7 tempest-GroupsV314Test-111535998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f43ee9b1-04d8-4c9c-9b5a-af5179c53b57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:27:57 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-01f0a946-e60e-4f4f-8af9-a614d559c9d7 tempest-GroupsV314Test-111535998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e1d7364-47ef-44ed-b3f4-ba5ed8681cf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:27:57 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-01f0a946-e60e-4f4f-8af9-a614d559c9d7 tempest-GroupsV314Test-111535998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e1d7364-47ef-44ed-b3f4-ba5ed8681cf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fbd993d0-1882-497f-bb62-defc4dd5de0b', 'volume_name': 'volume-fbd993d0-1882-497f-bb62-defc4dd5de0b', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:27:57 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-01f0a946-e60e-4f4f-8af9-a614d559c9d7 tempest-GroupsV314Test-111535998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12943b96-f6fd-4572-94b9-768e63b1ac98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:27:57 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-01f0a946-e60e-4f4f-8af9-a614d559c9d7 tempest-GroupsV314Test-111535998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12943b96-f6fd-4572-94b9-768e63b1ac98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:27:57 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-01f0a946-e60e-4f4f-8af9-a614d559c9d7 tempest-GroupsV314Test-111535998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7af61afc-a10f-4ab3-9233-4474b19b2aeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:27:57 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-01f0a946-e60e-4f4f-8af9-a614d559c9d7 tempest-GroupsV314Test-111535998 None] Volume fbd993d0-1882-497f-bb62-defc4dd5de0b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fbd993d0-1882-497f-bb62-defc4dd5de0b', 'volume_size': 1} Sep 29 18:27:57 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-01f0a946-e60e-4f4f-8af9-a614d559c9d7 tempest-GroupsV314Test-111535998 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:27:57 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-01f0a946-e60e-4f4f-8af9-a614d559c9d7 tempest-GroupsV314Test-111535998 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:27:57 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-01f0a946-e60e-4f4f-8af9-a614d559c9d7 tempest-GroupsV314Test-111535998 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=ae067326-99ad-46d6-a9b9-5b150c7af932,created_at=2026-09-29T16:27:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1123276484',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ae067326-99ad-46d6-a9b9-5b150c7af932,host='devstack@QuobyteHD#QuobyteHD',id=fbd993d0-1882-497f-bb62-defc4dd5de0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef715aec297c4be4b39aa767a6b1a671',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:27:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:27:57Z,use_quota=True,user_id='abe0bd8be32047f0a2cdc330b30d015d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3bac2111-d46d-432b-85db-19657d55b608),volume_type_id=3bac2111-d46d-432b-85db-19657d55b608)}" {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:27:57 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-01f0a946-e60e-4f4f-8af9-a614d559c9d7 tempest-GroupsV314Test-111535998 None] Creating volume fbd993d0-1882-497f-bb62-defc4dd5de0b {{(pid=86512) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:27:57 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-01f0a946-e60e-4f4f-8af9-a614d559c9d7 tempest-GroupsV314Test-111535998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:27:57 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-01f0a946-e60e-4f4f-8af9-a614d559c9d7 tempest-GroupsV314Test-111535998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:27:57 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-01f0a946-e60e-4f4f-8af9-a614d559c9d7 tempest-GroupsV314Test-111535998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:27:57 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-01f0a946-e60e-4f4f-8af9-a614d559c9d7 tempest-GroupsV314Test-111535998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:27:57 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-01f0a946-e60e-4f4f-8af9-a614d559c9d7 tempest-GroupsV314Test-111535998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:27:57 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-01f0a946-e60e-4f4f-8af9-a614d559c9d7 tempest-GroupsV314Test-111535998 None] Selected osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 as target Quobyte volume. {{(pid=86512) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:27:57 devstack cinder-volume[86512]: INFO cinder.volume.drivers.remotefs [None req-01f0a946-e60e-4f4f-8af9-a614d559c9d7 tempest-GroupsV314Test-111535998 None] casted to osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 Sep 29 18:27:57 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-01f0a946-e60e-4f4f-8af9-a614d559c9d7 tempest-GroupsV314Test-111535998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fbd993d0-1882-497f-bb62-defc4dd5de0b 1073741824 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:27:57 devstack sudo[100230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fbd993d0-1882-497f-bb62-defc4dd5de0b 1073741824 Sep 29 18:27:57 devstack sudo[100230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:27:57 devstack sudo[100228]: pam_unix(sudo:session): session closed for user root Sep 29 18:27:57 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-758e3a0c-ff6f-4883-a312-ab94dfffd1c8 tempest-VolumesTransfersV357Test-1380990303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.443s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:27:57 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-758e3a0c-ff6f-4883-a312-ab94dfffd1c8 tempest-VolumesTransfersV357Test-1380990303 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:27:57 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-758e3a0c-ff6f-4883-a312-ab94dfffd1c8 tempest-VolumesTransfersV357Test-1380990303 None] Deleted volume successfully. Sep 29 18:27:57 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-758e3a0c-ff6f-4883-a312-ab94dfffd1c8 tempest-VolumesTransfersV357Test-1380990303 None] Lock "cinder-1638bd98-4f06-4a89-aa14-84199f790a58-delete_volume" released by "delete_volume" :: held 1.552s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:27:57 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-91ff8cf3-473c-44a9-b8e2-c45805eb7247 tempest-VolumesGetTest-329956023 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86512) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:27:57 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-91ff8cf3-473c-44a9-b8e2-c45805eb7247 tempest-VolumesGetTest-329956023 None] Flow 'volume_create_manager' (4d03ee2b-dd09-4f76-bbca-6504af76f8de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:27:57 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-91ff8cf3-473c-44a9-b8e2-c45805eb7247 tempest-VolumesGetTest-329956023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f40f0633-4ef4-49ec-bba5-c21a7e810b4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:27:57 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-91ff8cf3-473c-44a9-b8e2-c45805eb7247 tempest-VolumesGetTest-329956023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f40f0633-4ef4-49ec-bba5-c21a7e810b4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:27:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-145947125',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef879903-8e61-496a-9d41-0cebc74826c2,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='123ca1c819ab4c939d34d15531ec218c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:27:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=a307d519-1974-4ac1-8d2d-f0890bf2a944,status='creating',terminated_at=None,updated_at=2026-09-29T16:27:58Z,use_quota=True,user_id='d4b8a389e95e4820826e3c19485b4a7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:27:57 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-91ff8cf3-473c-44a9-b8e2-c45805eb7247 tempest-VolumesGetTest-329956023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7693feba-d8db-452f-87f2-9840e3da27af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:27:57 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-91ff8cf3-473c-44a9-b8e2-c45805eb7247 tempest-VolumesGetTest-329956023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7693feba-d8db-452f-87f2-9840e3da27af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:27:57 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-91ff8cf3-473c-44a9-b8e2-c45805eb7247 tempest-VolumesGetTest-329956023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (884460a4-7da2-4ee8-b922-51f54f820931) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:27:57 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-91ff8cf3-473c-44a9-b8e2-c45805eb7247 tempest-VolumesGetTest-329956023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (884460a4-7da2-4ee8-b922-51f54f820931) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'ef879903-8e61-496a-9d41-0cebc74826c2', 'volume_name': 'volume-ef879903-8e61-496a-9d41-0cebc74826c2', 'volume_size': 1, 'source_volid': 'a307d519-1974-4ac1-8d2d-f0890bf2a944', 'source_volstatus': 'available'}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:27:57 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-91ff8cf3-473c-44a9-b8e2-c45805eb7247 tempest-VolumesGetTest-329956023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e54dc21d-f253-4747-93cf-ade5afd4ecb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:27:57 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-91ff8cf3-473c-44a9-b8e2-c45805eb7247 tempest-VolumesGetTest-329956023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e54dc21d-f253-4747-93cf-ade5afd4ecb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:27:57 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-91ff8cf3-473c-44a9-b8e2-c45805eb7247 tempest-VolumesGetTest-329956023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5276ed31-2d84-4f11-ab0c-fabca9bab06c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:27:57 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-91ff8cf3-473c-44a9-b8e2-c45805eb7247 tempest-VolumesGetTest-329956023 None] Volume ef879903-8e61-496a-9d41-0cebc74826c2: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-ef879903-8e61-496a-9d41-0cebc74826c2', 'volume_size': 1, 'source_volid': 'a307d519-1974-4ac1-8d2d-f0890bf2a944', 'source_volstatus': 'available'} Sep 29 18:27:58 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-91ff8cf3-473c-44a9-b8e2-c45805eb7247 tempest-VolumesGetTest-329956023 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:27:58 devstack sudo[100230]: pam_unix(sudo:session): session closed for user root Sep 29 18:27:58 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-01f0a946-e60e-4f4f-8af9-a614d559c9d7 tempest-GroupsV314Test-111535998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fbd993d0-1882-497f-bb62-defc4dd5de0b 1073741824" returned: 0 in 0.676s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:27:58 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-01f0a946-e60e-4f4f-8af9-a614d559c9d7 tempest-GroupsV314Test-111535998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fbd993d0-1882-497f-bb62-defc4dd5de0b {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:27:58 devstack sudo[100237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fbd993d0-1882-497f-bb62-defc4dd5de0b Sep 29 18:27:58 devstack sudo[100237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:27:58 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-74047a8a-6045-4b61-bd2e-b3f27376707a tempest-VolumesTransfersV357Test-166835440 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86512) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:27:58 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-74047a8a-6045-4b61-bd2e-b3f27376707a tempest-VolumesTransfersV357Test-166835440 None] Flow 'volume_create_manager' (c6125f96-3df1-49dd-b875-0e819747644e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:27:58 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-74047a8a-6045-4b61-bd2e-b3f27376707a tempest-VolumesTransfersV357Test-166835440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbd1cd0f-794d-4b4b-8c40-78fc0ab1def2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:27:58 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-74047a8a-6045-4b61-bd2e-b3f27376707a tempest-VolumesTransfersV357Test-166835440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbd1cd0f-794d-4b4b-8c40-78fc0ab1def2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:27:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-599176647',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6caecbf0-8441-46e3-8250-83ff985bdc49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b17ca724a6a44d39d895ba0c057af81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:27:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:27:58Z,use_quota=True,user_id='cc9180bd47174855a37e7360806a2ee7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:27:58 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-74047a8a-6045-4b61-bd2e-b3f27376707a tempest-VolumesTransfersV357Test-166835440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b9a6995-aaef-454c-bae0-938a239a1e59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:27:58 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-74047a8a-6045-4b61-bd2e-b3f27376707a tempest-VolumesTransfersV357Test-166835440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b9a6995-aaef-454c-bae0-938a239a1e59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:27:58 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-74047a8a-6045-4b61-bd2e-b3f27376707a tempest-VolumesTransfersV357Test-166835440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0af3fb0b-a6ff-414d-afe4-3e511a398efc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:27:58 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-74047a8a-6045-4b61-bd2e-b3f27376707a tempest-VolumesTransfersV357Test-166835440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0af3fb0b-a6ff-414d-afe4-3e511a398efc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6caecbf0-8441-46e3-8250-83ff985bdc49', 'volume_name': 'volume-6caecbf0-8441-46e3-8250-83ff985bdc49', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:27:58 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-74047a8a-6045-4b61-bd2e-b3f27376707a tempest-VolumesTransfersV357Test-166835440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4be8387e-8f48-4a5c-a796-b0bdb040263f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:27:58 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-74047a8a-6045-4b61-bd2e-b3f27376707a tempest-VolumesTransfersV357Test-166835440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4be8387e-8f48-4a5c-a796-b0bdb040263f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:27:58 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-74047a8a-6045-4b61-bd2e-b3f27376707a tempest-VolumesTransfersV357Test-166835440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (493f08c5-a3b4-4f5f-8602-eeddef4a0bb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:27:58 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-74047a8a-6045-4b61-bd2e-b3f27376707a tempest-VolumesTransfersV357Test-166835440 None] Volume 6caecbf0-8441-46e3-8250-83ff985bdc49: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6caecbf0-8441-46e3-8250-83ff985bdc49', 'volume_size': 1} Sep 29 18:27:58 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-74047a8a-6045-4b61-bd2e-b3f27376707a tempest-VolumesTransfersV357Test-166835440 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:27:58 devstack sudo[100237]: pam_unix(sudo:session): session closed for user root Sep 29 18:27:58 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-01f0a946-e60e-4f4f-8af9-a614d559c9d7 tempest-GroupsV314Test-111535998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fbd993d0-1882-497f-bb62-defc4dd5de0b" returned: 0 in 0.306s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:27:58 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-01f0a946-e60e-4f4f-8af9-a614d559c9d7 tempest-GroupsV314Test-111535998 None] <== create_volume: return (1041ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'} {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:27:58 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-01f0a946-e60e-4f4f-8af9-a614d559c9d7 tempest-GroupsV314Test-111535998 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.043s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:27:58 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-91ff8cf3-473c-44a9-b8e2-c45805eb7247 tempest-VolumesGetTest-329956023 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.420s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:27:58 devstack cinder-volume[86512]: INFO cinder.volume.drivers.remotefs [None req-91ff8cf3-473c-44a9-b8e2-c45805eb7247 tempest-VolumesGetTest-329956023 None] Cloning volume a307d519-1974-4ac1-8d2d-f0890bf2a944 to volume ef879903-8e61-496a-9d41-0cebc74826c2 Sep 29 18:27:58 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-01f0a946-e60e-4f4f-8af9-a614d559c9d7 tempest-GroupsV314Test-111535998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7af61afc-a10f-4ab3-9233-4474b19b2aeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fbd993d0-1882-497f-bb62-defc4dd5de0b', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:27:58 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-01f0a946-e60e-4f4f-8af9-a614d559c9d7 tempest-GroupsV314Test-111535998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43792024-53af-43ea-a813-a3b23029d38f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:27:58 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-01f0a946-e60e-4f4f-8af9-a614d559c9d7 tempest-GroupsV314Test-111535998 None] Volume volume-fbd993d0-1882-497f-bb62-defc4dd5de0b (fbd993d0-1882-497f-bb62-defc4dd5de0b): created successfully Sep 29 18:27:58 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-01f0a946-e60e-4f4f-8af9-a614d559c9d7 tempest-GroupsV314Test-111535998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43792024-53af-43ea-a813-a3b23029d38f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:27:58 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-01f0a946-e60e-4f4f-8af9-a614d559c9d7 tempest-GroupsV314Test-111535998 None] Flow 'volume_create_manager' (ac6c503c-5867-4e28-bc12-8737e9643fb7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:27:58 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-91ff8cf3-473c-44a9-b8e2-c45805eb7247 tempest-VolumesGetTest-329956023 None] Creating offline snapshot b02fc696-e909-4143-a04d-c1ab34b3ec4b of volume a307d519-1974-4ac1-8d2d-f0890bf2a944 {{(pid=86512) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 18:27:58 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-01f0a946-e60e-4f4f-8af9-a614d559c9d7 tempest-GroupsV314Test-111535998 None] Created volume successfully. Sep 29 18:27:58 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fe2cd29-5554-4882-a685-62a3ef5d93d4]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:27:58 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-91ff8cf3-473c-44a9-b8e2-c45805eb7247 tempest-VolumesGetTest-329956023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a307d519-1974-4ac1-8d2d-f0890bf2a944 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:27:58 devstack sudo[100240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a307d519-1974-4ac1-8d2d-f0890bf2a944 Sep 29 18:27:58 devstack sudo[100240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:27:58 devstack sudo[100240]: pam_unix(sudo:session): session closed for user root Sep 29 18:27:58 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-91ff8cf3-473c-44a9-b8e2-c45805eb7247 tempest-VolumesGetTest-329956023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a307d519-1974-4ac1-8d2d-f0890bf2a944" returned: 0 in 0.366s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:27:58 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-91ff8cf3-473c-44a9-b8e2-c45805eb7247 tempest-VolumesGetTest-329956023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a307d519-1974-4ac1-8d2d-f0890bf2a944,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a307d519-1974-4ac1-8d2d-f0890bf2a944.b02fc696-e909-4143-a04d-c1ab34b3ec4b 1G {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:27:58 devstack sudo[100245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a307d519-1974-4ac1-8d2d-f0890bf2a944,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a307d519-1974-4ac1-8d2d-f0890bf2a944.b02fc696-e909-4143-a04d-c1ab34b3ec4b 1G Sep 29 18:27:58 devstack sudo[100245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:27:59 devstack sudo[100245]: pam_unix(sudo:session): session closed for user root Sep 29 18:27:59 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-91ff8cf3-473c-44a9-b8e2-c45805eb7247 tempest-VolumesGetTest-329956023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a307d519-1974-4ac1-8d2d-f0890bf2a944,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a307d519-1974-4ac1-8d2d-f0890bf2a944.b02fc696-e909-4143-a04d-c1ab34b3ec4b 1G" returned: 0 in 0.443s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:27:59 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-91ff8cf3-473c-44a9-b8e2-c45805eb7247 tempest-VolumesGetTest-329956023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a307d519-1974-4ac1-8d2d-f0890bf2a944 -F qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a307d519-1974-4ac1-8d2d-f0890bf2a944.b02fc696-e909-4143-a04d-c1ab34b3ec4b {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:27:59 devstack sudo[100251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a307d519-1974-4ac1-8d2d-f0890bf2a944 -F qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a307d519-1974-4ac1-8d2d-f0890bf2a944.b02fc696-e909-4143-a04d-c1ab34b3ec4b Sep 29 18:27:59 devstack sudo[100251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:27:59 devstack sudo[100251]: pam_unix(sudo:session): session closed for user root Sep 29 18:27:59 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-91ff8cf3-473c-44a9-b8e2-c45805eb7247 tempest-VolumesGetTest-329956023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a307d519-1974-4ac1-8d2d-f0890bf2a944 -F qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a307d519-1974-4ac1-8d2d-f0890bf2a944.b02fc696-e909-4143-a04d-c1ab34b3ec4b" returned: 0 in 0.322s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:27:59 devstack cinder-volume[86512]: WARNING cinder.volume.drivers.remotefs [None req-91ff8cf3-473c-44a9-b8e2-c45805eb7247 tempest-VolumesGetTest-329956023 None] /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a307d519-1974-4ac1-8d2d-f0890bf2a944.b02fc696-e909-4143-a04d-c1ab34b3ec4b is being set with open permissions: ugo+rw Sep 29 18:27:59 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-91ff8cf3-473c-44a9-b8e2-c45805eb7247 tempest-VolumesGetTest-329956023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a307d519-1974-4ac1-8d2d-f0890bf2a944.b02fc696-e909-4143-a04d-c1ab34b3ec4b {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:27:59 devstack sudo[100256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a307d519-1974-4ac1-8d2d-f0890bf2a944.b02fc696-e909-4143-a04d-c1ab34b3ec4b Sep 29 18:27:59 devstack sudo[100256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:27:59 devstack sudo[100256]: pam_unix(sudo:session): session closed for user root Sep 29 18:27:59 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-91ff8cf3-473c-44a9-b8e2-c45805eb7247 tempest-VolumesGetTest-329956023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a307d519-1974-4ac1-8d2d-f0890bf2a944.b02fc696-e909-4143-a04d-c1ab34b3ec4b" returned: 0 in 0.293s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:27:59 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-91ff8cf3-473c-44a9-b8e2-c45805eb7247 tempest-VolumesGetTest-329956023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a307d519-1974-4ac1-8d2d-f0890bf2a944.info {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:28:00 devstack sudo[100259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a307d519-1974-4ac1-8d2d-f0890bf2a944.info Sep 29 18:28:00 devstack sudo[100259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:28:00 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-985b69a2-2b31-4bab-86f0-58cfeb016345 tempest-GroupsV314Test-111535998 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:28:00 devstack sudo[100259]: pam_unix(sudo:session): session closed for user root Sep 29 18:28:00 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-91ff8cf3-473c-44a9-b8e2-c45805eb7247 tempest-VolumesGetTest-329956023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a307d519-1974-4ac1-8d2d-f0890bf2a944.info" returned: 0 in 0.309s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:28:00 devstack cinder-volume[86512]: WARNING cinder.volume.drivers.remotefs [None req-91ff8cf3-473c-44a9-b8e2-c45805eb7247 tempest-VolumesGetTest-329956023 None] /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a307d519-1974-4ac1-8d2d-f0890bf2a944.info is being set with open permissions: ugo+rw Sep 29 18:28:00 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-91ff8cf3-473c-44a9-b8e2-c45805eb7247 tempest-VolumesGetTest-329956023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a307d519-1974-4ac1-8d2d-f0890bf2a944.info {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:28:00 devstack sudo[100262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a307d519-1974-4ac1-8d2d-f0890bf2a944.info Sep 29 18:28:00 devstack sudo[100262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:28:00 devstack sudo[100262]: pam_unix(sudo:session): session closed for user root Sep 29 18:28:00 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-91ff8cf3-473c-44a9-b8e2-c45805eb7247 tempest-VolumesGetTest-329956023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a307d519-1974-4ac1-8d2d-f0890bf2a944.info" returned: 0 in 0.273s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:28:00 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-91ff8cf3-473c-44a9-b8e2-c45805eb7247 tempest-VolumesGetTest-329956023 None] Acquiring lock "cinder-quobyte-ef879903-8e61-496a-9d41-0cebc74826c2" by "_copy_volume_from_snapshot" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:28:00 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-91ff8cf3-473c-44a9-b8e2-c45805eb7247 tempest-VolumesGetTest-329956023 None] Lock "cinder-quobyte-ef879903-8e61-496a-9d41-0cebc74826c2" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:28:00 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-91ff8cf3-473c-44a9-b8e2-c45805eb7247 tempest-VolumesGetTest-329956023 None] snapshot: b02fc696-e909-4143-a04d-c1ab34b3ec4b, volume: ef879903-8e61-496a-9d41-0cebc74826c2, {{(pid=86512) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 29 18:28:00 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-91ff8cf3-473c-44a9-b8e2-c45805eb7247 tempest-VolumesGetTest-329956023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:28:00 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-91ff8cf3-473c-44a9-b8e2-c45805eb7247 tempest-VolumesGetTest-329956023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:28:00 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-91ff8cf3-473c-44a9-b8e2-c45805eb7247 tempest-VolumesGetTest-329956023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:28:00 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-91ff8cf3-473c-44a9-b8e2-c45805eb7247 tempest-VolumesGetTest-329956023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:28:00 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-91ff8cf3-473c-44a9-b8e2-c45805eb7247 tempest-VolumesGetTest-329956023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:28:00 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[78722311-d4b6-400e-9f71-fceee2e58cec]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:28:00 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-91ff8cf3-473c-44a9-b8e2-c45805eb7247 tempest-VolumesGetTest-329956023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a307d519-1974-4ac1-8d2d-f0890bf2a944.b02fc696-e909-4143-a04d-c1ab34b3ec4b {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:28:00 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-943943c4-72cf-4582-9970-5ef76f49f5e8 tempest-ProjectReaderTests-2070855465 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86512) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:28:00 devstack sudo[100265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a307d519-1974-4ac1-8d2d-f0890bf2a944.b02fc696-e909-4143-a04d-c1ab34b3ec4b Sep 29 18:28:00 devstack sudo[100265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:28:00 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-943943c4-72cf-4582-9970-5ef76f49f5e8 tempest-ProjectReaderTests-2070855465 None] Flow 'volume_create_manager' (d25f8634-4f9e-4d06-8c8b-047be3116159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:28:00 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-943943c4-72cf-4582-9970-5ef76f49f5e8 tempest-ProjectReaderTests-2070855465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf3a8d3b-1530-4003-803d-8bb3a1cc15be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:28:00 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-943943c4-72cf-4582-9970-5ef76f49f5e8 tempest-ProjectReaderTests-2070855465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf3a8d3b-1530-4003-803d-8bb3a1cc15be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:28:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1026257914',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7f264c0-76b6-4456-a9ce-9210bacde901,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f92c36a33aa1437ba704ce7f48246c50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:28:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:28:01Z,use_quota=True,user_id='0dcba85655314108a410c5150a09b572',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:28:00 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-943943c4-72cf-4582-9970-5ef76f49f5e8 tempest-ProjectReaderTests-2070855465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd0f92c4-c225-47eb-9d04-c3adacf764ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:28:00 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-943943c4-72cf-4582-9970-5ef76f49f5e8 tempest-ProjectReaderTests-2070855465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd0f92c4-c225-47eb-9d04-c3adacf764ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:28:00 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-943943c4-72cf-4582-9970-5ef76f49f5e8 tempest-ProjectReaderTests-2070855465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (714f2f07-9965-4b4f-8d2f-9443a254d7cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:28:00 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-943943c4-72cf-4582-9970-5ef76f49f5e8 tempest-ProjectReaderTests-2070855465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (714f2f07-9965-4b4f-8d2f-9443a254d7cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7f264c0-76b6-4456-a9ce-9210bacde901', 'volume_name': 'volume-d7f264c0-76b6-4456-a9ce-9210bacde901', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:28:00 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-943943c4-72cf-4582-9970-5ef76f49f5e8 tempest-ProjectReaderTests-2070855465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (241f20e9-4a9d-4210-a9e7-74c33bc6bd27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:28:00 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-943943c4-72cf-4582-9970-5ef76f49f5e8 tempest-ProjectReaderTests-2070855465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (241f20e9-4a9d-4210-a9e7-74c33bc6bd27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:28:00 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-943943c4-72cf-4582-9970-5ef76f49f5e8 tempest-ProjectReaderTests-2070855465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c16247d-0cb7-4ef4-9d5b-d703c5669e5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:28:00 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-943943c4-72cf-4582-9970-5ef76f49f5e8 tempest-ProjectReaderTests-2070855465 None] Volume d7f264c0-76b6-4456-a9ce-9210bacde901: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7f264c0-76b6-4456-a9ce-9210bacde901', 'volume_size': 1} Sep 29 18:28:00 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-943943c4-72cf-4582-9970-5ef76f49f5e8 tempest-ProjectReaderTests-2070855465 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:28:01 devstack sudo[100265]: pam_unix(sudo:session): session closed for user root Sep 29 18:28:01 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-91ff8cf3-473c-44a9-b8e2-c45805eb7247 tempest-VolumesGetTest-329956023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a307d519-1974-4ac1-8d2d-f0890bf2a944.b02fc696-e909-4143-a04d-c1ab34b3ec4b" returned: 0 in 0.384s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:28:01 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-91ff8cf3-473c-44a9-b8e2-c45805eb7247 tempest-VolumesGetTest-329956023 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a307d519-1974-4ac1-8d2d-f0890bf2a944(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86512) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 18:28:01 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[86e466b3-0756-4343-a375-5ad5c7317a69]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:28:01 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-91ff8cf3-473c-44a9-b8e2-c45805eb7247 tempest-VolumesGetTest-329956023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a307d519-1974-4ac1-8d2d-f0890bf2a944 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:28:01 devstack sudo[100270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a307d519-1974-4ac1-8d2d-f0890bf2a944 Sep 29 18:28:01 devstack sudo[100270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:28:01 devstack sudo[100270]: pam_unix(sudo:session): session closed for user root Sep 29 18:28:01 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-91ff8cf3-473c-44a9-b8e2-c45805eb7247 tempest-VolumesGetTest-329956023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a307d519-1974-4ac1-8d2d-f0890bf2a944" returned: 0 in 0.371s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:28:01 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-91ff8cf3-473c-44a9-b8e2-c45805eb7247 tempest-VolumesGetTest-329956023 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a307d519-1974-4ac1-8d2d-f0890bf2a944 {{(pid=86512) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 29 18:28:01 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-91ff8cf3-473c-44a9-b8e2-c45805eb7247 tempest-VolumesGetTest-329956023 None] Creating direct copy from snapshot {{(pid=86512) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 29 18:28:01 devstack cinder-volume[86512]: DEBUG cinder.utils [None req-91ff8cf3-473c-44a9-b8e2-c45805eb7247 tempest-VolumesGetTest-329956023 None] Path /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ef879903-8e61-496a-9d41-0cebc74826c2 not found in is_blk_device check {{(pid=86512) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 29 18:28:01 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-91ff8cf3-473c-44a9-b8e2-c45805eb7247 tempest-VolumesGetTest-329956023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a307d519-1974-4ac1-8d2d-f0890bf2a944 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ef879903-8e61-496a-9d41-0cebc74826c2 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:28:01 devstack sudo[100275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a307d519-1974-4ac1-8d2d-f0890bf2a944 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ef879903-8e61-496a-9d41-0cebc74826c2 Sep 29 18:28:01 devstack sudo[100275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:28:07 devstack sudo[100275]: pam_unix(sudo:session): session closed for user root Sep 29 18:28:07 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-91ff8cf3-473c-44a9-b8e2-c45805eb7247 tempest-VolumesGetTest-329956023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a307d519-1974-4ac1-8d2d-f0890bf2a944 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ef879903-8e61-496a-9d41-0cebc74826c2" returned: 0 in 6.014s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:28:07 devstack cinder-volume[86512]: DEBUG cinder.image.image_utils [None req-91ff8cf3-473c-44a9-b8e2-c45805eb7247 tempest-VolumesGetTest-329956023 None] Image conversion details: src /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a307d519-1974-4ac1-8d2d-f0890bf2a944, size 1024.00 MB, duration 6.02 sec, destination /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ef879903-8e61-496a-9d41-0cebc74826c2 {{(pid=86512) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 29 18:28:07 devstack cinder-volume[86512]: INFO cinder.image.image_utils [None req-91ff8cf3-473c-44a9-b8e2-c45805eb7247 tempest-VolumesGetTest-329956023 None] Converted 1024.00 MB image at 170.23 MB/s Sep 29 18:28:07 devstack cinder-volume[86512]: WARNING cinder.volume.drivers.remotefs [None req-91ff8cf3-473c-44a9-b8e2-c45805eb7247 tempest-VolumesGetTest-329956023 None] /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ef879903-8e61-496a-9d41-0cebc74826c2 is being set with open permissions: ugo+rw Sep 29 18:28:07 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-91ff8cf3-473c-44a9-b8e2-c45805eb7247 tempest-VolumesGetTest-329956023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ef879903-8e61-496a-9d41-0cebc74826c2 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:28:07 devstack sudo[100289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ef879903-8e61-496a-9d41-0cebc74826c2 Sep 29 18:28:07 devstack sudo[100289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:28:07 devstack sudo[100289]: pam_unix(sudo:session): session closed for user root Sep 29 18:28:07 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-91ff8cf3-473c-44a9-b8e2-c45805eb7247 tempest-VolumesGetTest-329956023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ef879903-8e61-496a-9d41-0cebc74826c2" returned: 0 in 0.249s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:28:07 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-91ff8cf3-473c-44a9-b8e2-c45805eb7247 tempest-VolumesGetTest-329956023 None] Lock "cinder-quobyte-ef879903-8e61-496a-9d41-0cebc74826c2" released by "_copy_volume_from_snapshot" :: held 7.094s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:28:07 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-91ff8cf3-473c-44a9-b8e2-c45805eb7247 tempest-VolumesGetTest-329956023 None] Acquiring lock "cinder-quobyte-b02fc696-e909-4143-a04d-c1ab34b3ec4b" by "_delete_snapshot" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:28:07 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-91ff8cf3-473c-44a9-b8e2-c45805eb7247 tempest-VolumesGetTest-329956023 None] Lock "cinder-quobyte-b02fc696-e909-4143-a04d-c1ab34b3ec4b" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:28:07 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-91ff8cf3-473c-44a9-b8e2-c45805eb7247 tempest-VolumesGetTest-329956023 None] Deleting offline snapshot b02fc696-e909-4143-a04d-c1ab34b3ec4b of volume a307d519-1974-4ac1-8d2d-f0890bf2a944 {{(pid=86512) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 18:28:07 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-91ff8cf3-473c-44a9-b8e2-c45805eb7247 tempest-VolumesGetTest-329956023 None] snapshot_file for this snap is: volume-a307d519-1974-4ac1-8d2d-f0890bf2a944.b02fc696-e909-4143-a04d-c1ab34b3ec4b {{(pid=86512) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 18:28:07 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[968a7fd7-0697-4a1b-844e-40a62fd9c94e]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:28:07 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-91ff8cf3-473c-44a9-b8e2-c45805eb7247 tempest-VolumesGetTest-329956023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a307d519-1974-4ac1-8d2d-f0890bf2a944.b02fc696-e909-4143-a04d-c1ab34b3ec4b {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:28:07 devstack sudo[100292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a307d519-1974-4ac1-8d2d-f0890bf2a944.b02fc696-e909-4143-a04d-c1ab34b3ec4b Sep 29 18:28:07 devstack sudo[100292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:28:08 devstack sudo[100292]: pam_unix(sudo:session): session closed for user root Sep 29 18:28:08 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-91ff8cf3-473c-44a9-b8e2-c45805eb7247 tempest-VolumesGetTest-329956023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a307d519-1974-4ac1-8d2d-f0890bf2a944.b02fc696-e909-4143-a04d-c1ab34b3ec4b" returned: 0 in 0.342s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:28:08 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-91ff8cf3-473c-44a9-b8e2-c45805eb7247 tempest-VolumesGetTest-329956023 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a307d519-1974-4ac1-8d2d-f0890bf2a944(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86512) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 18:28:08 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[e315ec8f-f887-4f21-a3ce-763684e47d2e]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:28:08 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-91ff8cf3-473c-44a9-b8e2-c45805eb7247 tempest-VolumesGetTest-329956023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a307d519-1974-4ac1-8d2d-f0890bf2a944 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:28:08 devstack sudo[100297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a307d519-1974-4ac1-8d2d-f0890bf2a944 Sep 29 18:28:08 devstack sudo[100297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:28:08 devstack sudo[100297]: pam_unix(sudo:session): session closed for user root Sep 29 18:28:08 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-91ff8cf3-473c-44a9-b8e2-c45805eb7247 tempest-VolumesGetTest-329956023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a307d519-1974-4ac1-8d2d-f0890bf2a944" returned: 0 in 0.519s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:28:08 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-91ff8cf3-473c-44a9-b8e2-c45805eb7247 tempest-VolumesGetTest-329956023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a307d519-1974-4ac1-8d2d-f0890bf2a944.b02fc696-e909-4143-a04d-c1ab34b3ec4b {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:28:08 devstack sudo[100302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a307d519-1974-4ac1-8d2d-f0890bf2a944.b02fc696-e909-4143-a04d-c1ab34b3ec4b Sep 29 18:28:08 devstack sudo[100302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:28:08 devstack sudo[100302]: pam_unix(sudo:session): session closed for user root Sep 29 18:28:08 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-91ff8cf3-473c-44a9-b8e2-c45805eb7247 tempest-VolumesGetTest-329956023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a307d519-1974-4ac1-8d2d-f0890bf2a944.b02fc696-e909-4143-a04d-c1ab34b3ec4b" returned: 0 in 0.336s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:28:08 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-91ff8cf3-473c-44a9-b8e2-c45805eb7247 tempest-VolumesGetTest-329956023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a307d519-1974-4ac1-8d2d-f0890bf2a944.b02fc696-e909-4143-a04d-c1ab34b3ec4b {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:28:09 devstack sudo[100308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a307d519-1974-4ac1-8d2d-f0890bf2a944.b02fc696-e909-4143-a04d-c1ab34b3ec4b Sep 29 18:28:09 devstack sudo[100308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:28:09 devstack sudo[100308]: pam_unix(sudo:session): session closed for user root Sep 29 18:28:09 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-91ff8cf3-473c-44a9-b8e2-c45805eb7247 tempest-VolumesGetTest-329956023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a307d519-1974-4ac1-8d2d-f0890bf2a944.b02fc696-e909-4143-a04d-c1ab34b3ec4b" returned: 0 in 0.247s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:28:09 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-91ff8cf3-473c-44a9-b8e2-c45805eb7247 tempest-VolumesGetTest-329956023 None] Lock "cinder-quobyte-b02fc696-e909-4143-a04d-c1ab34b3ec4b" released by "_delete_snapshot" :: held 1.539s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:28:09 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-91ff8cf3-473c-44a9-b8e2-c45805eb7247 tempest-VolumesGetTest-329956023 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.865s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:28:09 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-74047a8a-6045-4b61-bd2e-b3f27376707a tempest-VolumesTransfersV357Test-166835440 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.036s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:28:09 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-74047a8a-6045-4b61-bd2e-b3f27376707a tempest-VolumesTransfersV357Test-166835440 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:27:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-599176647',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6caecbf0-8441-46e3-8250-83ff985bdc49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b17ca724a6a44d39d895ba0c057af81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:27:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:27:58Z,use_quota=True,user_id='cc9180bd47174855a37e7360806a2ee7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)}" {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:28:09 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-74047a8a-6045-4b61-bd2e-b3f27376707a tempest-VolumesTransfersV357Test-166835440 None] Creating volume 6caecbf0-8441-46e3-8250-83ff985bdc49 {{(pid=86512) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:28:09 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-74047a8a-6045-4b61-bd2e-b3f27376707a tempest-VolumesTransfersV357Test-166835440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:28:09 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-74047a8a-6045-4b61-bd2e-b3f27376707a tempest-VolumesTransfersV357Test-166835440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:28:09 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-74047a8a-6045-4b61-bd2e-b3f27376707a tempest-VolumesTransfersV357Test-166835440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:28:09 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-74047a8a-6045-4b61-bd2e-b3f27376707a tempest-VolumesTransfersV357Test-166835440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:28:09 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-74047a8a-6045-4b61-bd2e-b3f27376707a tempest-VolumesTransfersV357Test-166835440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:28:09 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-74047a8a-6045-4b61-bd2e-b3f27376707a tempest-VolumesTransfersV357Test-166835440 None] Selected osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 as target Quobyte volume. {{(pid=86512) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:28:09 devstack cinder-volume[86512]: INFO cinder.volume.drivers.remotefs [None req-74047a8a-6045-4b61-bd2e-b3f27376707a tempest-VolumesTransfersV357Test-166835440 None] casted to osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 Sep 29 18:28:09 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-74047a8a-6045-4b61-bd2e-b3f27376707a tempest-VolumesTransfersV357Test-166835440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-6caecbf0-8441-46e3-8250-83ff985bdc49 1073741824 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:28:09 devstack sudo[100311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-6caecbf0-8441-46e3-8250-83ff985bdc49 1073741824 Sep 29 18:28:09 devstack sudo[100311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:28:09 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-91ff8cf3-473c-44a9-b8e2-c45805eb7247 tempest-VolumesGetTest-329956023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5276ed31-2d84-4f11-ab0c-fabca9bab06c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef879903-8e61-496a-9d41-0cebc74826c2', 'volume_size': 1, 'source_volid': 'a307d519-1974-4ac1-8d2d-f0890bf2a944', 'source_volstatus': 'available'}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:28:09 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-91ff8cf3-473c-44a9-b8e2-c45805eb7247 tempest-VolumesGetTest-329956023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f67191d9-e6fd-426a-bc9e-b6cebdcb6e8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:28:09 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-91ff8cf3-473c-44a9-b8e2-c45805eb7247 tempest-VolumesGetTest-329956023 None] Volume volume-ef879903-8e61-496a-9d41-0cebc74826c2 (ef879903-8e61-496a-9d41-0cebc74826c2): created successfully Sep 29 18:28:09 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-91ff8cf3-473c-44a9-b8e2-c45805eb7247 tempest-VolumesGetTest-329956023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f67191d9-e6fd-426a-bc9e-b6cebdcb6e8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:28:09 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-91ff8cf3-473c-44a9-b8e2-c45805eb7247 tempest-VolumesGetTest-329956023 None] Flow 'volume_create_manager' (4d03ee2b-dd09-4f76-bbca-6504af76f8de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:28:09 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-91ff8cf3-473c-44a9-b8e2-c45805eb7247 tempest-VolumesGetTest-329956023 None] Created volume successfully. Sep 29 18:28:09 devstack sudo[100311]: pam_unix(sudo:session): session closed for user root Sep 29 18:28:09 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-74047a8a-6045-4b61-bd2e-b3f27376707a tempest-VolumesTransfersV357Test-166835440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-6caecbf0-8441-46e3-8250-83ff985bdc49 1073741824" returned: 0 in 0.446s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:28:09 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-74047a8a-6045-4b61-bd2e-b3f27376707a tempest-VolumesTransfersV357Test-166835440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-6caecbf0-8441-46e3-8250-83ff985bdc49 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:28:09 devstack sudo[100317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-6caecbf0-8441-46e3-8250-83ff985bdc49 Sep 29 18:28:09 devstack sudo[100317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:28:10 devstack sudo[100317]: pam_unix(sudo:session): session closed for user root Sep 29 18:28:10 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-74047a8a-6045-4b61-bd2e-b3f27376707a tempest-VolumesTransfersV357Test-166835440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-6caecbf0-8441-46e3-8250-83ff985bdc49" returned: 0 in 0.249s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:28:10 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-74047a8a-6045-4b61-bd2e-b3f27376707a tempest-VolumesTransfersV357Test-166835440 None] <== create_volume: return (734ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'} {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:28:10 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-74047a8a-6045-4b61-bd2e-b3f27376707a tempest-VolumesTransfersV357Test-166835440 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.738s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:28:10 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-985b69a2-2b31-4bab-86f0-58cfeb016345 tempest-GroupsV314Test-111535998 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 9.788s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:28:10 devstack cinder-volume[86512]: INFO cinder.volume.drivers.remotefs [None req-985b69a2-2b31-4bab-86f0-58cfeb016345 tempest-GroupsV314Test-111535998 None] Cloning volume fbd993d0-1882-497f-bb62-defc4dd5de0b to volume f5441650-b6f8-4863-8e22-99667cfe7004 Sep 29 18:28:10 devstack cinder-volume[86512]: DEBUG dbcounter [-] [86512] Writing DB stats cinder:UPDATE=234,cinder:DELETE=18,cinder:SELECT=181,cinder:INSERT=60 {{(pid=86512) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 18:28:10 devstack cinder-volume[86512]: DEBUG dbcounter [-] [86512] Writing DB stats cinder:SELECT=165,cinder:INSERT=61,cinder:UPDATE=230,cinder:DELETE=19 {{(pid=86512) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 18:28:10 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-74047a8a-6045-4b61-bd2e-b3f27376707a tempest-VolumesTransfersV357Test-166835440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (493f08c5-a3b4-4f5f-8602-eeddef4a0bb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6caecbf0-8441-46e3-8250-83ff985bdc49', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:28:10 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-74047a8a-6045-4b61-bd2e-b3f27376707a tempest-VolumesTransfersV357Test-166835440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e197f957-2b52-4cec-ba26-e7651b57a322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:28:10 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-74047a8a-6045-4b61-bd2e-b3f27376707a tempest-VolumesTransfersV357Test-166835440 None] Volume volume-6caecbf0-8441-46e3-8250-83ff985bdc49 (6caecbf0-8441-46e3-8250-83ff985bdc49): created successfully Sep 29 18:28:10 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-74047a8a-6045-4b61-bd2e-b3f27376707a tempest-VolumesTransfersV357Test-166835440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e197f957-2b52-4cec-ba26-e7651b57a322) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:28:10 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-74047a8a-6045-4b61-bd2e-b3f27376707a tempest-VolumesTransfersV357Test-166835440 None] Flow 'volume_create_manager' (c6125f96-3df1-49dd-b875-0e819747644e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:28:10 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-985b69a2-2b31-4bab-86f0-58cfeb016345 tempest-GroupsV314Test-111535998 None] Creating offline snapshot 6f7ea0b1-2da9-4537-a98f-45b78699c1d4 of volume fbd993d0-1882-497f-bb62-defc4dd5de0b {{(pid=86512) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 18:28:10 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-74047a8a-6045-4b61-bd2e-b3f27376707a tempest-VolumesTransfersV357Test-166835440 None] Created volume successfully. Sep 29 18:28:10 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f480b9d-0b7a-488b-ab97-34ae9c0dab2a]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:28:10 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-985b69a2-2b31-4bab-86f0-58cfeb016345 tempest-GroupsV314Test-111535998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fbd993d0-1882-497f-bb62-defc4dd5de0b {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:28:10 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-8765edbc-8a44-4d98-9b94-ce0d4142a5f8 tempest-VolumesGetTest-329956023 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86512) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:28:10 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-8765edbc-8a44-4d98-9b94-ce0d4142a5f8 tempest-VolumesGetTest-329956023 None] Flow 'volume_create_manager' (87e6fb97-3743-4593-9209-06693b4f7af0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:28:10 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-8765edbc-8a44-4d98-9b94-ce0d4142a5f8 tempest-VolumesGetTest-329956023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (328a56ec-8c68-4863-8595-0462a25bcacc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:28:10 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-8765edbc-8a44-4d98-9b94-ce0d4142a5f8 tempest-VolumesGetTest-329956023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (328a56ec-8c68-4863-8595-0462a25bcacc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:28:10Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2015609347',display_name='tempest-VolumesGetTest-Volume-52468926',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9db4b3ca-5fb5-4b1a-96bb-36251915d08c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='123ca1c819ab4c939d34d15531ec218c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:28:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:28:10Z,use_quota=True,user_id='d4b8a389e95e4820826e3c19485b4a7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:28:10 devstack sudo[100320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fbd993d0-1882-497f-bb62-defc4dd5de0b Sep 29 18:28:10 devstack sudo[100320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:28:10 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-8765edbc-8a44-4d98-9b94-ce0d4142a5f8 tempest-VolumesGetTest-329956023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b69c1da-f537-4428-9c05-2ebaa8eb56e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:28:10 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-8765edbc-8a44-4d98-9b94-ce0d4142a5f8 tempest-VolumesGetTest-329956023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b69c1da-f537-4428-9c05-2ebaa8eb56e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:28:10 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-8765edbc-8a44-4d98-9b94-ce0d4142a5f8 tempest-VolumesGetTest-329956023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (207c216f-4b38-4e46-a6aa-b1835a65b55a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:28:10 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-8765edbc-8a44-4d98-9b94-ce0d4142a5f8 tempest-VolumesGetTest-329956023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (207c216f-4b38-4e46-a6aa-b1835a65b55a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9db4b3ca-5fb5-4b1a-96bb-36251915d08c', 'volume_name': 'volume-9db4b3ca-5fb5-4b1a-96bb-36251915d08c', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:28:10 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-8765edbc-8a44-4d98-9b94-ce0d4142a5f8 tempest-VolumesGetTest-329956023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e485a51b-aae1-4484-b1ab-faa381274166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:28:10 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-8765edbc-8a44-4d98-9b94-ce0d4142a5f8 tempest-VolumesGetTest-329956023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e485a51b-aae1-4484-b1ab-faa381274166) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:28:10 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-8765edbc-8a44-4d98-9b94-ce0d4142a5f8 tempest-VolumesGetTest-329956023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4550ddd9-6835-4748-859e-ea781b6004b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:28:10 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-8765edbc-8a44-4d98-9b94-ce0d4142a5f8 tempest-VolumesGetTest-329956023 None] Volume 9db4b3ca-5fb5-4b1a-96bb-36251915d08c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9db4b3ca-5fb5-4b1a-96bb-36251915d08c', 'volume_size': 1} Sep 29 18:28:10 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-8765edbc-8a44-4d98-9b94-ce0d4142a5f8 tempest-VolumesGetTest-329956023 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:28:10 devstack sudo[100320]: pam_unix(sudo:session): session closed for user root Sep 29 18:28:10 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-985b69a2-2b31-4bab-86f0-58cfeb016345 tempest-GroupsV314Test-111535998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fbd993d0-1882-497f-bb62-defc4dd5de0b" returned: 0 in 0.396s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:28:10 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-985b69a2-2b31-4bab-86f0-58cfeb016345 tempest-GroupsV314Test-111535998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fbd993d0-1882-497f-bb62-defc4dd5de0b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fbd993d0-1882-497f-bb62-defc4dd5de0b.6f7ea0b1-2da9-4537-a98f-45b78699c1d4 1G {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:28:10 devstack sudo[100325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fbd993d0-1882-497f-bb62-defc4dd5de0b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fbd993d0-1882-497f-bb62-defc4dd5de0b.6f7ea0b1-2da9-4537-a98f-45b78699c1d4 1G Sep 29 18:28:10 devstack sudo[100325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:28:10 devstack sudo[100325]: pam_unix(sudo:session): session closed for user root Sep 29 18:28:10 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-985b69a2-2b31-4bab-86f0-58cfeb016345 tempest-GroupsV314Test-111535998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fbd993d0-1882-497f-bb62-defc4dd5de0b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fbd993d0-1882-497f-bb62-defc4dd5de0b.6f7ea0b1-2da9-4537-a98f-45b78699c1d4 1G" returned: 0 in 0.374s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:28:10 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-985b69a2-2b31-4bab-86f0-58cfeb016345 tempest-GroupsV314Test-111535998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fbd993d0-1882-497f-bb62-defc4dd5de0b -F qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fbd993d0-1882-497f-bb62-defc4dd5de0b.6f7ea0b1-2da9-4537-a98f-45b78699c1d4 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:28:10 devstack sudo[100331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fbd993d0-1882-497f-bb62-defc4dd5de0b -F qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fbd993d0-1882-497f-bb62-defc4dd5de0b.6f7ea0b1-2da9-4537-a98f-45b78699c1d4 Sep 29 18:28:10 devstack sudo[100331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:28:11 devstack sudo[100331]: pam_unix(sudo:session): session closed for user root Sep 29 18:28:11 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-985b69a2-2b31-4bab-86f0-58cfeb016345 tempest-GroupsV314Test-111535998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fbd993d0-1882-497f-bb62-defc4dd5de0b -F qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fbd993d0-1882-497f-bb62-defc4dd5de0b.6f7ea0b1-2da9-4537-a98f-45b78699c1d4" returned: 0 in 0.299s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:28:11 devstack cinder-volume[86512]: WARNING cinder.volume.drivers.remotefs [None req-985b69a2-2b31-4bab-86f0-58cfeb016345 tempest-GroupsV314Test-111535998 None] /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fbd993d0-1882-497f-bb62-defc4dd5de0b.6f7ea0b1-2da9-4537-a98f-45b78699c1d4 is being set with open permissions: ugo+rw: NotImplementedError Sep 29 18:28:11 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-985b69a2-2b31-4bab-86f0-58cfeb016345 tempest-GroupsV314Test-111535998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fbd993d0-1882-497f-bb62-defc4dd5de0b.6f7ea0b1-2da9-4537-a98f-45b78699c1d4 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:28:11 devstack sudo[100336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fbd993d0-1882-497f-bb62-defc4dd5de0b.6f7ea0b1-2da9-4537-a98f-45b78699c1d4 Sep 29 18:28:11 devstack sudo[100336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:28:11 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-8fd5d048-4592-4ec7-ab8e-d480c93a9402 tempest-VolumesTransfersV357Test-1380990303 None] Acquiring lock "cinder-6caecbf0-8441-46e3-8250-83ff985bdc49-delete_volume" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:28:11 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-8fd5d048-4592-4ec7-ab8e-d480c93a9402 tempest-VolumesTransfersV357Test-1380990303 None] Lock "cinder-6caecbf0-8441-46e3-8250-83ff985bdc49-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:28:11 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-8fd5d048-4592-4ec7-ab8e-d480c93a9402 tempest-VolumesTransfersV357Test-1380990303 None] Acquiring lock "cinder-quobyte-6caecbf0-8441-46e3-8250-83ff985bdc49" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:28:11 devstack sudo[100336]: pam_unix(sudo:session): session closed for user root Sep 29 18:28:11 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-985b69a2-2b31-4bab-86f0-58cfeb016345 tempest-GroupsV314Test-111535998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fbd993d0-1882-497f-bb62-defc4dd5de0b.6f7ea0b1-2da9-4537-a98f-45b78699c1d4" returned: 0 in 0.264s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:28:11 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-8fd5d048-4592-4ec7-ab8e-d480c93a9402 tempest-VolumesTransfersV357Test-1380990303 None] Lock "cinder-quobyte-6caecbf0-8441-46e3-8250-83ff985bdc49" acquired by "delete_volume" :: waited 0.020s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:28:11 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[16af821c-32bc-4ce7-ab56-b9b62d5dce2a]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:28:11 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-8fd5d048-4592-4ec7-ab8e-d480c93a9402 tempest-VolumesTransfersV357Test-1380990303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-6caecbf0-8441-46e3-8250-83ff985bdc49 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:28:11 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-985b69a2-2b31-4bab-86f0-58cfeb016345 tempest-GroupsV314Test-111535998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fbd993d0-1882-497f-bb62-defc4dd5de0b.info {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:28:11 devstack sudo[100340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fbd993d0-1882-497f-bb62-defc4dd5de0b.info Sep 29 18:28:11 devstack sudo[100340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:28:11 devstack sudo[100339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-6caecbf0-8441-46e3-8250-83ff985bdc49 Sep 29 18:28:11 devstack sudo[100339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:28:11 devstack sudo[100340]: pam_unix(sudo:session): session closed for user root Sep 29 18:28:11 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-985b69a2-2b31-4bab-86f0-58cfeb016345 tempest-GroupsV314Test-111535998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fbd993d0-1882-497f-bb62-defc4dd5de0b.info" returned: 0 in 0.262s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:28:11 devstack cinder-volume[86512]: WARNING cinder.volume.drivers.remotefs [None req-985b69a2-2b31-4bab-86f0-58cfeb016345 tempest-GroupsV314Test-111535998 None] /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fbd993d0-1882-497f-bb62-defc4dd5de0b.info is being set with open permissions: ugo+rw: NotImplementedError Sep 29 18:28:11 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-985b69a2-2b31-4bab-86f0-58cfeb016345 tempest-GroupsV314Test-111535998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fbd993d0-1882-497f-bb62-defc4dd5de0b.info {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:28:11 devstack sudo[100345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fbd993d0-1882-497f-bb62-defc4dd5de0b.info Sep 29 18:28:11 devstack sudo[100345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:28:11 devstack sudo[100339]: pam_unix(sudo:session): session closed for user root Sep 29 18:28:11 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-8fd5d048-4592-4ec7-ab8e-d480c93a9402 tempest-VolumesTransfersV357Test-1380990303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-6caecbf0-8441-46e3-8250-83ff985bdc49" returned: 0 in 0.367s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:28:11 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-8fd5d048-4592-4ec7-ab8e-d480c93a9402 tempest-VolumesTransfersV357Test-1380990303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-6caecbf0-8441-46e3-8250-83ff985bdc49 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:28:11 devstack sudo[100349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-6caecbf0-8441-46e3-8250-83ff985bdc49 Sep 29 18:28:11 devstack sudo[100349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:28:12 devstack sudo[100345]: pam_unix(sudo:session): session closed for user root Sep 29 18:28:12 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-985b69a2-2b31-4bab-86f0-58cfeb016345 tempest-GroupsV314Test-111535998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fbd993d0-1882-497f-bb62-defc4dd5de0b.info" returned: 0 in 0.239s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:28:12 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-985b69a2-2b31-4bab-86f0-58cfeb016345 tempest-GroupsV314Test-111535998 None] Acquiring lock "cinder-quobyte-f5441650-b6f8-4863-8e22-99667cfe7004" by "_copy_volume_from_snapshot" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:28:12 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-985b69a2-2b31-4bab-86f0-58cfeb016345 tempest-GroupsV314Test-111535998 None] Lock "cinder-quobyte-f5441650-b6f8-4863-8e22-99667cfe7004" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:28:12 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-985b69a2-2b31-4bab-86f0-58cfeb016345 tempest-GroupsV314Test-111535998 None] snapshot: 6f7ea0b1-2da9-4537-a98f-45b78699c1d4, volume: f5441650-b6f8-4863-8e22-99667cfe7004, {{(pid=86512) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 29 18:28:12 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-985b69a2-2b31-4bab-86f0-58cfeb016345 tempest-GroupsV314Test-111535998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:28:12 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-985b69a2-2b31-4bab-86f0-58cfeb016345 tempest-GroupsV314Test-111535998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:28:12 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-985b69a2-2b31-4bab-86f0-58cfeb016345 tempest-GroupsV314Test-111535998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:28:12 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-985b69a2-2b31-4bab-86f0-58cfeb016345 tempest-GroupsV314Test-111535998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:28:12 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-985b69a2-2b31-4bab-86f0-58cfeb016345 tempest-GroupsV314Test-111535998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:28:12 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[df28f8df-831b-4925-862b-8426c8f3970c]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:28:12 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-985b69a2-2b31-4bab-86f0-58cfeb016345 tempest-GroupsV314Test-111535998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fbd993d0-1882-497f-bb62-defc4dd5de0b.6f7ea0b1-2da9-4537-a98f-45b78699c1d4 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:28:12 devstack sudo[100349]: pam_unix(sudo:session): session closed for user root Sep 29 18:28:12 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-8fd5d048-4592-4ec7-ab8e-d480c93a9402 tempest-VolumesTransfersV357Test-1380990303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-6caecbf0-8441-46e3-8250-83ff985bdc49" returned: 0 in 0.246s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:28:12 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-8fd5d048-4592-4ec7-ab8e-d480c93a9402 tempest-VolumesTransfersV357Test-1380990303 None] Lock "cinder-quobyte-6caecbf0-8441-46e3-8250-83ff985bdc49" released by "delete_volume" :: held 0.658s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:28:12 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-8fd5d048-4592-4ec7-ab8e-d480c93a9402 tempest-VolumesTransfersV357Test-1380990303 None] Created reservations ['5d86bd7b-cea8-491f-b501-2ac0d39333ee', 'd59a30e4-a401-428c-b673-f8826e9cda96', '20a61901-8f7f-4052-96db-f60cb48709e8', 'f6e787cb-a383-4e33-8ac1-a4b476790b78'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:28:12 devstack sudo[100353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fbd993d0-1882-497f-bb62-defc4dd5de0b.6f7ea0b1-2da9-4537-a98f-45b78699c1d4 Sep 29 18:28:12 devstack sudo[100353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:28:12 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-8fd5d048-4592-4ec7-ab8e-d480c93a9402 tempest-VolumesTransfersV357Test-1380990303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:28:12 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-8fd5d048-4592-4ec7-ab8e-d480c93a9402 tempest-VolumesTransfersV357Test-1380990303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:28:12 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-8fd5d048-4592-4ec7-ab8e-d480c93a9402 tempest-VolumesTransfersV357Test-1380990303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:28:12 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-8fd5d048-4592-4ec7-ab8e-d480c93a9402 tempest-VolumesTransfersV357Test-1380990303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:28:12 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-8fd5d048-4592-4ec7-ab8e-d480c93a9402 tempest-VolumesTransfersV357Test-1380990303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:28:12 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-8fd5d048-4592-4ec7-ab8e-d480c93a9402 tempest-VolumesTransfersV357Test-1380990303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:28:12 devstack sudo[100355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:28:12 devstack sudo[100355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:28:12 devstack sudo[100353]: pam_unix(sudo:session): session closed for user root Sep 29 18:28:12 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-985b69a2-2b31-4bab-86f0-58cfeb016345 tempest-GroupsV314Test-111535998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fbd993d0-1882-497f-bb62-defc4dd5de0b.6f7ea0b1-2da9-4537-a98f-45b78699c1d4" returned: 0 in 0.360s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:28:12 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-985b69a2-2b31-4bab-86f0-58cfeb016345 tempest-GroupsV314Test-111535998 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fbd993d0-1882-497f-bb62-defc4dd5de0b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86512) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 18:28:12 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d804e3d-ca88-4a91-846f-b075f5c9be44]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:28:12 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-985b69a2-2b31-4bab-86f0-58cfeb016345 tempest-GroupsV314Test-111535998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fbd993d0-1882-497f-bb62-defc4dd5de0b {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:28:12 devstack sudo[100355]: pam_unix(sudo:session): session closed for user root Sep 29 18:28:12 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-8fd5d048-4592-4ec7-ab8e-d480c93a9402 tempest-VolumesTransfersV357Test-1380990303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.263s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:28:12 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-8fd5d048-4592-4ec7-ab8e-d480c93a9402 tempest-VolumesTransfersV357Test-1380990303 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:28:12 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-8fd5d048-4592-4ec7-ab8e-d480c93a9402 tempest-VolumesTransfersV357Test-1380990303 None] Deleted volume successfully. Sep 29 18:28:12 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-8fd5d048-4592-4ec7-ab8e-d480c93a9402 tempest-VolumesTransfersV357Test-1380990303 None] Lock "cinder-6caecbf0-8441-46e3-8250-83ff985bdc49-delete_volume" released by "delete_volume" :: held 1.218s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:28:12 devstack sudo[100360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fbd993d0-1882-497f-bb62-defc4dd5de0b Sep 29 18:28:12 devstack sudo[100360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:28:12 devstack sudo[100360]: pam_unix(sudo:session): session closed for user root Sep 29 18:28:12 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-985b69a2-2b31-4bab-86f0-58cfeb016345 tempest-GroupsV314Test-111535998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fbd993d0-1882-497f-bb62-defc4dd5de0b" returned: 0 in 0.399s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:28:12 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-985b69a2-2b31-4bab-86f0-58cfeb016345 tempest-GroupsV314Test-111535998 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fbd993d0-1882-497f-bb62-defc4dd5de0b {{(pid=86512) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 29 18:28:12 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-985b69a2-2b31-4bab-86f0-58cfeb016345 tempest-GroupsV314Test-111535998 None] Creating direct copy from snapshot {{(pid=86512) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 29 18:28:12 devstack cinder-volume[86512]: DEBUG cinder.utils [None req-985b69a2-2b31-4bab-86f0-58cfeb016345 tempest-GroupsV314Test-111535998 None] Path /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-f5441650-b6f8-4863-8e22-99667cfe7004 not found in is_blk_device check {{(pid=86512) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 29 18:28:12 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-985b69a2-2b31-4bab-86f0-58cfeb016345 tempest-GroupsV314Test-111535998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fbd993d0-1882-497f-bb62-defc4dd5de0b /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-f5441650-b6f8-4863-8e22-99667cfe7004 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:28:12 devstack sudo[100366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fbd993d0-1882-497f-bb62-defc4dd5de0b /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-f5441650-b6f8-4863-8e22-99667cfe7004 Sep 29 18:28:12 devstack sudo[100366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:28:19 devstack sudo[100366]: pam_unix(sudo:session): session closed for user root Sep 29 18:28:19 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-985b69a2-2b31-4bab-86f0-58cfeb016345 tempest-GroupsV314Test-111535998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fbd993d0-1882-497f-bb62-defc4dd5de0b /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-f5441650-b6f8-4863-8e22-99667cfe7004" returned: 0 in 6.719s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:28:19 devstack cinder-volume[86512]: DEBUG cinder.image.image_utils [None req-985b69a2-2b31-4bab-86f0-58cfeb016345 tempest-GroupsV314Test-111535998 None] Image conversion details: src /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fbd993d0-1882-497f-bb62-defc4dd5de0b, size 1024.00 MB, duration 6.72 sec, destination /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-f5441650-b6f8-4863-8e22-99667cfe7004 {{(pid=86512) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 29 18:28:19 devstack cinder-volume[86512]: INFO cinder.image.image_utils [None req-985b69a2-2b31-4bab-86f0-58cfeb016345 tempest-GroupsV314Test-111535998 None] Converted 1024.00 MB image at 152.37 MB/s Sep 29 18:28:19 devstack cinder-volume[86512]: WARNING cinder.volume.drivers.remotefs [None req-985b69a2-2b31-4bab-86f0-58cfeb016345 tempest-GroupsV314Test-111535998 None] /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-f5441650-b6f8-4863-8e22-99667cfe7004 is being set with open permissions: ugo+rw: NotImplementedError Sep 29 18:28:19 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-985b69a2-2b31-4bab-86f0-58cfeb016345 tempest-GroupsV314Test-111535998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-f5441650-b6f8-4863-8e22-99667cfe7004 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:28:19 devstack sudo[100381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-f5441650-b6f8-4863-8e22-99667cfe7004 Sep 29 18:28:19 devstack sudo[100381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:28:19 devstack sudo[100381]: pam_unix(sudo:session): session closed for user root Sep 29 18:28:19 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-985b69a2-2b31-4bab-86f0-58cfeb016345 tempest-GroupsV314Test-111535998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-f5441650-b6f8-4863-8e22-99667cfe7004" returned: 0 in 0.241s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:28:19 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-985b69a2-2b31-4bab-86f0-58cfeb016345 tempest-GroupsV314Test-111535998 None] Lock "cinder-quobyte-f5441650-b6f8-4863-8e22-99667cfe7004" released by "_copy_volume_from_snapshot" :: held 7.804s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:28:19 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-985b69a2-2b31-4bab-86f0-58cfeb016345 tempest-GroupsV314Test-111535998 None] Acquiring lock "cinder-quobyte-6f7ea0b1-2da9-4537-a98f-45b78699c1d4" by "_delete_snapshot" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:28:19 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-985b69a2-2b31-4bab-86f0-58cfeb016345 tempest-GroupsV314Test-111535998 None] Lock "cinder-quobyte-6f7ea0b1-2da9-4537-a98f-45b78699c1d4" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:28:19 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-985b69a2-2b31-4bab-86f0-58cfeb016345 tempest-GroupsV314Test-111535998 None] Deleting offline snapshot 6f7ea0b1-2da9-4537-a98f-45b78699c1d4 of volume fbd993d0-1882-497f-bb62-defc4dd5de0b {{(pid=86512) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 18:28:19 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-985b69a2-2b31-4bab-86f0-58cfeb016345 tempest-GroupsV314Test-111535998 None] snapshot_file for this snap is: volume-fbd993d0-1882-497f-bb62-defc4dd5de0b.6f7ea0b1-2da9-4537-a98f-45b78699c1d4 {{(pid=86512) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 18:28:19 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[799a5339-0f18-4f6b-b538-49d1c7f056a4]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:28:19 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-985b69a2-2b31-4bab-86f0-58cfeb016345 tempest-GroupsV314Test-111535998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fbd993d0-1882-497f-bb62-defc4dd5de0b.6f7ea0b1-2da9-4537-a98f-45b78699c1d4 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:28:20 devstack sudo[100384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fbd993d0-1882-497f-bb62-defc4dd5de0b.6f7ea0b1-2da9-4537-a98f-45b78699c1d4 Sep 29 18:28:20 devstack sudo[100384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:28:20 devstack sudo[100384]: pam_unix(sudo:session): session closed for user root Sep 29 18:28:20 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-985b69a2-2b31-4bab-86f0-58cfeb016345 tempest-GroupsV314Test-111535998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fbd993d0-1882-497f-bb62-defc4dd5de0b.6f7ea0b1-2da9-4537-a98f-45b78699c1d4" returned: 0 in 0.396s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:28:20 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-985b69a2-2b31-4bab-86f0-58cfeb016345 tempest-GroupsV314Test-111535998 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fbd993d0-1882-497f-bb62-defc4dd5de0b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86512) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 18:28:20 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2296161-7027-48c0-a8be-8a5778b5f026]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:28:20 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-985b69a2-2b31-4bab-86f0-58cfeb016345 tempest-GroupsV314Test-111535998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fbd993d0-1882-497f-bb62-defc4dd5de0b {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:28:20 devstack sudo[100389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fbd993d0-1882-497f-bb62-defc4dd5de0b Sep 29 18:28:20 devstack sudo[100389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:28:20 devstack sudo[100389]: pam_unix(sudo:session): session closed for user root Sep 29 18:28:20 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-985b69a2-2b31-4bab-86f0-58cfeb016345 tempest-GroupsV314Test-111535998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fbd993d0-1882-497f-bb62-defc4dd5de0b" returned: 0 in 0.517s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:28:20 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-985b69a2-2b31-4bab-86f0-58cfeb016345 tempest-GroupsV314Test-111535998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fbd993d0-1882-497f-bb62-defc4dd5de0b.6f7ea0b1-2da9-4537-a98f-45b78699c1d4 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:28:20 devstack sudo[100394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fbd993d0-1882-497f-bb62-defc4dd5de0b.6f7ea0b1-2da9-4537-a98f-45b78699c1d4 Sep 29 18:28:20 devstack sudo[100394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:28:21 devstack sudo[100394]: pam_unix(sudo:session): session closed for user root Sep 29 18:28:21 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-985b69a2-2b31-4bab-86f0-58cfeb016345 tempest-GroupsV314Test-111535998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fbd993d0-1882-497f-bb62-defc4dd5de0b.6f7ea0b1-2da9-4537-a98f-45b78699c1d4" returned: 0 in 0.359s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:28:21 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-985b69a2-2b31-4bab-86f0-58cfeb016345 tempest-GroupsV314Test-111535998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fbd993d0-1882-497f-bb62-defc4dd5de0b.6f7ea0b1-2da9-4537-a98f-45b78699c1d4 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:28:21 devstack sudo[100401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fbd993d0-1882-497f-bb62-defc4dd5de0b.6f7ea0b1-2da9-4537-a98f-45b78699c1d4 Sep 29 18:28:21 devstack sudo[100401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:28:21 devstack sudo[100401]: pam_unix(sudo:session): session closed for user root Sep 29 18:28:21 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-985b69a2-2b31-4bab-86f0-58cfeb016345 tempest-GroupsV314Test-111535998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fbd993d0-1882-497f-bb62-defc4dd5de0b.6f7ea0b1-2da9-4537-a98f-45b78699c1d4" returned: 0 in 0.272s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:28:21 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-985b69a2-2b31-4bab-86f0-58cfeb016345 tempest-GroupsV314Test-111535998 None] Lock "cinder-quobyte-6f7ea0b1-2da9-4537-a98f-45b78699c1d4" released by "_delete_snapshot" :: held 1.661s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:28:21 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-985b69a2-2b31-4bab-86f0-58cfeb016345 tempest-GroupsV314Test-111535998 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.561s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:28:21 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-943943c4-72cf-4582-9970-5ef76f49f5e8 tempest-ProjectReaderTests-2070855465 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 20.756s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:28:21 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-943943c4-72cf-4582-9970-5ef76f49f5e8 tempest-ProjectReaderTests-2070855465 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:28:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1026257914',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7f264c0-76b6-4456-a9ce-9210bacde901,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f92c36a33aa1437ba704ce7f48246c50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:28:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:28:01Z,use_quota=True,user_id='0dcba85655314108a410c5150a09b572',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)}" {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:28:21 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-943943c4-72cf-4582-9970-5ef76f49f5e8 tempest-ProjectReaderTests-2070855465 None] Creating volume d7f264c0-76b6-4456-a9ce-9210bacde901 {{(pid=86512) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:28:21 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-943943c4-72cf-4582-9970-5ef76f49f5e8 tempest-ProjectReaderTests-2070855465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:28:21 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-943943c4-72cf-4582-9970-5ef76f49f5e8 tempest-ProjectReaderTests-2070855465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:28:21 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-943943c4-72cf-4582-9970-5ef76f49f5e8 tempest-ProjectReaderTests-2070855465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:28:21 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-943943c4-72cf-4582-9970-5ef76f49f5e8 tempest-ProjectReaderTests-2070855465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:28:21 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-943943c4-72cf-4582-9970-5ef76f49f5e8 tempest-ProjectReaderTests-2070855465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:28:21 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-943943c4-72cf-4582-9970-5ef76f49f5e8 tempest-ProjectReaderTests-2070855465 None] Selected osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 as target Quobyte volume. {{(pid=86512) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:28:21 devstack cinder-volume[86512]: INFO cinder.volume.drivers.remotefs [None req-943943c4-72cf-4582-9970-5ef76f49f5e8 tempest-ProjectReaderTests-2070855465 None] casted to osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 Sep 29 18:28:21 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-943943c4-72cf-4582-9970-5ef76f49f5e8 tempest-ProjectReaderTests-2070855465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-d7f264c0-76b6-4456-a9ce-9210bacde901 1073741824 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:28:21 devstack sudo[100404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-d7f264c0-76b6-4456-a9ce-9210bacde901 1073741824 Sep 29 18:28:21 devstack sudo[100404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:28:21 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-985b69a2-2b31-4bab-86f0-58cfeb016345 tempest-GroupsV314Test-111535998 None] Create group from source-group-ae067326-99ad-46d6-a9b9-5b150c7af932 completed successfully. Sep 29 18:28:21 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f8d8f16-61a9-433c-95e5-13f483a27410 tempest-VolumesCloneTest-598432755 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86512) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:28:21 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-8f8d8f16-61a9-433c-95e5-13f483a27410 tempest-VolumesCloneTest-598432755 None] Flow 'volume_create_manager' (a9381c10-0605-4f93-8624-76cda5b9d4fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:28:21 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-8f8d8f16-61a9-433c-95e5-13f483a27410 tempest-VolumesCloneTest-598432755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a656c691-73f6-4499-b9e3-f1ae5f46133b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:28:21 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-8f8d8f16-61a9-433c-95e5-13f483a27410 tempest-VolumesCloneTest-598432755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a656c691-73f6-4499-b9e3-f1ae5f46133b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:28:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-118981923',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5c35513-e73c-471d-b56f-e3eec6dbd56d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3225fdcf606944a98d2f0048fdad2ea0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:28:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:28:22Z,use_quota=True,user_id='b4a472f7853c4150ade9345ffd7cde76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:28:21 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-8f8d8f16-61a9-433c-95e5-13f483a27410 tempest-VolumesCloneTest-598432755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28f42504-d313-4324-a565-ad8288a8b9ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:28:21 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-8f8d8f16-61a9-433c-95e5-13f483a27410 tempest-VolumesCloneTest-598432755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28f42504-d313-4324-a565-ad8288a8b9ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:28:21 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-8f8d8f16-61a9-433c-95e5-13f483a27410 tempest-VolumesCloneTest-598432755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (557b130b-6387-475d-8e17-240cace4ee76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:28:21 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-8f8d8f16-61a9-433c-95e5-13f483a27410 tempest-VolumesCloneTest-598432755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (557b130b-6387-475d-8e17-240cace4ee76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5c35513-e73c-471d-b56f-e3eec6dbd56d', 'volume_name': 'volume-a5c35513-e73c-471d-b56f-e3eec6dbd56d', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:28:21 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-8f8d8f16-61a9-433c-95e5-13f483a27410 tempest-VolumesCloneTest-598432755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5447cf26-6762-4f45-a4ed-7043befa338a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:28:21 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-8f8d8f16-61a9-433c-95e5-13f483a27410 tempest-VolumesCloneTest-598432755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5447cf26-6762-4f45-a4ed-7043befa338a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:28:21 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-8f8d8f16-61a9-433c-95e5-13f483a27410 tempest-VolumesCloneTest-598432755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4c1c844-3712-4637-b8e6-87616c6b023e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:28:21 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-8f8d8f16-61a9-433c-95e5-13f483a27410 tempest-VolumesCloneTest-598432755 None] Volume a5c35513-e73c-471d-b56f-e3eec6dbd56d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5c35513-e73c-471d-b56f-e3eec6dbd56d', 'volume_size': 1} Sep 29 18:28:21 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-8f8d8f16-61a9-433c-95e5-13f483a27410 tempest-VolumesCloneTest-598432755 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:28:22 devstack sudo[100404]: pam_unix(sudo:session): session closed for user root Sep 29 18:28:22 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-943943c4-72cf-4582-9970-5ef76f49f5e8 tempest-ProjectReaderTests-2070855465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-d7f264c0-76b6-4456-a9ce-9210bacde901 1073741824" returned: 0 in 0.408s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:28:22 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-943943c4-72cf-4582-9970-5ef76f49f5e8 tempest-ProjectReaderTests-2070855465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-d7f264c0-76b6-4456-a9ce-9210bacde901 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:28:22 devstack sudo[100409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-d7f264c0-76b6-4456-a9ce-9210bacde901 Sep 29 18:28:22 devstack sudo[100409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:28:22 devstack sudo[100409]: pam_unix(sudo:session): session closed for user root Sep 29 18:28:22 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-943943c4-72cf-4582-9970-5ef76f49f5e8 tempest-ProjectReaderTests-2070855465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-d7f264c0-76b6-4456-a9ce-9210bacde901" returned: 0 in 0.234s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:28:22 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-943943c4-72cf-4582-9970-5ef76f49f5e8 tempest-ProjectReaderTests-2070855465 None] <== create_volume: return (682ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'} {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:28:22 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-943943c4-72cf-4582-9970-5ef76f49f5e8 tempest-ProjectReaderTests-2070855465 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.685s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:28:22 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-8765edbc-8a44-4d98-9b94-ce0d4142a5f8 tempest-VolumesGetTest-329956023 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.947s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:28:22 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-8765edbc-8a44-4d98-9b94-ce0d4142a5f8 tempest-VolumesGetTest-329956023 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:28:10Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2015609347',display_name='tempest-VolumesGetTest-Volume-52468926',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9db4b3ca-5fb5-4b1a-96bb-36251915d08c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='123ca1c819ab4c939d34d15531ec218c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:28:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:28:10Z,use_quota=True,user_id='d4b8a389e95e4820826e3c19485b4a7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)}" {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:28:22 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-8765edbc-8a44-4d98-9b94-ce0d4142a5f8 tempest-VolumesGetTest-329956023 None] Creating volume 9db4b3ca-5fb5-4b1a-96bb-36251915d08c {{(pid=86512) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:28:22 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-8765edbc-8a44-4d98-9b94-ce0d4142a5f8 tempest-VolumesGetTest-329956023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:28:22 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-8765edbc-8a44-4d98-9b94-ce0d4142a5f8 tempest-VolumesGetTest-329956023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:28:22 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-8765edbc-8a44-4d98-9b94-ce0d4142a5f8 tempest-VolumesGetTest-329956023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:28:22 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-8765edbc-8a44-4d98-9b94-ce0d4142a5f8 tempest-VolumesGetTest-329956023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:28:22 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-8765edbc-8a44-4d98-9b94-ce0d4142a5f8 tempest-VolumesGetTest-329956023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:28:22 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-8765edbc-8a44-4d98-9b94-ce0d4142a5f8 tempest-VolumesGetTest-329956023 None] Selected osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 as target Quobyte volume. {{(pid=86512) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:28:22 devstack cinder-volume[86512]: INFO cinder.volume.drivers.remotefs [None req-8765edbc-8a44-4d98-9b94-ce0d4142a5f8 tempest-VolumesGetTest-329956023 None] casted to osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 Sep 29 18:28:22 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-8765edbc-8a44-4d98-9b94-ce0d4142a5f8 tempest-VolumesGetTest-329956023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-9db4b3ca-5fb5-4b1a-96bb-36251915d08c 1073741824 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:28:22 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-943943c4-72cf-4582-9970-5ef76f49f5e8 tempest-ProjectReaderTests-2070855465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c16247d-0cb7-4ef4-9d5b-d703c5669e5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7f264c0-76b6-4456-a9ce-9210bacde901', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:28:22 devstack sudo[100412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-9db4b3ca-5fb5-4b1a-96bb-36251915d08c 1073741824 Sep 29 18:28:22 devstack sudo[100412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:28:22 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-943943c4-72cf-4582-9970-5ef76f49f5e8 tempest-ProjectReaderTests-2070855465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8eeb18a-598d-4aeb-9219-c195b7de99e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:28:22 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-943943c4-72cf-4582-9970-5ef76f49f5e8 tempest-ProjectReaderTests-2070855465 None] Volume volume-d7f264c0-76b6-4456-a9ce-9210bacde901 (d7f264c0-76b6-4456-a9ce-9210bacde901): created successfully Sep 29 18:28:22 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-943943c4-72cf-4582-9970-5ef76f49f5e8 tempest-ProjectReaderTests-2070855465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8eeb18a-598d-4aeb-9219-c195b7de99e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:28:22 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-943943c4-72cf-4582-9970-5ef76f49f5e8 tempest-ProjectReaderTests-2070855465 None] Flow 'volume_create_manager' (d25f8634-4f9e-4d06-8c8b-047be3116159) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:28:22 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-943943c4-72cf-4582-9970-5ef76f49f5e8 tempest-ProjectReaderTests-2070855465 None] Created volume successfully. Sep 29 18:28:22 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-d9b1c719-0cf5-401a-a939-980ba2ee263d tempest-ProjectReaderTests-2070855465 None] Acquiring lock "cinder-d7f264c0-76b6-4456-a9ce-9210bacde901-delete_volume" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:28:22 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-d9b1c719-0cf5-401a-a939-980ba2ee263d tempest-ProjectReaderTests-2070855465 None] Lock "cinder-d7f264c0-76b6-4456-a9ce-9210bacde901-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:28:22 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-d9b1c719-0cf5-401a-a939-980ba2ee263d tempest-ProjectReaderTests-2070855465 None] Acquiring lock "cinder-quobyte-d7f264c0-76b6-4456-a9ce-9210bacde901" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:28:22 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-d9b1c719-0cf5-401a-a939-980ba2ee263d tempest-ProjectReaderTests-2070855465 None] Lock "cinder-quobyte-d7f264c0-76b6-4456-a9ce-9210bacde901" acquired by "delete_volume" :: waited 0.029s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:28:22 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[b72ca324-8ad0-4cf7-8208-dafbf3ed62f2]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:28:22 devstack sudo[100412]: pam_unix(sudo:session): session closed for user root Sep 29 18:28:22 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-d9b1c719-0cf5-401a-a939-980ba2ee263d tempest-ProjectReaderTests-2070855465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-d7f264c0-76b6-4456-a9ce-9210bacde901 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:28:22 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-8765edbc-8a44-4d98-9b94-ce0d4142a5f8 tempest-VolumesGetTest-329956023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-9db4b3ca-5fb5-4b1a-96bb-36251915d08c 1073741824" returned: 0 in 0.521s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:28:22 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-8765edbc-8a44-4d98-9b94-ce0d4142a5f8 tempest-VolumesGetTest-329956023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-9db4b3ca-5fb5-4b1a-96bb-36251915d08c {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:28:22 devstack sudo[100420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-9db4b3ca-5fb5-4b1a-96bb-36251915d08c Sep 29 18:28:22 devstack sudo[100420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:28:22 devstack sudo[100419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-d7f264c0-76b6-4456-a9ce-9210bacde901 Sep 29 18:28:22 devstack sudo[100419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:28:23 devstack sudo[100420]: pam_unix(sudo:session): session closed for user root Sep 29 18:28:23 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-8765edbc-8a44-4d98-9b94-ce0d4142a5f8 tempest-VolumesGetTest-329956023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-9db4b3ca-5fb5-4b1a-96bb-36251915d08c" returned: 0 in 0.260s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:28:23 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-8765edbc-8a44-4d98-9b94-ce0d4142a5f8 tempest-VolumesGetTest-329956023 None] <== create_volume: return (828ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'} {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:28:23 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-8765edbc-8a44-4d98-9b94-ce0d4142a5f8 tempest-VolumesGetTest-329956023 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.830s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:28:23 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-8f8d8f16-61a9-433c-95e5-13f483a27410 tempest-VolumesCloneTest-598432755 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.301s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:28:23 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-8f8d8f16-61a9-433c-95e5-13f483a27410 tempest-VolumesCloneTest-598432755 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:28:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-118981923',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5c35513-e73c-471d-b56f-e3eec6dbd56d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3225fdcf606944a98d2f0048fdad2ea0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:28:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:28:22Z,use_quota=True,user_id='b4a472f7853c4150ade9345ffd7cde76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)}" {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:28:23 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-8f8d8f16-61a9-433c-95e5-13f483a27410 tempest-VolumesCloneTest-598432755 None] Creating volume a5c35513-e73c-471d-b56f-e3eec6dbd56d {{(pid=86512) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:28:23 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-8f8d8f16-61a9-433c-95e5-13f483a27410 tempest-VolumesCloneTest-598432755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:28:23 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-8f8d8f16-61a9-433c-95e5-13f483a27410 tempest-VolumesCloneTest-598432755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:28:23 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-8f8d8f16-61a9-433c-95e5-13f483a27410 tempest-VolumesCloneTest-598432755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:28:23 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-8f8d8f16-61a9-433c-95e5-13f483a27410 tempest-VolumesCloneTest-598432755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:28:23 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-8f8d8f16-61a9-433c-95e5-13f483a27410 tempest-VolumesCloneTest-598432755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:28:23 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-8f8d8f16-61a9-433c-95e5-13f483a27410 tempest-VolumesCloneTest-598432755 None] Selected osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 as target Quobyte volume. {{(pid=86512) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:28:23 devstack cinder-volume[86512]: INFO cinder.volume.drivers.remotefs [None req-8f8d8f16-61a9-433c-95e5-13f483a27410 tempest-VolumesCloneTest-598432755 None] casted to osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 Sep 29 18:28:23 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-8f8d8f16-61a9-433c-95e5-13f483a27410 tempest-VolumesCloneTest-598432755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a5c35513-e73c-471d-b56f-e3eec6dbd56d 1073741824 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:28:23 devstack sudo[100427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a5c35513-e73c-471d-b56f-e3eec6dbd56d 1073741824 Sep 29 18:28:23 devstack sudo[100427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:28:23 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-8765edbc-8a44-4d98-9b94-ce0d4142a5f8 tempest-VolumesGetTest-329956023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4550ddd9-6835-4748-859e-ea781b6004b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9db4b3ca-5fb5-4b1a-96bb-36251915d08c', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:28:23 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-8765edbc-8a44-4d98-9b94-ce0d4142a5f8 tempest-VolumesGetTest-329956023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd07014f-4d9a-4618-995f-11c385b6ce88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:28:23 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-8765edbc-8a44-4d98-9b94-ce0d4142a5f8 tempest-VolumesGetTest-329956023 None] Volume volume-9db4b3ca-5fb5-4b1a-96bb-36251915d08c (9db4b3ca-5fb5-4b1a-96bb-36251915d08c): created successfully Sep 29 18:28:23 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-8765edbc-8a44-4d98-9b94-ce0d4142a5f8 tempest-VolumesGetTest-329956023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd07014f-4d9a-4618-995f-11c385b6ce88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:28:23 devstack sudo[100419]: pam_unix(sudo:session): session closed for user root Sep 29 18:28:23 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-8765edbc-8a44-4d98-9b94-ce0d4142a5f8 tempest-VolumesGetTest-329956023 None] Flow 'volume_create_manager' (87e6fb97-3743-4593-9209-06693b4f7af0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:28:23 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-d9b1c719-0cf5-401a-a939-980ba2ee263d tempest-ProjectReaderTests-2070855465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-d7f264c0-76b6-4456-a9ce-9210bacde901" returned: 0 in 0.419s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:28:23 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-d9b1c719-0cf5-401a-a939-980ba2ee263d tempest-ProjectReaderTests-2070855465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-d7f264c0-76b6-4456-a9ce-9210bacde901 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:28:23 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-a123dcd9-5bae-4162-93dc-452a08ce56bc tempest-GroupsV314Test-111535998 None] Acquiring lock "cinder-quobyte-f5441650-b6f8-4863-8e22-99667cfe7004" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:28:23 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-8765edbc-8a44-4d98-9b94-ce0d4142a5f8 tempest-VolumesGetTest-329956023 None] Created volume successfully. Sep 29 18:28:23 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-a123dcd9-5bae-4162-93dc-452a08ce56bc tempest-GroupsV314Test-111535998 None] Lock "cinder-quobyte-f5441650-b6f8-4863-8e22-99667cfe7004" acquired by "delete_volume" :: waited 0.029s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:28:23 devstack sudo[100429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-d7f264c0-76b6-4456-a9ce-9210bacde901 Sep 29 18:28:23 devstack sudo[100429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:28:23 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ef8ac5e-2f6d-4028-98dc-fd75ed2b5882]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:28:23 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a123dcd9-5bae-4162-93dc-452a08ce56bc tempest-GroupsV314Test-111535998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-f5441650-b6f8-4863-8e22-99667cfe7004 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:28:23 devstack sudo[100431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-f5441650-b6f8-4863-8e22-99667cfe7004 Sep 29 18:28:23 devstack sudo[100431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:28:23 devstack sudo[100429]: pam_unix(sudo:session): session closed for user root Sep 29 18:28:23 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-d9b1c719-0cf5-401a-a939-980ba2ee263d tempest-ProjectReaderTests-2070855465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-d7f264c0-76b6-4456-a9ce-9210bacde901" returned: 0 in 0.315s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:28:23 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-d9b1c719-0cf5-401a-a939-980ba2ee263d tempest-ProjectReaderTests-2070855465 None] Lock "cinder-quobyte-d7f264c0-76b6-4456-a9ce-9210bacde901" released by "delete_volume" :: held 0.788s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:28:23 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-afb6992f-46d9-43a2-874e-fcc51d21f3d6 tempest-VolumesGetTest-329956023 None] Acquiring lock "cinder-9db4b3ca-5fb5-4b1a-96bb-36251915d08c-delete_volume" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:28:23 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-afb6992f-46d9-43a2-874e-fcc51d21f3d6 tempest-VolumesGetTest-329956023 None] Lock "cinder-9db4b3ca-5fb5-4b1a-96bb-36251915d08c-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:28:23 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-d9b1c719-0cf5-401a-a939-980ba2ee263d tempest-ProjectReaderTests-2070855465 None] Created reservations ['f255f82d-acb3-4c85-ba27-5ce24fc76d11', '8805b723-2399-4b92-a52d-24d40fb903dc', '6a944176-5fb1-49bb-939a-267f1445c260', '03ee81c5-f94c-412b-95ff-c02b55352fd4'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:28:23 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-afb6992f-46d9-43a2-874e-fcc51d21f3d6 tempest-VolumesGetTest-329956023 None] Acquiring lock "cinder-quobyte-9db4b3ca-5fb5-4b1a-96bb-36251915d08c" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:28:23 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-afb6992f-46d9-43a2-874e-fcc51d21f3d6 tempest-VolumesGetTest-329956023 None] Lock "cinder-quobyte-9db4b3ca-5fb5-4b1a-96bb-36251915d08c" acquired by "delete_volume" :: waited 0.021s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:28:23 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b7c1373-1b94-447c-b14f-d97769ad717a]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:28:23 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-afb6992f-46d9-43a2-874e-fcc51d21f3d6 tempest-VolumesGetTest-329956023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-9db4b3ca-5fb5-4b1a-96bb-36251915d08c {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:28:23 devstack sudo[100427]: pam_unix(sudo:session): session closed for user root Sep 29 18:28:23 devstack sudo[100431]: pam_unix(sudo:session): session closed for user root Sep 29 18:28:23 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-8f8d8f16-61a9-433c-95e5-13f483a27410 tempest-VolumesCloneTest-598432755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a5c35513-e73c-471d-b56f-e3eec6dbd56d 1073741824" returned: 0 in 0.616s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:28:23 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a123dcd9-5bae-4162-93dc-452a08ce56bc tempest-GroupsV314Test-111535998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-f5441650-b6f8-4863-8e22-99667cfe7004" returned: 0 in 0.462s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:28:23 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a123dcd9-5bae-4162-93dc-452a08ce56bc tempest-GroupsV314Test-111535998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-f5441650-b6f8-4863-8e22-99667cfe7004 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:28:23 devstack sudo[100443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-f5441650-b6f8-4863-8e22-99667cfe7004 Sep 29 18:28:23 devstack sudo[100443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:28:23 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-d9b1c719-0cf5-401a-a939-980ba2ee263d tempest-ProjectReaderTests-2070855465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:28:23 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-d9b1c719-0cf5-401a-a939-980ba2ee263d tempest-ProjectReaderTests-2070855465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:28:23 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-d9b1c719-0cf5-401a-a939-980ba2ee263d tempest-ProjectReaderTests-2070855465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:28:23 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-d9b1c719-0cf5-401a-a939-980ba2ee263d tempest-ProjectReaderTests-2070855465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:28:23 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-d9b1c719-0cf5-401a-a939-980ba2ee263d tempest-ProjectReaderTests-2070855465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:28:23 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-d9b1c719-0cf5-401a-a939-980ba2ee263d tempest-ProjectReaderTests-2070855465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:28:23 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-8f8d8f16-61a9-433c-95e5-13f483a27410 tempest-VolumesCloneTest-598432755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a5c35513-e73c-471d-b56f-e3eec6dbd56d {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:28:23 devstack sudo[100445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:28:23 devstack sudo[100445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:28:23 devstack sudo[100446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a5c35513-e73c-471d-b56f-e3eec6dbd56d Sep 29 18:28:23 devstack sudo[100446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:28:23 devstack sudo[100442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-9db4b3ca-5fb5-4b1a-96bb-36251915d08c Sep 29 18:28:23 devstack sudo[100442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:28:24 devstack sudo[100445]: pam_unix(sudo:session): session closed for user root Sep 29 18:28:24 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-d9b1c719-0cf5-401a-a939-980ba2ee263d tempest-ProjectReaderTests-2070855465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.309s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:28:24 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-d9b1c719-0cf5-401a-a939-980ba2ee263d tempest-ProjectReaderTests-2070855465 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:28:24 devstack sudo[100443]: pam_unix(sudo:session): session closed for user root Sep 29 18:28:24 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-d9b1c719-0cf5-401a-a939-980ba2ee263d tempest-ProjectReaderTests-2070855465 None] Deleted volume successfully. Sep 29 18:28:24 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a123dcd9-5bae-4162-93dc-452a08ce56bc tempest-GroupsV314Test-111535998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-f5441650-b6f8-4863-8e22-99667cfe7004" returned: 0 in 0.378s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:28:24 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-a123dcd9-5bae-4162-93dc-452a08ce56bc tempest-GroupsV314Test-111535998 None] Lock "cinder-quobyte-f5441650-b6f8-4863-8e22-99667cfe7004" released by "delete_volume" :: held 0.898s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:28:24 devstack sudo[100446]: pam_unix(sudo:session): session closed for user root Sep 29 18:28:24 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-d9b1c719-0cf5-401a-a939-980ba2ee263d tempest-ProjectReaderTests-2070855465 None] Lock "cinder-d7f264c0-76b6-4456-a9ce-9210bacde901-delete_volume" released by "delete_volume" :: held 1.489s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:28:24 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-8f8d8f16-61a9-433c-95e5-13f483a27410 tempest-VolumesCloneTest-598432755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a5c35513-e73c-471d-b56f-e3eec6dbd56d" returned: 0 in 0.350s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:28:24 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-8f8d8f16-61a9-433c-95e5-13f483a27410 tempest-VolumesCloneTest-598432755 None] <== create_volume: return (1074ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'} {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:28:24 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-8f8d8f16-61a9-433c-95e5-13f483a27410 tempest-VolumesCloneTest-598432755 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.078s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:28:24 devstack sudo[100442]: pam_unix(sudo:session): session closed for user root Sep 29 18:28:24 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-8f8d8f16-61a9-433c-95e5-13f483a27410 tempest-VolumesCloneTest-598432755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4c1c844-3712-4637-b8e6-87616c6b023e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5c35513-e73c-471d-b56f-e3eec6dbd56d', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:28:24 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-8f8d8f16-61a9-433c-95e5-13f483a27410 tempest-VolumesCloneTest-598432755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37041808-9824-4fe4-bc3e-8090a06c8a09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:28:24 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-afb6992f-46d9-43a2-874e-fcc51d21f3d6 tempest-VolumesGetTest-329956023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-9db4b3ca-5fb5-4b1a-96bb-36251915d08c" returned: 0 in 0.508s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:28:24 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-afb6992f-46d9-43a2-874e-fcc51d21f3d6 tempest-VolumesGetTest-329956023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-9db4b3ca-5fb5-4b1a-96bb-36251915d08c {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:28:24 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-8f8d8f16-61a9-433c-95e5-13f483a27410 tempest-VolumesCloneTest-598432755 None] Volume volume-a5c35513-e73c-471d-b56f-e3eec6dbd56d (a5c35513-e73c-471d-b56f-e3eec6dbd56d): created successfully Sep 29 18:28:24 devstack sudo[100458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-9db4b3ca-5fb5-4b1a-96bb-36251915d08c Sep 29 18:28:24 devstack sudo[100458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:28:24 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-8f8d8f16-61a9-433c-95e5-13f483a27410 tempest-VolumesCloneTest-598432755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37041808-9824-4fe4-bc3e-8090a06c8a09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:28:24 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-8f8d8f16-61a9-433c-95e5-13f483a27410 tempest-VolumesCloneTest-598432755 None] Flow 'volume_create_manager' (a9381c10-0605-4f93-8624-76cda5b9d4fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:28:24 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-8f8d8f16-61a9-433c-95e5-13f483a27410 tempest-VolumesCloneTest-598432755 None] Created volume successfully. Sep 29 18:28:24 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-a123dcd9-5bae-4162-93dc-452a08ce56bc tempest-GroupsV314Test-111535998 None] Created reservations ['592abac3-49f6-4ae0-8461-cda5cdf5b469'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:28:24 devstack cinder-volume[86512]: WARNING cinder.quota [None req-a123dcd9-5bae-4162-93dc-452a08ce56bc tempest-GroupsV314Test-111535998 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-650314718 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-650314718, it is now deprecated. Please use the default quota class for default quota. Sep 29 18:28:24 devstack cinder-volume[86512]: WARNING cinder.quota [None req-a123dcd9-5bae-4162-93dc-452a08ce56bc tempest-GroupsV314Test-111535998 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-650314718 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-650314718, it is now deprecated. Please use the default quota class for default quota. Sep 29 18:28:24 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-a123dcd9-5bae-4162-93dc-452a08ce56bc tempest-GroupsV314Test-111535998 None] Created reservations ['d6468bc7-cc3f-49b5-bfc1-726aa9f9c874', 'a5f6cdcc-d9e5-437b-acc5-0e27d3757030', '70702ef1-4fc9-40cc-b226-9e712113f817', '82dfed90-bd82-489a-9d14-a958f9b77069'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:28:24 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-a123dcd9-5bae-4162-93dc-452a08ce56bc tempest-GroupsV314Test-111535998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:28:24 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-a123dcd9-5bae-4162-93dc-452a08ce56bc tempest-GroupsV314Test-111535998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:28:24 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-a123dcd9-5bae-4162-93dc-452a08ce56bc tempest-GroupsV314Test-111535998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:28:24 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-a123dcd9-5bae-4162-93dc-452a08ce56bc tempest-GroupsV314Test-111535998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:28:24 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-a123dcd9-5bae-4162-93dc-452a08ce56bc tempest-GroupsV314Test-111535998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:28:24 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a123dcd9-5bae-4162-93dc-452a08ce56bc tempest-GroupsV314Test-111535998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:28:24 devstack sudo[100460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:28:24 devstack sudo[100460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:28:24 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-066be6bf-2b9d-4fed-a776-0051a061bac8 tempest-ProjectReaderTests-2070855465 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86512) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:28:24 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-066be6bf-2b9d-4fed-a776-0051a061bac8 tempest-ProjectReaderTests-2070855465 None] Flow 'volume_create_manager' (86e6deef-0af7-47c7-a369-b82f6ddda528) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:28:24 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-066be6bf-2b9d-4fed-a776-0051a061bac8 tempest-ProjectReaderTests-2070855465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17414845-e7ee-4c37-aa34-2b3ae601d9f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:28:24 devstack sudo[100458]: pam_unix(sudo:session): session closed for user root Sep 29 18:28:24 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-066be6bf-2b9d-4fed-a776-0051a061bac8 tempest-ProjectReaderTests-2070855465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17414845-e7ee-4c37-aa34-2b3ae601d9f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:28:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1171080641',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86e633f1-198f-4a46-9cc7-6c4fe5aa12e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f92c36a33aa1437ba704ce7f48246c50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:28:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:28:25Z,use_quota=True,user_id='0dcba85655314108a410c5150a09b572',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:28:24 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-066be6bf-2b9d-4fed-a776-0051a061bac8 tempest-ProjectReaderTests-2070855465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0233e5b-5281-4dce-9a3d-1f8ac48263d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:28:24 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-066be6bf-2b9d-4fed-a776-0051a061bac8 tempest-ProjectReaderTests-2070855465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0233e5b-5281-4dce-9a3d-1f8ac48263d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:28:24 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-066be6bf-2b9d-4fed-a776-0051a061bac8 tempest-ProjectReaderTests-2070855465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a80506a9-e3ef-4de2-ae2e-4702b2b4a007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:28:24 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-066be6bf-2b9d-4fed-a776-0051a061bac8 tempest-ProjectReaderTests-2070855465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a80506a9-e3ef-4de2-ae2e-4702b2b4a007) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '86e633f1-198f-4a46-9cc7-6c4fe5aa12e9', 'volume_name': 'volume-86e633f1-198f-4a46-9cc7-6c4fe5aa12e9', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:28:24 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-066be6bf-2b9d-4fed-a776-0051a061bac8 tempest-ProjectReaderTests-2070855465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e6ba751-5672-4aaa-a821-7abf965d8eff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:28:24 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-066be6bf-2b9d-4fed-a776-0051a061bac8 tempest-ProjectReaderTests-2070855465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e6ba751-5672-4aaa-a821-7abf965d8eff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:28:24 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-066be6bf-2b9d-4fed-a776-0051a061bac8 tempest-ProjectReaderTests-2070855465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae2eec18-142e-491c-bbe8-55db24c0bb65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:28:24 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-066be6bf-2b9d-4fed-a776-0051a061bac8 tempest-ProjectReaderTests-2070855465 None] Volume 86e633f1-198f-4a46-9cc7-6c4fe5aa12e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-86e633f1-198f-4a46-9cc7-6c4fe5aa12e9', 'volume_size': 1} Sep 29 18:28:24 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-066be6bf-2b9d-4fed-a776-0051a061bac8 tempest-ProjectReaderTests-2070855465 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:28:24 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-066be6bf-2b9d-4fed-a776-0051a061bac8 tempest-ProjectReaderTests-2070855465 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:28:24 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-066be6bf-2b9d-4fed-a776-0051a061bac8 tempest-ProjectReaderTests-2070855465 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:28:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1171080641',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86e633f1-198f-4a46-9cc7-6c4fe5aa12e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f92c36a33aa1437ba704ce7f48246c50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:28:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:28:25Z,use_quota=True,user_id='0dcba85655314108a410c5150a09b572',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)}" {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:28:24 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-066be6bf-2b9d-4fed-a776-0051a061bac8 tempest-ProjectReaderTests-2070855465 None] Creating volume 86e633f1-198f-4a46-9cc7-6c4fe5aa12e9 {{(pid=86512) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:28:24 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-066be6bf-2b9d-4fed-a776-0051a061bac8 tempest-ProjectReaderTests-2070855465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:28:24 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-066be6bf-2b9d-4fed-a776-0051a061bac8 tempest-ProjectReaderTests-2070855465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:28:24 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-066be6bf-2b9d-4fed-a776-0051a061bac8 tempest-ProjectReaderTests-2070855465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:28:24 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-066be6bf-2b9d-4fed-a776-0051a061bac8 tempest-ProjectReaderTests-2070855465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:28:24 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-066be6bf-2b9d-4fed-a776-0051a061bac8 tempest-ProjectReaderTests-2070855465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:28:24 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-066be6bf-2b9d-4fed-a776-0051a061bac8 tempest-ProjectReaderTests-2070855465 None] Selected osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 as target Quobyte volume. {{(pid=86512) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:28:24 devstack cinder-volume[86512]: INFO cinder.volume.drivers.remotefs [None req-066be6bf-2b9d-4fed-a776-0051a061bac8 tempest-ProjectReaderTests-2070855465 None] casted to osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 Sep 29 18:28:24 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-066be6bf-2b9d-4fed-a776-0051a061bac8 tempest-ProjectReaderTests-2070855465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-86e633f1-198f-4a46-9cc7-6c4fe5aa12e9 1073741824 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:28:24 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-afb6992f-46d9-43a2-874e-fcc51d21f3d6 tempest-VolumesGetTest-329956023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-9db4b3ca-5fb5-4b1a-96bb-36251915d08c" returned: 0 in 0.524s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:28:24 devstack sudo[100463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-86e633f1-198f-4a46-9cc7-6c4fe5aa12e9 1073741824 Sep 29 18:28:24 devstack sudo[100463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:28:24 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-afb6992f-46d9-43a2-874e-fcc51d21f3d6 tempest-VolumesGetTest-329956023 None] Lock "cinder-quobyte-9db4b3ca-5fb5-4b1a-96bb-36251915d08c" released by "delete_volume" :: held 1.102s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:28:24 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-afb6992f-46d9-43a2-874e-fcc51d21f3d6 tempest-VolumesGetTest-329956023 None] Created reservations ['d248a647-b34f-47a3-af2d-b72195f97027', '10793214-f161-4d3e-910b-d6048ffc9004', 'e809a9db-7125-48c6-8350-d745f86cdb48', 'de1d1655-55e3-4826-9d3b-481571806515'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:28:24 devstack sudo[100460]: pam_unix(sudo:session): session closed for user root Sep 29 18:28:24 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a123dcd9-5bae-4162-93dc-452a08ce56bc tempest-GroupsV314Test-111535998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.413s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:28:24 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-a123dcd9-5bae-4162-93dc-452a08ce56bc tempest-GroupsV314Test-111535998 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:28:24 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-a123dcd9-5bae-4162-93dc-452a08ce56bc tempest-GroupsV314Test-111535998 None] Delete group completed successfully. Sep 29 18:28:24 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-afb6992f-46d9-43a2-874e-fcc51d21f3d6 tempest-VolumesGetTest-329956023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:28:24 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-afb6992f-46d9-43a2-874e-fcc51d21f3d6 tempest-VolumesGetTest-329956023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:28:24 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-afb6992f-46d9-43a2-874e-fcc51d21f3d6 tempest-VolumesGetTest-329956023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:28:24 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-afb6992f-46d9-43a2-874e-fcc51d21f3d6 tempest-VolumesGetTest-329956023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:28:25 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-afb6992f-46d9-43a2-874e-fcc51d21f3d6 tempest-VolumesGetTest-329956023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:28:25 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-afb6992f-46d9-43a2-874e-fcc51d21f3d6 tempest-VolumesGetTest-329956023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:28:25 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-abfcbd9f-dfdf-4c11-96be-9ee88cd39a05 tempest-GroupsV314Test-111535998 None] Acquiring lock "cinder-quobyte-fbd993d0-1882-497f-bb62-defc4dd5de0b" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:28:25 devstack sudo[100466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:28:25 devstack sudo[100466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:28:25 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-abfcbd9f-dfdf-4c11-96be-9ee88cd39a05 tempest-GroupsV314Test-111535998 None] Lock "cinder-quobyte-fbd993d0-1882-497f-bb62-defc4dd5de0b" acquired by "delete_volume" :: waited 0.025s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:28:25 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[649256f1-02b8-4498-ac4b-098415937f5a]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:28:25 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-abfcbd9f-dfdf-4c11-96be-9ee88cd39a05 tempest-GroupsV314Test-111535998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fbd993d0-1882-497f-bb62-defc4dd5de0b {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:28:25 devstack sudo[100471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fbd993d0-1882-497f-bb62-defc4dd5de0b Sep 29 18:28:25 devstack sudo[100471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:28:25 devstack sudo[100466]: pam_unix(sudo:session): session closed for user root Sep 29 18:28:25 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-afb6992f-46d9-43a2-874e-fcc51d21f3d6 tempest-VolumesGetTest-329956023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.344s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:28:25 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-afb6992f-46d9-43a2-874e-fcc51d21f3d6 tempest-VolumesGetTest-329956023 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:28:25 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-afb6992f-46d9-43a2-874e-fcc51d21f3d6 tempest-VolumesGetTest-329956023 None] Deleted volume successfully. Sep 29 18:28:25 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-afb6992f-46d9-43a2-874e-fcc51d21f3d6 tempest-VolumesGetTest-329956023 None] Lock "cinder-9db4b3ca-5fb5-4b1a-96bb-36251915d08c-delete_volume" released by "delete_volume" :: held 1.731s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:28:25 devstack sudo[100463]: pam_unix(sudo:session): session closed for user root Sep 29 18:28:25 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-066be6bf-2b9d-4fed-a776-0051a061bac8 tempest-ProjectReaderTests-2070855465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-86e633f1-198f-4a46-9cc7-6c4fe5aa12e9 1073741824" returned: 0 in 0.647s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:28:25 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-066be6bf-2b9d-4fed-a776-0051a061bac8 tempest-ProjectReaderTests-2070855465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-86e633f1-198f-4a46-9cc7-6c4fe5aa12e9 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:28:25 devstack sudo[100474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-86e633f1-198f-4a46-9cc7-6c4fe5aa12e9 Sep 29 18:28:25 devstack sudo[100474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:28:25 devstack sudo[100471]: pam_unix(sudo:session): session closed for user root Sep 29 18:28:25 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-abfcbd9f-dfdf-4c11-96be-9ee88cd39a05 tempest-GroupsV314Test-111535998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fbd993d0-1882-497f-bb62-defc4dd5de0b" returned: 0 in 0.449s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:28:25 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-abfcbd9f-dfdf-4c11-96be-9ee88cd39a05 tempest-GroupsV314Test-111535998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fbd993d0-1882-497f-bb62-defc4dd5de0b {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:28:25 devstack sudo[100479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fbd993d0-1882-497f-bb62-defc4dd5de0b Sep 29 18:28:25 devstack sudo[100479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:28:25 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e19058e-4734-481d-a091-d1461012f38a tempest-VolumesCloneTest-598432755 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86512) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:28:25 devstack sudo[100474]: pam_unix(sudo:session): session closed for user root Sep 29 18:28:25 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-2e19058e-4734-481d-a091-d1461012f38a tempest-VolumesCloneTest-598432755 None] Flow 'volume_create_manager' (13aa4e80-b47b-4dd2-bec7-f84464fe5db1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:28:25 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-2e19058e-4734-481d-a091-d1461012f38a tempest-VolumesCloneTest-598432755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc5ecbb9-de20-4fcb-bcf1-7f1708b2bd37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:28:25 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-066be6bf-2b9d-4fed-a776-0051a061bac8 tempest-ProjectReaderTests-2070855465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-86e633f1-198f-4a46-9cc7-6c4fe5aa12e9" returned: 0 in 0.301s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:28:25 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-066be6bf-2b9d-4fed-a776-0051a061bac8 tempest-ProjectReaderTests-2070855465 None] <== create_volume: return (1004ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'} {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:28:25 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-066be6bf-2b9d-4fed-a776-0051a061bac8 tempest-ProjectReaderTests-2070855465 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.006s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:28:25 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-2e19058e-4734-481d-a091-d1461012f38a tempest-VolumesCloneTest-598432755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc5ecbb9-de20-4fcb-bcf1-7f1708b2bd37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:28:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-18970343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e589948-071e-4a1d-99b0-80094c9ba8e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3225fdcf606944a98d2f0048fdad2ea0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:28:26Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=a5c35513-e73c-471d-b56f-e3eec6dbd56d,status='creating',terminated_at=None,updated_at=2026-09-29T16:28:26Z,use_quota=True,user_id='b4a472f7853c4150ade9345ffd7cde76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:28:25 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-2e19058e-4734-481d-a091-d1461012f38a tempest-VolumesCloneTest-598432755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc0b9cf0-11cb-40a0-9ae7-0452c2dfc20f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:28:25 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-2e19058e-4734-481d-a091-d1461012f38a tempest-VolumesCloneTest-598432755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc0b9cf0-11cb-40a0-9ae7-0452c2dfc20f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:28:25 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-2e19058e-4734-481d-a091-d1461012f38a tempest-VolumesCloneTest-598432755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9d0b23e-f7a9-431a-81ae-3bb87e05427b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:28:25 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-066be6bf-2b9d-4fed-a776-0051a061bac8 tempest-ProjectReaderTests-2070855465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae2eec18-142e-491c-bbe8-55db24c0bb65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86e633f1-198f-4a46-9cc7-6c4fe5aa12e9', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:28:25 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-066be6bf-2b9d-4fed-a776-0051a061bac8 tempest-ProjectReaderTests-2070855465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (509b5f00-6aae-4459-85ff-11ab0e6a9694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:28:25 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-2e19058e-4734-481d-a091-d1461012f38a tempest-VolumesCloneTest-598432755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9d0b23e-f7a9-431a-81ae-3bb87e05427b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '9e589948-071e-4a1d-99b0-80094c9ba8e9', 'volume_name': 'volume-9e589948-071e-4a1d-99b0-80094c9ba8e9', 'volume_size': 2, 'source_volid': 'a5c35513-e73c-471d-b56f-e3eec6dbd56d', 'source_volstatus': 'available'}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:28:25 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-2e19058e-4734-481d-a091-d1461012f38a tempest-VolumesCloneTest-598432755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5130c95b-6f53-4771-a893-f6a95b4a227d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:28:25 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-2e19058e-4734-481d-a091-d1461012f38a tempest-VolumesCloneTest-598432755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5130c95b-6f53-4771-a893-f6a95b4a227d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:28:25 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-2e19058e-4734-481d-a091-d1461012f38a tempest-VolumesCloneTest-598432755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (518cdeb5-f155-4877-ac25-d4d6cb8df9cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:28:25 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-2e19058e-4734-481d-a091-d1461012f38a tempest-VolumesCloneTest-598432755 None] Volume 9e589948-071e-4a1d-99b0-80094c9ba8e9: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-9e589948-071e-4a1d-99b0-80094c9ba8e9', 'volume_size': 2, 'source_volid': 'a5c35513-e73c-471d-b56f-e3eec6dbd56d', 'source_volstatus': 'available'} Sep 29 18:28:25 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-066be6bf-2b9d-4fed-a776-0051a061bac8 tempest-ProjectReaderTests-2070855465 None] Volume volume-86e633f1-198f-4a46-9cc7-6c4fe5aa12e9 (86e633f1-198f-4a46-9cc7-6c4fe5aa12e9): created successfully Sep 29 18:28:25 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-066be6bf-2b9d-4fed-a776-0051a061bac8 tempest-ProjectReaderTests-2070855465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (509b5f00-6aae-4459-85ff-11ab0e6a9694) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:28:25 devstack sudo[100479]: pam_unix(sudo:session): session closed for user root Sep 29 18:28:25 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-066be6bf-2b9d-4fed-a776-0051a061bac8 tempest-ProjectReaderTests-2070855465 None] Flow 'volume_create_manager' (86e6deef-0af7-47c7-a369-b82f6ddda528) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:28:25 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-abfcbd9f-dfdf-4c11-96be-9ee88cd39a05 tempest-GroupsV314Test-111535998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fbd993d0-1882-497f-bb62-defc4dd5de0b" returned: 0 in 0.278s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:28:25 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-2e19058e-4734-481d-a091-d1461012f38a tempest-VolumesCloneTest-598432755 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:28:25 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-2e19058e-4734-481d-a091-d1461012f38a tempest-VolumesCloneTest-598432755 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:28:25 devstack cinder-volume[86512]: INFO cinder.volume.drivers.remotefs [None req-2e19058e-4734-481d-a091-d1461012f38a tempest-VolumesCloneTest-598432755 None] Cloning volume a5c35513-e73c-471d-b56f-e3eec6dbd56d to volume 9e589948-071e-4a1d-99b0-80094c9ba8e9 Sep 29 18:28:25 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-abfcbd9f-dfdf-4c11-96be-9ee88cd39a05 tempest-GroupsV314Test-111535998 None] Lock "cinder-quobyte-fbd993d0-1882-497f-bb62-defc4dd5de0b" released by "delete_volume" :: held 0.810s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:28:25 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-066be6bf-2b9d-4fed-a776-0051a061bac8 tempest-ProjectReaderTests-2070855465 None] Created volume successfully. Sep 29 18:28:25 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-2e19058e-4734-481d-a091-d1461012f38a tempest-VolumesCloneTest-598432755 None] Creating offline snapshot 36df81aa-7f8c-45f3-8521-294b6bee04e1 of volume a5c35513-e73c-471d-b56f-e3eec6dbd56d {{(pid=86512) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 18:28:25 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[d20457c7-e45c-4572-9ed5-fe386a069f87]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:28:25 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-2e19058e-4734-481d-a091-d1461012f38a tempest-VolumesCloneTest-598432755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a5c35513-e73c-471d-b56f-e3eec6dbd56d {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:28:25 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-abfcbd9f-dfdf-4c11-96be-9ee88cd39a05 tempest-GroupsV314Test-111535998 None] Created reservations ['73c8162d-a720-4032-aff7-41d430825733'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:28:26 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-8f2685e0-8670-4406-9753-8a2304a8d065 tempest-VolumesGetTest-329956023 None] Acquiring lock "cinder-ef879903-8e61-496a-9d41-0cebc74826c2-delete_volume" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:28:26 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-8f2685e0-8670-4406-9753-8a2304a8d065 tempest-VolumesGetTest-329956023 None] Lock "cinder-ef879903-8e61-496a-9d41-0cebc74826c2-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:28:26 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-abfcbd9f-dfdf-4c11-96be-9ee88cd39a05 tempest-GroupsV314Test-111535998 None] Created reservations ['771216d8-ad57-4b22-8b0b-09cfcc7af59e', '8753e08c-cfe4-4aed-8fde-e2652498ddb7', '3c2080ed-14f9-4ae7-b92c-63d2c3d7b6aa', '8c7a0b56-0a99-4b5a-8cf3-27b1fba78274'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:28:26 devstack sudo[100483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a5c35513-e73c-471d-b56f-e3eec6dbd56d Sep 29 18:28:26 devstack sudo[100483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:28:26 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-8f2685e0-8670-4406-9753-8a2304a8d065 tempest-VolumesGetTest-329956023 None] Acquiring lock "cinder-quobyte-ef879903-8e61-496a-9d41-0cebc74826c2" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:28:26 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-8f2685e0-8670-4406-9753-8a2304a8d065 tempest-VolumesGetTest-329956023 None] Lock "cinder-quobyte-ef879903-8e61-496a-9d41-0cebc74826c2" acquired by "delete_volume" :: waited 0.020s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:28:26 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[3292202c-4385-4916-a94b-a054d9780a3f]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:28:26 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-8f2685e0-8670-4406-9753-8a2304a8d065 tempest-VolumesGetTest-329956023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ef879903-8e61-496a-9d41-0cebc74826c2 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:28:26 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-abfcbd9f-dfdf-4c11-96be-9ee88cd39a05 tempest-GroupsV314Test-111535998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:28:26 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-abfcbd9f-dfdf-4c11-96be-9ee88cd39a05 tempest-GroupsV314Test-111535998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:28:26 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-abfcbd9f-dfdf-4c11-96be-9ee88cd39a05 tempest-GroupsV314Test-111535998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:28:26 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-abfcbd9f-dfdf-4c11-96be-9ee88cd39a05 tempest-GroupsV314Test-111535998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:28:26 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-abfcbd9f-dfdf-4c11-96be-9ee88cd39a05 tempest-GroupsV314Test-111535998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:28:26 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-abfcbd9f-dfdf-4c11-96be-9ee88cd39a05 tempest-GroupsV314Test-111535998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:28:26 devstack sudo[100486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:28:26 devstack sudo[100486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:28:26 devstack sudo[100485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ef879903-8e61-496a-9d41-0cebc74826c2 Sep 29 18:28:26 devstack sudo[100485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:28:26 devstack sudo[100483]: pam_unix(sudo:session): session closed for user root Sep 29 18:28:26 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-2e19058e-4734-481d-a091-d1461012f38a tempest-VolumesCloneTest-598432755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a5c35513-e73c-471d-b56f-e3eec6dbd56d" returned: 0 in 0.450s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:28:26 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-2e19058e-4734-481d-a091-d1461012f38a tempest-VolumesCloneTest-598432755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a5c35513-e73c-471d-b56f-e3eec6dbd56d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a5c35513-e73c-471d-b56f-e3eec6dbd56d.36df81aa-7f8c-45f3-8521-294b6bee04e1 1G {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:28:26 devstack sudo[100492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a5c35513-e73c-471d-b56f-e3eec6dbd56d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a5c35513-e73c-471d-b56f-e3eec6dbd56d.36df81aa-7f8c-45f3-8521-294b6bee04e1 1G Sep 29 18:28:26 devstack sudo[100492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:28:26 devstack sudo[100486]: pam_unix(sudo:session): session closed for user root Sep 29 18:28:26 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-abfcbd9f-dfdf-4c11-96be-9ee88cd39a05 tempest-GroupsV314Test-111535998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.296s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:28:26 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-abfcbd9f-dfdf-4c11-96be-9ee88cd39a05 tempest-GroupsV314Test-111535998 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:28:26 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-abfcbd9f-dfdf-4c11-96be-9ee88cd39a05 tempest-GroupsV314Test-111535998 None] Delete group completed successfully. Sep 29 18:28:26 devstack sudo[100485]: pam_unix(sudo:session): session closed for user root Sep 29 18:28:26 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-8f2685e0-8670-4406-9753-8a2304a8d065 tempest-VolumesGetTest-329956023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ef879903-8e61-496a-9d41-0cebc74826c2" returned: 0 in 0.454s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:28:26 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-8f2685e0-8670-4406-9753-8a2304a8d065 tempest-VolumesGetTest-329956023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ef879903-8e61-496a-9d41-0cebc74826c2 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:28:26 devstack sudo[100499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ef879903-8e61-496a-9d41-0cebc74826c2 Sep 29 18:28:26 devstack sudo[100499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:28:26 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-e7659176-df45-404e-9e1f-482ca9d6580b tempest-ProjectReaderTests-2070855465 None] Acquiring lock "cinder-86e633f1-198f-4a46-9cc7-6c4fe5aa12e9-delete_volume" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:28:26 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-e7659176-df45-404e-9e1f-482ca9d6580b tempest-ProjectReaderTests-2070855465 None] Lock "cinder-86e633f1-198f-4a46-9cc7-6c4fe5aa12e9-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:28:26 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-e7659176-df45-404e-9e1f-482ca9d6580b tempest-ProjectReaderTests-2070855465 None] Acquiring lock "cinder-quobyte-86e633f1-198f-4a46-9cc7-6c4fe5aa12e9" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:28:26 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-e7659176-df45-404e-9e1f-482ca9d6580b tempest-ProjectReaderTests-2070855465 None] Lock "cinder-quobyte-86e633f1-198f-4a46-9cc7-6c4fe5aa12e9" acquired by "delete_volume" :: waited 0.017s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:28:26 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1508f00-8f57-466f-a413-8170a84698f4]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:28:26 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-e7659176-df45-404e-9e1f-482ca9d6580b tempest-ProjectReaderTests-2070855465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-86e633f1-198f-4a46-9cc7-6c4fe5aa12e9 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:28:26 devstack sudo[100499]: pam_unix(sudo:session): session closed for user root Sep 29 18:28:26 devstack sudo[100492]: pam_unix(sudo:session): session closed for user root Sep 29 18:28:26 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-2e19058e-4734-481d-a091-d1461012f38a tempest-VolumesCloneTest-598432755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a5c35513-e73c-471d-b56f-e3eec6dbd56d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a5c35513-e73c-471d-b56f-e3eec6dbd56d.36df81aa-7f8c-45f3-8521-294b6bee04e1 1G" returned: 0 in 0.533s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:28:26 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-8f2685e0-8670-4406-9753-8a2304a8d065 tempest-VolumesGetTest-329956023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ef879903-8e61-496a-9d41-0cebc74826c2" returned: 0 in 0.337s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:28:26 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-2e19058e-4734-481d-a091-d1461012f38a tempest-VolumesCloneTest-598432755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5c35513-e73c-471d-b56f-e3eec6dbd56d -F qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a5c35513-e73c-471d-b56f-e3eec6dbd56d.36df81aa-7f8c-45f3-8521-294b6bee04e1 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:28:26 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-8f2685e0-8670-4406-9753-8a2304a8d065 tempest-VolumesGetTest-329956023 None] Lock "cinder-quobyte-ef879903-8e61-496a-9d41-0cebc74826c2" released by "delete_volume" :: held 0.855s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:28:26 devstack sudo[100507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5c35513-e73c-471d-b56f-e3eec6dbd56d -F qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a5c35513-e73c-471d-b56f-e3eec6dbd56d.36df81aa-7f8c-45f3-8521-294b6bee04e1 Sep 29 18:28:26 devstack sudo[100507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:28:27 devstack sudo[100505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-86e633f1-198f-4a46-9cc7-6c4fe5aa12e9 Sep 29 18:28:27 devstack sudo[100505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:28:27 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-8f2685e0-8670-4406-9753-8a2304a8d065 tempest-VolumesGetTest-329956023 None] Created reservations ['9235e6ed-963a-45dd-95e3-4900549ea843', 'bfbe3636-f59f-41be-9d4a-5f259c9d8c7c', '5a26e2de-529a-49c0-ade4-6e1304f23890', '5a86d80d-cbcc-4df2-b023-15bd51eaf683'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:28:27 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-8f2685e0-8670-4406-9753-8a2304a8d065 tempest-VolumesGetTest-329956023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:28:27 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-8f2685e0-8670-4406-9753-8a2304a8d065 tempest-VolumesGetTest-329956023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:28:27 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-8f2685e0-8670-4406-9753-8a2304a8d065 tempest-VolumesGetTest-329956023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:28:27 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-8f2685e0-8670-4406-9753-8a2304a8d065 tempest-VolumesGetTest-329956023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:28:27 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-8f2685e0-8670-4406-9753-8a2304a8d065 tempest-VolumesGetTest-329956023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:28:27 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-8f2685e0-8670-4406-9753-8a2304a8d065 tempest-VolumesGetTest-329956023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:28:27 devstack sudo[100510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:28:27 devstack sudo[100510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:28:27 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-f6e58908-43f1-4318-a8ec-8dce3f5cfd14 tempest-VolumesGetTest-329956023 None] Acquiring lock "cinder-a307d519-1974-4ac1-8d2d-f0890bf2a944-delete_volume" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:28:27 devstack sudo[100505]: pam_unix(sudo:session): session closed for user root Sep 29 18:28:27 devstack sudo[100507]: pam_unix(sudo:session): session closed for user root Sep 29 18:28:27 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-e7659176-df45-404e-9e1f-482ca9d6580b tempest-ProjectReaderTests-2070855465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-86e633f1-198f-4a46-9cc7-6c4fe5aa12e9" returned: 0 in 0.482s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:28:27 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-e7659176-df45-404e-9e1f-482ca9d6580b tempest-ProjectReaderTests-2070855465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-86e633f1-198f-4a46-9cc7-6c4fe5aa12e9 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:28:27 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-2e19058e-4734-481d-a091-d1461012f38a tempest-VolumesCloneTest-598432755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a5c35513-e73c-471d-b56f-e3eec6dbd56d -F qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a5c35513-e73c-471d-b56f-e3eec6dbd56d.36df81aa-7f8c-45f3-8521-294b6bee04e1" returned: 0 in 0.430s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:28:27 devstack cinder-volume[86512]: WARNING cinder.volume.drivers.remotefs [None req-2e19058e-4734-481d-a091-d1461012f38a tempest-VolumesCloneTest-598432755 None] /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a5c35513-e73c-471d-b56f-e3eec6dbd56d.36df81aa-7f8c-45f3-8521-294b6bee04e1 is being set with open permissions: ugo+rw Sep 29 18:28:27 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-2e19058e-4734-481d-a091-d1461012f38a tempest-VolumesCloneTest-598432755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a5c35513-e73c-471d-b56f-e3eec6dbd56d.36df81aa-7f8c-45f3-8521-294b6bee04e1 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:28:27 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-f6e58908-43f1-4318-a8ec-8dce3f5cfd14 tempest-VolumesGetTest-329956023 None] Lock "cinder-a307d519-1974-4ac1-8d2d-f0890bf2a944-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:28:27 devstack sudo[100519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a5c35513-e73c-471d-b56f-e3eec6dbd56d.36df81aa-7f8c-45f3-8521-294b6bee04e1 Sep 29 18:28:27 devstack sudo[100519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:28:27 devstack sudo[100518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-86e633f1-198f-4a46-9cc7-6c4fe5aa12e9 Sep 29 18:28:27 devstack sudo[100518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:28:27 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-f6e58908-43f1-4318-a8ec-8dce3f5cfd14 tempest-VolumesGetTest-329956023 None] Acquiring lock "cinder-quobyte-a307d519-1974-4ac1-8d2d-f0890bf2a944" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:28:27 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-f6e58908-43f1-4318-a8ec-8dce3f5cfd14 tempest-VolumesGetTest-329956023 None] Lock "cinder-quobyte-a307d519-1974-4ac1-8d2d-f0890bf2a944" acquired by "delete_volume" :: waited 0.030s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:28:27 devstack sudo[100510]: pam_unix(sudo:session): session closed for user root Sep 29 18:28:27 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[d20e783a-13e0-409e-a46a-869bf4b773f0]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:28:27 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-f6e58908-43f1-4318-a8ec-8dce3f5cfd14 tempest-VolumesGetTest-329956023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a307d519-1974-4ac1-8d2d-f0890bf2a944 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:28:27 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-8f2685e0-8670-4406-9753-8a2304a8d065 tempest-VolumesGetTest-329956023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.417s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:28:27 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-8f2685e0-8670-4406-9753-8a2304a8d065 tempest-VolumesGetTest-329956023 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:28:27 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-8f2685e0-8670-4406-9753-8a2304a8d065 tempest-VolumesGetTest-329956023 None] Deleted volume successfully. Sep 29 18:28:27 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-8f2685e0-8670-4406-9753-8a2304a8d065 tempest-VolumesGetTest-329956023 None] Lock "cinder-ef879903-8e61-496a-9d41-0cebc74826c2-delete_volume" released by "delete_volume" :: held 1.599s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:28:27 devstack sudo[100519]: pam_unix(sudo:session): session closed for user root Sep 29 18:28:27 devstack sudo[100523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a307d519-1974-4ac1-8d2d-f0890bf2a944 Sep 29 18:28:27 devstack sudo[100523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:28:27 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-2e19058e-4734-481d-a091-d1461012f38a tempest-VolumesCloneTest-598432755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a5c35513-e73c-471d-b56f-e3eec6dbd56d.36df81aa-7f8c-45f3-8521-294b6bee04e1" returned: 0 in 0.349s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:28:27 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-2e19058e-4734-481d-a091-d1461012f38a tempest-VolumesCloneTest-598432755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a5c35513-e73c-471d-b56f-e3eec6dbd56d.info {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:28:27 devstack sudo[100518]: pam_unix(sudo:session): session closed for user root Sep 29 18:28:27 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-e7659176-df45-404e-9e1f-482ca9d6580b tempest-ProjectReaderTests-2070855465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-86e633f1-198f-4a46-9cc7-6c4fe5aa12e9" returned: 0 in 0.428s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:28:27 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-e7659176-df45-404e-9e1f-482ca9d6580b tempest-ProjectReaderTests-2070855465 None] Lock "cinder-quobyte-86e633f1-198f-4a46-9cc7-6c4fe5aa12e9" released by "delete_volume" :: held 0.962s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:28:27 devstack sudo[100527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a5c35513-e73c-471d-b56f-e3eec6dbd56d.info Sep 29 18:28:27 devstack sudo[100527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:28:27 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-e7659176-df45-404e-9e1f-482ca9d6580b tempest-ProjectReaderTests-2070855465 None] Created reservations ['4295efae-6e7e-4543-9363-ba020d149b08', '8ba35b77-0bf9-48c4-95a0-b22b156d7fc4', '728065a5-3d69-462f-acd0-e5259271010a', '8b18048a-2965-46e7-b891-d00ed28ba486'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:28:27 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-e7659176-df45-404e-9e1f-482ca9d6580b tempest-ProjectReaderTests-2070855465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:28:27 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-e7659176-df45-404e-9e1f-482ca9d6580b tempest-ProjectReaderTests-2070855465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:28:27 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-e7659176-df45-404e-9e1f-482ca9d6580b tempest-ProjectReaderTests-2070855465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:28:27 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-e7659176-df45-404e-9e1f-482ca9d6580b tempest-ProjectReaderTests-2070855465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:28:27 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-e7659176-df45-404e-9e1f-482ca9d6580b tempest-ProjectReaderTests-2070855465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:28:27 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-e7659176-df45-404e-9e1f-482ca9d6580b tempest-ProjectReaderTests-2070855465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:28:27 devstack sudo[100531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:28:27 devstack sudo[100531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:28:28 devstack sudo[100523]: pam_unix(sudo:session): session closed for user root Sep 29 18:28:28 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-f6e58908-43f1-4318-a8ec-8dce3f5cfd14 tempest-VolumesGetTest-329956023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a307d519-1974-4ac1-8d2d-f0890bf2a944" returned: 0 in 0.461s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:28:28 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-f6e58908-43f1-4318-a8ec-8dce3f5cfd14 tempest-VolumesGetTest-329956023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a307d519-1974-4ac1-8d2d-f0890bf2a944 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:28:28 devstack sudo[100534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a307d519-1974-4ac1-8d2d-f0890bf2a944 Sep 29 18:28:28 devstack sudo[100534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:28:28 devstack sudo[100527]: pam_unix(sudo:session): session closed for user root Sep 29 18:28:28 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-2e19058e-4734-481d-a091-d1461012f38a tempest-VolumesCloneTest-598432755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a5c35513-e73c-471d-b56f-e3eec6dbd56d.info" returned: 0 in 0.383s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:28:28 devstack cinder-volume[86512]: WARNING cinder.volume.drivers.remotefs [None req-2e19058e-4734-481d-a091-d1461012f38a tempest-VolumesCloneTest-598432755 None] /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a5c35513-e73c-471d-b56f-e3eec6dbd56d.info is being set with open permissions: ugo+rw Sep 29 18:28:28 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-2e19058e-4734-481d-a091-d1461012f38a tempest-VolumesCloneTest-598432755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a5c35513-e73c-471d-b56f-e3eec6dbd56d.info {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:28:28 devstack sudo[100537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a5c35513-e73c-471d-b56f-e3eec6dbd56d.info Sep 29 18:28:28 devstack sudo[100537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:28:28 devstack sudo[100531]: pam_unix(sudo:session): session closed for user root Sep 29 18:28:28 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-e7659176-df45-404e-9e1f-482ca9d6580b tempest-ProjectReaderTests-2070855465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.285s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:28:28 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-e7659176-df45-404e-9e1f-482ca9d6580b tempest-ProjectReaderTests-2070855465 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:28:28 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-e7659176-df45-404e-9e1f-482ca9d6580b tempest-ProjectReaderTests-2070855465 None] Deleted volume successfully. Sep 29 18:28:28 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-e7659176-df45-404e-9e1f-482ca9d6580b tempest-ProjectReaderTests-2070855465 None] Lock "cinder-86e633f1-198f-4a46-9cc7-6c4fe5aa12e9-delete_volume" released by "delete_volume" :: held 1.519s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:28:28 devstack sudo[100534]: pam_unix(sudo:session): session closed for user root Sep 29 18:28:28 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-f6e58908-43f1-4318-a8ec-8dce3f5cfd14 tempest-VolumesGetTest-329956023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a307d519-1974-4ac1-8d2d-f0890bf2a944" returned: 0 in 0.294s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:28:28 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-f6e58908-43f1-4318-a8ec-8dce3f5cfd14 tempest-VolumesGetTest-329956023 None] Lock "cinder-quobyte-a307d519-1974-4ac1-8d2d-f0890bf2a944" released by "delete_volume" :: held 0.849s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:28:28 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-f6e58908-43f1-4318-a8ec-8dce3f5cfd14 tempest-VolumesGetTest-329956023 None] Created reservations ['f0ce95ea-5e52-43d6-92cb-587a5d0aca9e', '0854d10c-90c6-44fb-acc7-68fa01545a6f', '24affc09-19ff-4b6a-bd0c-e4ac0ac8ac1c', 'bd6b44ab-143d-4aed-abc2-83ebeb0d7cd1'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:28:28 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-f6e58908-43f1-4318-a8ec-8dce3f5cfd14 tempest-VolumesGetTest-329956023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:28:28 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-f6e58908-43f1-4318-a8ec-8dce3f5cfd14 tempest-VolumesGetTest-329956023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:28:28 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-f6e58908-43f1-4318-a8ec-8dce3f5cfd14 tempest-VolumesGetTest-329956023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:28:28 devstack sudo[100537]: pam_unix(sudo:session): session closed for user root Sep 29 18:28:28 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-f6e58908-43f1-4318-a8ec-8dce3f5cfd14 tempest-VolumesGetTest-329956023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:28:28 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-f6e58908-43f1-4318-a8ec-8dce3f5cfd14 tempest-VolumesGetTest-329956023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:28:28 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-f6e58908-43f1-4318-a8ec-8dce3f5cfd14 tempest-VolumesGetTest-329956023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:28:28 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-2e19058e-4734-481d-a091-d1461012f38a tempest-VolumesCloneTest-598432755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a5c35513-e73c-471d-b56f-e3eec6dbd56d.info" returned: 0 in 0.354s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:28:28 devstack sudo[100542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:28:28 devstack sudo[100542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:28:28 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-2e19058e-4734-481d-a091-d1461012f38a tempest-VolumesCloneTest-598432755 None] Acquiring lock "cinder-quobyte-9e589948-071e-4a1d-99b0-80094c9ba8e9" by "_copy_volume_from_snapshot" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:28:28 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-2e19058e-4734-481d-a091-d1461012f38a tempest-VolumesCloneTest-598432755 None] Lock "cinder-quobyte-9e589948-071e-4a1d-99b0-80094c9ba8e9" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:28:28 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-2e19058e-4734-481d-a091-d1461012f38a tempest-VolumesCloneTest-598432755 None] snapshot: 36df81aa-7f8c-45f3-8521-294b6bee04e1, volume: 9e589948-071e-4a1d-99b0-80094c9ba8e9, {{(pid=86512) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 29 18:28:28 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-2e19058e-4734-481d-a091-d1461012f38a tempest-VolumesCloneTest-598432755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:28:28 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-2e19058e-4734-481d-a091-d1461012f38a tempest-VolumesCloneTest-598432755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:28:28 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-2e19058e-4734-481d-a091-d1461012f38a tempest-VolumesCloneTest-598432755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:28:28 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-2e19058e-4734-481d-a091-d1461012f38a tempest-VolumesCloneTest-598432755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:28:28 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-2e19058e-4734-481d-a091-d1461012f38a tempest-VolumesCloneTest-598432755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:28:28 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[882c0aef-e596-4322-8d90-7a31dedf1ca3]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:28:28 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-2e19058e-4734-481d-a091-d1461012f38a tempest-VolumesCloneTest-598432755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a5c35513-e73c-471d-b56f-e3eec6dbd56d.36df81aa-7f8c-45f3-8521-294b6bee04e1 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:28:28 devstack sudo[100544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a5c35513-e73c-471d-b56f-e3eec6dbd56d.36df81aa-7f8c-45f3-8521-294b6bee04e1 Sep 29 18:28:28 devstack sudo[100544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:28:28 devstack sudo[100542]: pam_unix(sudo:session): session closed for user root Sep 29 18:28:28 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-f6e58908-43f1-4318-a8ec-8dce3f5cfd14 tempest-VolumesGetTest-329956023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.276s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:28:28 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-f6e58908-43f1-4318-a8ec-8dce3f5cfd14 tempest-VolumesGetTest-329956023 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:28:28 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-f6e58908-43f1-4318-a8ec-8dce3f5cfd14 tempest-VolumesGetTest-329956023 None] Deleted volume successfully. Sep 29 18:28:28 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-f6e58908-43f1-4318-a8ec-8dce3f5cfd14 tempest-VolumesGetTest-329956023 None] Lock "cinder-a307d519-1974-4ac1-8d2d-f0890bf2a944-delete_volume" released by "delete_volume" :: held 1.428s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:28:29 devstack sudo[100544]: pam_unix(sudo:session): session closed for user root Sep 29 18:28:29 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-2e19058e-4734-481d-a091-d1461012f38a tempest-VolumesCloneTest-598432755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a5c35513-e73c-471d-b56f-e3eec6dbd56d.36df81aa-7f8c-45f3-8521-294b6bee04e1" returned: 0 in 0.454s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:28:29 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-2e19058e-4734-481d-a091-d1461012f38a tempest-VolumesCloneTest-598432755 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a5c35513-e73c-471d-b56f-e3eec6dbd56d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86512) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 18:28:29 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3031603-da8e-42c3-8082-890f7600fe23]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:28:29 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-2e19058e-4734-481d-a091-d1461012f38a tempest-VolumesCloneTest-598432755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a5c35513-e73c-471d-b56f-e3eec6dbd56d {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:28:29 devstack sudo[100550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a5c35513-e73c-471d-b56f-e3eec6dbd56d Sep 29 18:28:29 devstack sudo[100550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:28:29 devstack sudo[100550]: pam_unix(sudo:session): session closed for user root Sep 29 18:28:29 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-2e19058e-4734-481d-a091-d1461012f38a tempest-VolumesCloneTest-598432755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a5c35513-e73c-471d-b56f-e3eec6dbd56d" returned: 0 in 0.438s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:28:29 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-2e19058e-4734-481d-a091-d1461012f38a tempest-VolumesCloneTest-598432755 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a5c35513-e73c-471d-b56f-e3eec6dbd56d {{(pid=86512) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 29 18:28:29 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-2e19058e-4734-481d-a091-d1461012f38a tempest-VolumesCloneTest-598432755 None] Creating direct copy from snapshot {{(pid=86512) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 29 18:28:29 devstack cinder-volume[86512]: DEBUG cinder.utils [None req-2e19058e-4734-481d-a091-d1461012f38a tempest-VolumesCloneTest-598432755 None] Path /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-9e589948-071e-4a1d-99b0-80094c9ba8e9 not found in is_blk_device check {{(pid=86512) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 29 18:28:29 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-2e19058e-4734-481d-a091-d1461012f38a tempest-VolumesCloneTest-598432755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a5c35513-e73c-471d-b56f-e3eec6dbd56d /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-9e589948-071e-4a1d-99b0-80094c9ba8e9 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:28:29 devstack sudo[100556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a5c35513-e73c-471d-b56f-e3eec6dbd56d /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-9e589948-071e-4a1d-99b0-80094c9ba8e9 Sep 29 18:28:29 devstack sudo[100556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:28:29 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-985238c3-40fe-4d12-b702-25ade63e70f4 tempest-VolumesGetTest-329956023 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86512) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:28:29 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-985238c3-40fe-4d12-b702-25ade63e70f4 tempest-VolumesGetTest-329956023 None] Flow 'volume_create_manager' (5f9d0b03-c7bb-4676-b612-3c4d7fdd9e37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:28:29 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-985238c3-40fe-4d12-b702-25ade63e70f4 tempest-VolumesGetTest-329956023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4a8f1c7-0b7f-45a1-a71a-37c941bbc05c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:28:29 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-985238c3-40fe-4d12-b702-25ade63e70f4 tempest-VolumesGetTest-329956023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4a8f1c7-0b7f-45a1-a71a-37c941bbc05c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:28:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1655488539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02590481-4b3f-474d-99a1-c8d5f99d131f,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='123ca1c819ab4c939d34d15531ec218c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:28:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:28:30Z,use_quota=True,user_id='d4b8a389e95e4820826e3c19485b4a7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:28:29 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-985238c3-40fe-4d12-b702-25ade63e70f4 tempest-VolumesGetTest-329956023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9cdc7fd-a798-49d1-91d8-5c2ce223f69a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:28:29 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-985238c3-40fe-4d12-b702-25ade63e70f4 tempest-VolumesGetTest-329956023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9cdc7fd-a798-49d1-91d8-5c2ce223f69a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:28:29 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-985238c3-40fe-4d12-b702-25ade63e70f4 tempest-VolumesGetTest-329956023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a049f06-6757-4962-8608-cb7580815043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:28:29 devstack cinder-volume[86512]: DEBUG cinder.image.glance [None req-985238c3-40fe-4d12-b702-25ade63e70f4 tempest-VolumesGetTest-329956023 None] Creating Keystone auth plugin from conf {{(pid=86512) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 29 18:28:29 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-30363326-b335-4733-b148-6fa7ac1c261d tempest-ProjectReaderTests-2070855465 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86512) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:28:29 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-30363326-b335-4733-b148-6fa7ac1c261d tempest-ProjectReaderTests-2070855465 None] Flow 'volume_create_manager' (0701f0bb-5a74-4573-8d6d-4a618ff36ae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:28:29 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-30363326-b335-4733-b148-6fa7ac1c261d tempest-ProjectReaderTests-2070855465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ee9d64a-cda1-4647-8851-1089c60d24b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:28:29 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-30363326-b335-4733-b148-6fa7ac1c261d tempest-ProjectReaderTests-2070855465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ee9d64a-cda1-4647-8851-1089c60d24b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:28:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-345435390',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97601be5-d849-414d-8154-c279461f596c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f92c36a33aa1437ba704ce7f48246c50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:28:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:28:30Z,use_quota=True,user_id='0dcba85655314108a410c5150a09b572',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:28:29 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-30363326-b335-4733-b148-6fa7ac1c261d tempest-ProjectReaderTests-2070855465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e06a4fc-6c02-4ffb-bf75-d4cc74c72de9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:28:29 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-30363326-b335-4733-b148-6fa7ac1c261d tempest-ProjectReaderTests-2070855465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e06a4fc-6c02-4ffb-bf75-d4cc74c72de9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:28:29 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-30363326-b335-4733-b148-6fa7ac1c261d tempest-ProjectReaderTests-2070855465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32eef221-8405-4851-9e46-cef5f1fec6da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:28:30 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-30363326-b335-4733-b148-6fa7ac1c261d tempest-ProjectReaderTests-2070855465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32eef221-8405-4851-9e46-cef5f1fec6da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97601be5-d849-414d-8154-c279461f596c', 'volume_name': 'volume-97601be5-d849-414d-8154-c279461f596c', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:28:30 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-30363326-b335-4733-b148-6fa7ac1c261d tempest-ProjectReaderTests-2070855465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25babe79-3885-4090-9ed9-210f174604df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:28:30 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-30363326-b335-4733-b148-6fa7ac1c261d tempest-ProjectReaderTests-2070855465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25babe79-3885-4090-9ed9-210f174604df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:28:30 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-30363326-b335-4733-b148-6fa7ac1c261d tempest-ProjectReaderTests-2070855465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (518e1521-005e-4426-b415-62656c7333c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:28:30 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-30363326-b335-4733-b148-6fa7ac1c261d tempest-ProjectReaderTests-2070855465 None] Volume 97601be5-d849-414d-8154-c279461f596c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97601be5-d849-414d-8154-c279461f596c', 'volume_size': 1} Sep 29 18:28:30 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-30363326-b335-4733-b148-6fa7ac1c261d tempest-ProjectReaderTests-2070855465 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:28:30 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-985238c3-40fe-4d12-b702-25ade63e70f4 tempest-VolumesGetTest-329956023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a049f06-6757-4962-8608-cb7580815043) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '02590481-4b3f-474d-99a1-c8d5f99d131f', 'volume_name': 'volume-02590481-4b3f-474d-99a1-c8d5f99d131f', 'volume_size': 1, 'image_id': 'd8ebca63-1178-4b36-a1a2-e10949cbc87f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d8ebca63-1178-4b36-a1a2-e10949cbc87f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '987aeb00888a4b9bb9954392d91b8741', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd8ebca63-1178-4b36-a1a2-e10949cbc87f', 'created_at': datetime.datetime(2026, 9, 29, 16, 11, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 16, 11, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d8ebca63-1178-4b36-a1a2-e10949cbc87f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:28:30 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-985238c3-40fe-4d12-b702-25ade63e70f4 tempest-VolumesGetTest-329956023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (137836b6-3a5c-490c-9823-9192e928c107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:28:30 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-985238c3-40fe-4d12-b702-25ade63e70f4 tempest-VolumesGetTest-329956023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (137836b6-3a5c-490c-9823-9192e928c107) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:28:30 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-985238c3-40fe-4d12-b702-25ade63e70f4 tempest-VolumesGetTest-329956023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95c67dff-018f-45ce-b1aa-ada8e9333126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:28:30 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-985238c3-40fe-4d12-b702-25ade63e70f4 tempest-VolumesGetTest-329956023 None] Volume 02590481-4b3f-474d-99a1-c8d5f99d131f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-02590481-4b3f-474d-99a1-c8d5f99d131f', 'volume_size': 1, 'image_id': 'd8ebca63-1178-4b36-a1a2-e10949cbc87f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d8ebca63-1178-4b36-a1a2-e10949cbc87f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '987aeb00888a4b9bb9954392d91b8741', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd8ebca63-1178-4b36-a1a2-e10949cbc87f', 'created_at': datetime.datetime(2026, 9, 29, 16, 11, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 16, 11, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d8ebca63-1178-4b36-a1a2-e10949cbc87f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 29 18:28:30 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-985238c3-40fe-4d12-b702-25ade63e70f4 tempest-VolumesGetTest-329956023 None] Trying to clone 02590481-4b3f-474d-99a1-c8d5f99d131f from image d8ebca63-1178-4b36-a1a2-e10949cbc87f at location (None, [{'url': 'file:///opt/stack/data/glance/images/d8ebca63-1178-4b36-a1a2-e10949cbc87f', 'metadata': {}}]). {{(pid=86512) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 29 18:28:30 devstack cinder-volume[86512]: DEBUG cinder.image.image_utils [None req-985238c3-40fe-4d12-b702-25ade63e70f4 tempest-VolumesGetTest-329956023 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d8ebca63-1178-4b36-a1a2-e10949cbc87f_mrx79txcdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86512) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 29 18:28:30 devstack cinder-volume[86512]: INFO cinder.image.image_utils [None req-985238c3-40fe-4d12-b702-25ade63e70f4 tempest-VolumesGetTest-329956023 None] Image download 20.69 MB at 20.69 MB/s Sep 29 18:28:31 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[11986258-1d1f-4c77-80bf-d463e72f9705]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:28:31 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-985238c3-40fe-4d12-b702-25ade63e70f4 tempest-VolumesGetTest-329956023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d8ebca63-1178-4b36-a1a2-e10949cbc87f_mrx79txcdevstack@QuobyteHD {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:28:31 devstack sudo[100569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d8ebca63-1178-4b36-a1a2-e10949cbc87f_mrx79txcdevstack@QuobyteHD Sep 29 18:28:31 devstack sudo[100569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:28:31 devstack sudo[100569]: pam_unix(sudo:session): session closed for user root Sep 29 18:28:31 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-985238c3-40fe-4d12-b702-25ade63e70f4 tempest-VolumesGetTest-329956023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d8ebca63-1178-4b36-a1a2-e10949cbc87f_mrx79txcdevstack@QuobyteHD" returned: 0 in 0.702s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:28:31 devstack cinder-volume[86512]: DEBUG cinder.image.image_utils [None req-985238c3-40fe-4d12-b702-25ade63e70f4 tempest-VolumesGetTest-329956023 None] Temporary image d8ebca63-1178-4b36-a1a2-e10949cbc87f is fetched for user d4b8a389e95e4820826e3c19485b4a7a. {{(pid=86512) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 29 18:28:31 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b2ecad9-5ab9-4cb8-8b2b-173565349a39]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:28:31 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-985238c3-40fe-4d12-b702-25ade63e70f4 tempest-VolumesGetTest-329956023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d8ebca63-1178-4b36-a1a2-e10949cbc87f_mrx79txcdevstack@QuobyteHD {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:28:32 devstack sudo[100575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d8ebca63-1178-4b36-a1a2-e10949cbc87f_mrx79txcdevstack@QuobyteHD Sep 29 18:28:32 devstack sudo[100575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:28:32 devstack sudo[100575]: pam_unix(sudo:session): session closed for user root Sep 29 18:28:32 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-985238c3-40fe-4d12-b702-25ade63e70f4 tempest-VolumesGetTest-329956023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d8ebca63-1178-4b36-a1a2-e10949cbc87f_mrx79txcdevstack@QuobyteHD" returned: 0 in 0.514s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:28:32 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-985238c3-40fe-4d12-b702-25ade63e70f4 tempest-VolumesGetTest-329956023 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:28:36 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-35e8a5a3-2487-4a53-8612-560aac861080 tempest-SnapshotsActionsTest-1013262860 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86512) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:28:36 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-35e8a5a3-2487-4a53-8612-560aac861080 tempest-SnapshotsActionsTest-1013262860 None] Flow 'volume_create_manager' (9469c940-807d-4b24-aa88-dd8166e8f979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:28:36 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-35e8a5a3-2487-4a53-8612-560aac861080 tempest-SnapshotsActionsTest-1013262860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ca71a4d-7b3a-4def-8edb-9ebf09cbac22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:28:36 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-35e8a5a3-2487-4a53-8612-560aac861080 tempest-SnapshotsActionsTest-1013262860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ca71a4d-7b3a-4def-8edb-9ebf09cbac22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:28:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-564158446',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d93adb1-1c36-4157-b126-84bc227ec0f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d798eed855324ea4be96f9891a23c069',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:28:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:28:37Z,use_quota=True,user_id='63a3fa0947024162b54c03b4f1dd8887',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:28:36 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-35e8a5a3-2487-4a53-8612-560aac861080 tempest-SnapshotsActionsTest-1013262860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf241b8f-b6f4-4b69-a9bf-41e48beda5b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:28:36 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-35e8a5a3-2487-4a53-8612-560aac861080 tempest-SnapshotsActionsTest-1013262860 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf241b8f-b6f4-4b69-a9bf-41e48beda5b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:28:36 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-35e8a5a3-2487-4a53-8612-560aac861080 tempest-SnapshotsActionsTest-1013262860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c227100a-3c12-46ae-8580-3dfe2b4ae89b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:28:36 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-35e8a5a3-2487-4a53-8612-560aac861080 tempest-SnapshotsActionsTest-1013262860 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c227100a-3c12-46ae-8580-3dfe2b4ae89b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d93adb1-1c36-4157-b126-84bc227ec0f3', 'volume_name': 'volume-3d93adb1-1c36-4157-b126-84bc227ec0f3', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:28:36 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-35e8a5a3-2487-4a53-8612-560aac861080 tempest-SnapshotsActionsTest-1013262860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28b1ed4c-434f-4c4b-9920-ade6bc0ccf5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:28:36 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-35e8a5a3-2487-4a53-8612-560aac861080 tempest-SnapshotsActionsTest-1013262860 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28b1ed4c-434f-4c4b-9920-ade6bc0ccf5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:28:36 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-35e8a5a3-2487-4a53-8612-560aac861080 tempest-SnapshotsActionsTest-1013262860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8feb82f7-e945-47e9-87f2-f48909c642a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:28:36 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-35e8a5a3-2487-4a53-8612-560aac861080 tempest-SnapshotsActionsTest-1013262860 None] Volume 3d93adb1-1c36-4157-b126-84bc227ec0f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d93adb1-1c36-4157-b126-84bc227ec0f3', 'volume_size': 1} Sep 29 18:28:36 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-35e8a5a3-2487-4a53-8612-560aac861080 tempest-SnapshotsActionsTest-1013262860 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:28:37 devstack sudo[100556]: pam_unix(sudo:session): session closed for user root Sep 29 18:28:37 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-2e19058e-4734-481d-a091-d1461012f38a tempest-VolumesCloneTest-598432755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a5c35513-e73c-471d-b56f-e3eec6dbd56d /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-9e589948-071e-4a1d-99b0-80094c9ba8e9" returned: 0 in 7.456s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:28:37 devstack cinder-volume[86512]: DEBUG cinder.image.image_utils [None req-2e19058e-4734-481d-a091-d1461012f38a tempest-VolumesCloneTest-598432755 None] Image conversion details: src /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a5c35513-e73c-471d-b56f-e3eec6dbd56d, size 1024.00 MB, duration 7.46 sec, destination /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-9e589948-071e-4a1d-99b0-80094c9ba8e9 {{(pid=86512) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 29 18:28:37 devstack cinder-volume[86512]: INFO cinder.image.image_utils [None req-2e19058e-4734-481d-a091-d1461012f38a tempest-VolumesCloneTest-598432755 None] Converted 1024.00 MB image at 137.33 MB/s Sep 29 18:28:37 devstack cinder-volume[86512]: WARNING cinder.volume.drivers.remotefs [None req-2e19058e-4734-481d-a091-d1461012f38a tempest-VolumesCloneTest-598432755 None] /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-9e589948-071e-4a1d-99b0-80094c9ba8e9 is being set with open permissions: ugo+rw Sep 29 18:28:37 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-2e19058e-4734-481d-a091-d1461012f38a tempest-VolumesCloneTest-598432755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-9e589948-071e-4a1d-99b0-80094c9ba8e9 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:28:37 devstack sudo[100586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-9e589948-071e-4a1d-99b0-80094c9ba8e9 Sep 29 18:28:37 devstack sudo[100586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:28:37 devstack sudo[100586]: pam_unix(sudo:session): session closed for user root Sep 29 18:28:37 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-2e19058e-4734-481d-a091-d1461012f38a tempest-VolumesCloneTest-598432755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-9e589948-071e-4a1d-99b0-80094c9ba8e9" returned: 0 in 0.240s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:28:37 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-2e19058e-4734-481d-a091-d1461012f38a tempest-VolumesCloneTest-598432755 None] Lock "cinder-quobyte-9e589948-071e-4a1d-99b0-80094c9ba8e9" released by "_copy_volume_from_snapshot" :: held 8.694s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:28:37 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-2e19058e-4734-481d-a091-d1461012f38a tempest-VolumesCloneTest-598432755 None] Acquiring lock "cinder-quobyte-36df81aa-7f8c-45f3-8521-294b6bee04e1" by "_delete_snapshot" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:28:37 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-2e19058e-4734-481d-a091-d1461012f38a tempest-VolumesCloneTest-598432755 None] Lock "cinder-quobyte-36df81aa-7f8c-45f3-8521-294b6bee04e1" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:28:37 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-2e19058e-4734-481d-a091-d1461012f38a tempest-VolumesCloneTest-598432755 None] Deleting offline snapshot 36df81aa-7f8c-45f3-8521-294b6bee04e1 of volume a5c35513-e73c-471d-b56f-e3eec6dbd56d {{(pid=86512) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 18:28:37 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-2e19058e-4734-481d-a091-d1461012f38a tempest-VolumesCloneTest-598432755 None] snapshot_file for this snap is: volume-a5c35513-e73c-471d-b56f-e3eec6dbd56d.36df81aa-7f8c-45f3-8521-294b6bee04e1 {{(pid=86512) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 18:28:37 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[0487f457-07ac-4a81-910f-080e8f291ff1]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:28:37 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-2e19058e-4734-481d-a091-d1461012f38a tempest-VolumesCloneTest-598432755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a5c35513-e73c-471d-b56f-e3eec6dbd56d.36df81aa-7f8c-45f3-8521-294b6bee04e1 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:28:37 devstack sudo[100589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a5c35513-e73c-471d-b56f-e3eec6dbd56d.36df81aa-7f8c-45f3-8521-294b6bee04e1 Sep 29 18:28:37 devstack sudo[100589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:28:37 devstack sudo[100589]: pam_unix(sudo:session): session closed for user root Sep 29 18:28:37 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-2e19058e-4734-481d-a091-d1461012f38a tempest-VolumesCloneTest-598432755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a5c35513-e73c-471d-b56f-e3eec6dbd56d.36df81aa-7f8c-45f3-8521-294b6bee04e1" returned: 0 in 0.348s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:28:37 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-2e19058e-4734-481d-a091-d1461012f38a tempest-VolumesCloneTest-598432755 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a5c35513-e73c-471d-b56f-e3eec6dbd56d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86512) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 18:28:37 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[6191bf8b-18d2-428e-929a-94367db7a5ed]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:28:37 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-2e19058e-4734-481d-a091-d1461012f38a tempest-VolumesCloneTest-598432755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a5c35513-e73c-471d-b56f-e3eec6dbd56d {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:28:37 devstack sudo[100594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a5c35513-e73c-471d-b56f-e3eec6dbd56d Sep 29 18:28:37 devstack sudo[100594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:28:38 devstack sudo[100594]: pam_unix(sudo:session): session closed for user root Sep 29 18:28:38 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-2e19058e-4734-481d-a091-d1461012f38a tempest-VolumesCloneTest-598432755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a5c35513-e73c-471d-b56f-e3eec6dbd56d" returned: 0 in 0.510s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:28:38 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-2e19058e-4734-481d-a091-d1461012f38a tempest-VolumesCloneTest-598432755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a5c35513-e73c-471d-b56f-e3eec6dbd56d.36df81aa-7f8c-45f3-8521-294b6bee04e1 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:28:38 devstack sudo[100599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a5c35513-e73c-471d-b56f-e3eec6dbd56d.36df81aa-7f8c-45f3-8521-294b6bee04e1 Sep 29 18:28:38 devstack sudo[100599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:28:38 devstack sudo[100599]: pam_unix(sudo:session): session closed for user root Sep 29 18:28:38 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-2e19058e-4734-481d-a091-d1461012f38a tempest-VolumesCloneTest-598432755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a5c35513-e73c-471d-b56f-e3eec6dbd56d.36df81aa-7f8c-45f3-8521-294b6bee04e1" returned: 0 in 0.350s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:28:38 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-2e19058e-4734-481d-a091-d1461012f38a tempest-VolumesCloneTest-598432755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a5c35513-e73c-471d-b56f-e3eec6dbd56d.36df81aa-7f8c-45f3-8521-294b6bee04e1 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:28:38 devstack sudo[100605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a5c35513-e73c-471d-b56f-e3eec6dbd56d.36df81aa-7f8c-45f3-8521-294b6bee04e1 Sep 29 18:28:38 devstack sudo[100605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:28:38 devstack sudo[100605]: pam_unix(sudo:session): session closed for user root Sep 29 18:28:38 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-2e19058e-4734-481d-a091-d1461012f38a tempest-VolumesCloneTest-598432755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a5c35513-e73c-471d-b56f-e3eec6dbd56d.36df81aa-7f8c-45f3-8521-294b6bee04e1" returned: 0 in 0.246s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:28:38 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-2e19058e-4734-481d-a091-d1461012f38a tempest-VolumesCloneTest-598432755 None] Lock "cinder-quobyte-36df81aa-7f8c-45f3-8521-294b6bee04e1" released by "_delete_snapshot" :: held 1.548s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:28:38 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-2e19058e-4734-481d-a091-d1461012f38a tempest-VolumesCloneTest-598432755 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.990s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:28:38 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-30363326-b335-4733-b148-6fa7ac1c261d tempest-ProjectReaderTests-2070855465 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.851s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:28:38 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-30363326-b335-4733-b148-6fa7ac1c261d tempest-ProjectReaderTests-2070855465 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:28:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-345435390',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97601be5-d849-414d-8154-c279461f596c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f92c36a33aa1437ba704ce7f48246c50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:28:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:28:30Z,use_quota=True,user_id='0dcba85655314108a410c5150a09b572',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)}" {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:28:38 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-30363326-b335-4733-b148-6fa7ac1c261d tempest-ProjectReaderTests-2070855465 None] Creating volume 97601be5-d849-414d-8154-c279461f596c {{(pid=86512) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:28:38 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-30363326-b335-4733-b148-6fa7ac1c261d tempest-ProjectReaderTests-2070855465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:28:38 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-30363326-b335-4733-b148-6fa7ac1c261d tempest-ProjectReaderTests-2070855465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:28:38 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-30363326-b335-4733-b148-6fa7ac1c261d tempest-ProjectReaderTests-2070855465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:28:38 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-30363326-b335-4733-b148-6fa7ac1c261d tempest-ProjectReaderTests-2070855465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:28:38 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-30363326-b335-4733-b148-6fa7ac1c261d tempest-ProjectReaderTests-2070855465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:28:38 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-30363326-b335-4733-b148-6fa7ac1c261d tempest-ProjectReaderTests-2070855465 None] Selected osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 as target Quobyte volume. {{(pid=86512) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:28:38 devstack cinder-volume[86512]: INFO cinder.volume.drivers.remotefs [None req-30363326-b335-4733-b148-6fa7ac1c261d tempest-ProjectReaderTests-2070855465 None] casted to osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 Sep 29 18:28:38 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-30363326-b335-4733-b148-6fa7ac1c261d tempest-ProjectReaderTests-2070855465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-97601be5-d849-414d-8154-c279461f596c 1073741824 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:28:38 devstack sudo[100608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-97601be5-d849-414d-8154-c279461f596c 1073741824 Sep 29 18:28:38 devstack sudo[100608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:28:38 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-2e19058e-4734-481d-a091-d1461012f38a tempest-VolumesCloneTest-598432755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (518cdeb5-f155-4877-ac25-d4d6cb8df9cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e589948-071e-4a1d-99b0-80094c9ba8e9', 'volume_size': 2, 'source_volid': 'a5c35513-e73c-471d-b56f-e3eec6dbd56d', 'source_volstatus': 'available'}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:28:38 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-2e19058e-4734-481d-a091-d1461012f38a tempest-VolumesCloneTest-598432755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (276abebd-f804-4f71-acfb-c4a6604049d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:28:38 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-2e19058e-4734-481d-a091-d1461012f38a tempest-VolumesCloneTest-598432755 None] Volume volume-9e589948-071e-4a1d-99b0-80094c9ba8e9 (9e589948-071e-4a1d-99b0-80094c9ba8e9): created successfully Sep 29 18:28:38 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-2e19058e-4734-481d-a091-d1461012f38a tempest-VolumesCloneTest-598432755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (276abebd-f804-4f71-acfb-c4a6604049d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:28:38 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-2e19058e-4734-481d-a091-d1461012f38a tempest-VolumesCloneTest-598432755 None] Flow 'volume_create_manager' (13aa4e80-b47b-4dd2-bec7-f84464fe5db1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:28:38 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-2e19058e-4734-481d-a091-d1461012f38a tempest-VolumesCloneTest-598432755 None] Created volume successfully. Sep 29 18:28:39 devstack sudo[100608]: pam_unix(sudo:session): session closed for user root Sep 29 18:28:39 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-30363326-b335-4733-b148-6fa7ac1c261d tempest-ProjectReaderTests-2070855465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-97601be5-d849-414d-8154-c279461f596c 1073741824" returned: 0 in 0.424s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:28:39 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-30363326-b335-4733-b148-6fa7ac1c261d tempest-ProjectReaderTests-2070855465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-97601be5-d849-414d-8154-c279461f596c {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:28:39 devstack sudo[100613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-97601be5-d849-414d-8154-c279461f596c Sep 29 18:28:39 devstack sudo[100613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:28:39 devstack sudo[100613]: pam_unix(sudo:session): session closed for user root Sep 29 18:28:39 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-30363326-b335-4733-b148-6fa7ac1c261d tempest-ProjectReaderTests-2070855465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-97601be5-d849-414d-8154-c279461f596c" returned: 0 in 0.245s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:28:39 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-30363326-b335-4733-b148-6fa7ac1c261d tempest-ProjectReaderTests-2070855465 None] <== create_volume: return (712ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'} {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:28:39 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-30363326-b335-4733-b148-6fa7ac1c261d tempest-ProjectReaderTests-2070855465 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.716s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:28:39 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-985238c3-40fe-4d12-b702-25ade63e70f4 tempest-VolumesGetTest-329956023 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.148s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:28:39 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-985238c3-40fe-4d12-b702-25ade63e70f4 tempest-VolumesGetTest-329956023 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:28:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1655488539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02590481-4b3f-474d-99a1-c8d5f99d131f,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='123ca1c819ab4c939d34d15531ec218c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:28:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:28:30Z,use_quota=True,user_id='d4b8a389e95e4820826e3c19485b4a7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)}" {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:28:39 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-985238c3-40fe-4d12-b702-25ade63e70f4 tempest-VolumesGetTest-329956023 None] Creating volume 02590481-4b3f-474d-99a1-c8d5f99d131f {{(pid=86512) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:28:39 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-985238c3-40fe-4d12-b702-25ade63e70f4 tempest-VolumesGetTest-329956023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:28:39 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-985238c3-40fe-4d12-b702-25ade63e70f4 tempest-VolumesGetTest-329956023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:28:39 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-985238c3-40fe-4d12-b702-25ade63e70f4 tempest-VolumesGetTest-329956023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:28:39 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-985238c3-40fe-4d12-b702-25ade63e70f4 tempest-VolumesGetTest-329956023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:28:39 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-985238c3-40fe-4d12-b702-25ade63e70f4 tempest-VolumesGetTest-329956023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:28:39 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-985238c3-40fe-4d12-b702-25ade63e70f4 tempest-VolumesGetTest-329956023 None] Selected osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 as target Quobyte volume. {{(pid=86512) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:28:39 devstack cinder-volume[86512]: INFO cinder.volume.drivers.remotefs [None req-985238c3-40fe-4d12-b702-25ade63e70f4 tempest-VolumesGetTest-329956023 None] casted to osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 Sep 29 18:28:39 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-985238c3-40fe-4d12-b702-25ade63e70f4 tempest-VolumesGetTest-329956023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-02590481-4b3f-474d-99a1-c8d5f99d131f 1073741824 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:28:39 devstack sudo[100616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-02590481-4b3f-474d-99a1-c8d5f99d131f 1073741824 Sep 29 18:28:39 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-30363326-b335-4733-b148-6fa7ac1c261d tempest-ProjectReaderTests-2070855465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (518e1521-005e-4426-b415-62656c7333c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97601be5-d849-414d-8154-c279461f596c', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:28:39 devstack sudo[100616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:28:39 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-30363326-b335-4733-b148-6fa7ac1c261d tempest-ProjectReaderTests-2070855465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f344f648-9c50-4000-81d0-a0811c36b001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:28:39 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-30363326-b335-4733-b148-6fa7ac1c261d tempest-ProjectReaderTests-2070855465 None] Volume volume-97601be5-d849-414d-8154-c279461f596c (97601be5-d849-414d-8154-c279461f596c): created successfully Sep 29 18:28:39 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-30363326-b335-4733-b148-6fa7ac1c261d tempest-ProjectReaderTests-2070855465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f344f648-9c50-4000-81d0-a0811c36b001) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:28:39 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-30363326-b335-4733-b148-6fa7ac1c261d tempest-ProjectReaderTests-2070855465 None] Flow 'volume_create_manager' (0701f0bb-5a74-4573-8d6d-4a618ff36ae2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:28:39 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-30363326-b335-4733-b148-6fa7ac1c261d tempest-ProjectReaderTests-2070855465 None] Created volume successfully. Sep 29 18:28:40 devstack sudo[100616]: pam_unix(sudo:session): session closed for user root Sep 29 18:28:40 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-985238c3-40fe-4d12-b702-25ade63e70f4 tempest-VolumesGetTest-329956023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-02590481-4b3f-474d-99a1-c8d5f99d131f 1073741824" returned: 0 in 0.447s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:28:40 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-985238c3-40fe-4d12-b702-25ade63e70f4 tempest-VolumesGetTest-329956023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-02590481-4b3f-474d-99a1-c8d5f99d131f {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:28:40 devstack sudo[100622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-02590481-4b3f-474d-99a1-c8d5f99d131f Sep 29 18:28:40 devstack sudo[100622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:28:40 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-ce81975d-2c57-4d67-96dd-d644bfe6a738 tempest-VolumesCloneTest-598432755 None] Acquiring lock "cinder-9e589948-071e-4a1d-99b0-80094c9ba8e9-delete_volume" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:28:40 devstack sudo[100622]: pam_unix(sudo:session): session closed for user root Sep 29 18:28:40 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-985238c3-40fe-4d12-b702-25ade63e70f4 tempest-VolumesGetTest-329956023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-02590481-4b3f-474d-99a1-c8d5f99d131f" returned: 0 in 0.246s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:28:40 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-985238c3-40fe-4d12-b702-25ade63e70f4 tempest-VolumesGetTest-329956023 None] <== create_volume: return (736ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'} {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:28:40 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-985238c3-40fe-4d12-b702-25ade63e70f4 tempest-VolumesGetTest-329956023 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.738s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:28:40 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-35e8a5a3-2487-4a53-8612-560aac861080 tempest-SnapshotsActionsTest-1013262860 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.507s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:28:40 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-35e8a5a3-2487-4a53-8612-560aac861080 tempest-SnapshotsActionsTest-1013262860 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:28:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-564158446',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d93adb1-1c36-4157-b126-84bc227ec0f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d798eed855324ea4be96f9891a23c069',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:28:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:28:37Z,use_quota=True,user_id='63a3fa0947024162b54c03b4f1dd8887',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)}" {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:28:40 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-35e8a5a3-2487-4a53-8612-560aac861080 tempest-SnapshotsActionsTest-1013262860 None] Creating volume 3d93adb1-1c36-4157-b126-84bc227ec0f3 {{(pid=86512) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:28:40 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-35e8a5a3-2487-4a53-8612-560aac861080 tempest-SnapshotsActionsTest-1013262860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:28:40 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-35e8a5a3-2487-4a53-8612-560aac861080 tempest-SnapshotsActionsTest-1013262860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:28:40 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-35e8a5a3-2487-4a53-8612-560aac861080 tempest-SnapshotsActionsTest-1013262860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:28:40 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-35e8a5a3-2487-4a53-8612-560aac861080 tempest-SnapshotsActionsTest-1013262860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:28:40 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-35e8a5a3-2487-4a53-8612-560aac861080 tempest-SnapshotsActionsTest-1013262860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:28:40 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-35e8a5a3-2487-4a53-8612-560aac861080 tempest-SnapshotsActionsTest-1013262860 None] Selected osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 as target Quobyte volume. {{(pid=86512) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:28:40 devstack cinder-volume[86512]: INFO cinder.volume.drivers.remotefs [None req-35e8a5a3-2487-4a53-8612-560aac861080 tempest-SnapshotsActionsTest-1013262860 None] casted to osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 Sep 29 18:28:40 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-35e8a5a3-2487-4a53-8612-560aac861080 tempest-SnapshotsActionsTest-1013262860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-3d93adb1-1c36-4157-b126-84bc227ec0f3 1073741824 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:28:40 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-ce81975d-2c57-4d67-96dd-d644bfe6a738 tempest-VolumesCloneTest-598432755 None] Lock "cinder-9e589948-071e-4a1d-99b0-80094c9ba8e9-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:28:40 devstack sudo[100625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-3d93adb1-1c36-4157-b126-84bc227ec0f3 1073741824 Sep 29 18:28:40 devstack sudo[100625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:28:40 devstack cinder-volume[86512]: DEBUG cinder.volume.volume_utils [None req-985238c3-40fe-4d12-b702-25ade63e70f4 tempest-VolumesGetTest-329956023 None] Attempting download of d8ebca63-1178-4b36-a1a2-e10949cbc87f ((None, [{'url': 'file:///opt/stack/data/glance/images/d8ebca63-1178-4b36-a1a2-e10949cbc87f', 'metadata': {}}])) to volume 02590481-4b3f-474d-99a1-c8d5f99d131f. {{(pid=86512) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 29 18:28:40 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-ce81975d-2c57-4d67-96dd-d644bfe6a738 tempest-VolumesCloneTest-598432755 None] Acquiring lock "cinder-quobyte-9e589948-071e-4a1d-99b0-80094c9ba8e9" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:28:40 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-ce81975d-2c57-4d67-96dd-d644bfe6a738 tempest-VolumesCloneTest-598432755 None] Lock "cinder-quobyte-9e589948-071e-4a1d-99b0-80094c9ba8e9" acquired by "delete_volume" :: waited 0.018s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:28:40 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f0f530e-81dd-403e-bb16-99d0c48dfebc]: (4, 'raw') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:28:40 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-985238c3-40fe-4d12-b702-25ade63e70f4 tempest-VolumesGetTest-329956023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d8ebca63-1178-4b36-a1a2-e10949cbc87f_0lfk4gx0 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:28:40 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ab947d2-3e54-44d6-a6ed-dad5c9de2c94]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:28:40 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-ce81975d-2c57-4d67-96dd-d644bfe6a738 tempest-VolumesCloneTest-598432755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-9e589948-071e-4a1d-99b0-80094c9ba8e9 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:28:40 devstack sudo[100628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d8ebca63-1178-4b36-a1a2-e10949cbc87f_0lfk4gx0 Sep 29 18:28:40 devstack sudo[100628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:28:40 devstack sudo[100629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-9e589948-071e-4a1d-99b0-80094c9ba8e9 Sep 29 18:28:40 devstack sudo[100629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:28:40 devstack sudo[100628]: pam_unix(sudo:session): session closed for user root Sep 29 18:28:40 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-985238c3-40fe-4d12-b702-25ade63e70f4 tempest-VolumesGetTest-329956023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d8ebca63-1178-4b36-a1a2-e10949cbc87f_0lfk4gx0" returned: 0 in 0.422s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:28:40 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-985238c3-40fe-4d12-b702-25ade63e70f4 tempest-VolumesGetTest-329956023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d8ebca63-1178-4b36-a1a2-e10949cbc87f_0lfk4gx0 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:28:40 devstack sudo[100625]: pam_unix(sudo:session): session closed for user root Sep 29 18:28:40 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-35e8a5a3-2487-4a53-8612-560aac861080 tempest-SnapshotsActionsTest-1013262860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-3d93adb1-1c36-4157-b126-84bc227ec0f3 1073741824" returned: 0 in 0.548s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:28:40 devstack sudo[100629]: pam_unix(sudo:session): session closed for user root Sep 29 18:28:40 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-0c7b7315-9939-4863-9179-547972311e42 tempest-ProjectReaderTests-2070855465 None] Acquiring lock "cinder-97601be5-d849-414d-8154-c279461f596c-delete_volume" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:28:40 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-ce81975d-2c57-4d67-96dd-d644bfe6a738 tempest-VolumesCloneTest-598432755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-9e589948-071e-4a1d-99b0-80094c9ba8e9" returned: 0 in 0.439s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:28:40 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-ce81975d-2c57-4d67-96dd-d644bfe6a738 tempest-VolumesCloneTest-598432755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-9e589948-071e-4a1d-99b0-80094c9ba8e9 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:28:40 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-0c7b7315-9939-4863-9179-547972311e42 tempest-ProjectReaderTests-2070855465 None] Lock "cinder-97601be5-d849-414d-8154-c279461f596c-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:28:40 devstack sudo[100642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-9e589948-071e-4a1d-99b0-80094c9ba8e9 Sep 29 18:28:40 devstack sudo[100642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:28:40 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-35e8a5a3-2487-4a53-8612-560aac861080 tempest-SnapshotsActionsTest-1013262860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-3d93adb1-1c36-4157-b126-84bc227ec0f3 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:28:41 devstack sudo[100641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d8ebca63-1178-4b36-a1a2-e10949cbc87f_0lfk4gx0 Sep 29 18:28:41 devstack sudo[100641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:28:41 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-0c7b7315-9939-4863-9179-547972311e42 tempest-ProjectReaderTests-2070855465 None] Acquiring lock "cinder-quobyte-97601be5-d849-414d-8154-c279461f596c" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:28:41 devstack sudo[100644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-3d93adb1-1c36-4157-b126-84bc227ec0f3 Sep 29 18:28:41 devstack sudo[100644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:28:41 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-0c7b7315-9939-4863-9179-547972311e42 tempest-ProjectReaderTests-2070855465 None] Lock "cinder-quobyte-97601be5-d849-414d-8154-c279461f596c" acquired by "delete_volume" :: waited 0.022s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:28:41 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d35fe09-e7ab-4f11-8086-5a33adb45a88]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:28:41 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-0c7b7315-9939-4863-9179-547972311e42 tempest-ProjectReaderTests-2070855465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-97601be5-d849-414d-8154-c279461f596c {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:28:41 devstack sudo[100647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-97601be5-d849-414d-8154-c279461f596c Sep 29 18:28:41 devstack sudo[100647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:28:41 devstack sudo[100642]: pam_unix(sudo:session): session closed for user root Sep 29 18:28:41 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-ce81975d-2c57-4d67-96dd-d644bfe6a738 tempest-VolumesCloneTest-598432755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-9e589948-071e-4a1d-99b0-80094c9ba8e9" returned: 0 in 0.299s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:28:41 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-ce81975d-2c57-4d67-96dd-d644bfe6a738 tempest-VolumesCloneTest-598432755 None] Lock "cinder-quobyte-9e589948-071e-4a1d-99b0-80094c9ba8e9" released by "delete_volume" :: held 0.799s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:28:41 devstack sudo[100641]: pam_unix(sudo:session): session closed for user root Sep 29 18:28:41 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-985238c3-40fe-4d12-b702-25ade63e70f4 tempest-VolumesGetTest-329956023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d8ebca63-1178-4b36-a1a2-e10949cbc87f_0lfk4gx0" returned: 1 in 0.363s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:28:41 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-985238c3-40fe-4d12-b702-25ade63e70f4 tempest-VolumesGetTest-329956023 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d8ebca63-1178-4b36-a1a2-e10949cbc87f_0lfk4gx0' failed. Not Retrying. {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 29 18:28:41 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[76de3320-d5e0-4510-ae73-90d2835f7294]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:28:41 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-985238c3-40fe-4d12-b702-25ade63e70f4 tempest-VolumesGetTest-329956023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d8ebca63-1178-4b36-a1a2-e10949cbc87f_mrx79txcdevstack@QuobyteHD {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:28:41 devstack sudo[100644]: pam_unix(sudo:session): session closed for user root Sep 29 18:28:41 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-35e8a5a3-2487-4a53-8612-560aac861080 tempest-SnapshotsActionsTest-1013262860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-3d93adb1-1c36-4157-b126-84bc227ec0f3" returned: 0 in 0.312s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:28:41 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-35e8a5a3-2487-4a53-8612-560aac861080 tempest-SnapshotsActionsTest-1013262860 None] <== create_volume: return (962ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'} {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:28:41 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-35e8a5a3-2487-4a53-8612-560aac861080 tempest-SnapshotsActionsTest-1013262860 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.968s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:28:41 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-35e8a5a3-2487-4a53-8612-560aac861080 tempest-SnapshotsActionsTest-1013262860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8feb82f7-e945-47e9-87f2-f48909c642a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d93adb1-1c36-4157-b126-84bc227ec0f3', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:28:41 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-35e8a5a3-2487-4a53-8612-560aac861080 tempest-SnapshotsActionsTest-1013262860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a77d5926-0509-4b9a-89a0-ac4c8e65b8cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:28:41 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-ce81975d-2c57-4d67-96dd-d644bfe6a738 tempest-VolumesCloneTest-598432755 None] Created reservations ['74531cd4-d308-470a-b93d-85d66fe5d3a7', '2cd914bc-4944-4379-b86f-a41c2c2d3dea', '9486aa7a-94e3-4fc0-8516-fc72d9d0e60f', 'e4b7f015-3b3f-402d-b426-8384a8d790d2'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:28:41 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-35e8a5a3-2487-4a53-8612-560aac861080 tempest-SnapshotsActionsTest-1013262860 None] Volume volume-3d93adb1-1c36-4157-b126-84bc227ec0f3 (3d93adb1-1c36-4157-b126-84bc227ec0f3): created successfully Sep 29 18:28:41 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-35e8a5a3-2487-4a53-8612-560aac861080 tempest-SnapshotsActionsTest-1013262860 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a77d5926-0509-4b9a-89a0-ac4c8e65b8cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:28:41 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-35e8a5a3-2487-4a53-8612-560aac861080 tempest-SnapshotsActionsTest-1013262860 None] Flow 'volume_create_manager' (9469c940-807d-4b24-aa88-dd8166e8f979) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:28:41 devstack sudo[100653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d8ebca63-1178-4b36-a1a2-e10949cbc87f_mrx79txcdevstack@QuobyteHD Sep 29 18:28:41 devstack sudo[100653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:28:41 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-35e8a5a3-2487-4a53-8612-560aac861080 tempest-SnapshotsActionsTest-1013262860 None] Created volume successfully. Sep 29 18:28:41 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-ce81975d-2c57-4d67-96dd-d644bfe6a738 tempest-VolumesCloneTest-598432755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:28:41 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-ce81975d-2c57-4d67-96dd-d644bfe6a738 tempest-VolumesCloneTest-598432755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:28:41 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-ce81975d-2c57-4d67-96dd-d644bfe6a738 tempest-VolumesCloneTest-598432755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:28:41 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-ce81975d-2c57-4d67-96dd-d644bfe6a738 tempest-VolumesCloneTest-598432755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:28:41 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-ce81975d-2c57-4d67-96dd-d644bfe6a738 tempest-VolumesCloneTest-598432755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:28:41 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-ce81975d-2c57-4d67-96dd-d644bfe6a738 tempest-VolumesCloneTest-598432755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:28:41 devstack sudo[100658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:28:41 devstack sudo[100658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:28:41 devstack sudo[100647]: pam_unix(sudo:session): session closed for user root Sep 29 18:28:41 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-0c7b7315-9939-4863-9179-547972311e42 tempest-ProjectReaderTests-2070855465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-97601be5-d849-414d-8154-c279461f596c" returned: 0 in 0.449s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:28:41 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-0c7b7315-9939-4863-9179-547972311e42 tempest-ProjectReaderTests-2070855465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-97601be5-d849-414d-8154-c279461f596c {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:28:41 devstack sudo[100660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-97601be5-d849-414d-8154-c279461f596c Sep 29 18:28:41 devstack sudo[100660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:28:41 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-e4f71b7b-5156-4f4c-bff2-9dad1aff33e7 tempest-VolumesCloneTest-598432755 None] Acquiring lock "cinder-a5c35513-e73c-471d-b56f-e3eec6dbd56d-delete_volume" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:28:41 devstack sudo[100653]: pam_unix(sudo:session): session closed for user root Sep 29 18:28:41 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-985238c3-40fe-4d12-b702-25ade63e70f4 tempest-VolumesGetTest-329956023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d8ebca63-1178-4b36-a1a2-e10949cbc87f_mrx79txcdevstack@QuobyteHD" returned: 0 in 0.386s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:28:41 devstack cinder-volume[86512]: DEBUG cinder.image.image_utils [None req-985238c3-40fe-4d12-b702-25ade63e70f4 tempest-VolumesGetTest-329956023 None] d8ebca63-1178-4b36-a1a2-e10949cbc87f was qcow2, converting to qcow2 {{(pid=86512) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 29 18:28:41 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-985238c3-40fe-4d12-b702-25ade63e70f4 tempest-VolumesGetTest-329956023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d8ebca63-1178-4b36-a1a2-e10949cbc87f_mrx79txcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-02590481-4b3f-474d-99a1-c8d5f99d131f {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:28:41 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-e4f71b7b-5156-4f4c-bff2-9dad1aff33e7 tempest-VolumesCloneTest-598432755 None] Lock "cinder-a5c35513-e73c-471d-b56f-e3eec6dbd56d-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:28:41 devstack sudo[100665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d8ebca63-1178-4b36-a1a2-e10949cbc87f_mrx79txcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-02590481-4b3f-474d-99a1-c8d5f99d131f Sep 29 18:28:41 devstack sudo[100665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:28:41 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-e4f71b7b-5156-4f4c-bff2-9dad1aff33e7 tempest-VolumesCloneTest-598432755 None] Acquiring lock "cinder-quobyte-a5c35513-e73c-471d-b56f-e3eec6dbd56d" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:28:41 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-e4f71b7b-5156-4f4c-bff2-9dad1aff33e7 tempest-VolumesCloneTest-598432755 None] Lock "cinder-quobyte-a5c35513-e73c-471d-b56f-e3eec6dbd56d" acquired by "delete_volume" :: waited 0.022s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:28:41 devstack sudo[100658]: pam_unix(sudo:session): session closed for user root Sep 29 18:28:41 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-ce81975d-2c57-4d67-96dd-d644bfe6a738 tempest-VolumesCloneTest-598432755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.335s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:28:41 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-ce81975d-2c57-4d67-96dd-d644bfe6a738 tempest-VolumesCloneTest-598432755 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:28:41 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-ce81975d-2c57-4d67-96dd-d644bfe6a738 tempest-VolumesCloneTest-598432755 None] Deleted volume successfully. Sep 29 18:28:41 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec365ccc-f9dc-4b22-8503-bb35138f102a]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:28:41 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-e4f71b7b-5156-4f4c-bff2-9dad1aff33e7 tempest-VolumesCloneTest-598432755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a5c35513-e73c-471d-b56f-e3eec6dbd56d {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:28:41 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-ce81975d-2c57-4d67-96dd-d644bfe6a738 tempest-VolumesCloneTest-598432755 None] Lock "cinder-9e589948-071e-4a1d-99b0-80094c9ba8e9-delete_volume" released by "delete_volume" :: held 1.481s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:28:41 devstack sudo[100660]: pam_unix(sudo:session): session closed for user root Sep 29 18:28:41 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-0c7b7315-9939-4863-9179-547972311e42 tempest-ProjectReaderTests-2070855465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-97601be5-d849-414d-8154-c279461f596c" returned: 0 in 0.381s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:28:41 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-0c7b7315-9939-4863-9179-547972311e42 tempest-ProjectReaderTests-2070855465 None] Lock "cinder-quobyte-97601be5-d849-414d-8154-c279461f596c" released by "delete_volume" :: held 0.891s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:28:41 devstack sudo[100669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a5c35513-e73c-471d-b56f-e3eec6dbd56d Sep 29 18:28:41 devstack sudo[100669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:28:42 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-0c7b7315-9939-4863-9179-547972311e42 tempest-ProjectReaderTests-2070855465 None] Created reservations ['70d54fdf-27dc-4e1f-8aa1-bfbb41868d72', '34b5760c-d081-41bb-ae18-86ab103624fa', 'fe87553f-d65a-47e1-9391-cdfeba434090', '82921cce-1b39-40ef-b96e-98c9b1c26c75'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:28:42 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-71550f17-24c7-4851-aa27-f82daf9a81fe tempest-SnapshotsActionsTest-1013262860 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:28:42 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-71550f17-24c7-4851-aa27-f82daf9a81fe tempest-SnapshotsActionsTest-1013262860 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:28:42 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-71550f17-24c7-4851-aa27-f82daf9a81fe tempest-SnapshotsActionsTest-1013262860 None] Creating offline snapshot d1eb3c76-f7d0-4969-af6d-3e9f9b051821 of volume 3d93adb1-1c36-4157-b126-84bc227ec0f3 {{(pid=86512) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 18:28:42 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-0c7b7315-9939-4863-9179-547972311e42 tempest-ProjectReaderTests-2070855465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:28:42 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-0c7b7315-9939-4863-9179-547972311e42 tempest-ProjectReaderTests-2070855465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:28:42 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-0c7b7315-9939-4863-9179-547972311e42 tempest-ProjectReaderTests-2070855465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:28:42 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-0c7b7315-9939-4863-9179-547972311e42 tempest-ProjectReaderTests-2070855465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:28:42 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-0c7b7315-9939-4863-9179-547972311e42 tempest-ProjectReaderTests-2070855465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:28:42 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-0c7b7315-9939-4863-9179-547972311e42 tempest-ProjectReaderTests-2070855465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:28:42 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[79855d60-815b-4c66-8016-df067158bba5]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:28:42 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-71550f17-24c7-4851-aa27-f82daf9a81fe tempest-SnapshotsActionsTest-1013262860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-3d93adb1-1c36-4157-b126-84bc227ec0f3 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:28:42 devstack sudo[100675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:28:42 devstack sudo[100675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:28:42 devstack sudo[100669]: pam_unix(sudo:session): session closed for user root Sep 29 18:28:42 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-e4f71b7b-5156-4f4c-bff2-9dad1aff33e7 tempest-VolumesCloneTest-598432755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a5c35513-e73c-471d-b56f-e3eec6dbd56d" returned: 0 in 0.512s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:28:42 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-e4f71b7b-5156-4f4c-bff2-9dad1aff33e7 tempest-VolumesCloneTest-598432755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a5c35513-e73c-471d-b56f-e3eec6dbd56d {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:28:42 devstack sudo[100683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a5c35513-e73c-471d-b56f-e3eec6dbd56d Sep 29 18:28:42 devstack sudo[100683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:28:42 devstack sudo[100676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-3d93adb1-1c36-4157-b126-84bc227ec0f3 Sep 29 18:28:42 devstack sudo[100676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:28:42 devstack sudo[100675]: pam_unix(sudo:session): session closed for user root Sep 29 18:28:42 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-0c7b7315-9939-4863-9179-547972311e42 tempest-ProjectReaderTests-2070855465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.279s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:28:42 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-0c7b7315-9939-4863-9179-547972311e42 tempest-ProjectReaderTests-2070855465 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:28:42 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-0c7b7315-9939-4863-9179-547972311e42 tempest-ProjectReaderTests-2070855465 None] Deleted volume successfully. Sep 29 18:28:42 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-0c7b7315-9939-4863-9179-547972311e42 tempest-ProjectReaderTests-2070855465 None] Lock "cinder-97601be5-d849-414d-8154-c279461f596c-delete_volume" released by "delete_volume" :: held 1.588s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:28:42 devstack sudo[100683]: pam_unix(sudo:session): session closed for user root Sep 29 18:28:42 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-e4f71b7b-5156-4f4c-bff2-9dad1aff33e7 tempest-VolumesCloneTest-598432755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a5c35513-e73c-471d-b56f-e3eec6dbd56d" returned: 0 in 0.345s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:28:42 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-e4f71b7b-5156-4f4c-bff2-9dad1aff33e7 tempest-VolumesCloneTest-598432755 None] Lock "cinder-quobyte-a5c35513-e73c-471d-b56f-e3eec6dbd56d" released by "delete_volume" :: held 0.974s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:28:42 devstack sudo[100676]: pam_unix(sudo:session): session closed for user root Sep 29 18:28:42 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-71550f17-24c7-4851-aa27-f82daf9a81fe tempest-SnapshotsActionsTest-1013262860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-3d93adb1-1c36-4157-b126-84bc227ec0f3" returned: 0 in 0.536s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:28:42 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-71550f17-24c7-4851-aa27-f82daf9a81fe tempest-SnapshotsActionsTest-1013262860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-3d93adb1-1c36-4157-b126-84bc227ec0f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-3d93adb1-1c36-4157-b126-84bc227ec0f3.d1eb3c76-f7d0-4969-af6d-3e9f9b051821 1G {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:28:42 devstack sudo[100691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-3d93adb1-1c36-4157-b126-84bc227ec0f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-3d93adb1-1c36-4157-b126-84bc227ec0f3.d1eb3c76-f7d0-4969-af6d-3e9f9b051821 1G Sep 29 18:28:42 devstack sudo[100691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:28:42 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-e4f71b7b-5156-4f4c-bff2-9dad1aff33e7 tempest-VolumesCloneTest-598432755 None] Created reservations ['e4ce0305-c54a-4f39-8231-2b8ef4d4b423', 'd4345466-da62-45a6-92b7-b403aa9d75a5', '7d2dbafa-d1e9-475c-9e19-34b93b3d2baf', 'efb38a0f-bc92-44c0-a775-5ff180e8d7e8'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:28:42 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-e4f71b7b-5156-4f4c-bff2-9dad1aff33e7 tempest-VolumesCloneTest-598432755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:28:42 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-e4f71b7b-5156-4f4c-bff2-9dad1aff33e7 tempest-VolumesCloneTest-598432755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:28:42 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-e4f71b7b-5156-4f4c-bff2-9dad1aff33e7 tempest-VolumesCloneTest-598432755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:28:42 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-e4f71b7b-5156-4f4c-bff2-9dad1aff33e7 tempest-VolumesCloneTest-598432755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:28:42 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-e4f71b7b-5156-4f4c-bff2-9dad1aff33e7 tempest-VolumesCloneTest-598432755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:28:42 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-e4f71b7b-5156-4f4c-bff2-9dad1aff33e7 tempest-VolumesCloneTest-598432755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:28:42 devstack sudo[100693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:28:42 devstack sudo[100693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:28:43 devstack sudo[100693]: pam_unix(sudo:session): session closed for user root Sep 29 18:28:43 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-e4f71b7b-5156-4f4c-bff2-9dad1aff33e7 tempest-VolumesCloneTest-598432755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.329s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:28:43 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-e4f71b7b-5156-4f4c-bff2-9dad1aff33e7 tempest-VolumesCloneTest-598432755 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:28:43 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-e4f71b7b-5156-4f4c-bff2-9dad1aff33e7 tempest-VolumesCloneTest-598432755 None] Deleted volume successfully. Sep 29 18:28:43 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-e4f71b7b-5156-4f4c-bff2-9dad1aff33e7 tempest-VolumesCloneTest-598432755 None] Lock "cinder-a5c35513-e73c-471d-b56f-e3eec6dbd56d-delete_volume" released by "delete_volume" :: held 1.615s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:28:43 devstack sudo[100691]: pam_unix(sudo:session): session closed for user root Sep 29 18:28:43 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-71550f17-24c7-4851-aa27-f82daf9a81fe tempest-SnapshotsActionsTest-1013262860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-3d93adb1-1c36-4157-b126-84bc227ec0f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-3d93adb1-1c36-4157-b126-84bc227ec0f3.d1eb3c76-f7d0-4969-af6d-3e9f9b051821 1G" returned: 0 in 0.526s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:28:43 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-71550f17-24c7-4851-aa27-f82daf9a81fe tempest-SnapshotsActionsTest-1013262860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d93adb1-1c36-4157-b126-84bc227ec0f3 -F qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-3d93adb1-1c36-4157-b126-84bc227ec0f3.d1eb3c76-f7d0-4969-af6d-3e9f9b051821 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:28:43 devstack sudo[100700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d93adb1-1c36-4157-b126-84bc227ec0f3 -F qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-3d93adb1-1c36-4157-b126-84bc227ec0f3.d1eb3c76-f7d0-4969-af6d-3e9f9b051821 Sep 29 18:28:43 devstack sudo[100700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:28:43 devstack sudo[100700]: pam_unix(sudo:session): session closed for user root Sep 29 18:28:43 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-71550f17-24c7-4851-aa27-f82daf9a81fe tempest-SnapshotsActionsTest-1013262860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d93adb1-1c36-4157-b126-84bc227ec0f3 -F qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-3d93adb1-1c36-4157-b126-84bc227ec0f3.d1eb3c76-f7d0-4969-af6d-3e9f9b051821" returned: 0 in 0.387s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:28:43 devstack cinder-volume[86512]: WARNING cinder.volume.drivers.remotefs [None req-71550f17-24c7-4851-aa27-f82daf9a81fe tempest-SnapshotsActionsTest-1013262860 None] /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-3d93adb1-1c36-4157-b126-84bc227ec0f3.d1eb3c76-f7d0-4969-af6d-3e9f9b051821 is being set with open permissions: ugo+rw Sep 29 18:28:43 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-71550f17-24c7-4851-aa27-f82daf9a81fe tempest-SnapshotsActionsTest-1013262860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-3d93adb1-1c36-4157-b126-84bc227ec0f3.d1eb3c76-f7d0-4969-af6d-3e9f9b051821 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:28:43 devstack sudo[100707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-3d93adb1-1c36-4157-b126-84bc227ec0f3.d1eb3c76-f7d0-4969-af6d-3e9f9b051821 Sep 29 18:28:43 devstack sudo[100707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:28:43 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-45189359-1fa0-4915-ae11-9532a71494a5 tempest-ProjectReaderTests-2070855465 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86512) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:28:43 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-45189359-1fa0-4915-ae11-9532a71494a5 tempest-ProjectReaderTests-2070855465 None] Flow 'volume_create_manager' (f343d5a1-4206-404d-af3a-fe4d4bbbe094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:28:43 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-45189359-1fa0-4915-ae11-9532a71494a5 tempest-ProjectReaderTests-2070855465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c7704cc-6390-4d0e-82fd-87e437ee4eaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:28:43 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-45189359-1fa0-4915-ae11-9532a71494a5 tempest-ProjectReaderTests-2070855465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c7704cc-6390-4d0e-82fd-87e437ee4eaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:28:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1132868650',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff0299ba-f3b6-4a3b-b0f8-e8472321a40a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f92c36a33aa1437ba704ce7f48246c50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:28:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:28:44Z,use_quota=True,user_id='0dcba85655314108a410c5150a09b572',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:28:43 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-45189359-1fa0-4915-ae11-9532a71494a5 tempest-ProjectReaderTests-2070855465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9a99d32-9dde-4bff-8622-f543187b2374) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:28:43 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-45189359-1fa0-4915-ae11-9532a71494a5 tempest-ProjectReaderTests-2070855465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9a99d32-9dde-4bff-8622-f543187b2374) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:28:43 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-45189359-1fa0-4915-ae11-9532a71494a5 tempest-ProjectReaderTests-2070855465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d669642b-7eb9-4499-99ef-99f2a7966d11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:28:43 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-45189359-1fa0-4915-ae11-9532a71494a5 tempest-ProjectReaderTests-2070855465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d669642b-7eb9-4499-99ef-99f2a7966d11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff0299ba-f3b6-4a3b-b0f8-e8472321a40a', 'volume_name': 'volume-ff0299ba-f3b6-4a3b-b0f8-e8472321a40a', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:28:43 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-45189359-1fa0-4915-ae11-9532a71494a5 tempest-ProjectReaderTests-2070855465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b465a7a9-8a7d-42da-a585-2d7643f33c9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:28:43 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-45189359-1fa0-4915-ae11-9532a71494a5 tempest-ProjectReaderTests-2070855465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b465a7a9-8a7d-42da-a585-2d7643f33c9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:28:43 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-45189359-1fa0-4915-ae11-9532a71494a5 tempest-ProjectReaderTests-2070855465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bc3f7de-bac8-4a32-920b-e6da442be58e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:28:43 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-45189359-1fa0-4915-ae11-9532a71494a5 tempest-ProjectReaderTests-2070855465 None] Volume ff0299ba-f3b6-4a3b-b0f8-e8472321a40a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff0299ba-f3b6-4a3b-b0f8-e8472321a40a', 'volume_size': 1} Sep 29 18:28:43 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-45189359-1fa0-4915-ae11-9532a71494a5 tempest-ProjectReaderTests-2070855465 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:28:43 devstack sudo[100707]: pam_unix(sudo:session): session closed for user root Sep 29 18:28:43 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-71550f17-24c7-4851-aa27-f82daf9a81fe tempest-SnapshotsActionsTest-1013262860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-3d93adb1-1c36-4157-b126-84bc227ec0f3.d1eb3c76-f7d0-4969-af6d-3e9f9b051821" returned: 0 in 0.276s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:28:43 devstack sudo[100665]: pam_unix(sudo:session): session closed for user root Sep 29 18:28:43 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-985238c3-40fe-4d12-b702-25ade63e70f4 tempest-VolumesGetTest-329956023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d8ebca63-1178-4b36-a1a2-e10949cbc87f_mrx79txcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-02590481-4b3f-474d-99a1-c8d5f99d131f" returned: 0 in 2.315s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:28:43 devstack cinder-volume[86512]: DEBUG cinder.image.image_utils [None req-985238c3-40fe-4d12-b702-25ade63e70f4 tempest-VolumesGetTest-329956023 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d8ebca63-1178-4b36-a1a2-e10949cbc87f_mrx79txcdevstack@QuobyteHD, size 112.00 MB, duration 2.32 sec, destination /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-02590481-4b3f-474d-99a1-c8d5f99d131f {{(pid=86512) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 29 18:28:43 devstack cinder-volume[86512]: INFO cinder.image.image_utils [None req-985238c3-40fe-4d12-b702-25ade63e70f4 tempest-VolumesGetTest-329956023 None] Converted 112.00 MB image at 48.34 MB/s Sep 29 18:28:43 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-985238c3-40fe-4d12-b702-25ade63e70f4 tempest-VolumesGetTest-329956023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-02590481-4b3f-474d-99a1-c8d5f99d131f 1G {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:28:43 devstack sudo[100710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-02590481-4b3f-474d-99a1-c8d5f99d131f 1G Sep 29 18:28:44 devstack sudo[100710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:28:44 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-71550f17-24c7-4851-aa27-f82daf9a81fe tempest-SnapshotsActionsTest-1013262860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-3d93adb1-1c36-4157-b126-84bc227ec0f3.info {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:28:44 devstack sudo[100712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-3d93adb1-1c36-4157-b126-84bc227ec0f3.info Sep 29 18:28:44 devstack sudo[100712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:28:44 devstack sudo[100712]: pam_unix(sudo:session): session closed for user root Sep 29 18:28:44 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-71550f17-24c7-4851-aa27-f82daf9a81fe tempest-SnapshotsActionsTest-1013262860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-3d93adb1-1c36-4157-b126-84bc227ec0f3.info" returned: 0 in 0.303s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:28:44 devstack cinder-volume[86512]: WARNING cinder.volume.drivers.remotefs [None req-71550f17-24c7-4851-aa27-f82daf9a81fe tempest-SnapshotsActionsTest-1013262860 None] /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-3d93adb1-1c36-4157-b126-84bc227ec0f3.info is being set with open permissions: ugo+rw Sep 29 18:28:44 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-71550f17-24c7-4851-aa27-f82daf9a81fe tempest-SnapshotsActionsTest-1013262860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-3d93adb1-1c36-4157-b126-84bc227ec0f3.info {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:28:44 devstack sudo[100710]: pam_unix(sudo:session): session closed for user root Sep 29 18:28:44 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-985238c3-40fe-4d12-b702-25ade63e70f4 tempest-VolumesGetTest-329956023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-02590481-4b3f-474d-99a1-c8d5f99d131f 1G" returned: 0 in 0.374s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:28:44 devstack cinder-volume[86512]: DEBUG cinder.volume.volume_utils [None req-985238c3-40fe-4d12-b702-25ade63e70f4 tempest-VolumesGetTest-329956023 None] Downloaded image d8ebca63-1178-4b36-a1a2-e10949cbc87f ((None, [{'url': 'file:///opt/stack/data/glance/images/d8ebca63-1178-4b36-a1a2-e10949cbc87f', 'metadata': {}}])) to volume 02590481-4b3f-474d-99a1-c8d5f99d131f successfully. {{(pid=86512) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 29 18:28:44 devstack sudo[100752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-3d93adb1-1c36-4157-b126-84bc227ec0f3.info Sep 29 18:28:44 devstack cinder-volume[86512]: DEBUG cinder.image.image_utils [None req-985238c3-40fe-4d12-b702-25ade63e70f4 tempest-VolumesGetTest-329956023 None] Temporary image d8ebca63-1178-4b36-a1a2-e10949cbc87f for user d4b8a389e95e4820826e3c19485b4a7a is deleted. {{(pid=86512) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 29 18:28:44 devstack cinder-volume[86512]: DEBUG cinder.volume.volume_utils [None req-985238c3-40fe-4d12-b702-25ade63e70f4 tempest-VolumesGetTest-329956023 None] Marking volume 02590481-4b3f-474d-99a1-c8d5f99d131f as bootable. {{(pid=86512) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 29 18:28:44 devstack sudo[100752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:28:44 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-985238c3-40fe-4d12-b702-25ade63e70f4 tempest-VolumesGetTest-329956023 None] Copying metadata from image d8ebca63-1178-4b36-a1a2-e10949cbc87f to 02590481-4b3f-474d-99a1-c8d5f99d131f. {{(pid=86512) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 29 18:28:44 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-985238c3-40fe-4d12-b702-25ade63e70f4 tempest-VolumesGetTest-329956023 None] Creating volume glance metadata for volume 02590481-4b3f-474d-99a1-c8d5f99d131f backed by image d8ebca63-1178-4b36-a1a2-e10949cbc87f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'd8ebca63-1178-4b36-a1a2-e10949cbc87f', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86512) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 29 18:28:44 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-985238c3-40fe-4d12-b702-25ade63e70f4 tempest-VolumesGetTest-329956023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95c67dff-018f-45ce-b1aa-ada8e9333126) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02590481-4b3f-474d-99a1-c8d5f99d131f', 'volume_size': 1, 'image_id': 'd8ebca63-1178-4b36-a1a2-e10949cbc87f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d8ebca63-1178-4b36-a1a2-e10949cbc87f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '987aeb00888a4b9bb9954392d91b8741', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd8ebca63-1178-4b36-a1a2-e10949cbc87f', 'created_at': datetime.datetime(2026, 9, 29, 16, 11, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 16, 11, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d8ebca63-1178-4b36-a1a2-e10949cbc87f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:28:44 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-985238c3-40fe-4d12-b702-25ade63e70f4 tempest-VolumesGetTest-329956023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e11aeb9-4c9e-415d-aff9-2aed291967bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:28:44 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-985238c3-40fe-4d12-b702-25ade63e70f4 tempest-VolumesGetTest-329956023 None] Volume volume-02590481-4b3f-474d-99a1-c8d5f99d131f (02590481-4b3f-474d-99a1-c8d5f99d131f): created successfully Sep 29 18:28:44 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-985238c3-40fe-4d12-b702-25ade63e70f4 tempest-VolumesGetTest-329956023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e11aeb9-4c9e-415d-aff9-2aed291967bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:28:44 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-985238c3-40fe-4d12-b702-25ade63e70f4 tempest-VolumesGetTest-329956023 None] Flow 'volume_create_manager' (5f9d0b03-c7bb-4676-b612-3c4d7fdd9e37) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:28:44 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-985238c3-40fe-4d12-b702-25ade63e70f4 tempest-VolumesGetTest-329956023 None] Created volume successfully. Sep 29 18:28:44 devstack sudo[100752]: pam_unix(sudo:session): session closed for user root Sep 29 18:28:44 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-71550f17-24c7-4851-aa27-f82daf9a81fe tempest-SnapshotsActionsTest-1013262860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-3d93adb1-1c36-4157-b126-84bc227ec0f3.info" returned: 0 in 0.341s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:28:44 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-71550f17-24c7-4851-aa27-f82daf9a81fe tempest-SnapshotsActionsTest-1013262860 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.562s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:28:44 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-45189359-1fa0-4915-ae11-9532a71494a5 tempest-ProjectReaderTests-2070855465 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.750s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:28:44 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-45189359-1fa0-4915-ae11-9532a71494a5 tempest-ProjectReaderTests-2070855465 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:28:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1132868650',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff0299ba-f3b6-4a3b-b0f8-e8472321a40a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f92c36a33aa1437ba704ce7f48246c50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:28:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:28:44Z,use_quota=True,user_id='0dcba85655314108a410c5150a09b572',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)}" {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:28:44 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-45189359-1fa0-4915-ae11-9532a71494a5 tempest-ProjectReaderTests-2070855465 None] Creating volume ff0299ba-f3b6-4a3b-b0f8-e8472321a40a {{(pid=86512) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:28:44 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-45189359-1fa0-4915-ae11-9532a71494a5 tempest-ProjectReaderTests-2070855465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:28:44 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-45189359-1fa0-4915-ae11-9532a71494a5 tempest-ProjectReaderTests-2070855465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:28:44 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-45189359-1fa0-4915-ae11-9532a71494a5 tempest-ProjectReaderTests-2070855465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:28:44 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-45189359-1fa0-4915-ae11-9532a71494a5 tempest-ProjectReaderTests-2070855465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:28:44 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-45189359-1fa0-4915-ae11-9532a71494a5 tempest-ProjectReaderTests-2070855465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:28:44 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-45189359-1fa0-4915-ae11-9532a71494a5 tempest-ProjectReaderTests-2070855465 None] Selected osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 as target Quobyte volume. {{(pid=86512) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:28:44 devstack cinder-volume[86512]: INFO cinder.volume.drivers.remotefs [None req-45189359-1fa0-4915-ae11-9532a71494a5 tempest-ProjectReaderTests-2070855465 None] casted to osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 Sep 29 18:28:44 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-45189359-1fa0-4915-ae11-9532a71494a5 tempest-ProjectReaderTests-2070855465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ff0299ba-f3b6-4a3b-b0f8-e8472321a40a 1073741824 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:28:44 devstack sudo[100757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ff0299ba-f3b6-4a3b-b0f8-e8472321a40a 1073741824 Sep 29 18:28:44 devstack sudo[100757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:28:44 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-71550f17-24c7-4851-aa27-f82daf9a81fe tempest-SnapshotsActionsTest-1013262860 None] Create snapshot completed successfully Sep 29 18:28:45 devstack sudo[100757]: pam_unix(sudo:session): session closed for user root Sep 29 18:28:45 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-45189359-1fa0-4915-ae11-9532a71494a5 tempest-ProjectReaderTests-2070855465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ff0299ba-f3b6-4a3b-b0f8-e8472321a40a 1073741824" returned: 0 in 0.660s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:28:45 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-45189359-1fa0-4915-ae11-9532a71494a5 tempest-ProjectReaderTests-2070855465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ff0299ba-f3b6-4a3b-b0f8-e8472321a40a {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:28:45 devstack sudo[100763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ff0299ba-f3b6-4a3b-b0f8-e8472321a40a Sep 29 18:28:45 devstack sudo[100763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:28:45 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-4da1b71d-54ac-48be-a31d-ad0710df5df8 tempest-VolumesGetTest-329956023 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86512) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:28:45 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-4da1b71d-54ac-48be-a31d-ad0710df5df8 tempest-VolumesGetTest-329956023 None] Flow 'volume_create_manager' (ecb8fb0b-27ea-4eb9-887f-3017584bb5a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:28:45 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-4da1b71d-54ac-48be-a31d-ad0710df5df8 tempest-VolumesGetTest-329956023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2afa2f86-e9fa-46dc-b417-3654d1360659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:28:45 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-4da1b71d-54ac-48be-a31d-ad0710df5df8 tempest-VolumesGetTest-329956023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2afa2f86-e9fa-46dc-b417-3654d1360659) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:28:45Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1440886435',display_name='tempest-VolumesGetTest-Volume-596221813',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03a8b3c5-f219-4825-8b14-fb243d62bcd4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='123ca1c819ab4c939d34d15531ec218c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:28:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:28:46Z,use_quota=True,user_id='d4b8a389e95e4820826e3c19485b4a7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:28:45 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-4da1b71d-54ac-48be-a31d-ad0710df5df8 tempest-VolumesGetTest-329956023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e52b5d6b-45ec-486c-9014-70b3c0acd508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:28:45 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-4da1b71d-54ac-48be-a31d-ad0710df5df8 tempest-VolumesGetTest-329956023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e52b5d6b-45ec-486c-9014-70b3c0acd508) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:28:45 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-4da1b71d-54ac-48be-a31d-ad0710df5df8 tempest-VolumesGetTest-329956023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10b71d6c-a9a0-4c5a-a707-bfba730b8e0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:28:45 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-4da1b71d-54ac-48be-a31d-ad0710df5df8 tempest-VolumesGetTest-329956023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10b71d6c-a9a0-4c5a-a707-bfba730b8e0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03a8b3c5-f219-4825-8b14-fb243d62bcd4', 'volume_name': 'volume-03a8b3c5-f219-4825-8b14-fb243d62bcd4', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:28:45 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-4da1b71d-54ac-48be-a31d-ad0710df5df8 tempest-VolumesGetTest-329956023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2514d24d-1467-48b9-a534-72c219106a09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:28:45 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-4da1b71d-54ac-48be-a31d-ad0710df5df8 tempest-VolumesGetTest-329956023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2514d24d-1467-48b9-a534-72c219106a09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:28:45 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-4da1b71d-54ac-48be-a31d-ad0710df5df8 tempest-VolumesGetTest-329956023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a86e408-1480-4f86-9279-4aeb3e39f5df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:28:45 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-4da1b71d-54ac-48be-a31d-ad0710df5df8 tempest-VolumesGetTest-329956023 None] Volume 03a8b3c5-f219-4825-8b14-fb243d62bcd4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03a8b3c5-f219-4825-8b14-fb243d62bcd4', 'volume_size': 1} Sep 29 18:28:45 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-4da1b71d-54ac-48be-a31d-ad0710df5df8 tempest-VolumesGetTest-329956023 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:28:45 devstack sudo[100763]: pam_unix(sudo:session): session closed for user root Sep 29 18:28:45 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-45189359-1fa0-4915-ae11-9532a71494a5 tempest-ProjectReaderTests-2070855465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ff0299ba-f3b6-4a3b-b0f8-e8472321a40a" returned: 0 in 0.482s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:28:45 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-45189359-1fa0-4915-ae11-9532a71494a5 tempest-ProjectReaderTests-2070855465 None] <== create_volume: return (1206ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'} {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:28:45 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-45189359-1fa0-4915-ae11-9532a71494a5 tempest-ProjectReaderTests-2070855465 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.209s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:28:45 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-4da1b71d-54ac-48be-a31d-ad0710df5df8 tempest-VolumesGetTest-329956023 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.010s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:28:45 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-4da1b71d-54ac-48be-a31d-ad0710df5df8 tempest-VolumesGetTest-329956023 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:28:45Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1440886435',display_name='tempest-VolumesGetTest-Volume-596221813',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03a8b3c5-f219-4825-8b14-fb243d62bcd4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='123ca1c819ab4c939d34d15531ec218c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:28:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:28:46Z,use_quota=True,user_id='d4b8a389e95e4820826e3c19485b4a7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)}" {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:28:45 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-4da1b71d-54ac-48be-a31d-ad0710df5df8 tempest-VolumesGetTest-329956023 None] Creating volume 03a8b3c5-f219-4825-8b14-fb243d62bcd4 {{(pid=86512) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:28:45 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-4da1b71d-54ac-48be-a31d-ad0710df5df8 tempest-VolumesGetTest-329956023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:28:45 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-4da1b71d-54ac-48be-a31d-ad0710df5df8 tempest-VolumesGetTest-329956023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:28:45 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-4da1b71d-54ac-48be-a31d-ad0710df5df8 tempest-VolumesGetTest-329956023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:28:45 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-4da1b71d-54ac-48be-a31d-ad0710df5df8 tempest-VolumesGetTest-329956023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:28:45 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-4da1b71d-54ac-48be-a31d-ad0710df5df8 tempest-VolumesGetTest-329956023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:28:45 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-4da1b71d-54ac-48be-a31d-ad0710df5df8 tempest-VolumesGetTest-329956023 None] Selected osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 as target Quobyte volume. {{(pid=86512) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:28:45 devstack cinder-volume[86512]: INFO cinder.volume.drivers.remotefs [None req-4da1b71d-54ac-48be-a31d-ad0710df5df8 tempest-VolumesGetTest-329956023 None] casted to osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 Sep 29 18:28:45 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-4da1b71d-54ac-48be-a31d-ad0710df5df8 tempest-VolumesGetTest-329956023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-03a8b3c5-f219-4825-8b14-fb243d62bcd4 1073741824 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:28:45 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-45189359-1fa0-4915-ae11-9532a71494a5 tempest-ProjectReaderTests-2070855465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bc3f7de-bac8-4a32-920b-e6da442be58e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff0299ba-f3b6-4a3b-b0f8-e8472321a40a', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:28:45 devstack sudo[100766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-03a8b3c5-f219-4825-8b14-fb243d62bcd4 1073741824 Sep 29 18:28:45 devstack sudo[100766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:28:45 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-45189359-1fa0-4915-ae11-9532a71494a5 tempest-ProjectReaderTests-2070855465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0756fd4-666d-47d1-afe2-ba448dec2f3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:28:45 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-45189359-1fa0-4915-ae11-9532a71494a5 tempest-ProjectReaderTests-2070855465 None] Volume volume-ff0299ba-f3b6-4a3b-b0f8-e8472321a40a (ff0299ba-f3b6-4a3b-b0f8-e8472321a40a): created successfully Sep 29 18:28:45 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-45189359-1fa0-4915-ae11-9532a71494a5 tempest-ProjectReaderTests-2070855465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0756fd4-666d-47d1-afe2-ba448dec2f3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:28:45 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-45189359-1fa0-4915-ae11-9532a71494a5 tempest-ProjectReaderTests-2070855465 None] Flow 'volume_create_manager' (f343d5a1-4206-404d-af3a-fe4d4bbbe094) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:28:45 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-45189359-1fa0-4915-ae11-9532a71494a5 tempest-ProjectReaderTests-2070855465 None] Created volume successfully. Sep 29 18:28:46 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-53aa95ac-9c4b-44fa-90cb-b93c0074298c tempest-SnapshotsActionsTest-1013262860 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:28:46 devstack sudo[100766]: pam_unix(sudo:session): session closed for user root Sep 29 18:28:46 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-4da1b71d-54ac-48be-a31d-ad0710df5df8 tempest-VolumesGetTest-329956023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-03a8b3c5-f219-4825-8b14-fb243d62bcd4 1073741824" returned: 0 in 0.501s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:28:46 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-4da1b71d-54ac-48be-a31d-ad0710df5df8 tempest-VolumesGetTest-329956023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-03a8b3c5-f219-4825-8b14-fb243d62bcd4 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:28:46 devstack sudo[100772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-03a8b3c5-f219-4825-8b14-fb243d62bcd4 Sep 29 18:28:46 devstack sudo[100772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:28:46 devstack sudo[100772]: pam_unix(sudo:session): session closed for user root Sep 29 18:28:46 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-4da1b71d-54ac-48be-a31d-ad0710df5df8 tempest-VolumesGetTest-329956023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-03a8b3c5-f219-4825-8b14-fb243d62bcd4" returned: 0 in 0.269s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:28:46 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-4da1b71d-54ac-48be-a31d-ad0710df5df8 tempest-VolumesGetTest-329956023 None] <== create_volume: return (815ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'} {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:28:46 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-4da1b71d-54ac-48be-a31d-ad0710df5df8 tempest-VolumesGetTest-329956023 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.818s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:28:46 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-53aa95ac-9c4b-44fa-90cb-b93c0074298c tempest-SnapshotsActionsTest-1013262860 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.581s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:28:46 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-53aa95ac-9c4b-44fa-90cb-b93c0074298c tempest-SnapshotsActionsTest-1013262860 None] Creating offline snapshot 30d09fd3-a482-4a18-ae07-0d3909a83e5c of volume 3d93adb1-1c36-4157-b126-84bc227ec0f3 {{(pid=86512) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 18:28:46 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-4da1b71d-54ac-48be-a31d-ad0710df5df8 tempest-VolumesGetTest-329956023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a86e408-1480-4f86-9279-4aeb3e39f5df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03a8b3c5-f219-4825-8b14-fb243d62bcd4', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:28:46 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-4da1b71d-54ac-48be-a31d-ad0710df5df8 tempest-VolumesGetTest-329956023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e29221c3-d7cd-4ed9-b4f7-106e7cc69c1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:28:46 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7e5e08b-147b-4a92-b83e-7478cc3e2c24]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:28:46 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-53aa95ac-9c4b-44fa-90cb-b93c0074298c tempest-SnapshotsActionsTest-1013262860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-3d93adb1-1c36-4157-b126-84bc227ec0f3.d1eb3c76-f7d0-4969-af6d-3e9f9b051821 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:28:46 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-4da1b71d-54ac-48be-a31d-ad0710df5df8 tempest-VolumesGetTest-329956023 None] Volume volume-03a8b3c5-f219-4825-8b14-fb243d62bcd4 (03a8b3c5-f219-4825-8b14-fb243d62bcd4): created successfully Sep 29 18:28:46 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-4da1b71d-54ac-48be-a31d-ad0710df5df8 tempest-VolumesGetTest-329956023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e29221c3-d7cd-4ed9-b4f7-106e7cc69c1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:28:46 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-4da1b71d-54ac-48be-a31d-ad0710df5df8 tempest-VolumesGetTest-329956023 None] Flow 'volume_create_manager' (ecb8fb0b-27ea-4eb9-887f-3017584bb5a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:28:46 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-4da1b71d-54ac-48be-a31d-ad0710df5df8 tempest-VolumesGetTest-329956023 None] Created volume successfully. Sep 29 18:28:46 devstack sudo[100775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-3d93adb1-1c36-4157-b126-84bc227ec0f3.d1eb3c76-f7d0-4969-af6d-3e9f9b051821 Sep 29 18:28:46 devstack sudo[100775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:28:47 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-63d52363-75ae-48b9-a8a2-1f8557ffa124 tempest-ProjectReaderTests-2070855465 None] Acquiring lock "cinder-ff0299ba-f3b6-4a3b-b0f8-e8472321a40a-delete_volume" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:28:47 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-63d52363-75ae-48b9-a8a2-1f8557ffa124 tempest-ProjectReaderTests-2070855465 None] Lock "cinder-ff0299ba-f3b6-4a3b-b0f8-e8472321a40a-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:28:47 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-63d52363-75ae-48b9-a8a2-1f8557ffa124 tempest-ProjectReaderTests-2070855465 None] Acquiring lock "cinder-quobyte-ff0299ba-f3b6-4a3b-b0f8-e8472321a40a" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:28:47 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-63d52363-75ae-48b9-a8a2-1f8557ffa124 tempest-ProjectReaderTests-2070855465 None] Lock "cinder-quobyte-ff0299ba-f3b6-4a3b-b0f8-e8472321a40a" acquired by "delete_volume" :: waited 0.023s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:28:47 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[c93aab79-874e-4ba7-87ca-3c1111481c45]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:28:47 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-63d52363-75ae-48b9-a8a2-1f8557ffa124 tempest-ProjectReaderTests-2070855465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ff0299ba-f3b6-4a3b-b0f8-e8472321a40a {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:28:47 devstack sudo[100775]: pam_unix(sudo:session): session closed for user root Sep 29 18:28:47 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-53aa95ac-9c4b-44fa-90cb-b93c0074298c tempest-SnapshotsActionsTest-1013262860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-3d93adb1-1c36-4157-b126-84bc227ec0f3.d1eb3c76-f7d0-4969-af6d-3e9f9b051821" returned: 0 in 0.429s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:28:47 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-53aa95ac-9c4b-44fa-90cb-b93c0074298c tempest-SnapshotsActionsTest-1013262860 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3d93adb1-1c36-4157-b126-84bc227ec0f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86512) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 18:28:47 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-53aa95ac-9c4b-44fa-90cb-b93c0074298c tempest-SnapshotsActionsTest-1013262860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-3d93adb1-1c36-4157-b126-84bc227ec0f3.d1eb3c76-f7d0-4969-af6d-3e9f9b051821,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-3d93adb1-1c36-4157-b126-84bc227ec0f3.30d09fd3-a482-4a18-ae07-0d3909a83e5c 1G {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:28:47 devstack sudo[100781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-3d93adb1-1c36-4157-b126-84bc227ec0f3.d1eb3c76-f7d0-4969-af6d-3e9f9b051821,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-3d93adb1-1c36-4157-b126-84bc227ec0f3.30d09fd3-a482-4a18-ae07-0d3909a83e5c 1G Sep 29 18:28:47 devstack sudo[100781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:28:47 devstack sudo[100780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ff0299ba-f3b6-4a3b-b0f8-e8472321a40a Sep 29 18:28:47 devstack sudo[100780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:28:47 devstack sudo[100780]: pam_unix(sudo:session): session closed for user root Sep 29 18:28:47 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-63d52363-75ae-48b9-a8a2-1f8557ffa124 tempest-ProjectReaderTests-2070855465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ff0299ba-f3b6-4a3b-b0f8-e8472321a40a" returned: 0 in 0.395s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:28:47 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-63d52363-75ae-48b9-a8a2-1f8557ffa124 tempest-ProjectReaderTests-2070855465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ff0299ba-f3b6-4a3b-b0f8-e8472321a40a {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:28:47 devstack sudo[100790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ff0299ba-f3b6-4a3b-b0f8-e8472321a40a Sep 29 18:28:47 devstack sudo[100790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:28:47 devstack sudo[100781]: pam_unix(sudo:session): session closed for user root Sep 29 18:28:47 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-53aa95ac-9c4b-44fa-90cb-b93c0074298c tempest-SnapshotsActionsTest-1013262860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-3d93adb1-1c36-4157-b126-84bc227ec0f3.d1eb3c76-f7d0-4969-af6d-3e9f9b051821,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-3d93adb1-1c36-4157-b126-84bc227ec0f3.30d09fd3-a482-4a18-ae07-0d3909a83e5c 1G" returned: 0 in 0.544s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:28:47 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-53aa95ac-9c4b-44fa-90cb-b93c0074298c tempest-SnapshotsActionsTest-1013262860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d93adb1-1c36-4157-b126-84bc227ec0f3.d1eb3c76-f7d0-4969-af6d-3e9f9b051821 -F qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-3d93adb1-1c36-4157-b126-84bc227ec0f3.30d09fd3-a482-4a18-ae07-0d3909a83e5c {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:28:47 devstack sudo[100792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d93adb1-1c36-4157-b126-84bc227ec0f3.d1eb3c76-f7d0-4969-af6d-3e9f9b051821 -F qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-3d93adb1-1c36-4157-b126-84bc227ec0f3.30d09fd3-a482-4a18-ae07-0d3909a83e5c Sep 29 18:28:47 devstack sudo[100792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:28:47 devstack sudo[100790]: pam_unix(sudo:session): session closed for user root Sep 29 18:28:47 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-63d52363-75ae-48b9-a8a2-1f8557ffa124 tempest-ProjectReaderTests-2070855465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ff0299ba-f3b6-4a3b-b0f8-e8472321a40a" returned: 0 in 0.301s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:28:47 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-63d52363-75ae-48b9-a8a2-1f8557ffa124 tempest-ProjectReaderTests-2070855465 None] Lock "cinder-quobyte-ff0299ba-f3b6-4a3b-b0f8-e8472321a40a" released by "delete_volume" :: held 0.752s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:28:48 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-c6514081-1750-4329-945c-dc2d233d816e tempest-VolumesGetTest-329956023 None] Acquiring lock "cinder-03a8b3c5-f219-4825-8b14-fb243d62bcd4-delete_volume" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:28:48 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-63d52363-75ae-48b9-a8a2-1f8557ffa124 tempest-ProjectReaderTests-2070855465 None] Created reservations ['68ae4843-81a4-4f25-acfa-d720dc7828a2', '9324e28f-a467-4b6a-a5ff-a975b73dd218', 'a9c2bbf8-04ec-4da9-9ae3-19154d03858b', '152dc5b7-bf7c-4728-9d5d-529e7387d114'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:28:48 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-c6514081-1750-4329-945c-dc2d233d816e tempest-VolumesGetTest-329956023 None] Lock "cinder-03a8b3c5-f219-4825-8b14-fb243d62bcd4-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:28:48 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-c6514081-1750-4329-945c-dc2d233d816e tempest-VolumesGetTest-329956023 None] Acquiring lock "cinder-quobyte-03a8b3c5-f219-4825-8b14-fb243d62bcd4" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:28:48 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-c6514081-1750-4329-945c-dc2d233d816e tempest-VolumesGetTest-329956023 None] Lock "cinder-quobyte-03a8b3c5-f219-4825-8b14-fb243d62bcd4" acquired by "delete_volume" :: waited 0.028s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:28:48 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-63d52363-75ae-48b9-a8a2-1f8557ffa124 tempest-ProjectReaderTests-2070855465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:28:48 devstack sudo[100792]: pam_unix(sudo:session): session closed for user root Sep 29 18:28:48 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-63d52363-75ae-48b9-a8a2-1f8557ffa124 tempest-ProjectReaderTests-2070855465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:28:48 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-63d52363-75ae-48b9-a8a2-1f8557ffa124 tempest-ProjectReaderTests-2070855465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:28:48 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-63d52363-75ae-48b9-a8a2-1f8557ffa124 tempest-ProjectReaderTests-2070855465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:28:48 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-63d52363-75ae-48b9-a8a2-1f8557ffa124 tempest-ProjectReaderTests-2070855465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:28:48 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-63d52363-75ae-48b9-a8a2-1f8557ffa124 tempest-ProjectReaderTests-2070855465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:28:48 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9e19f1f-058f-4be6-a722-76badebd2d11]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:28:48 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-c6514081-1750-4329-945c-dc2d233d816e tempest-VolumesGetTest-329956023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-03a8b3c5-f219-4825-8b14-fb243d62bcd4 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:28:48 devstack sudo[100798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:28:48 devstack sudo[100798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:28:48 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-53aa95ac-9c4b-44fa-90cb-b93c0074298c tempest-SnapshotsActionsTest-1013262860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d93adb1-1c36-4157-b126-84bc227ec0f3.d1eb3c76-f7d0-4969-af6d-3e9f9b051821 -F qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-3d93adb1-1c36-4157-b126-84bc227ec0f3.30d09fd3-a482-4a18-ae07-0d3909a83e5c" returned: 0 in 0.483s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:28:48 devstack cinder-volume[86512]: WARNING cinder.volume.drivers.remotefs [None req-53aa95ac-9c4b-44fa-90cb-b93c0074298c tempest-SnapshotsActionsTest-1013262860 None] /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-3d93adb1-1c36-4157-b126-84bc227ec0f3.30d09fd3-a482-4a18-ae07-0d3909a83e5c is being set with open permissions: ugo+rw Sep 29 18:28:48 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-53aa95ac-9c4b-44fa-90cb-b93c0074298c tempest-SnapshotsActionsTest-1013262860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-3d93adb1-1c36-4157-b126-84bc227ec0f3.30d09fd3-a482-4a18-ae07-0d3909a83e5c {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:28:48 devstack sudo[100801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-3d93adb1-1c36-4157-b126-84bc227ec0f3.30d09fd3-a482-4a18-ae07-0d3909a83e5c Sep 29 18:28:48 devstack sudo[100801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:28:48 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5470e81-1684-4df0-81b2-8987966b7777 tempest-VolumesCloneNegativeTest-222300006 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86512) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:28:48 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-a5470e81-1684-4df0-81b2-8987966b7777 tempest-VolumesCloneNegativeTest-222300006 None] Flow 'volume_create_manager' (f6324df4-e6af-4180-aaab-debde2178cd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:28:48 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-a5470e81-1684-4df0-81b2-8987966b7777 tempest-VolumesCloneNegativeTest-222300006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (515e217b-f273-4614-b653-88f38b117b08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:28:48 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-a5470e81-1684-4df0-81b2-8987966b7777 tempest-VolumesCloneNegativeTest-222300006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (515e217b-f273-4614-b653-88f38b117b08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:28:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-603921845',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53fc07fa-1b98-48eb-a8ce-a6c6fbbb8cfe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e60dd5695e584fe58ec647e3bb0c926e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:28:48Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:28:48Z,use_quota=True,user_id='eb835a05cbae4d39970c68e39c7d6f53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:28:48 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-a5470e81-1684-4df0-81b2-8987966b7777 tempest-VolumesCloneNegativeTest-222300006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f407c462-9ed5-4e4e-a4fe-898af41ee727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:28:48 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-a5470e81-1684-4df0-81b2-8987966b7777 tempest-VolumesCloneNegativeTest-222300006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f407c462-9ed5-4e4e-a4fe-898af41ee727) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:28:48 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-a5470e81-1684-4df0-81b2-8987966b7777 tempest-VolumesCloneNegativeTest-222300006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78e9ccee-539e-4c72-b78b-b0d4d054694f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:28:48 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-a5470e81-1684-4df0-81b2-8987966b7777 tempest-VolumesCloneNegativeTest-222300006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78e9ccee-539e-4c72-b78b-b0d4d054694f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53fc07fa-1b98-48eb-a8ce-a6c6fbbb8cfe', 'volume_name': 'volume-53fc07fa-1b98-48eb-a8ce-a6c6fbbb8cfe', 'volume_size': 2}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:28:48 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-a5470e81-1684-4df0-81b2-8987966b7777 tempest-VolumesCloneNegativeTest-222300006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (166f82fe-63ae-44df-85fe-e329ee0952ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:28:48 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-a5470e81-1684-4df0-81b2-8987966b7777 tempest-VolumesCloneNegativeTest-222300006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (166f82fe-63ae-44df-85fe-e329ee0952ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:28:48 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-a5470e81-1684-4df0-81b2-8987966b7777 tempest-VolumesCloneNegativeTest-222300006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d9d9339-84a9-4d73-8512-1b7920b66b17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:28:48 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-a5470e81-1684-4df0-81b2-8987966b7777 tempest-VolumesCloneNegativeTest-222300006 None] Volume 53fc07fa-1b98-48eb-a8ce-a6c6fbbb8cfe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53fc07fa-1b98-48eb-a8ce-a6c6fbbb8cfe', 'volume_size': 2} Sep 29 18:28:48 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-a5470e81-1684-4df0-81b2-8987966b7777 tempest-VolumesCloneNegativeTest-222300006 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:28:48 devstack sudo[100799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-03a8b3c5-f219-4825-8b14-fb243d62bcd4 Sep 29 18:28:48 devstack sudo[100799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:28:48 devstack sudo[100798]: pam_unix(sudo:session): session closed for user root Sep 29 18:28:48 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-63d52363-75ae-48b9-a8a2-1f8557ffa124 tempest-ProjectReaderTests-2070855465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.307s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:28:48 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-63d52363-75ae-48b9-a8a2-1f8557ffa124 tempest-ProjectReaderTests-2070855465 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:28:48 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-63d52363-75ae-48b9-a8a2-1f8557ffa124 tempest-ProjectReaderTests-2070855465 None] Deleted volume successfully. Sep 29 18:28:48 devstack sudo[100801]: pam_unix(sudo:session): session closed for user root Sep 29 18:28:48 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-63d52363-75ae-48b9-a8a2-1f8557ffa124 tempest-ProjectReaderTests-2070855465 None] Lock "cinder-ff0299ba-f3b6-4a3b-b0f8-e8472321a40a-delete_volume" released by "delete_volume" :: held 1.459s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:28:48 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-53aa95ac-9c4b-44fa-90cb-b93c0074298c tempest-SnapshotsActionsTest-1013262860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-3d93adb1-1c36-4157-b126-84bc227ec0f3.30d09fd3-a482-4a18-ae07-0d3909a83e5c" returned: 0 in 0.291s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:28:48 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-53aa95ac-9c4b-44fa-90cb-b93c0074298c tempest-SnapshotsActionsTest-1013262860 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.874s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:28:48 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-a5470e81-1684-4df0-81b2-8987966b7777 tempest-VolumesCloneNegativeTest-222300006 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.203s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:28:48 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-a5470e81-1684-4df0-81b2-8987966b7777 tempest-VolumesCloneNegativeTest-222300006 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:28:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-603921845',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53fc07fa-1b98-48eb-a8ce-a6c6fbbb8cfe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e60dd5695e584fe58ec647e3bb0c926e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:28:48Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:28:48Z,use_quota=True,user_id='eb835a05cbae4d39970c68e39c7d6f53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)}" {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:28:48 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-a5470e81-1684-4df0-81b2-8987966b7777 tempest-VolumesCloneNegativeTest-222300006 None] Creating volume 53fc07fa-1b98-48eb-a8ce-a6c6fbbb8cfe {{(pid=86512) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:28:48 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-a5470e81-1684-4df0-81b2-8987966b7777 tempest-VolumesCloneNegativeTest-222300006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:28:48 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-a5470e81-1684-4df0-81b2-8987966b7777 tempest-VolumesCloneNegativeTest-222300006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:28:48 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-a5470e81-1684-4df0-81b2-8987966b7777 tempest-VolumesCloneNegativeTest-222300006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:28:48 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-a5470e81-1684-4df0-81b2-8987966b7777 tempest-VolumesCloneNegativeTest-222300006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:28:48 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-a5470e81-1684-4df0-81b2-8987966b7777 tempest-VolumesCloneNegativeTest-222300006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:28:48 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-a5470e81-1684-4df0-81b2-8987966b7777 tempest-VolumesCloneNegativeTest-222300006 None] Selected osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 as target Quobyte volume. {{(pid=86512) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:28:48 devstack cinder-volume[86512]: INFO cinder.volume.drivers.remotefs [None req-a5470e81-1684-4df0-81b2-8987966b7777 tempest-VolumesCloneNegativeTest-222300006 None] casted to osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 Sep 29 18:28:48 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a5470e81-1684-4df0-81b2-8987966b7777 tempest-VolumesCloneNegativeTest-222300006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-53fc07fa-1b98-48eb-a8ce-a6c6fbbb8cfe 2147483648 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:28:48 devstack sudo[100806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-53fc07fa-1b98-48eb-a8ce-a6c6fbbb8cfe 2147483648 Sep 29 18:28:48 devstack sudo[100806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:28:48 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-53aa95ac-9c4b-44fa-90cb-b93c0074298c tempest-SnapshotsActionsTest-1013262860 None] Create snapshot completed successfully Sep 29 18:28:48 devstack sudo[100799]: pam_unix(sudo:session): session closed for user root Sep 29 18:28:48 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-c6514081-1750-4329-945c-dc2d233d816e tempest-VolumesGetTest-329956023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-03a8b3c5-f219-4825-8b14-fb243d62bcd4" returned: 0 in 0.537s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:28:48 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-c6514081-1750-4329-945c-dc2d233d816e tempest-VolumesGetTest-329956023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-03a8b3c5-f219-4825-8b14-fb243d62bcd4 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:28:48 devstack sudo[100812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-03a8b3c5-f219-4825-8b14-fb243d62bcd4 Sep 29 18:28:48 devstack sudo[100812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:28:49 devstack sudo[100812]: pam_unix(sudo:session): session closed for user root Sep 29 18:28:49 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-c6514081-1750-4329-945c-dc2d233d816e tempest-VolumesGetTest-329956023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-03a8b3c5-f219-4825-8b14-fb243d62bcd4" returned: 0 in 0.256s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:28:49 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-c6514081-1750-4329-945c-dc2d233d816e tempest-VolumesGetTest-329956023 None] Lock "cinder-quobyte-03a8b3c5-f219-4825-8b14-fb243d62bcd4" released by "delete_volume" :: held 0.877s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:28:49 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-c6514081-1750-4329-945c-dc2d233d816e tempest-VolumesGetTest-329956023 None] Created reservations ['a0b9d51a-59da-4ec8-b8d6-1b806f603251', '7ebb09ec-4111-4670-9c99-58cd05b8f71e', 'b727c664-a8ad-4577-9092-864398f161f7', '7478d86f-1cb8-469c-874d-5c1709e12a6a'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:28:49 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-c6514081-1750-4329-945c-dc2d233d816e tempest-VolumesGetTest-329956023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:28:49 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-c6514081-1750-4329-945c-dc2d233d816e tempest-VolumesGetTest-329956023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:28:49 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-c6514081-1750-4329-945c-dc2d233d816e tempest-VolumesGetTest-329956023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:28:49 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-c6514081-1750-4329-945c-dc2d233d816e tempest-VolumesGetTest-329956023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:28:49 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-c6514081-1750-4329-945c-dc2d233d816e tempest-VolumesGetTest-329956023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:28:49 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-c6514081-1750-4329-945c-dc2d233d816e tempest-VolumesGetTest-329956023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:28:49 devstack sudo[100806]: pam_unix(sudo:session): session closed for user root Sep 29 18:28:49 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a5470e81-1684-4df0-81b2-8987966b7777 tempest-VolumesCloneNegativeTest-222300006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-53fc07fa-1b98-48eb-a8ce-a6c6fbbb8cfe 2147483648" returned: 0 in 0.584s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:28:49 devstack sudo[100819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:28:49 devstack sudo[100819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:28:49 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a5470e81-1684-4df0-81b2-8987966b7777 tempest-VolumesCloneNegativeTest-222300006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-53fc07fa-1b98-48eb-a8ce-a6c6fbbb8cfe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:28:49 devstack sudo[100821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-53fc07fa-1b98-48eb-a8ce-a6c6fbbb8cfe Sep 29 18:28:49 devstack sudo[100821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:28:49 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-23b3664e-c99a-4bed-ab46-baa40e2cb116 tempest-VolumesGetTest-329956023 None] Acquiring lock "cinder-02590481-4b3f-474d-99a1-c8d5f99d131f-delete_volume" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:28:49 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-23b3664e-c99a-4bed-ab46-baa40e2cb116 tempest-VolumesGetTest-329956023 None] Lock "cinder-02590481-4b3f-474d-99a1-c8d5f99d131f-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:28:49 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-23b3664e-c99a-4bed-ab46-baa40e2cb116 tempest-VolumesGetTest-329956023 None] Acquiring lock "cinder-quobyte-02590481-4b3f-474d-99a1-c8d5f99d131f" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:28:49 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-23b3664e-c99a-4bed-ab46-baa40e2cb116 tempest-VolumesGetTest-329956023 None] Lock "cinder-quobyte-02590481-4b3f-474d-99a1-c8d5f99d131f" acquired by "delete_volume" :: waited 0.029s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:28:49 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e6304d7-ae8a-44a6-977b-1fdebabb92db]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:28:49 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-23b3664e-c99a-4bed-ab46-baa40e2cb116 tempest-VolumesGetTest-329956023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-02590481-4b3f-474d-99a1-c8d5f99d131f {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:28:49 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-b0b45fd9-2d31-4465-af88-785087454cd3 tempest-SnapshotsActionsTest-2036303098 None] Acquiring lock "cinder-30d09fd3-a482-4a18-ae07-0d3909a83e5c-delete_snapshot" by "delete_snapshot" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:28:49 devstack sudo[100821]: pam_unix(sudo:session): session closed for user root Sep 29 18:28:49 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-b0b45fd9-2d31-4465-af88-785087454cd3 tempest-SnapshotsActionsTest-2036303098 None] Lock "cinder-30d09fd3-a482-4a18-ae07-0d3909a83e5c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:28:49 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-b0b45fd9-2d31-4465-af88-785087454cd3 tempest-SnapshotsActionsTest-2036303098 None] Acquiring lock "cinder-quobyte-3d93adb1-1c36-4157-b126-84bc227ec0f3" by "delete_snapshot" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:28:49 devstack sudo[100819]: pam_unix(sudo:session): session closed for user root Sep 29 18:28:49 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a5470e81-1684-4df0-81b2-8987966b7777 tempest-VolumesCloneNegativeTest-222300006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-53fc07fa-1b98-48eb-a8ce-a6c6fbbb8cfe" returned: 0 in 0.416s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:28:49 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-a5470e81-1684-4df0-81b2-8987966b7777 tempest-VolumesCloneNegativeTest-222300006 None] <== create_volume: return (1061ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'} {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:28:49 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-a5470e81-1684-4df0-81b2-8987966b7777 tempest-VolumesCloneNegativeTest-222300006 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.065s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:28:49 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-c6514081-1750-4329-945c-dc2d233d816e tempest-VolumesGetTest-329956023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.493s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:28:49 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-c6514081-1750-4329-945c-dc2d233d816e tempest-VolumesGetTest-329956023 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:28:49 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-b0b45fd9-2d31-4465-af88-785087454cd3 tempest-SnapshotsActionsTest-2036303098 None] Lock "cinder-quobyte-3d93adb1-1c36-4157-b126-84bc227ec0f3" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:28:49 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-b0b45fd9-2d31-4465-af88-785087454cd3 tempest-SnapshotsActionsTest-2036303098 None] Acquiring lock "cinder-quobyte-30d09fd3-a482-4a18-ae07-0d3909a83e5c" by "_delete_snapshot" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:28:49 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-c6514081-1750-4329-945c-dc2d233d816e tempest-VolumesGetTest-329956023 None] Deleted volume successfully. Sep 29 18:28:49 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-a5470e81-1684-4df0-81b2-8987966b7777 tempest-VolumesCloneNegativeTest-222300006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d9d9339-84a9-4d73-8512-1b7920b66b17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53fc07fa-1b98-48eb-a8ce-a6c6fbbb8cfe', 'volume_size': 2}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:28:49 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-a5470e81-1684-4df0-81b2-8987966b7777 tempest-VolumesCloneNegativeTest-222300006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (714d0285-28d0-4f9d-8442-b980bfcc1431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:28:49 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-b0b45fd9-2d31-4465-af88-785087454cd3 tempest-SnapshotsActionsTest-2036303098 None] Lock "cinder-quobyte-30d09fd3-a482-4a18-ae07-0d3909a83e5c" acquired by "_delete_snapshot" :: waited 0.049s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:28:49 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-b0b45fd9-2d31-4465-af88-785087454cd3 tempest-SnapshotsActionsTest-2036303098 None] Deleting offline snapshot 30d09fd3-a482-4a18-ae07-0d3909a83e5c of volume 3d93adb1-1c36-4157-b126-84bc227ec0f3 {{(pid=86512) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 18:28:49 devstack sudo[100823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-02590481-4b3f-474d-99a1-c8d5f99d131f Sep 29 18:28:49 devstack sudo[100823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:28:49 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-b0b45fd9-2d31-4465-af88-785087454cd3 tempest-SnapshotsActionsTest-2036303098 None] snapshot_file for this snap is: volume-3d93adb1-1c36-4157-b126-84bc227ec0f3.30d09fd3-a482-4a18-ae07-0d3909a83e5c {{(pid=86512) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 18:28:49 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcf5615b-792f-491d-b842-4af047738c88]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:28:49 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-b0b45fd9-2d31-4465-af88-785087454cd3 tempest-SnapshotsActionsTest-2036303098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-3d93adb1-1c36-4157-b126-84bc227ec0f3.30d09fd3-a482-4a18-ae07-0d3909a83e5c {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:28:49 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-c6514081-1750-4329-945c-dc2d233d816e tempest-VolumesGetTest-329956023 None] Lock "cinder-03a8b3c5-f219-4825-8b14-fb243d62bcd4-delete_volume" released by "delete_volume" :: held 1.751s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:28:49 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-a5470e81-1684-4df0-81b2-8987966b7777 tempest-VolumesCloneNegativeTest-222300006 None] Volume volume-53fc07fa-1b98-48eb-a8ce-a6c6fbbb8cfe (53fc07fa-1b98-48eb-a8ce-a6c6fbbb8cfe): created successfully Sep 29 18:28:49 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-a5470e81-1684-4df0-81b2-8987966b7777 tempest-VolumesCloneNegativeTest-222300006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (714d0285-28d0-4f9d-8442-b980bfcc1431) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:28:49 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-a5470e81-1684-4df0-81b2-8987966b7777 tempest-VolumesCloneNegativeTest-222300006 None] Flow 'volume_create_manager' (f6324df4-e6af-4180-aaab-debde2178cd4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:28:49 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-a5470e81-1684-4df0-81b2-8987966b7777 tempest-VolumesCloneNegativeTest-222300006 None] Created volume successfully. Sep 29 18:28:49 devstack sudo[100827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-3d93adb1-1c36-4157-b126-84bc227ec0f3.30d09fd3-a482-4a18-ae07-0d3909a83e5c Sep 29 18:28:49 devstack sudo[100827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:28:50 devstack sudo[100823]: pam_unix(sudo:session): session closed for user root Sep 29 18:28:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-23b3664e-c99a-4bed-ab46-baa40e2cb116 tempest-VolumesGetTest-329956023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-02590481-4b3f-474d-99a1-c8d5f99d131f" returned: 0 in 0.522s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:28:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-23b3664e-c99a-4bed-ab46-baa40e2cb116 tempest-VolumesGetTest-329956023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-02590481-4b3f-474d-99a1-c8d5f99d131f {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:28:50 devstack sudo[100832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-02590481-4b3f-474d-99a1-c8d5f99d131f Sep 29 18:28:50 devstack sudo[100832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:28:50 devstack sudo[100827]: pam_unix(sudo:session): session closed for user root Sep 29 18:28:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-b0b45fd9-2d31-4465-af88-785087454cd3 tempest-SnapshotsActionsTest-2036303098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-3d93adb1-1c36-4157-b126-84bc227ec0f3.30d09fd3-a482-4a18-ae07-0d3909a83e5c" returned: 0 in 0.426s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:28:50 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-b0b45fd9-2d31-4465-af88-785087454cd3 tempest-SnapshotsActionsTest-2036303098 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3d93adb1-1c36-4157-b126-84bc227ec0f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86512) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 18:28:50 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a378140-dca0-4185-88bf-67acd3b877a4]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:28:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-b0b45fd9-2d31-4465-af88-785087454cd3 tempest-SnapshotsActionsTest-2036303098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-3d93adb1-1c36-4157-b126-84bc227ec0f3.d1eb3c76-f7d0-4969-af6d-3e9f9b051821 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:28:50 devstack sudo[100832]: pam_unix(sudo:session): session closed for user root Sep 29 18:28:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-23b3664e-c99a-4bed-ab46-baa40e2cb116 tempest-VolumesGetTest-329956023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-02590481-4b3f-474d-99a1-c8d5f99d131f" returned: 0 in 0.325s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:28:50 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-23b3664e-c99a-4bed-ab46-baa40e2cb116 tempest-VolumesGetTest-329956023 None] Lock "cinder-quobyte-02590481-4b3f-474d-99a1-c8d5f99d131f" released by "delete_volume" :: held 0.940s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:28:50 devstack sudo[100837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-3d93adb1-1c36-4157-b126-84bc227ec0f3.d1eb3c76-f7d0-4969-af6d-3e9f9b051821 Sep 29 18:28:50 devstack sudo[100837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:28:50 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-23b3664e-c99a-4bed-ab46-baa40e2cb116 tempest-VolumesGetTest-329956023 None] Created reservations ['fa694bed-cd21-4fdd-a3c3-26b8f060bbd2', 'b84bf314-937f-4e33-b207-1868cb9988f4', 'e1bfab18-02fa-486f-a687-f329019db757', 'cfc00b3e-6c35-497a-a80b-42039c255a3b'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:28:50 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-6ccd28de-cd07-4ea0-8ba6-87c938b23b67 tempest-VolumesCloneNegativeTest-222300006 None] Acquiring lock "cinder-53fc07fa-1b98-48eb-a8ce-a6c6fbbb8cfe-delete_volume" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:28:50 devstack cinder-volume[86512]: DEBUG oslo_service.periodic_task [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86512) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 18:28:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:28:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:28:50 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:28:50 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:28:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:28:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:28:50 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-6ccd28de-cd07-4ea0-8ba6-87c938b23b67 tempest-VolumesCloneNegativeTest-222300006 None] Lock "cinder-53fc07fa-1b98-48eb-a8ce-a6c6fbbb8cfe-delete_volume" acquired by "delete_volume" :: waited 0.077s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:28:50 devstack sudo[100840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:28:50 devstack sudo[100840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:28:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-23b3664e-c99a-4bed-ab46-baa40e2cb116 tempest-VolumesGetTest-329956023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:28:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-23b3664e-c99a-4bed-ab46-baa40e2cb116 tempest-VolumesGetTest-329956023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:28:50 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-23b3664e-c99a-4bed-ab46-baa40e2cb116 tempest-VolumesGetTest-329956023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:28:50 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-23b3664e-c99a-4bed-ab46-baa40e2cb116 tempest-VolumesGetTest-329956023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:28:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-23b3664e-c99a-4bed-ab46-baa40e2cb116 tempest-VolumesGetTest-329956023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:28:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-23b3664e-c99a-4bed-ab46-baa40e2cb116 tempest-VolumesGetTest-329956023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:28:50 devstack sudo[100842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:28:50 devstack sudo[100842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:28:50 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-6ccd28de-cd07-4ea0-8ba6-87c938b23b67 tempest-VolumesCloneNegativeTest-222300006 None] Acquiring lock "cinder-quobyte-53fc07fa-1b98-48eb-a8ce-a6c6fbbb8cfe" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:28:50 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-6ccd28de-cd07-4ea0-8ba6-87c938b23b67 tempest-VolumesCloneNegativeTest-222300006 None] Lock "cinder-quobyte-53fc07fa-1b98-48eb-a8ce-a6c6fbbb8cfe" acquired by "delete_volume" :: waited 0.037s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:28:50 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f75b1b9-5615-4ff2-9fb4-7edc7efc752a]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:28:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-6ccd28de-cd07-4ea0-8ba6-87c938b23b67 tempest-VolumesCloneNegativeTest-222300006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-53fc07fa-1b98-48eb-a8ce-a6c6fbbb8cfe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:28:50 devstack sudo[100837]: pam_unix(sudo:session): session closed for user root Sep 29 18:28:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-b0b45fd9-2d31-4465-af88-785087454cd3 tempest-SnapshotsActionsTest-2036303098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-3d93adb1-1c36-4157-b126-84bc227ec0f3.d1eb3c76-f7d0-4969-af6d-3e9f9b051821" returned: 0 in 0.665s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:28:50 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-b0b45fd9-2d31-4465-af88-785087454cd3 tempest-SnapshotsActionsTest-2036303098 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3d93adb1-1c36-4157-b126-84bc227ec0f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86512) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 18:28:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-b0b45fd9-2d31-4465-af88-785087454cd3 tempest-SnapshotsActionsTest-2036303098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-3d93adb1-1c36-4157-b126-84bc227ec0f3.30d09fd3-a482-4a18-ae07-0d3909a83e5c {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:28:50 devstack sudo[100848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-3d93adb1-1c36-4157-b126-84bc227ec0f3.30d09fd3-a482-4a18-ae07-0d3909a83e5c Sep 29 18:28:50 devstack sudo[100848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:28:51 devstack sudo[100847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-53fc07fa-1b98-48eb-a8ce-a6c6fbbb8cfe Sep 29 18:28:51 devstack sudo[100847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:28:51 devstack sudo[100842]: pam_unix(sudo:session): session closed for user root Sep 29 18:28:51 devstack sudo[100840]: pam_unix(sudo:session): session closed for user root Sep 29 18:28:51 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-23b3664e-c99a-4bed-ab46-baa40e2cb116 tempest-VolumesGetTest-329956023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.339s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:28:51 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-23b3664e-c99a-4bed-ab46-baa40e2cb116 tempest-VolumesGetTest-329956023 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:28:51 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.426s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:28:51 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:28:51 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-23b3664e-c99a-4bed-ab46-baa40e2cb116 tempest-VolumesGetTest-329956023 None] Deleted volume successfully. Sep 29 18:28:51 devstack cinder-volume[86512]: DEBUG oslo_service.periodic_task [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Running periodic task VolumeManager._thread_info {{(pid=86512) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 18:28:51 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] thread count: 29 {{(pid=86512) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 29 18:28:51 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] thread info: [<_MainThread(MainThread, started 135593654804608)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86512) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 29 18:28:51 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-23b3664e-c99a-4bed-ab46-baa40e2cb116 tempest-VolumesGetTest-329956023 None] Lock "cinder-02590481-4b3f-474d-99a1-c8d5f99d131f-delete_volume" released by "delete_volume" :: held 1.730s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:28:51 devstack sudo[100847]: pam_unix(sudo:session): session closed for user root Sep 29 18:28:51 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-6ccd28de-cd07-4ea0-8ba6-87c938b23b67 tempest-VolumesCloneNegativeTest-222300006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-53fc07fa-1b98-48eb-a8ce-a6c6fbbb8cfe" returned: 0 in 0.426s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:28:51 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-6ccd28de-cd07-4ea0-8ba6-87c938b23b67 tempest-VolumesCloneNegativeTest-222300006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-53fc07fa-1b98-48eb-a8ce-a6c6fbbb8cfe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:28:51 devstack sudo[100859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-53fc07fa-1b98-48eb-a8ce-a6c6fbbb8cfe Sep 29 18:28:51 devstack sudo[100859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:28:51 devstack sudo[100848]: pam_unix(sudo:session): session closed for user root Sep 29 18:28:51 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-b0b45fd9-2d31-4465-af88-785087454cd3 tempest-SnapshotsActionsTest-2036303098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-3d93adb1-1c36-4157-b126-84bc227ec0f3.30d09fd3-a482-4a18-ae07-0d3909a83e5c" returned: 0 in 0.429s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:28:51 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-b0b45fd9-2d31-4465-af88-785087454cd3 tempest-SnapshotsActionsTest-2036303098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-3d93adb1-1c36-4157-b126-84bc227ec0f3.30d09fd3-a482-4a18-ae07-0d3909a83e5c {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:28:51 devstack sudo[100861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-3d93adb1-1c36-4157-b126-84bc227ec0f3.30d09fd3-a482-4a18-ae07-0d3909a83e5c Sep 29 18:28:51 devstack sudo[100861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:28:51 devstack sudo[100859]: pam_unix(sudo:session): session closed for user root Sep 29 18:28:51 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-6ccd28de-cd07-4ea0-8ba6-87c938b23b67 tempest-VolumesCloneNegativeTest-222300006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-53fc07fa-1b98-48eb-a8ce-a6c6fbbb8cfe" returned: 0 in 0.242s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:28:51 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-6ccd28de-cd07-4ea0-8ba6-87c938b23b67 tempest-VolumesCloneNegativeTest-222300006 None] Lock "cinder-quobyte-53fc07fa-1b98-48eb-a8ce-a6c6fbbb8cfe" released by "delete_volume" :: held 0.735s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:28:51 devstack sudo[100861]: pam_unix(sudo:session): session closed for user root Sep 29 18:28:51 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-b0b45fd9-2d31-4465-af88-785087454cd3 tempest-SnapshotsActionsTest-2036303098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-3d93adb1-1c36-4157-b126-84bc227ec0f3.30d09fd3-a482-4a18-ae07-0d3909a83e5c" returned: 0 in 0.269s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:28:51 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-b0b45fd9-2d31-4465-af88-785087454cd3 tempest-SnapshotsActionsTest-2036303098 None] Lock "cinder-quobyte-30d09fd3-a482-4a18-ae07-0d3909a83e5c" released by "_delete_snapshot" :: held 1.945s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:28:51 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-6ccd28de-cd07-4ea0-8ba6-87c938b23b67 tempest-VolumesCloneNegativeTest-222300006 None] Created reservations ['008e500b-f775-4c89-bcf6-6a17a23ec851', '7dcbe01f-9429-4793-877b-fc90fa752b25', 'c79cd572-2987-4e0b-b4aa-dc4b20da4c76', 'd5e0e34e-5f79-44ef-b19f-6a88ad3c24a3'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:28:51 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-b0b45fd9-2d31-4465-af88-785087454cd3 tempest-SnapshotsActionsTest-2036303098 None] Lock "cinder-quobyte-3d93adb1-1c36-4157-b126-84bc227ec0f3" released by "delete_snapshot" :: held 2.003s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:28:51 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-6ccd28de-cd07-4ea0-8ba6-87c938b23b67 tempest-VolumesCloneNegativeTest-222300006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:28:51 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-6ccd28de-cd07-4ea0-8ba6-87c938b23b67 tempest-VolumesCloneNegativeTest-222300006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:28:51 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-6ccd28de-cd07-4ea0-8ba6-87c938b23b67 tempest-VolumesCloneNegativeTest-222300006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:28:51 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-6ccd28de-cd07-4ea0-8ba6-87c938b23b67 tempest-VolumesCloneNegativeTest-222300006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:28:51 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-6ccd28de-cd07-4ea0-8ba6-87c938b23b67 tempest-VolumesCloneNegativeTest-222300006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:28:51 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-6ccd28de-cd07-4ea0-8ba6-87c938b23b67 tempest-VolumesCloneNegativeTest-222300006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:28:51 devstack sudo[100865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:28:51 devstack sudo[100865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:28:51 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-b0b45fd9-2d31-4465-af88-785087454cd3 tempest-SnapshotsActionsTest-2036303098 None] Created reservations ['976e0748-96d4-4fe6-b300-baa28d981b7c', '9d18a79f-6997-4628-a3bd-2b46e951bdf9', '1df29ecb-84b3-4bf8-8cb7-d07bb7214623', '06c5f80b-e082-4ab8-933e-fb984bffee9e'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:28:51 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-b0b45fd9-2d31-4465-af88-785087454cd3 tempest-SnapshotsActionsTest-2036303098 None] Delete snapshot completed successfully. Sep 29 18:28:51 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-b0b45fd9-2d31-4465-af88-785087454cd3 tempest-SnapshotsActionsTest-2036303098 None] Lock "cinder-30d09fd3-a482-4a18-ae07-0d3909a83e5c-delete_snapshot" released by "delete_snapshot" :: held 2.246s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:28:52 devstack sudo[100865]: pam_unix(sudo:session): session closed for user root Sep 29 18:28:52 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-6ccd28de-cd07-4ea0-8ba6-87c938b23b67 tempest-VolumesCloneNegativeTest-222300006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.279s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:28:52 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-6ccd28de-cd07-4ea0-8ba6-87c938b23b67 tempest-VolumesCloneNegativeTest-222300006 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:28:52 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-6ccd28de-cd07-4ea0-8ba6-87c938b23b67 tempest-VolumesCloneNegativeTest-222300006 None] Deleted volume successfully. Sep 29 18:28:52 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-6ccd28de-cd07-4ea0-8ba6-87c938b23b67 tempest-VolumesCloneNegativeTest-222300006 None] Lock "cinder-53fc07fa-1b98-48eb-a8ce-a6c6fbbb8cfe-delete_volume" released by "delete_volume" :: held 1.419s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:28:53 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-327886d4-8978-4117-99d3-fec8dbe915f4 tempest-SnapshotsActionsTest-1013262860 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:28:53 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-327886d4-8978-4117-99d3-fec8dbe915f4 tempest-SnapshotsActionsTest-1013262860 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:28:53 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-327886d4-8978-4117-99d3-fec8dbe915f4 tempest-SnapshotsActionsTest-1013262860 None] Creating offline snapshot ccc53b4a-da0d-44bd-936e-cdb9bf6366b5 of volume 3d93adb1-1c36-4157-b126-84bc227ec0f3 {{(pid=86512) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 18:28:53 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[398f5616-6f12-488d-b2b2-6b7fc11286d7]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:28:53 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-327886d4-8978-4117-99d3-fec8dbe915f4 tempest-SnapshotsActionsTest-1013262860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-3d93adb1-1c36-4157-b126-84bc227ec0f3.d1eb3c76-f7d0-4969-af6d-3e9f9b051821 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:28:53 devstack sudo[100868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-3d93adb1-1c36-4157-b126-84bc227ec0f3.d1eb3c76-f7d0-4969-af6d-3e9f9b051821 Sep 29 18:28:53 devstack sudo[100868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:28:53 devstack sudo[100868]: pam_unix(sudo:session): session closed for user root Sep 29 18:28:53 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-327886d4-8978-4117-99d3-fec8dbe915f4 tempest-SnapshotsActionsTest-1013262860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-3d93adb1-1c36-4157-b126-84bc227ec0f3.d1eb3c76-f7d0-4969-af6d-3e9f9b051821" returned: 0 in 0.430s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:28:53 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-327886d4-8978-4117-99d3-fec8dbe915f4 tempest-SnapshotsActionsTest-1013262860 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3d93adb1-1c36-4157-b126-84bc227ec0f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86512) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 18:28:53 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-327886d4-8978-4117-99d3-fec8dbe915f4 tempest-SnapshotsActionsTest-1013262860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-3d93adb1-1c36-4157-b126-84bc227ec0f3.d1eb3c76-f7d0-4969-af6d-3e9f9b051821,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-3d93adb1-1c36-4157-b126-84bc227ec0f3.ccc53b4a-da0d-44bd-936e-cdb9bf6366b5 1G {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:28:53 devstack sudo[100874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-3d93adb1-1c36-4157-b126-84bc227ec0f3.d1eb3c76-f7d0-4969-af6d-3e9f9b051821,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-3d93adb1-1c36-4157-b126-84bc227ec0f3.ccc53b4a-da0d-44bd-936e-cdb9bf6366b5 1G Sep 29 18:28:53 devstack sudo[100874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:28:54 devstack sudo[100874]: pam_unix(sudo:session): session closed for user root Sep 29 18:28:54 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-327886d4-8978-4117-99d3-fec8dbe915f4 tempest-SnapshotsActionsTest-1013262860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-3d93adb1-1c36-4157-b126-84bc227ec0f3.d1eb3c76-f7d0-4969-af6d-3e9f9b051821,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-3d93adb1-1c36-4157-b126-84bc227ec0f3.ccc53b4a-da0d-44bd-936e-cdb9bf6366b5 1G" returned: 0 in 0.527s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:28:54 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-327886d4-8978-4117-99d3-fec8dbe915f4 tempest-SnapshotsActionsTest-1013262860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d93adb1-1c36-4157-b126-84bc227ec0f3.d1eb3c76-f7d0-4969-af6d-3e9f9b051821 -F qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-3d93adb1-1c36-4157-b126-84bc227ec0f3.ccc53b4a-da0d-44bd-936e-cdb9bf6366b5 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:28:54 devstack sudo[100880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d93adb1-1c36-4157-b126-84bc227ec0f3.d1eb3c76-f7d0-4969-af6d-3e9f9b051821 -F qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-3d93adb1-1c36-4157-b126-84bc227ec0f3.ccc53b4a-da0d-44bd-936e-cdb9bf6366b5 Sep 29 18:28:54 devstack sudo[100880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:28:54 devstack sudo[100880]: pam_unix(sudo:session): session closed for user root Sep 29 18:28:54 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-327886d4-8978-4117-99d3-fec8dbe915f4 tempest-SnapshotsActionsTest-1013262860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d93adb1-1c36-4157-b126-84bc227ec0f3.d1eb3c76-f7d0-4969-af6d-3e9f9b051821 -F qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-3d93adb1-1c36-4157-b126-84bc227ec0f3.ccc53b4a-da0d-44bd-936e-cdb9bf6366b5" returned: 0 in 0.309s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:28:54 devstack cinder-volume[86512]: WARNING cinder.volume.drivers.remotefs [None req-327886d4-8978-4117-99d3-fec8dbe915f4 tempest-SnapshotsActionsTest-1013262860 None] /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-3d93adb1-1c36-4157-b126-84bc227ec0f3.ccc53b4a-da0d-44bd-936e-cdb9bf6366b5 is being set with open permissions: ugo+rw Sep 29 18:28:54 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-327886d4-8978-4117-99d3-fec8dbe915f4 tempest-SnapshotsActionsTest-1013262860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-3d93adb1-1c36-4157-b126-84bc227ec0f3.ccc53b4a-da0d-44bd-936e-cdb9bf6366b5 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:28:54 devstack sudo[100885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-3d93adb1-1c36-4157-b126-84bc227ec0f3.ccc53b4a-da0d-44bd-936e-cdb9bf6366b5 Sep 29 18:28:54 devstack sudo[100885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:28:54 devstack sudo[100885]: pam_unix(sudo:session): session closed for user root Sep 29 18:28:54 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-327886d4-8978-4117-99d3-fec8dbe915f4 tempest-SnapshotsActionsTest-1013262860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-3d93adb1-1c36-4157-b126-84bc227ec0f3.ccc53b4a-da0d-44bd-936e-cdb9bf6366b5" returned: 0 in 0.269s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:28:54 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-327886d4-8978-4117-99d3-fec8dbe915f4 tempest-SnapshotsActionsTest-1013262860 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.665s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:28:54 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-327886d4-8978-4117-99d3-fec8dbe915f4 tempest-SnapshotsActionsTest-1013262860 None] Create snapshot completed successfully Sep 29 18:28:55 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-c91221b9-049a-4205-b5ed-dbb78555a5ca tempest-SnapshotsActionsTest-2036303098 None] Acquiring lock "cinder-ccc53b4a-da0d-44bd-936e-cdb9bf6366b5-delete_snapshot" by "delete_snapshot" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:28:55 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-c91221b9-049a-4205-b5ed-dbb78555a5ca tempest-SnapshotsActionsTest-2036303098 None] Lock "cinder-ccc53b4a-da0d-44bd-936e-cdb9bf6366b5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:28:55 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-c91221b9-049a-4205-b5ed-dbb78555a5ca tempest-SnapshotsActionsTest-2036303098 None] Acquiring lock "cinder-quobyte-3d93adb1-1c36-4157-b126-84bc227ec0f3" by "delete_snapshot" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:28:55 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-c91221b9-049a-4205-b5ed-dbb78555a5ca tempest-SnapshotsActionsTest-2036303098 None] Lock "cinder-quobyte-3d93adb1-1c36-4157-b126-84bc227ec0f3" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:28:55 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-c91221b9-049a-4205-b5ed-dbb78555a5ca tempest-SnapshotsActionsTest-2036303098 None] Acquiring lock "cinder-quobyte-ccc53b4a-da0d-44bd-936e-cdb9bf6366b5" by "_delete_snapshot" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:28:55 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-c91221b9-049a-4205-b5ed-dbb78555a5ca tempest-SnapshotsActionsTest-2036303098 None] Lock "cinder-quobyte-ccc53b4a-da0d-44bd-936e-cdb9bf6366b5" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:28:55 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-c91221b9-049a-4205-b5ed-dbb78555a5ca tempest-SnapshotsActionsTest-2036303098 None] Deleting offline snapshot ccc53b4a-da0d-44bd-936e-cdb9bf6366b5 of volume 3d93adb1-1c36-4157-b126-84bc227ec0f3 {{(pid=86512) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 18:28:55 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-c91221b9-049a-4205-b5ed-dbb78555a5ca tempest-SnapshotsActionsTest-2036303098 None] snapshot_file for this snap is: volume-3d93adb1-1c36-4157-b126-84bc227ec0f3.ccc53b4a-da0d-44bd-936e-cdb9bf6366b5 {{(pid=86512) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 18:28:55 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[802d72b8-edae-404d-8f5e-f747d7b53fb8]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:28:55 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-c91221b9-049a-4205-b5ed-dbb78555a5ca tempest-SnapshotsActionsTest-2036303098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-3d93adb1-1c36-4157-b126-84bc227ec0f3.ccc53b4a-da0d-44bd-936e-cdb9bf6366b5 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:28:55 devstack sudo[100888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-3d93adb1-1c36-4157-b126-84bc227ec0f3.ccc53b4a-da0d-44bd-936e-cdb9bf6366b5 Sep 29 18:28:55 devstack sudo[100888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:28:56 devstack sudo[100888]: pam_unix(sudo:session): session closed for user root Sep 29 18:28:56 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-c91221b9-049a-4205-b5ed-dbb78555a5ca tempest-SnapshotsActionsTest-2036303098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-3d93adb1-1c36-4157-b126-84bc227ec0f3.ccc53b4a-da0d-44bd-936e-cdb9bf6366b5" returned: 0 in 0.432s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:28:56 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-c91221b9-049a-4205-b5ed-dbb78555a5ca tempest-SnapshotsActionsTest-2036303098 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3d93adb1-1c36-4157-b126-84bc227ec0f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86512) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 18:28:56 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[69b8f29a-70a1-4b1c-9524-76eb031a2dd3]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:28:56 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-c91221b9-049a-4205-b5ed-dbb78555a5ca tempest-SnapshotsActionsTest-2036303098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-3d93adb1-1c36-4157-b126-84bc227ec0f3.d1eb3c76-f7d0-4969-af6d-3e9f9b051821 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:28:56 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d981ce9-f38f-4090-9dd1-9868ec263926 tempest-VolumesListTestJSON-281567656 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86512) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:28:56 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-6d981ce9-f38f-4090-9dd1-9868ec263926 tempest-VolumesListTestJSON-281567656 None] Flow 'volume_create_manager' (5e669975-6f52-44c0-a8c6-132f258f5c5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:28:56 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-6d981ce9-f38f-4090-9dd1-9868ec263926 tempest-VolumesListTestJSON-281567656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93c14ca8-cc79-4115-8d27-96a0904b0fc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:28:56 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-6d981ce9-f38f-4090-9dd1-9868ec263926 tempest-VolumesListTestJSON-281567656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93c14ca8-cc79-4115-8d27-96a0904b0fc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:28:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-89477811',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=060084bf-4016-43be-b540-573dce76a46a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f27674b37b484188bcd575e0ae588d8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:28:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:28:56Z,use_quota=True,user_id='c0a42809388c40ca89b6bc8f08d6b9b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:28:56 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-6d981ce9-f38f-4090-9dd1-9868ec263926 tempest-VolumesListTestJSON-281567656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68e11509-83f1-487c-826a-c4f7421da98b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:28:56 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-6d981ce9-f38f-4090-9dd1-9868ec263926 tempest-VolumesListTestJSON-281567656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68e11509-83f1-487c-826a-c4f7421da98b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:28:56 devstack sudo[100899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-3d93adb1-1c36-4157-b126-84bc227ec0f3.d1eb3c76-f7d0-4969-af6d-3e9f9b051821 Sep 29 18:28:56 devstack sudo[100899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:28:56 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-6d981ce9-f38f-4090-9dd1-9868ec263926 tempest-VolumesListTestJSON-281567656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d576028-76d8-442a-8c40-89d77ef4d7c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:28:56 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-6d981ce9-f38f-4090-9dd1-9868ec263926 tempest-VolumesListTestJSON-281567656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d576028-76d8-442a-8c40-89d77ef4d7c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '060084bf-4016-43be-b540-573dce76a46a', 'volume_name': 'volume-060084bf-4016-43be-b540-573dce76a46a', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:28:56 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-6d981ce9-f38f-4090-9dd1-9868ec263926 tempest-VolumesListTestJSON-281567656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b170916-3fea-4687-8a34-17398f945322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:28:56 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-6d981ce9-f38f-4090-9dd1-9868ec263926 tempest-VolumesListTestJSON-281567656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b170916-3fea-4687-8a34-17398f945322) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:28:56 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-6d981ce9-f38f-4090-9dd1-9868ec263926 tempest-VolumesListTestJSON-281567656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cf8bb93-ab42-4376-85cd-f685a306c67e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:28:56 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-6d981ce9-f38f-4090-9dd1-9868ec263926 tempest-VolumesListTestJSON-281567656 None] Volume 060084bf-4016-43be-b540-573dce76a46a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-060084bf-4016-43be-b540-573dce76a46a', 'volume_size': 1} Sep 29 18:28:56 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-6d981ce9-f38f-4090-9dd1-9868ec263926 tempest-VolumesListTestJSON-281567656 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:28:56 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-6d981ce9-f38f-4090-9dd1-9868ec263926 tempest-VolumesListTestJSON-281567656 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:28:56 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-6d981ce9-f38f-4090-9dd1-9868ec263926 tempest-VolumesListTestJSON-281567656 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:28:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-89477811',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=060084bf-4016-43be-b540-573dce76a46a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f27674b37b484188bcd575e0ae588d8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:28:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:28:56Z,use_quota=True,user_id='c0a42809388c40ca89b6bc8f08d6b9b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)}" {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:28:56 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-6d981ce9-f38f-4090-9dd1-9868ec263926 tempest-VolumesListTestJSON-281567656 None] Creating volume 060084bf-4016-43be-b540-573dce76a46a {{(pid=86512) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:28:56 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-6d981ce9-f38f-4090-9dd1-9868ec263926 tempest-VolumesListTestJSON-281567656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:28:56 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-6d981ce9-f38f-4090-9dd1-9868ec263926 tempest-VolumesListTestJSON-281567656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:28:56 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-6d981ce9-f38f-4090-9dd1-9868ec263926 tempest-VolumesListTestJSON-281567656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:28:56 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-6d981ce9-f38f-4090-9dd1-9868ec263926 tempest-VolumesListTestJSON-281567656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:28:56 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-6d981ce9-f38f-4090-9dd1-9868ec263926 tempest-VolumesListTestJSON-281567656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:28:56 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-6d981ce9-f38f-4090-9dd1-9868ec263926 tempest-VolumesListTestJSON-281567656 None] Selected osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 as target Quobyte volume. {{(pid=86512) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:28:56 devstack cinder-volume[86512]: INFO cinder.volume.drivers.remotefs [None req-6d981ce9-f38f-4090-9dd1-9868ec263926 tempest-VolumesListTestJSON-281567656 None] casted to osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 Sep 29 18:28:56 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-6d981ce9-f38f-4090-9dd1-9868ec263926 tempest-VolumesListTestJSON-281567656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-060084bf-4016-43be-b540-573dce76a46a 1073741824 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:28:56 devstack sudo[100901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-060084bf-4016-43be-b540-573dce76a46a 1073741824 Sep 29 18:28:56 devstack sudo[100901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:28:56 devstack sudo[100899]: pam_unix(sudo:session): session closed for user root Sep 29 18:28:56 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-c91221b9-049a-4205-b5ed-dbb78555a5ca tempest-SnapshotsActionsTest-2036303098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-3d93adb1-1c36-4157-b126-84bc227ec0f3.d1eb3c76-f7d0-4969-af6d-3e9f9b051821" returned: 0 in 0.415s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:28:56 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-c91221b9-049a-4205-b5ed-dbb78555a5ca tempest-SnapshotsActionsTest-2036303098 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3d93adb1-1c36-4157-b126-84bc227ec0f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86512) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 18:28:56 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-c91221b9-049a-4205-b5ed-dbb78555a5ca tempest-SnapshotsActionsTest-2036303098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-3d93adb1-1c36-4157-b126-84bc227ec0f3.ccc53b4a-da0d-44bd-936e-cdb9bf6366b5 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:28:56 devstack sudo[100908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-3d93adb1-1c36-4157-b126-84bc227ec0f3.ccc53b4a-da0d-44bd-936e-cdb9bf6366b5 Sep 29 18:28:56 devstack sudo[100908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:28:56 devstack sudo[100901]: pam_unix(sudo:session): session closed for user root Sep 29 18:28:56 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-6d981ce9-f38f-4090-9dd1-9868ec263926 tempest-VolumesListTestJSON-281567656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-060084bf-4016-43be-b540-573dce76a46a 1073741824" returned: 0 in 0.523s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:28:56 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-6d981ce9-f38f-4090-9dd1-9868ec263926 tempest-VolumesListTestJSON-281567656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-060084bf-4016-43be-b540-573dce76a46a {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:28:56 devstack sudo[100915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-060084bf-4016-43be-b540-573dce76a46a Sep 29 18:28:56 devstack sudo[100915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:28:56 devstack sudo[100908]: pam_unix(sudo:session): session closed for user root Sep 29 18:28:56 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-c91221b9-049a-4205-b5ed-dbb78555a5ca tempest-SnapshotsActionsTest-2036303098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-3d93adb1-1c36-4157-b126-84bc227ec0f3.ccc53b4a-da0d-44bd-936e-cdb9bf6366b5" returned: 0 in 0.469s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:28:56 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-c91221b9-049a-4205-b5ed-dbb78555a5ca tempest-SnapshotsActionsTest-2036303098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-3d93adb1-1c36-4157-b126-84bc227ec0f3.ccc53b4a-da0d-44bd-936e-cdb9bf6366b5 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:28:56 devstack sudo[100917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-3d93adb1-1c36-4157-b126-84bc227ec0f3.ccc53b4a-da0d-44bd-936e-cdb9bf6366b5 Sep 29 18:28:56 devstack sudo[100917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:28:57 devstack sudo[100915]: pam_unix(sudo:session): session closed for user root Sep 29 18:28:57 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-6d981ce9-f38f-4090-9dd1-9868ec263926 tempest-VolumesListTestJSON-281567656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-060084bf-4016-43be-b540-573dce76a46a" returned: 0 in 0.321s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:28:57 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-6d981ce9-f38f-4090-9dd1-9868ec263926 tempest-VolumesListTestJSON-281567656 None] <== create_volume: return (894ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'} {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:28:57 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-6d981ce9-f38f-4090-9dd1-9868ec263926 tempest-VolumesListTestJSON-281567656 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.896s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:28:57 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-6d981ce9-f38f-4090-9dd1-9868ec263926 tempest-VolumesListTestJSON-281567656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cf8bb93-ab42-4376-85cd-f685a306c67e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-060084bf-4016-43be-b540-573dce76a46a', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:28:57 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-6d981ce9-f38f-4090-9dd1-9868ec263926 tempest-VolumesListTestJSON-281567656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b04e8f25-1c63-4b18-bae6-133c6abf46aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:28:57 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-6d981ce9-f38f-4090-9dd1-9868ec263926 tempest-VolumesListTestJSON-281567656 None] Volume volume-060084bf-4016-43be-b540-573dce76a46a (060084bf-4016-43be-b540-573dce76a46a): created successfully Sep 29 18:28:57 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-6d981ce9-f38f-4090-9dd1-9868ec263926 tempest-VolumesListTestJSON-281567656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b04e8f25-1c63-4b18-bae6-133c6abf46aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:28:57 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-6d981ce9-f38f-4090-9dd1-9868ec263926 tempest-VolumesListTestJSON-281567656 None] Flow 'volume_create_manager' (5e669975-6f52-44c0-a8c6-132f258f5c5a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:28:57 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-6d981ce9-f38f-4090-9dd1-9868ec263926 tempest-VolumesListTestJSON-281567656 None] Created volume successfully. Sep 29 18:28:57 devstack sudo[100917]: pam_unix(sudo:session): session closed for user root Sep 29 18:28:57 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-c91221b9-049a-4205-b5ed-dbb78555a5ca tempest-SnapshotsActionsTest-2036303098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-3d93adb1-1c36-4157-b126-84bc227ec0f3.ccc53b4a-da0d-44bd-936e-cdb9bf6366b5" returned: 0 in 0.284s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:28:57 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-c91221b9-049a-4205-b5ed-dbb78555a5ca tempest-SnapshotsActionsTest-2036303098 None] Lock "cinder-quobyte-ccc53b4a-da0d-44bd-936e-cdb9bf6366b5" released by "_delete_snapshot" :: held 1.719s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:28:57 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-c91221b9-049a-4205-b5ed-dbb78555a5ca tempest-SnapshotsActionsTest-2036303098 None] Lock "cinder-quobyte-3d93adb1-1c36-4157-b126-84bc227ec0f3" released by "delete_snapshot" :: held 1.747s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:28:57 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-c91221b9-049a-4205-b5ed-dbb78555a5ca tempest-SnapshotsActionsTest-2036303098 None] Created reservations ['cc5cae0b-b35e-4eeb-b4ae-d1fbafc7323a', 'b56e5d89-b2f7-471f-95ce-71fb457c11bf', 'aa0efed9-c4f5-465c-922b-cdb2cf0fe8d8', '0c7bab94-e036-40bc-ae7d-432f8af18f58'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:28:57 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-c91221b9-049a-4205-b5ed-dbb78555a5ca tempest-SnapshotsActionsTest-2036303098 None] Delete snapshot completed successfully. Sep 29 18:28:57 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-c91221b9-049a-4205-b5ed-dbb78555a5ca tempest-SnapshotsActionsTest-2036303098 None] Lock "cinder-ccc53b4a-da0d-44bd-936e-cdb9bf6366b5-delete_snapshot" released by "delete_snapshot" :: held 1.894s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:28:57 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-4eb1da30-b23d-48da-88df-b6d049b19199 tempest-SnapshotsActionsTest-1013262860 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:28:57 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-4eb1da30-b23d-48da-88df-b6d049b19199 tempest-SnapshotsActionsTest-1013262860 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:28:57 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-4eb1da30-b23d-48da-88df-b6d049b19199 tempest-SnapshotsActionsTest-1013262860 None] Creating offline snapshot 63a5c125-bac9-4d02-943e-b1daa2df874e of volume 3d93adb1-1c36-4157-b126-84bc227ec0f3 {{(pid=86512) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 18:28:57 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c2c4407-0f59-4ec2-ba2e-d38fee4faa52]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:28:57 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-4eb1da30-b23d-48da-88df-b6d049b19199 tempest-SnapshotsActionsTest-1013262860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-3d93adb1-1c36-4157-b126-84bc227ec0f3.d1eb3c76-f7d0-4969-af6d-3e9f9b051821 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:28:58 devstack sudo[100921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-3d93adb1-1c36-4157-b126-84bc227ec0f3.d1eb3c76-f7d0-4969-af6d-3e9f9b051821 Sep 29 18:28:58 devstack sudo[100921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:28:58 devstack sudo[100921]: pam_unix(sudo:session): session closed for user root Sep 29 18:28:58 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-4eb1da30-b23d-48da-88df-b6d049b19199 tempest-SnapshotsActionsTest-1013262860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-3d93adb1-1c36-4157-b126-84bc227ec0f3.d1eb3c76-f7d0-4969-af6d-3e9f9b051821" returned: 0 in 0.428s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:28:58 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-4eb1da30-b23d-48da-88df-b6d049b19199 tempest-SnapshotsActionsTest-1013262860 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3d93adb1-1c36-4157-b126-84bc227ec0f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86512) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 18:28:58 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-4eb1da30-b23d-48da-88df-b6d049b19199 tempest-SnapshotsActionsTest-1013262860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-3d93adb1-1c36-4157-b126-84bc227ec0f3.d1eb3c76-f7d0-4969-af6d-3e9f9b051821,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-3d93adb1-1c36-4157-b126-84bc227ec0f3.63a5c125-bac9-4d02-943e-b1daa2df874e 1G {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:28:58 devstack sudo[100927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-3d93adb1-1c36-4157-b126-84bc227ec0f3.d1eb3c76-f7d0-4969-af6d-3e9f9b051821,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-3d93adb1-1c36-4157-b126-84bc227ec0f3.63a5c125-bac9-4d02-943e-b1daa2df874e 1G Sep 29 18:28:58 devstack sudo[100927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:28:58 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-5df6dcbc-1518-43f8-a3b8-8f9ab47d567a tempest-VolumesListTestJSON-281567656 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86512) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:28:58 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-5df6dcbc-1518-43f8-a3b8-8f9ab47d567a tempest-VolumesListTestJSON-281567656 None] Flow 'volume_create_manager' (f7ac1368-f6f3-41b6-8dd5-45611127203d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:28:58 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-5df6dcbc-1518-43f8-a3b8-8f9ab47d567a tempest-VolumesListTestJSON-281567656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3b67aa6-5fea-4526-939e-32910695836e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:28:58 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-5df6dcbc-1518-43f8-a3b8-8f9ab47d567a tempest-VolumesListTestJSON-281567656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3b67aa6-5fea-4526-939e-32910695836e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:28:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1139368309',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae1819c5-abe7-47ff-9392-292c77998bd0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f27674b37b484188bcd575e0ae588d8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:28:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:28:59Z,use_quota=True,user_id='c0a42809388c40ca89b6bc8f08d6b9b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:28:58 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-5df6dcbc-1518-43f8-a3b8-8f9ab47d567a tempest-VolumesListTestJSON-281567656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9376696-9274-4622-9fa8-242bae4565dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:28:58 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-5df6dcbc-1518-43f8-a3b8-8f9ab47d567a tempest-VolumesListTestJSON-281567656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9376696-9274-4622-9fa8-242bae4565dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:28:58 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-5df6dcbc-1518-43f8-a3b8-8f9ab47d567a tempest-VolumesListTestJSON-281567656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed141fa2-901b-43d5-83ea-0b107cdd44ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:28:58 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-5df6dcbc-1518-43f8-a3b8-8f9ab47d567a tempest-VolumesListTestJSON-281567656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed141fa2-901b-43d5-83ea-0b107cdd44ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae1819c5-abe7-47ff-9392-292c77998bd0', 'volume_name': 'volume-ae1819c5-abe7-47ff-9392-292c77998bd0', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:28:58 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-5df6dcbc-1518-43f8-a3b8-8f9ab47d567a tempest-VolumesListTestJSON-281567656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56e26b09-c274-42b5-9716-34c5eeedee7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:28:58 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-5df6dcbc-1518-43f8-a3b8-8f9ab47d567a tempest-VolumesListTestJSON-281567656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56e26b09-c274-42b5-9716-34c5eeedee7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:28:58 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-5df6dcbc-1518-43f8-a3b8-8f9ab47d567a tempest-VolumesListTestJSON-281567656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (306cb965-1bae-4c68-bf55-154184715a84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:28:58 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-5df6dcbc-1518-43f8-a3b8-8f9ab47d567a tempest-VolumesListTestJSON-281567656 None] Volume ae1819c5-abe7-47ff-9392-292c77998bd0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae1819c5-abe7-47ff-9392-292c77998bd0', 'volume_size': 1} Sep 29 18:28:58 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-5df6dcbc-1518-43f8-a3b8-8f9ab47d567a tempest-VolumesListTestJSON-281567656 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:28:58 devstack sudo[100927]: pam_unix(sudo:session): session closed for user root Sep 29 18:28:58 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-4eb1da30-b23d-48da-88df-b6d049b19199 tempest-SnapshotsActionsTest-1013262860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-3d93adb1-1c36-4157-b126-84bc227ec0f3.d1eb3c76-f7d0-4969-af6d-3e9f9b051821,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-3d93adb1-1c36-4157-b126-84bc227ec0f3.63a5c125-bac9-4d02-943e-b1daa2df874e 1G" returned: 0 in 0.516s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:28:58 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-4eb1da30-b23d-48da-88df-b6d049b19199 tempest-SnapshotsActionsTest-1013262860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d93adb1-1c36-4157-b126-84bc227ec0f3.d1eb3c76-f7d0-4969-af6d-3e9f9b051821 -F qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-3d93adb1-1c36-4157-b126-84bc227ec0f3.63a5c125-bac9-4d02-943e-b1daa2df874e {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:28:58 devstack sudo[100933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d93adb1-1c36-4157-b126-84bc227ec0f3.d1eb3c76-f7d0-4969-af6d-3e9f9b051821 -F qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-3d93adb1-1c36-4157-b126-84bc227ec0f3.63a5c125-bac9-4d02-943e-b1daa2df874e Sep 29 18:28:58 devstack sudo[100933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:28:59 devstack sudo[100933]: pam_unix(sudo:session): session closed for user root Sep 29 18:28:59 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-4eb1da30-b23d-48da-88df-b6d049b19199 tempest-SnapshotsActionsTest-1013262860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d93adb1-1c36-4157-b126-84bc227ec0f3.d1eb3c76-f7d0-4969-af6d-3e9f9b051821 -F qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-3d93adb1-1c36-4157-b126-84bc227ec0f3.63a5c125-bac9-4d02-943e-b1daa2df874e" returned: 0 in 0.324s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:28:59 devstack cinder-volume[86512]: WARNING cinder.volume.drivers.remotefs [None req-4eb1da30-b23d-48da-88df-b6d049b19199 tempest-SnapshotsActionsTest-1013262860 None] /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-3d93adb1-1c36-4157-b126-84bc227ec0f3.63a5c125-bac9-4d02-943e-b1daa2df874e is being set with open permissions: ugo+rw Sep 29 18:28:59 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-4eb1da30-b23d-48da-88df-b6d049b19199 tempest-SnapshotsActionsTest-1013262860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-3d93adb1-1c36-4157-b126-84bc227ec0f3.63a5c125-bac9-4d02-943e-b1daa2df874e {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:28:59 devstack sudo[100938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-3d93adb1-1c36-4157-b126-84bc227ec0f3.63a5c125-bac9-4d02-943e-b1daa2df874e Sep 29 18:28:59 devstack sudo[100938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:28:59 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc94ce40-5f1a-4b3a-904f-35a308548a83 tempest-VolumesSnapshotListTestJSON-196598729 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86512) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:28:59 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-dc94ce40-5f1a-4b3a-904f-35a308548a83 tempest-VolumesSnapshotListTestJSON-196598729 None] Flow 'volume_create_manager' (fa1dd5b3-4159-4d91-b3cf-b535f07e4e29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:28:59 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-dc94ce40-5f1a-4b3a-904f-35a308548a83 tempest-VolumesSnapshotListTestJSON-196598729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7734b402-2f73-47f1-96d3-05b97c2df13d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:28:59 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-dc94ce40-5f1a-4b3a-904f-35a308548a83 tempest-VolumesSnapshotListTestJSON-196598729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7734b402-2f73-47f1-96d3-05b97c2df13d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:28:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1564045949',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5ff8f71-e843-480d-b750-871233065ceb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='769cdec48f044e61aff9b93bdede5ace',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:28:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:28:59Z,use_quota=True,user_id='8e4162469bd64d629fb1470c83733339',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:28:59 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-dc94ce40-5f1a-4b3a-904f-35a308548a83 tempest-VolumesSnapshotListTestJSON-196598729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab9ba854-1067-433c-a6c7-47b648b1f01d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:28:59 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-dc94ce40-5f1a-4b3a-904f-35a308548a83 tempest-VolumesSnapshotListTestJSON-196598729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab9ba854-1067-433c-a6c7-47b648b1f01d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:28:59 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-dc94ce40-5f1a-4b3a-904f-35a308548a83 tempest-VolumesSnapshotListTestJSON-196598729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cfd4fc0-24fd-4fbc-89f3-12b75ab19c04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:28:59 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-dc94ce40-5f1a-4b3a-904f-35a308548a83 tempest-VolumesSnapshotListTestJSON-196598729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cfd4fc0-24fd-4fbc-89f3-12b75ab19c04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5ff8f71-e843-480d-b750-871233065ceb', 'volume_name': 'volume-c5ff8f71-e843-480d-b750-871233065ceb', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:28:59 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-dc94ce40-5f1a-4b3a-904f-35a308548a83 tempest-VolumesSnapshotListTestJSON-196598729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b22dcc1f-5440-4cd5-a91a-5d544aea9471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:28:59 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-dc94ce40-5f1a-4b3a-904f-35a308548a83 tempest-VolumesSnapshotListTestJSON-196598729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b22dcc1f-5440-4cd5-a91a-5d544aea9471) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:28:59 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-dc94ce40-5f1a-4b3a-904f-35a308548a83 tempest-VolumesSnapshotListTestJSON-196598729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed3b088d-f4a4-463a-953a-44818c0ce441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:28:59 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-dc94ce40-5f1a-4b3a-904f-35a308548a83 tempest-VolumesSnapshotListTestJSON-196598729 None] Volume c5ff8f71-e843-480d-b750-871233065ceb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5ff8f71-e843-480d-b750-871233065ceb', 'volume_size': 1} Sep 29 18:28:59 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-dc94ce40-5f1a-4b3a-904f-35a308548a83 tempest-VolumesSnapshotListTestJSON-196598729 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:28:59 devstack sudo[100938]: pam_unix(sudo:session): session closed for user root Sep 29 18:28:59 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-4eb1da30-b23d-48da-88df-b6d049b19199 tempest-SnapshotsActionsTest-1013262860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-3d93adb1-1c36-4157-b126-84bc227ec0f3.63a5c125-bac9-4d02-943e-b1daa2df874e" returned: 0 in 0.247s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:28:59 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-4eb1da30-b23d-48da-88df-b6d049b19199 tempest-SnapshotsActionsTest-1013262860 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.624s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:28:59 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-5df6dcbc-1518-43f8-a3b8-8f9ab47d567a tempest-VolumesListTestJSON-281567656 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.665s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:28:59 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-5df6dcbc-1518-43f8-a3b8-8f9ab47d567a tempest-VolumesListTestJSON-281567656 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:28:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1139368309',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae1819c5-abe7-47ff-9392-292c77998bd0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f27674b37b484188bcd575e0ae588d8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:28:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:28:59Z,use_quota=True,user_id='c0a42809388c40ca89b6bc8f08d6b9b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)}" {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:28:59 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-5df6dcbc-1518-43f8-a3b8-8f9ab47d567a tempest-VolumesListTestJSON-281567656 None] Creating volume ae1819c5-abe7-47ff-9392-292c77998bd0 {{(pid=86512) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:28:59 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-5df6dcbc-1518-43f8-a3b8-8f9ab47d567a tempest-VolumesListTestJSON-281567656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:28:59 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-5df6dcbc-1518-43f8-a3b8-8f9ab47d567a tempest-VolumesListTestJSON-281567656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:28:59 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-5df6dcbc-1518-43f8-a3b8-8f9ab47d567a tempest-VolumesListTestJSON-281567656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:28:59 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-5df6dcbc-1518-43f8-a3b8-8f9ab47d567a tempest-VolumesListTestJSON-281567656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:28:59 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-5df6dcbc-1518-43f8-a3b8-8f9ab47d567a tempest-VolumesListTestJSON-281567656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:28:59 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-5df6dcbc-1518-43f8-a3b8-8f9ab47d567a tempest-VolumesListTestJSON-281567656 None] Selected osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 as target Quobyte volume. {{(pid=86512) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:28:59 devstack cinder-volume[86512]: INFO cinder.volume.drivers.remotefs [None req-5df6dcbc-1518-43f8-a3b8-8f9ab47d567a tempest-VolumesListTestJSON-281567656 None] casted to osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 Sep 29 18:28:59 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-5df6dcbc-1518-43f8-a3b8-8f9ab47d567a tempest-VolumesListTestJSON-281567656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ae1819c5-abe7-47ff-9392-292c77998bd0 1073741824 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:28:59 devstack sudo[100941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ae1819c5-abe7-47ff-9392-292c77998bd0 1073741824 Sep 29 18:28:59 devstack sudo[100941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:28:59 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-4eb1da30-b23d-48da-88df-b6d049b19199 tempest-SnapshotsActionsTest-1013262860 None] Create snapshot completed successfully Sep 29 18:28:59 devstack sudo[100941]: pam_unix(sudo:session): session closed for user root Sep 29 18:28:59 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-5df6dcbc-1518-43f8-a3b8-8f9ab47d567a tempest-VolumesListTestJSON-281567656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ae1819c5-abe7-47ff-9392-292c77998bd0 1073741824" returned: 0 in 0.412s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:28:59 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-5df6dcbc-1518-43f8-a3b8-8f9ab47d567a tempest-VolumesListTestJSON-281567656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ae1819c5-abe7-47ff-9392-292c77998bd0 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:29:00 devstack sudo[100946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ae1819c5-abe7-47ff-9392-292c77998bd0 Sep 29 18:29:00 devstack sudo[100946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:29:00 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-bfbd9cf4-54ed-4a8e-88c1-213add78b25c tempest-SnapshotsActionsTest-2036303098 None] Acquiring lock "cinder-63a5c125-bac9-4d02-943e-b1daa2df874e-delete_snapshot" by "delete_snapshot" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:29:00 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-bfbd9cf4-54ed-4a8e-88c1-213add78b25c tempest-SnapshotsActionsTest-2036303098 None] Lock "cinder-63a5c125-bac9-4d02-943e-b1daa2df874e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:29:00 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-bfbd9cf4-54ed-4a8e-88c1-213add78b25c tempest-SnapshotsActionsTest-2036303098 None] Acquiring lock "cinder-quobyte-3d93adb1-1c36-4157-b126-84bc227ec0f3" by "delete_snapshot" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:29:00 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-bfbd9cf4-54ed-4a8e-88c1-213add78b25c tempest-SnapshotsActionsTest-2036303098 None] Lock "cinder-quobyte-3d93adb1-1c36-4157-b126-84bc227ec0f3" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:29:00 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-bfbd9cf4-54ed-4a8e-88c1-213add78b25c tempest-SnapshotsActionsTest-2036303098 None] Acquiring lock "cinder-quobyte-63a5c125-bac9-4d02-943e-b1daa2df874e" by "_delete_snapshot" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:29:00 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-bfbd9cf4-54ed-4a8e-88c1-213add78b25c tempest-SnapshotsActionsTest-2036303098 None] Lock "cinder-quobyte-63a5c125-bac9-4d02-943e-b1daa2df874e" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:29:00 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-bfbd9cf4-54ed-4a8e-88c1-213add78b25c tempest-SnapshotsActionsTest-2036303098 None] Deleting offline snapshot 63a5c125-bac9-4d02-943e-b1daa2df874e of volume 3d93adb1-1c36-4157-b126-84bc227ec0f3 {{(pid=86512) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 18:29:00 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-bfbd9cf4-54ed-4a8e-88c1-213add78b25c tempest-SnapshotsActionsTest-2036303098 None] snapshot_file for this snap is: volume-3d93adb1-1c36-4157-b126-84bc227ec0f3.63a5c125-bac9-4d02-943e-b1daa2df874e {{(pid=86512) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 18:29:00 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[efe96a74-c8dd-433b-b697-ed24e1239bbd]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:29:00 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-bfbd9cf4-54ed-4a8e-88c1-213add78b25c tempest-SnapshotsActionsTest-2036303098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-3d93adb1-1c36-4157-b126-84bc227ec0f3.63a5c125-bac9-4d02-943e-b1daa2df874e {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:29:00 devstack sudo[100946]: pam_unix(sudo:session): session closed for user root Sep 29 18:29:00 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-5df6dcbc-1518-43f8-a3b8-8f9ab47d567a tempest-VolumesListTestJSON-281567656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ae1819c5-abe7-47ff-9392-292c77998bd0" returned: 0 in 0.270s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:29:00 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-5df6dcbc-1518-43f8-a3b8-8f9ab47d567a tempest-VolumesListTestJSON-281567656 None] <== create_volume: return (722ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'} {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:29:00 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-5df6dcbc-1518-43f8-a3b8-8f9ab47d567a tempest-VolumesListTestJSON-281567656 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.726s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:29:00 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-dc94ce40-5f1a-4b3a-904f-35a308548a83 tempest-VolumesSnapshotListTestJSON-196598729 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.869s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:29:00 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-dc94ce40-5f1a-4b3a-904f-35a308548a83 tempest-VolumesSnapshotListTestJSON-196598729 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:28:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1564045949',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5ff8f71-e843-480d-b750-871233065ceb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='769cdec48f044e61aff9b93bdede5ace',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:28:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:28:59Z,use_quota=True,user_id='8e4162469bd64d629fb1470c83733339',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)}" {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:29:00 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-dc94ce40-5f1a-4b3a-904f-35a308548a83 tempest-VolumesSnapshotListTestJSON-196598729 None] Creating volume c5ff8f71-e843-480d-b750-871233065ceb {{(pid=86512) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:29:00 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-dc94ce40-5f1a-4b3a-904f-35a308548a83 tempest-VolumesSnapshotListTestJSON-196598729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:29:00 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-dc94ce40-5f1a-4b3a-904f-35a308548a83 tempest-VolumesSnapshotListTestJSON-196598729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:29:00 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-dc94ce40-5f1a-4b3a-904f-35a308548a83 tempest-VolumesSnapshotListTestJSON-196598729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:29:00 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-dc94ce40-5f1a-4b3a-904f-35a308548a83 tempest-VolumesSnapshotListTestJSON-196598729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:29:00 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-dc94ce40-5f1a-4b3a-904f-35a308548a83 tempest-VolumesSnapshotListTestJSON-196598729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:29:00 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-dc94ce40-5f1a-4b3a-904f-35a308548a83 tempest-VolumesSnapshotListTestJSON-196598729 None] Selected osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 as target Quobyte volume. {{(pid=86512) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:29:00 devstack cinder-volume[86512]: INFO cinder.volume.drivers.remotefs [None req-dc94ce40-5f1a-4b3a-904f-35a308548a83 tempest-VolumesSnapshotListTestJSON-196598729 None] casted to osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 Sep 29 18:29:00 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-dc94ce40-5f1a-4b3a-904f-35a308548a83 tempest-VolumesSnapshotListTestJSON-196598729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-c5ff8f71-e843-480d-b750-871233065ceb 1073741824 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:29:00 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-5df6dcbc-1518-43f8-a3b8-8f9ab47d567a tempest-VolumesListTestJSON-281567656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (306cb965-1bae-4c68-bf55-154184715a84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae1819c5-abe7-47ff-9392-292c77998bd0', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:29:00 devstack sudo[100950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-c5ff8f71-e843-480d-b750-871233065ceb 1073741824 Sep 29 18:29:00 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-5df6dcbc-1518-43f8-a3b8-8f9ab47d567a tempest-VolumesListTestJSON-281567656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bd7a811-299f-486a-ae9d-0fd4c8f91e91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:29:00 devstack sudo[100950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:29:00 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-5df6dcbc-1518-43f8-a3b8-8f9ab47d567a tempest-VolumesListTestJSON-281567656 None] Volume volume-ae1819c5-abe7-47ff-9392-292c77998bd0 (ae1819c5-abe7-47ff-9392-292c77998bd0): created successfully Sep 29 18:29:00 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-5df6dcbc-1518-43f8-a3b8-8f9ab47d567a tempest-VolumesListTestJSON-281567656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bd7a811-299f-486a-ae9d-0fd4c8f91e91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:29:00 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-5df6dcbc-1518-43f8-a3b8-8f9ab47d567a tempest-VolumesListTestJSON-281567656 None] Flow 'volume_create_manager' (f7ac1368-f6f3-41b6-8dd5-45611127203d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:29:00 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-5df6dcbc-1518-43f8-a3b8-8f9ab47d567a tempest-VolumesListTestJSON-281567656 None] Created volume successfully. Sep 29 18:29:00 devstack sudo[100949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-3d93adb1-1c36-4157-b126-84bc227ec0f3.63a5c125-bac9-4d02-943e-b1daa2df874e Sep 29 18:29:00 devstack sudo[100949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:29:00 devstack sudo[100949]: pam_unix(sudo:session): session closed for user root Sep 29 18:29:00 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-bfbd9cf4-54ed-4a8e-88c1-213add78b25c tempest-SnapshotsActionsTest-2036303098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-3d93adb1-1c36-4157-b126-84bc227ec0f3.63a5c125-bac9-4d02-943e-b1daa2df874e" returned: 0 in 0.405s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:29:00 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-bfbd9cf4-54ed-4a8e-88c1-213add78b25c tempest-SnapshotsActionsTest-2036303098 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3d93adb1-1c36-4157-b126-84bc227ec0f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86512) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 18:29:00 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[e032ccc2-5c07-415a-aaa5-b9542b1b2dcb]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:29:00 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-bfbd9cf4-54ed-4a8e-88c1-213add78b25c tempest-SnapshotsActionsTest-2036303098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-3d93adb1-1c36-4157-b126-84bc227ec0f3.d1eb3c76-f7d0-4969-af6d-3e9f9b051821 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:29:00 devstack sudo[100950]: pam_unix(sudo:session): session closed for user root Sep 29 18:29:00 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-dc94ce40-5f1a-4b3a-904f-35a308548a83 tempest-VolumesSnapshotListTestJSON-196598729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-c5ff8f71-e843-480d-b750-871233065ceb 1073741824" returned: 0 in 0.453s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:29:00 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-dc94ce40-5f1a-4b3a-904f-35a308548a83 tempest-VolumesSnapshotListTestJSON-196598729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-c5ff8f71-e843-480d-b750-871233065ceb {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:29:00 devstack sudo[100959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-3d93adb1-1c36-4157-b126-84bc227ec0f3.d1eb3c76-f7d0-4969-af6d-3e9f9b051821 Sep 29 18:29:00 devstack sudo[100959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:29:00 devstack sudo[100961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-c5ff8f71-e843-480d-b750-871233065ceb Sep 29 18:29:00 devstack sudo[100961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:29:01 devstack sudo[100961]: pam_unix(sudo:session): session closed for user root Sep 29 18:29:01 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-dc94ce40-5f1a-4b3a-904f-35a308548a83 tempest-VolumesSnapshotListTestJSON-196598729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-c5ff8f71-e843-480d-b750-871233065ceb" returned: 0 in 0.251s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:29:01 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-dc94ce40-5f1a-4b3a-904f-35a308548a83 tempest-VolumesSnapshotListTestJSON-196598729 None] <== create_volume: return (762ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'} {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:29:01 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-dc94ce40-5f1a-4b3a-904f-35a308548a83 tempest-VolumesSnapshotListTestJSON-196598729 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.764s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:29:01 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-dc94ce40-5f1a-4b3a-904f-35a308548a83 tempest-VolumesSnapshotListTestJSON-196598729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed3b088d-f4a4-463a-953a-44818c0ce441) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5ff8f71-e843-480d-b750-871233065ceb', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:29:01 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-dc94ce40-5f1a-4b3a-904f-35a308548a83 tempest-VolumesSnapshotListTestJSON-196598729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b120081-8628-4a60-b6e8-402058c6be57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:29:01 devstack sudo[100959]: pam_unix(sudo:session): session closed for user root Sep 29 18:29:01 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-bfbd9cf4-54ed-4a8e-88c1-213add78b25c tempest-SnapshotsActionsTest-2036303098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-3d93adb1-1c36-4157-b126-84bc227ec0f3.d1eb3c76-f7d0-4969-af6d-3e9f9b051821" returned: 0 in 0.386s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:29:01 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-bfbd9cf4-54ed-4a8e-88c1-213add78b25c tempest-SnapshotsActionsTest-2036303098 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3d93adb1-1c36-4157-b126-84bc227ec0f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86512) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 18:29:01 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-bfbd9cf4-54ed-4a8e-88c1-213add78b25c tempest-SnapshotsActionsTest-2036303098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-3d93adb1-1c36-4157-b126-84bc227ec0f3.63a5c125-bac9-4d02-943e-b1daa2df874e {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:29:01 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-dc94ce40-5f1a-4b3a-904f-35a308548a83 tempest-VolumesSnapshotListTestJSON-196598729 None] Volume volume-c5ff8f71-e843-480d-b750-871233065ceb (c5ff8f71-e843-480d-b750-871233065ceb): created successfully Sep 29 18:29:01 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-dc94ce40-5f1a-4b3a-904f-35a308548a83 tempest-VolumesSnapshotListTestJSON-196598729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b120081-8628-4a60-b6e8-402058c6be57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:29:01 devstack sudo[100968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-3d93adb1-1c36-4157-b126-84bc227ec0f3.63a5c125-bac9-4d02-943e-b1daa2df874e Sep 29 18:29:01 devstack sudo[100968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:29:01 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-dc94ce40-5f1a-4b3a-904f-35a308548a83 tempest-VolumesSnapshotListTestJSON-196598729 None] Flow 'volume_create_manager' (fa1dd5b3-4159-4d91-b3cf-b535f07e4e29) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:29:01 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-dc94ce40-5f1a-4b3a-904f-35a308548a83 tempest-VolumesSnapshotListTestJSON-196598729 None] Created volume successfully. Sep 29 18:29:01 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-d449c8cd-5998-4c80-bfd9-16ff739fe270 tempest-VolumesListTestJSON-281567656 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86512) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:29:01 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d449c8cd-5998-4c80-bfd9-16ff739fe270 tempest-VolumesListTestJSON-281567656 None] Flow 'volume_create_manager' (8eab1857-d054-4175-b3fe-4b4ff887d525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:29:01 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d449c8cd-5998-4c80-bfd9-16ff739fe270 tempest-VolumesListTestJSON-281567656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (082233b3-6d7b-43b9-b1f0-fbeb7067b197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:29:01 devstack sudo[100968]: pam_unix(sudo:session): session closed for user root Sep 29 18:29:01 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d449c8cd-5998-4c80-bfd9-16ff739fe270 tempest-VolumesListTestJSON-281567656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (082233b3-6d7b-43b9-b1f0-fbeb7067b197) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:29:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2013277179',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9c8be52-7088-4c3f-bbc2-ca8dea4e6e38,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f27674b37b484188bcd575e0ae588d8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:29:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:29:01Z,use_quota=True,user_id='c0a42809388c40ca89b6bc8f08d6b9b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:29:01 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d449c8cd-5998-4c80-bfd9-16ff739fe270 tempest-VolumesListTestJSON-281567656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ad9fb9e-d433-4df2-a6af-4b95af64eeda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:29:01 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d449c8cd-5998-4c80-bfd9-16ff739fe270 tempest-VolumesListTestJSON-281567656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ad9fb9e-d433-4df2-a6af-4b95af64eeda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:29:01 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d449c8cd-5998-4c80-bfd9-16ff739fe270 tempest-VolumesListTestJSON-281567656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c939f081-38a0-4425-a202-6cf2a46cd410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:29:01 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d449c8cd-5998-4c80-bfd9-16ff739fe270 tempest-VolumesListTestJSON-281567656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c939f081-38a0-4425-a202-6cf2a46cd410) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9c8be52-7088-4c3f-bbc2-ca8dea4e6e38', 'volume_name': 'volume-a9c8be52-7088-4c3f-bbc2-ca8dea4e6e38', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:29:01 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d449c8cd-5998-4c80-bfd9-16ff739fe270 tempest-VolumesListTestJSON-281567656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c610e6da-1690-4a87-8b15-b8b3bd697f6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:29:01 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d449c8cd-5998-4c80-bfd9-16ff739fe270 tempest-VolumesListTestJSON-281567656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c610e6da-1690-4a87-8b15-b8b3bd697f6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:29:01 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d449c8cd-5998-4c80-bfd9-16ff739fe270 tempest-VolumesListTestJSON-281567656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b849900-37ad-465e-9aac-316627f47746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:29:01 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-d449c8cd-5998-4c80-bfd9-16ff739fe270 tempest-VolumesListTestJSON-281567656 None] Volume a9c8be52-7088-4c3f-bbc2-ca8dea4e6e38: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9c8be52-7088-4c3f-bbc2-ca8dea4e6e38', 'volume_size': 1} Sep 29 18:29:01 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-d449c8cd-5998-4c80-bfd9-16ff739fe270 tempest-VolumesListTestJSON-281567656 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:29:01 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-d449c8cd-5998-4c80-bfd9-16ff739fe270 tempest-VolumesListTestJSON-281567656 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:29:01 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-d449c8cd-5998-4c80-bfd9-16ff739fe270 tempest-VolumesListTestJSON-281567656 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:29:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2013277179',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9c8be52-7088-4c3f-bbc2-ca8dea4e6e38,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f27674b37b484188bcd575e0ae588d8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:29:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:29:01Z,use_quota=True,user_id='c0a42809388c40ca89b6bc8f08d6b9b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)}" {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:29:01 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-d449c8cd-5998-4c80-bfd9-16ff739fe270 tempest-VolumesListTestJSON-281567656 None] Creating volume a9c8be52-7088-4c3f-bbc2-ca8dea4e6e38 {{(pid=86512) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:29:01 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-d449c8cd-5998-4c80-bfd9-16ff739fe270 tempest-VolumesListTestJSON-281567656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:29:01 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-d449c8cd-5998-4c80-bfd9-16ff739fe270 tempest-VolumesListTestJSON-281567656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:29:01 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-d449c8cd-5998-4c80-bfd9-16ff739fe270 tempest-VolumesListTestJSON-281567656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:29:01 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-d449c8cd-5998-4c80-bfd9-16ff739fe270 tempest-VolumesListTestJSON-281567656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:29:01 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-d449c8cd-5998-4c80-bfd9-16ff739fe270 tempest-VolumesListTestJSON-281567656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:29:01 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-d449c8cd-5998-4c80-bfd9-16ff739fe270 tempest-VolumesListTestJSON-281567656 None] Selected osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 as target Quobyte volume. {{(pid=86512) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:29:01 devstack cinder-volume[86512]: INFO cinder.volume.drivers.remotefs [None req-d449c8cd-5998-4c80-bfd9-16ff739fe270 tempest-VolumesListTestJSON-281567656 None] casted to osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 Sep 29 18:29:01 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-d449c8cd-5998-4c80-bfd9-16ff739fe270 tempest-VolumesListTestJSON-281567656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a9c8be52-7088-4c3f-bbc2-ca8dea4e6e38 1073741824 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:29:01 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-bfbd9cf4-54ed-4a8e-88c1-213add78b25c tempest-SnapshotsActionsTest-2036303098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-3d93adb1-1c36-4157-b126-84bc227ec0f3.63a5c125-bac9-4d02-943e-b1daa2df874e" returned: 0 in 0.498s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:29:01 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-bfbd9cf4-54ed-4a8e-88c1-213add78b25c tempest-SnapshotsActionsTest-2036303098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-3d93adb1-1c36-4157-b126-84bc227ec0f3.63a5c125-bac9-4d02-943e-b1daa2df874e {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:29:01 devstack sudo[100973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a9c8be52-7088-4c3f-bbc2-ca8dea4e6e38 1073741824 Sep 29 18:29:01 devstack sudo[100973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:29:01 devstack sudo[100974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-3d93adb1-1c36-4157-b126-84bc227ec0f3.63a5c125-bac9-4d02-943e-b1daa2df874e Sep 29 18:29:01 devstack sudo[100974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:29:01 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-5eda447f-7408-407e-a467-6687399df0af tempest-VolumesSnapshotListTestJSON-196598729 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:29:01 devstack sudo[100974]: pam_unix(sudo:session): session closed for user root Sep 29 18:29:01 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-bfbd9cf4-54ed-4a8e-88c1-213add78b25c tempest-SnapshotsActionsTest-2036303098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-3d93adb1-1c36-4157-b126-84bc227ec0f3.63a5c125-bac9-4d02-943e-b1daa2df874e" returned: 0 in 0.257s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:29:01 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-bfbd9cf4-54ed-4a8e-88c1-213add78b25c tempest-SnapshotsActionsTest-2036303098 None] Lock "cinder-quobyte-63a5c125-bac9-4d02-943e-b1daa2df874e" released by "_delete_snapshot" :: held 1.662s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:29:01 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-bfbd9cf4-54ed-4a8e-88c1-213add78b25c tempest-SnapshotsActionsTest-2036303098 None] Lock "cinder-quobyte-3d93adb1-1c36-4157-b126-84bc227ec0f3" released by "delete_snapshot" :: held 1.683s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:29:01 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-bfbd9cf4-54ed-4a8e-88c1-213add78b25c tempest-SnapshotsActionsTest-2036303098 None] Created reservations ['12a75d7e-e04e-4a03-83e6-1912ee76e94e', '58e5229f-ef8c-4270-b346-3e666ca4ed22', '6eeb6f45-dc7f-4afa-bd4e-477c55185065', '4e5575a8-ab57-4429-9418-55c2ef9359dd'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:29:01 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-bfbd9cf4-54ed-4a8e-88c1-213add78b25c tempest-SnapshotsActionsTest-2036303098 None] Delete snapshot completed successfully. Sep 29 18:29:01 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-bfbd9cf4-54ed-4a8e-88c1-213add78b25c tempest-SnapshotsActionsTest-2036303098 None] Lock "cinder-63a5c125-bac9-4d02-943e-b1daa2df874e-delete_snapshot" released by "delete_snapshot" :: held 1.828s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:29:02 devstack sudo[100973]: pam_unix(sudo:session): session closed for user root Sep 29 18:29:02 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-d449c8cd-5998-4c80-bfd9-16ff739fe270 tempest-VolumesListTestJSON-281567656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a9c8be52-7088-4c3f-bbc2-ca8dea4e6e38 1073741824" returned: 0 in 0.470s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:29:02 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-d449c8cd-5998-4c80-bfd9-16ff739fe270 tempest-VolumesListTestJSON-281567656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a9c8be52-7088-4c3f-bbc2-ca8dea4e6e38 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:29:02 devstack sudo[100982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a9c8be52-7088-4c3f-bbc2-ca8dea4e6e38 Sep 29 18:29:02 devstack sudo[100982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:29:02 devstack sudo[100982]: pam_unix(sudo:session): session closed for user root Sep 29 18:29:02 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-d449c8cd-5998-4c80-bfd9-16ff739fe270 tempest-VolumesListTestJSON-281567656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a9c8be52-7088-4c3f-bbc2-ca8dea4e6e38" returned: 0 in 0.242s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:29:02 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-d449c8cd-5998-4c80-bfd9-16ff739fe270 tempest-VolumesListTestJSON-281567656 None] <== create_volume: return (752ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'} {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:29:02 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-d449c8cd-5998-4c80-bfd9-16ff739fe270 tempest-VolumesListTestJSON-281567656 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.755s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:29:02 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-5eda447f-7408-407e-a467-6687399df0af tempest-VolumesSnapshotListTestJSON-196598729 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.652s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:29:02 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d449c8cd-5998-4c80-bfd9-16ff739fe270 tempest-VolumesListTestJSON-281567656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b849900-37ad-465e-9aac-316627f47746) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9c8be52-7088-4c3f-bbc2-ca8dea4e6e38', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:29:02 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d449c8cd-5998-4c80-bfd9-16ff739fe270 tempest-VolumesListTestJSON-281567656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b37f24dc-310b-4c0f-b587-8266d969b644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:29:02 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-5eda447f-7408-407e-a467-6687399df0af tempest-VolumesSnapshotListTestJSON-196598729 None] Creating offline snapshot 6a91a30c-da00-4890-9a2b-afb6d118f2e6 of volume c5ff8f71-e843-480d-b750-871233065ceb {{(pid=86512) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 18:29:02 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-d449c8cd-5998-4c80-bfd9-16ff739fe270 tempest-VolumesListTestJSON-281567656 None] Volume volume-a9c8be52-7088-4c3f-bbc2-ca8dea4e6e38 (a9c8be52-7088-4c3f-bbc2-ca8dea4e6e38): created successfully Sep 29 18:29:02 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d449c8cd-5998-4c80-bfd9-16ff739fe270 tempest-VolumesListTestJSON-281567656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b37f24dc-310b-4c0f-b587-8266d969b644) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:29:02 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d449c8cd-5998-4c80-bfd9-16ff739fe270 tempest-VolumesListTestJSON-281567656 None] Flow 'volume_create_manager' (8eab1857-d054-4175-b3fe-4b4ff887d525) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:29:02 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e02f7c6-4ace-42ee-8dc6-ba5515e6297f]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:29:02 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-5eda447f-7408-407e-a467-6687399df0af tempest-VolumesSnapshotListTestJSON-196598729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-c5ff8f71-e843-480d-b750-871233065ceb {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:29:02 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-d449c8cd-5998-4c80-bfd9-16ff739fe270 tempest-VolumesListTestJSON-281567656 None] Created volume successfully. Sep 29 18:29:02 devstack sudo[100985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-c5ff8f71-e843-480d-b750-871233065ceb Sep 29 18:29:02 devstack sudo[100985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:29:02 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-a1389fe4-3c04-4fe7-943a-f7d456bdab81 tempest-SnapshotsActionsTest-1013262860 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:29:02 devstack sudo[100985]: pam_unix(sudo:session): session closed for user root Sep 29 18:29:02 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-5eda447f-7408-407e-a467-6687399df0af tempest-VolumesSnapshotListTestJSON-196598729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-c5ff8f71-e843-480d-b750-871233065ceb" returned: 0 in 0.370s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:29:02 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-5eda447f-7408-407e-a467-6687399df0af tempest-VolumesSnapshotListTestJSON-196598729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-c5ff8f71-e843-480d-b750-871233065ceb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-c5ff8f71-e843-480d-b750-871233065ceb.6a91a30c-da00-4890-9a2b-afb6d118f2e6 1G {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:29:02 devstack sudo[100990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-c5ff8f71-e843-480d-b750-871233065ceb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-c5ff8f71-e843-480d-b750-871233065ceb.6a91a30c-da00-4890-9a2b-afb6d118f2e6 1G Sep 29 18:29:02 devstack sudo[100990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:29:03 devstack sudo[100990]: pam_unix(sudo:session): session closed for user root Sep 29 18:29:03 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-5eda447f-7408-407e-a467-6687399df0af tempest-VolumesSnapshotListTestJSON-196598729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-c5ff8f71-e843-480d-b750-871233065ceb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-c5ff8f71-e843-480d-b750-871233065ceb.6a91a30c-da00-4890-9a2b-afb6d118f2e6 1G" returned: 0 in 0.391s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:29:03 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-5eda447f-7408-407e-a467-6687399df0af tempest-VolumesSnapshotListTestJSON-196598729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5ff8f71-e843-480d-b750-871233065ceb -F qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-c5ff8f71-e843-480d-b750-871233065ceb.6a91a30c-da00-4890-9a2b-afb6d118f2e6 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:29:03 devstack sudo[100995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5ff8f71-e843-480d-b750-871233065ceb -F qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-c5ff8f71-e843-480d-b750-871233065ceb.6a91a30c-da00-4890-9a2b-afb6d118f2e6 Sep 29 18:29:03 devstack sudo[100995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:29:03 devstack sudo[100995]: pam_unix(sudo:session): session closed for user root Sep 29 18:29:03 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-5eda447f-7408-407e-a467-6687399df0af tempest-VolumesSnapshotListTestJSON-196598729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5ff8f71-e843-480d-b750-871233065ceb -F qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-c5ff8f71-e843-480d-b750-871233065ceb.6a91a30c-da00-4890-9a2b-afb6d118f2e6" returned: 0 in 0.358s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:29:03 devstack cinder-volume[86512]: WARNING cinder.volume.drivers.remotefs [None req-5eda447f-7408-407e-a467-6687399df0af tempest-VolumesSnapshotListTestJSON-196598729 None] /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-c5ff8f71-e843-480d-b750-871233065ceb.6a91a30c-da00-4890-9a2b-afb6d118f2e6 is being set with open permissions: ugo+rw Sep 29 18:29:03 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-5eda447f-7408-407e-a467-6687399df0af tempest-VolumesSnapshotListTestJSON-196598729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-c5ff8f71-e843-480d-b750-871233065ceb.6a91a30c-da00-4890-9a2b-afb6d118f2e6 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:29:03 devstack sudo[101000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-c5ff8f71-e843-480d-b750-871233065ceb.6a91a30c-da00-4890-9a2b-afb6d118f2e6 Sep 29 18:29:03 devstack sudo[101000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:29:03 devstack sudo[101000]: pam_unix(sudo:session): session closed for user root Sep 29 18:29:03 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-5eda447f-7408-407e-a467-6687399df0af tempest-VolumesSnapshotListTestJSON-196598729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-c5ff8f71-e843-480d-b750-871233065ceb.6a91a30c-da00-4890-9a2b-afb6d118f2e6" returned: 0 in 0.270s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:29:03 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-5eda447f-7408-407e-a467-6687399df0af tempest-VolumesSnapshotListTestJSON-196598729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-c5ff8f71-e843-480d-b750-871233065ceb.info {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:29:03 devstack sudo[101004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-c5ff8f71-e843-480d-b750-871233065ceb.info Sep 29 18:29:03 devstack sudo[101004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:29:04 devstack sudo[101004]: pam_unix(sudo:session): session closed for user root Sep 29 18:29:04 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-5eda447f-7408-407e-a467-6687399df0af tempest-VolumesSnapshotListTestJSON-196598729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-c5ff8f71-e843-480d-b750-871233065ceb.info" returned: 0 in 0.254s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:29:04 devstack cinder-volume[86512]: WARNING cinder.volume.drivers.remotefs [None req-5eda447f-7408-407e-a467-6687399df0af tempest-VolumesSnapshotListTestJSON-196598729 None] /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-c5ff8f71-e843-480d-b750-871233065ceb.info is being set with open permissions: ugo+rw Sep 29 18:29:04 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-5eda447f-7408-407e-a467-6687399df0af tempest-VolumesSnapshotListTestJSON-196598729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-c5ff8f71-e843-480d-b750-871233065ceb.info {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:29:04 devstack sudo[101007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-c5ff8f71-e843-480d-b750-871233065ceb.info Sep 29 18:29:04 devstack sudo[101007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:29:04 devstack sudo[101007]: pam_unix(sudo:session): session closed for user root Sep 29 18:29:04 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-5eda447f-7408-407e-a467-6687399df0af tempest-VolumesSnapshotListTestJSON-196598729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-c5ff8f71-e843-480d-b750-871233065ceb.info" returned: 0 in 0.269s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:29:04 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-5eda447f-7408-407e-a467-6687399df0af tempest-VolumesSnapshotListTestJSON-196598729 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.052s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:29:04 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-a1389fe4-3c04-4fe7-943a-f7d456bdab81 tempest-SnapshotsActionsTest-1013262860 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.738s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:29:04 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-a1389fe4-3c04-4fe7-943a-f7d456bdab81 tempest-SnapshotsActionsTest-1013262860 None] Creating offline snapshot 451b5fdc-1321-4588-94b3-2ad5b3bae4f9 of volume 3d93adb1-1c36-4157-b126-84bc227ec0f3 {{(pid=86512) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 18:29:04 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-5eda447f-7408-407e-a467-6687399df0af tempest-VolumesSnapshotListTestJSON-196598729 None] Create snapshot completed successfully Sep 29 18:29:04 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd114d1f-bc62-4ba7-9387-6050de3d4074]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:29:04 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a1389fe4-3c04-4fe7-943a-f7d456bdab81 tempest-SnapshotsActionsTest-1013262860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-3d93adb1-1c36-4157-b126-84bc227ec0f3.d1eb3c76-f7d0-4969-af6d-3e9f9b051821 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:29:04 devstack sudo[101010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-3d93adb1-1c36-4157-b126-84bc227ec0f3.d1eb3c76-f7d0-4969-af6d-3e9f9b051821 Sep 29 18:29:04 devstack sudo[101010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:29:04 devstack sudo[101010]: pam_unix(sudo:session): session closed for user root Sep 29 18:29:04 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a1389fe4-3c04-4fe7-943a-f7d456bdab81 tempest-SnapshotsActionsTest-1013262860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-3d93adb1-1c36-4157-b126-84bc227ec0f3.d1eb3c76-f7d0-4969-af6d-3e9f9b051821" returned: 0 in 0.431s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:29:04 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-a1389fe4-3c04-4fe7-943a-f7d456bdab81 tempest-SnapshotsActionsTest-1013262860 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3d93adb1-1c36-4157-b126-84bc227ec0f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86512) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 18:29:04 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a1389fe4-3c04-4fe7-943a-f7d456bdab81 tempest-SnapshotsActionsTest-1013262860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-3d93adb1-1c36-4157-b126-84bc227ec0f3.d1eb3c76-f7d0-4969-af6d-3e9f9b051821,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-3d93adb1-1c36-4157-b126-84bc227ec0f3.451b5fdc-1321-4588-94b3-2ad5b3bae4f9 1G {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:29:04 devstack sudo[101016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-3d93adb1-1c36-4157-b126-84bc227ec0f3.d1eb3c76-f7d0-4969-af6d-3e9f9b051821,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-3d93adb1-1c36-4157-b126-84bc227ec0f3.451b5fdc-1321-4588-94b3-2ad5b3bae4f9 1G Sep 29 18:29:04 devstack sudo[101016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:29:04 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-102da4d9-9602-4851-b908-811cef8d3677 tempest-VolumesSnapshotListTestJSON-196598729 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:29:05 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a1389fe4-3c04-4fe7-943a-f7d456bdab81 tempest-SnapshotsActionsTest-1013262860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-3d93adb1-1c36-4157-b126-84bc227ec0f3.d1eb3c76-f7d0-4969-af6d-3e9f9b051821,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-3d93adb1-1c36-4157-b126-84bc227ec0f3.451b5fdc-1321-4588-94b3-2ad5b3bae4f9 1G" returned: 0 in 0.515s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:29:05 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a1389fe4-3c04-4fe7-943a-f7d456bdab81 tempest-SnapshotsActionsTest-1013262860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d93adb1-1c36-4157-b126-84bc227ec0f3.d1eb3c76-f7d0-4969-af6d-3e9f9b051821 -F qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-3d93adb1-1c36-4157-b126-84bc227ec0f3.451b5fdc-1321-4588-94b3-2ad5b3bae4f9 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:29:05 devstack sudo[101016]: pam_unix(sudo:session): session closed for user root Sep 29 18:29:05 devstack sudo[101022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d93adb1-1c36-4157-b126-84bc227ec0f3.d1eb3c76-f7d0-4969-af6d-3e9f9b051821 -F qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-3d93adb1-1c36-4157-b126-84bc227ec0f3.451b5fdc-1321-4588-94b3-2ad5b3bae4f9 Sep 29 18:29:05 devstack sudo[101022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:29:05 devstack sudo[101022]: pam_unix(sudo:session): session closed for user root Sep 29 18:29:05 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a1389fe4-3c04-4fe7-943a-f7d456bdab81 tempest-SnapshotsActionsTest-1013262860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d93adb1-1c36-4157-b126-84bc227ec0f3.d1eb3c76-f7d0-4969-af6d-3e9f9b051821 -F qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-3d93adb1-1c36-4157-b126-84bc227ec0f3.451b5fdc-1321-4588-94b3-2ad5b3bae4f9" returned: 0 in 0.348s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:29:05 devstack cinder-volume[86512]: WARNING cinder.volume.drivers.remotefs [None req-a1389fe4-3c04-4fe7-943a-f7d456bdab81 tempest-SnapshotsActionsTest-1013262860 None] /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-3d93adb1-1c36-4157-b126-84bc227ec0f3.451b5fdc-1321-4588-94b3-2ad5b3bae4f9 is being set with open permissions: ugo+rw Sep 29 18:29:05 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a1389fe4-3c04-4fe7-943a-f7d456bdab81 tempest-SnapshotsActionsTest-1013262860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-3d93adb1-1c36-4157-b126-84bc227ec0f3.451b5fdc-1321-4588-94b3-2ad5b3bae4f9 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:29:05 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-01cdfcae-1100-47e5-8bb7-346f01380bdf tempest-VolumesListTestJSON-281567656 None] Acquiring lock "cinder-a9c8be52-7088-4c3f-bbc2-ca8dea4e6e38-delete_volume" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:29:05 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-01cdfcae-1100-47e5-8bb7-346f01380bdf tempest-VolumesListTestJSON-281567656 None] Lock "cinder-a9c8be52-7088-4c3f-bbc2-ca8dea4e6e38-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:29:05 devstack sudo[101028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-3d93adb1-1c36-4157-b126-84bc227ec0f3.451b5fdc-1321-4588-94b3-2ad5b3bae4f9 Sep 29 18:29:05 devstack sudo[101028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:29:05 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-01cdfcae-1100-47e5-8bb7-346f01380bdf tempest-VolumesListTestJSON-281567656 None] Acquiring lock "cinder-quobyte-a9c8be52-7088-4c3f-bbc2-ca8dea4e6e38" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:29:05 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-01cdfcae-1100-47e5-8bb7-346f01380bdf tempest-VolumesListTestJSON-281567656 None] Lock "cinder-quobyte-a9c8be52-7088-4c3f-bbc2-ca8dea4e6e38" acquired by "delete_volume" :: waited 0.015s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:29:05 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[c292909a-3a9b-4f1b-8e8b-853d07cdfe89]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:29:05 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-01cdfcae-1100-47e5-8bb7-346f01380bdf tempest-VolumesListTestJSON-281567656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a9c8be52-7088-4c3f-bbc2-ca8dea4e6e38 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:29:05 devstack sudo[101030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a9c8be52-7088-4c3f-bbc2-ca8dea4e6e38 Sep 29 18:29:05 devstack sudo[101030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:29:06 devstack sudo[101028]: pam_unix(sudo:session): session closed for user root Sep 29 18:29:06 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a1389fe4-3c04-4fe7-943a-f7d456bdab81 tempest-SnapshotsActionsTest-1013262860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-3d93adb1-1c36-4157-b126-84bc227ec0f3.451b5fdc-1321-4588-94b3-2ad5b3bae4f9" returned: 0 in 0.297s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:29:06 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-a1389fe4-3c04-4fe7-943a-f7d456bdab81 tempest-SnapshotsActionsTest-1013262860 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.718s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:29:06 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-102da4d9-9602-4851-b908-811cef8d3677 tempest-VolumesSnapshotListTestJSON-196598729 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.089s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:29:06 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-102da4d9-9602-4851-b908-811cef8d3677 tempest-VolumesSnapshotListTestJSON-196598729 None] Creating offline snapshot 1d9bb5f8-749a-457f-a354-e2f04243fb4b of volume c5ff8f71-e843-480d-b750-871233065ceb {{(pid=86512) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 18:29:06 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-a1389fe4-3c04-4fe7-943a-f7d456bdab81 tempest-SnapshotsActionsTest-1013262860 None] Create snapshot completed successfully Sep 29 18:29:06 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[798959ee-8415-484e-a498-3e03a34e5ad9]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:29:06 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-102da4d9-9602-4851-b908-811cef8d3677 tempest-VolumesSnapshotListTestJSON-196598729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-c5ff8f71-e843-480d-b750-871233065ceb.6a91a30c-da00-4890-9a2b-afb6d118f2e6 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:29:06 devstack sudo[101030]: pam_unix(sudo:session): session closed for user root Sep 29 18:29:06 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-01cdfcae-1100-47e5-8bb7-346f01380bdf tempest-VolumesListTestJSON-281567656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a9c8be52-7088-4c3f-bbc2-ca8dea4e6e38" returned: 0 in 0.387s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:29:06 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-01cdfcae-1100-47e5-8bb7-346f01380bdf tempest-VolumesListTestJSON-281567656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a9c8be52-7088-4c3f-bbc2-ca8dea4e6e38 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:29:06 devstack sudo[101033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-c5ff8f71-e843-480d-b750-871233065ceb.6a91a30c-da00-4890-9a2b-afb6d118f2e6 Sep 29 18:29:06 devstack sudo[101033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:29:06 devstack sudo[101037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a9c8be52-7088-4c3f-bbc2-ca8dea4e6e38 Sep 29 18:29:06 devstack sudo[101037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:29:06 devstack sudo[101033]: pam_unix(sudo:session): session closed for user root Sep 29 18:29:06 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-102da4d9-9602-4851-b908-811cef8d3677 tempest-VolumesSnapshotListTestJSON-196598729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-c5ff8f71-e843-480d-b750-871233065ceb.6a91a30c-da00-4890-9a2b-afb6d118f2e6" returned: 0 in 0.373s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:29:06 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-102da4d9-9602-4851-b908-811cef8d3677 tempest-VolumesSnapshotListTestJSON-196598729 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c5ff8f71-e843-480d-b750-871233065ceb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86512) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 18:29:06 devstack sudo[101037]: pam_unix(sudo:session): session closed for user root Sep 29 18:29:06 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-102da4d9-9602-4851-b908-811cef8d3677 tempest-VolumesSnapshotListTestJSON-196598729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-c5ff8f71-e843-480d-b750-871233065ceb.6a91a30c-da00-4890-9a2b-afb6d118f2e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-c5ff8f71-e843-480d-b750-871233065ceb.1d9bb5f8-749a-457f-a354-e2f04243fb4b 1G {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:29:06 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-01cdfcae-1100-47e5-8bb7-346f01380bdf tempest-VolumesListTestJSON-281567656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a9c8be52-7088-4c3f-bbc2-ca8dea4e6e38" returned: 0 in 0.283s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:29:06 devstack sudo[101044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-c5ff8f71-e843-480d-b750-871233065ceb.6a91a30c-da00-4890-9a2b-afb6d118f2e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-c5ff8f71-e843-480d-b750-871233065ceb.1d9bb5f8-749a-457f-a354-e2f04243fb4b 1G Sep 29 18:29:06 devstack sudo[101044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:29:06 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-01cdfcae-1100-47e5-8bb7-346f01380bdf tempest-VolumesListTestJSON-281567656 None] Lock "cinder-quobyte-a9c8be52-7088-4c3f-bbc2-ca8dea4e6e38" released by "delete_volume" :: held 0.724s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:29:06 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-01cdfcae-1100-47e5-8bb7-346f01380bdf tempest-VolumesListTestJSON-281567656 None] Created reservations ['742c9cb2-c8cb-4d39-9bfb-ae7611c46d11', '46b5a53f-ef06-4e30-80f0-2d826caeb732', 'a8021e22-e347-4af2-bfdd-b2fae8e6c33c', 'fe784f03-b569-4d17-836d-3cb6fb005ba5'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:29:06 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-01cdfcae-1100-47e5-8bb7-346f01380bdf tempest-VolumesListTestJSON-281567656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:29:06 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-01cdfcae-1100-47e5-8bb7-346f01380bdf tempest-VolumesListTestJSON-281567656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:29:06 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-01cdfcae-1100-47e5-8bb7-346f01380bdf tempest-VolumesListTestJSON-281567656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:29:06 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-01cdfcae-1100-47e5-8bb7-346f01380bdf tempest-VolumesListTestJSON-281567656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:29:06 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-01cdfcae-1100-47e5-8bb7-346f01380bdf tempest-VolumesListTestJSON-281567656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:29:06 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-01cdfcae-1100-47e5-8bb7-346f01380bdf tempest-VolumesListTestJSON-281567656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:29:06 devstack sudo[101046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:29:06 devstack sudo[101046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:29:06 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-78e1a244-654b-4a2e-89b1-9e4149dde5ea tempest-SnapshotsActionsTest-2036303098 None] Acquiring lock "cinder-451b5fdc-1321-4588-94b3-2ad5b3bae4f9-delete_snapshot" by "delete_snapshot" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:29:06 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-78e1a244-654b-4a2e-89b1-9e4149dde5ea tempest-SnapshotsActionsTest-2036303098 None] Lock "cinder-451b5fdc-1321-4588-94b3-2ad5b3bae4f9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:29:06 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-78e1a244-654b-4a2e-89b1-9e4149dde5ea tempest-SnapshotsActionsTest-2036303098 None] Acquiring lock "cinder-quobyte-3d93adb1-1c36-4157-b126-84bc227ec0f3" by "delete_snapshot" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:29:06 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-78e1a244-654b-4a2e-89b1-9e4149dde5ea tempest-SnapshotsActionsTest-2036303098 None] Lock "cinder-quobyte-3d93adb1-1c36-4157-b126-84bc227ec0f3" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:29:06 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-78e1a244-654b-4a2e-89b1-9e4149dde5ea tempest-SnapshotsActionsTest-2036303098 None] Acquiring lock "cinder-quobyte-451b5fdc-1321-4588-94b3-2ad5b3bae4f9" by "_delete_snapshot" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:29:06 devstack sudo[101046]: pam_unix(sudo:session): session closed for user root Sep 29 18:29:06 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-78e1a244-654b-4a2e-89b1-9e4149dde5ea tempest-SnapshotsActionsTest-2036303098 None] Lock "cinder-quobyte-451b5fdc-1321-4588-94b3-2ad5b3bae4f9" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:29:06 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-78e1a244-654b-4a2e-89b1-9e4149dde5ea tempest-SnapshotsActionsTest-2036303098 None] Deleting offline snapshot 451b5fdc-1321-4588-94b3-2ad5b3bae4f9 of volume 3d93adb1-1c36-4157-b126-84bc227ec0f3 {{(pid=86512) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 18:29:07 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-78e1a244-654b-4a2e-89b1-9e4149dde5ea tempest-SnapshotsActionsTest-2036303098 None] snapshot_file for this snap is: volume-3d93adb1-1c36-4157-b126-84bc227ec0f3.451b5fdc-1321-4588-94b3-2ad5b3bae4f9 {{(pid=86512) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 18:29:07 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-01cdfcae-1100-47e5-8bb7-346f01380bdf tempest-VolumesListTestJSON-281567656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.342s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:29:07 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-01cdfcae-1100-47e5-8bb7-346f01380bdf tempest-VolumesListTestJSON-281567656 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:29:07 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-8f3f7525-312c-4439-8999-021ed8076fe5 tempest-VolumesListTestJSON-281567656 None] Acquiring lock "cinder-ae1819c5-abe7-47ff-9392-292c77998bd0-delete_volume" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:29:07 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-01cdfcae-1100-47e5-8bb7-346f01380bdf tempest-VolumesListTestJSON-281567656 None] Deleted volume successfully. Sep 29 18:29:07 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[905de4c4-7699-47d8-9cc8-98520a573637]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:29:07 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-78e1a244-654b-4a2e-89b1-9e4149dde5ea tempest-SnapshotsActionsTest-2036303098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-3d93adb1-1c36-4157-b126-84bc227ec0f3.451b5fdc-1321-4588-94b3-2ad5b3bae4f9 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:29:07 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-01cdfcae-1100-47e5-8bb7-346f01380bdf tempest-VolumesListTestJSON-281567656 None] Lock "cinder-a9c8be52-7088-4c3f-bbc2-ca8dea4e6e38-delete_volume" released by "delete_volume" :: held 1.301s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:29:07 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-8f3f7525-312c-4439-8999-021ed8076fe5 tempest-VolumesListTestJSON-281567656 None] Lock "cinder-ae1819c5-abe7-47ff-9392-292c77998bd0-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:29:07 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-8f3f7525-312c-4439-8999-021ed8076fe5 tempest-VolumesListTestJSON-281567656 None] Acquiring lock "cinder-quobyte-ae1819c5-abe7-47ff-9392-292c77998bd0" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:29:07 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-8f3f7525-312c-4439-8999-021ed8076fe5 tempest-VolumesListTestJSON-281567656 None] Lock "cinder-quobyte-ae1819c5-abe7-47ff-9392-292c77998bd0" acquired by "delete_volume" :: waited 0.014s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:29:07 devstack sudo[101044]: pam_unix(sudo:session): session closed for user root Sep 29 18:29:07 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-102da4d9-9602-4851-b908-811cef8d3677 tempest-VolumesSnapshotListTestJSON-196598729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-c5ff8f71-e843-480d-b750-871233065ceb.6a91a30c-da00-4890-9a2b-afb6d118f2e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-c5ff8f71-e843-480d-b750-871233065ceb.1d9bb5f8-749a-457f-a354-e2f04243fb4b 1G" returned: 0 in 0.624s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:29:07 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-102da4d9-9602-4851-b908-811cef8d3677 tempest-VolumesSnapshotListTestJSON-196598729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5ff8f71-e843-480d-b750-871233065ceb.6a91a30c-da00-4890-9a2b-afb6d118f2e6 -F qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-c5ff8f71-e843-480d-b750-871233065ceb.1d9bb5f8-749a-457f-a354-e2f04243fb4b {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:29:07 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cd3c8a8-2045-4dfe-9e5e-905443dc1ea2]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:29:07 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-8f3f7525-312c-4439-8999-021ed8076fe5 tempest-VolumesListTestJSON-281567656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ae1819c5-abe7-47ff-9392-292c77998bd0 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:29:07 devstack sudo[101054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5ff8f71-e843-480d-b750-871233065ceb.6a91a30c-da00-4890-9a2b-afb6d118f2e6 -F qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-c5ff8f71-e843-480d-b750-871233065ceb.1d9bb5f8-749a-457f-a354-e2f04243fb4b Sep 29 18:29:07 devstack sudo[101054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:29:07 devstack sudo[101053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-3d93adb1-1c36-4157-b126-84bc227ec0f3.451b5fdc-1321-4588-94b3-2ad5b3bae4f9 Sep 29 18:29:07 devstack sudo[101053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:29:07 devstack sudo[101055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ae1819c5-abe7-47ff-9392-292c77998bd0 Sep 29 18:29:07 devstack sudo[101055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:29:07 devstack sudo[101053]: pam_unix(sudo:session): session closed for user root Sep 29 18:29:07 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-78e1a244-654b-4a2e-89b1-9e4149dde5ea tempest-SnapshotsActionsTest-2036303098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-3d93adb1-1c36-4157-b126-84bc227ec0f3.451b5fdc-1321-4588-94b3-2ad5b3bae4f9" returned: 0 in 0.390s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:29:07 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-78e1a244-654b-4a2e-89b1-9e4149dde5ea tempest-SnapshotsActionsTest-2036303098 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3d93adb1-1c36-4157-b126-84bc227ec0f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86512) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 18:29:07 devstack sudo[101054]: pam_unix(sudo:session): session closed for user root Sep 29 18:29:07 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-102da4d9-9602-4851-b908-811cef8d3677 tempest-VolumesSnapshotListTestJSON-196598729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5ff8f71-e843-480d-b750-871233065ceb.6a91a30c-da00-4890-9a2b-afb6d118f2e6 -F qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-c5ff8f71-e843-480d-b750-871233065ceb.1d9bb5f8-749a-457f-a354-e2f04243fb4b" returned: 0 in 0.312s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:29:07 devstack cinder-volume[86512]: WARNING cinder.volume.drivers.remotefs [None req-102da4d9-9602-4851-b908-811cef8d3677 tempest-VolumesSnapshotListTestJSON-196598729 None] /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-c5ff8f71-e843-480d-b750-871233065ceb.1d9bb5f8-749a-457f-a354-e2f04243fb4b is being set with open permissions: ugo+rw Sep 29 18:29:07 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-102da4d9-9602-4851-b908-811cef8d3677 tempest-VolumesSnapshotListTestJSON-196598729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-c5ff8f71-e843-480d-b750-871233065ceb.1d9bb5f8-749a-457f-a354-e2f04243fb4b {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:29:07 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d94b4f9-adf5-4e63-a6f9-5a28c830b19d]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:29:07 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-78e1a244-654b-4a2e-89b1-9e4149dde5ea tempest-SnapshotsActionsTest-2036303098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-3d93adb1-1c36-4157-b126-84bc227ec0f3.d1eb3c76-f7d0-4969-af6d-3e9f9b051821 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:29:07 devstack sudo[101065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-c5ff8f71-e843-480d-b750-871233065ceb.1d9bb5f8-749a-457f-a354-e2f04243fb4b Sep 29 18:29:07 devstack sudo[101065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:29:07 devstack sudo[101055]: pam_unix(sudo:session): session closed for user root Sep 29 18:29:07 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-8f3f7525-312c-4439-8999-021ed8076fe5 tempest-VolumesListTestJSON-281567656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ae1819c5-abe7-47ff-9392-292c77998bd0" returned: 0 in 0.429s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:29:07 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-8f3f7525-312c-4439-8999-021ed8076fe5 tempest-VolumesListTestJSON-281567656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ae1819c5-abe7-47ff-9392-292c77998bd0 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:29:07 devstack sudo[101066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-3d93adb1-1c36-4157-b126-84bc227ec0f3.d1eb3c76-f7d0-4969-af6d-3e9f9b051821 Sep 29 18:29:07 devstack sudo[101066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:29:07 devstack sudo[101071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ae1819c5-abe7-47ff-9392-292c77998bd0 Sep 29 18:29:07 devstack sudo[101071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:29:07 devstack sudo[101065]: pam_unix(sudo:session): session closed for user root Sep 29 18:29:07 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-102da4d9-9602-4851-b908-811cef8d3677 tempest-VolumesSnapshotListTestJSON-196598729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-c5ff8f71-e843-480d-b750-871233065ceb.1d9bb5f8-749a-457f-a354-e2f04243fb4b" returned: 0 in 0.257s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:29:07 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-102da4d9-9602-4851-b908-811cef8d3677 tempest-VolumesSnapshotListTestJSON-196598729 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.680s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:29:07 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-102da4d9-9602-4851-b908-811cef8d3677 tempest-VolumesSnapshotListTestJSON-196598729 None] Create snapshot completed successfully Sep 29 18:29:07 devstack sudo[101071]: pam_unix(sudo:session): session closed for user root Sep 29 18:29:07 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-8f3f7525-312c-4439-8999-021ed8076fe5 tempest-VolumesListTestJSON-281567656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ae1819c5-abe7-47ff-9392-292c77998bd0" returned: 0 in 0.277s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:29:07 devstack sudo[101066]: pam_unix(sudo:session): session closed for user root Sep 29 18:29:07 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-78e1a244-654b-4a2e-89b1-9e4149dde5ea tempest-SnapshotsActionsTest-2036303098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-3d93adb1-1c36-4157-b126-84bc227ec0f3.d1eb3c76-f7d0-4969-af6d-3e9f9b051821" returned: 0 in 0.404s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:29:07 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-78e1a244-654b-4a2e-89b1-9e4149dde5ea tempest-SnapshotsActionsTest-2036303098 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3d93adb1-1c36-4157-b126-84bc227ec0f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86512) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 18:29:07 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-78e1a244-654b-4a2e-89b1-9e4149dde5ea tempest-SnapshotsActionsTest-2036303098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-3d93adb1-1c36-4157-b126-84bc227ec0f3.451b5fdc-1321-4588-94b3-2ad5b3bae4f9 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:29:07 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-8f3f7525-312c-4439-8999-021ed8076fe5 tempest-VolumesListTestJSON-281567656 None] Lock "cinder-quobyte-ae1819c5-abe7-47ff-9392-292c77998bd0" released by "delete_volume" :: held 0.764s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:29:07 devstack sudo[101079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-3d93adb1-1c36-4157-b126-84bc227ec0f3.451b5fdc-1321-4588-94b3-2ad5b3bae4f9 Sep 29 18:29:07 devstack sudo[101079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:29:07 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-8f3f7525-312c-4439-8999-021ed8076fe5 tempest-VolumesListTestJSON-281567656 None] Created reservations ['18925aa4-8426-4769-a474-a96c5166f058', 'a6c27010-3aa8-41e7-9fc7-33caaeebfc58', 'b0e4abe5-7567-4082-a739-17daa74942a6', 'a5c0fc0e-bc1b-412c-b4ff-df7fe3bea81b'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:29:07 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-8f3f7525-312c-4439-8999-021ed8076fe5 tempest-VolumesListTestJSON-281567656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:29:07 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-8f3f7525-312c-4439-8999-021ed8076fe5 tempest-VolumesListTestJSON-281567656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:29:07 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-8f3f7525-312c-4439-8999-021ed8076fe5 tempest-VolumesListTestJSON-281567656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:29:07 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-8f3f7525-312c-4439-8999-021ed8076fe5 tempest-VolumesListTestJSON-281567656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:29:07 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-8f3f7525-312c-4439-8999-021ed8076fe5 tempest-VolumesListTestJSON-281567656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:29:08 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-8f3f7525-312c-4439-8999-021ed8076fe5 tempest-VolumesListTestJSON-281567656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:29:08 devstack sudo[101081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:29:08 devstack sudo[101081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:29:08 devstack sudo[101081]: pam_unix(sudo:session): session closed for user root Sep 29 18:29:08 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-8f3f7525-312c-4439-8999-021ed8076fe5 tempest-VolumesListTestJSON-281567656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.272s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:29:08 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-8f3f7525-312c-4439-8999-021ed8076fe5 tempest-VolumesListTestJSON-281567656 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:29:08 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-8f3f7525-312c-4439-8999-021ed8076fe5 tempest-VolumesListTestJSON-281567656 None] Deleted volume successfully. Sep 29 18:29:08 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-8f3f7525-312c-4439-8999-021ed8076fe5 tempest-VolumesListTestJSON-281567656 None] Lock "cinder-ae1819c5-abe7-47ff-9392-292c77998bd0-delete_volume" released by "delete_volume" :: held 1.245s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:29:08 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-ce13f2d1-e250-4815-8918-e0caeb578d13 tempest-VolumesListTestJSON-281567656 None] Acquiring lock "cinder-060084bf-4016-43be-b540-573dce76a46a-delete_volume" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:29:08 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-ce13f2d1-e250-4815-8918-e0caeb578d13 tempest-VolumesListTestJSON-281567656 None] Lock "cinder-060084bf-4016-43be-b540-573dce76a46a-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:29:08 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-6de1b8c6-f525-422c-aac1-c229353c90f6 tempest-VolumesSnapshotListTestJSON-196598729 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:29:08 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-6de1b8c6-f525-422c-aac1-c229353c90f6 tempest-VolumesSnapshotListTestJSON-196598729 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:29:08 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-6de1b8c6-f525-422c-aac1-c229353c90f6 tempest-VolumesSnapshotListTestJSON-196598729 None] Creating offline snapshot 947cff06-e794-4eef-be7f-12c939d4ebdc of volume c5ff8f71-e843-480d-b750-871233065ceb {{(pid=86512) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 18:29:08 devstack sudo[101079]: pam_unix(sudo:session): session closed for user root Sep 29 18:29:08 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-78e1a244-654b-4a2e-89b1-9e4149dde5ea tempest-SnapshotsActionsTest-2036303098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-3d93adb1-1c36-4157-b126-84bc227ec0f3.451b5fdc-1321-4588-94b3-2ad5b3bae4f9" returned: 0 in 0.567s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:29:08 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-78e1a244-654b-4a2e-89b1-9e4149dde5ea tempest-SnapshotsActionsTest-2036303098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-3d93adb1-1c36-4157-b126-84bc227ec0f3.451b5fdc-1321-4588-94b3-2ad5b3bae4f9 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:29:08 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d6084f9-d8b3-4796-bb75-76bda8a00052]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:29:08 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-6de1b8c6-f525-422c-aac1-c229353c90f6 tempest-VolumesSnapshotListTestJSON-196598729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-c5ff8f71-e843-480d-b750-871233065ceb.1d9bb5f8-749a-457f-a354-e2f04243fb4b {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:29:08 devstack sudo[101087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-3d93adb1-1c36-4157-b126-84bc227ec0f3.451b5fdc-1321-4588-94b3-2ad5b3bae4f9 Sep 29 18:29:08 devstack sudo[101087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:29:08 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-ce13f2d1-e250-4815-8918-e0caeb578d13 tempest-VolumesListTestJSON-281567656 None] Acquiring lock "cinder-quobyte-060084bf-4016-43be-b540-573dce76a46a" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:29:08 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-ce13f2d1-e250-4815-8918-e0caeb578d13 tempest-VolumesListTestJSON-281567656 None] Lock "cinder-quobyte-060084bf-4016-43be-b540-573dce76a46a" acquired by "delete_volume" :: waited 0.025s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:29:08 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fdab5f6-81b4-4101-b2f0-3edbc42d9f2e]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:29:08 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-ce13f2d1-e250-4815-8918-e0caeb578d13 tempest-VolumesListTestJSON-281567656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-060084bf-4016-43be-b540-573dce76a46a {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:29:08 devstack sudo[101089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-c5ff8f71-e843-480d-b750-871233065ceb.1d9bb5f8-749a-457f-a354-e2f04243fb4b Sep 29 18:29:08 devstack sudo[101089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:29:08 devstack sudo[101090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-060084bf-4016-43be-b540-573dce76a46a Sep 29 18:29:08 devstack sudo[101090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:29:08 devstack sudo[101087]: pam_unix(sudo:session): session closed for user root Sep 29 18:29:08 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-78e1a244-654b-4a2e-89b1-9e4149dde5ea tempest-SnapshotsActionsTest-2036303098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-3d93adb1-1c36-4157-b126-84bc227ec0f3.451b5fdc-1321-4588-94b3-2ad5b3bae4f9" returned: 0 in 0.284s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:29:08 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-78e1a244-654b-4a2e-89b1-9e4149dde5ea tempest-SnapshotsActionsTest-2036303098 None] Lock "cinder-quobyte-451b5fdc-1321-4588-94b3-2ad5b3bae4f9" released by "_delete_snapshot" :: held 1.804s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:29:08 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-78e1a244-654b-4a2e-89b1-9e4149dde5ea tempest-SnapshotsActionsTest-2036303098 None] Lock "cinder-quobyte-3d93adb1-1c36-4157-b126-84bc227ec0f3" released by "delete_snapshot" :: held 1.833s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:29:08 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-78e1a244-654b-4a2e-89b1-9e4149dde5ea tempest-SnapshotsActionsTest-2036303098 None] Created reservations ['727edd6f-5089-4847-a47a-11ab48c31c77', '921b1e9c-1ddf-4458-bbeb-f3b56c17eeb6', 'c2ab1180-6364-4606-ad1f-ed091f07a9e2', 'bdab02d1-c9d1-4bbb-a547-417908cda4c4'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:29:08 devstack sudo[101089]: pam_unix(sudo:session): session closed for user root Sep 29 18:29:08 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-6de1b8c6-f525-422c-aac1-c229353c90f6 tempest-VolumesSnapshotListTestJSON-196598729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-c5ff8f71-e843-480d-b750-871233065ceb.1d9bb5f8-749a-457f-a354-e2f04243fb4b" returned: 0 in 0.402s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:29:08 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-6de1b8c6-f525-422c-aac1-c229353c90f6 tempest-VolumesSnapshotListTestJSON-196598729 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c5ff8f71-e843-480d-b750-871233065ceb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86512) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 18:29:08 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-6de1b8c6-f525-422c-aac1-c229353c90f6 tempest-VolumesSnapshotListTestJSON-196598729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-c5ff8f71-e843-480d-b750-871233065ceb.1d9bb5f8-749a-457f-a354-e2f04243fb4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-c5ff8f71-e843-480d-b750-871233065ceb.947cff06-e794-4eef-be7f-12c939d4ebdc 1G {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:29:08 devstack sudo[101099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-c5ff8f71-e843-480d-b750-871233065ceb.1d9bb5f8-749a-457f-a354-e2f04243fb4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-c5ff8f71-e843-480d-b750-871233065ceb.947cff06-e794-4eef-be7f-12c939d4ebdc 1G Sep 29 18:29:08 devstack sudo[101099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:29:08 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-78e1a244-654b-4a2e-89b1-9e4149dde5ea tempest-SnapshotsActionsTest-2036303098 None] Delete snapshot completed successfully. Sep 29 18:29:08 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-78e1a244-654b-4a2e-89b1-9e4149dde5ea tempest-SnapshotsActionsTest-2036303098 None] Lock "cinder-451b5fdc-1321-4588-94b3-2ad5b3bae4f9-delete_snapshot" released by "delete_snapshot" :: held 2.024s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:29:08 devstack sudo[101090]: pam_unix(sudo:session): session closed for user root Sep 29 18:29:08 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-ce13f2d1-e250-4815-8918-e0caeb578d13 tempest-VolumesListTestJSON-281567656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-060084bf-4016-43be-b540-573dce76a46a" returned: 0 in 0.407s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:29:08 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-ce13f2d1-e250-4815-8918-e0caeb578d13 tempest-VolumesListTestJSON-281567656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-060084bf-4016-43be-b540-573dce76a46a {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:29:08 devstack sudo[101102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-060084bf-4016-43be-b540-573dce76a46a Sep 29 18:29:08 devstack sudo[101102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:29:09 devstack sudo[101102]: pam_unix(sudo:session): session closed for user root Sep 29 18:29:09 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-ce13f2d1-e250-4815-8918-e0caeb578d13 tempest-VolumesListTestJSON-281567656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-060084bf-4016-43be-b540-573dce76a46a" returned: 0 in 0.286s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:29:09 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-ce13f2d1-e250-4815-8918-e0caeb578d13 tempest-VolumesListTestJSON-281567656 None] Lock "cinder-quobyte-060084bf-4016-43be-b540-573dce76a46a" released by "delete_volume" :: held 0.757s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:29:09 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-ce13f2d1-e250-4815-8918-e0caeb578d13 tempest-VolumesListTestJSON-281567656 None] Created reservations ['86bff356-9356-40ba-bf16-590144615bc3', '7065c3e1-fe11-4ead-bc66-ca3db6fbebc0', 'aaa70429-77da-46df-9de4-02ecc34c93b0', 'f7a7773f-d361-4826-ac06-40b3ec6eede1'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:29:09 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-ce13f2d1-e250-4815-8918-e0caeb578d13 tempest-VolumesListTestJSON-281567656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:29:09 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-ce13f2d1-e250-4815-8918-e0caeb578d13 tempest-VolumesListTestJSON-281567656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:29:09 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-ce13f2d1-e250-4815-8918-e0caeb578d13 tempest-VolumesListTestJSON-281567656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:29:09 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-ce13f2d1-e250-4815-8918-e0caeb578d13 tempest-VolumesListTestJSON-281567656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:29:09 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-ce13f2d1-e250-4815-8918-e0caeb578d13 tempest-VolumesListTestJSON-281567656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:29:09 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-ce13f2d1-e250-4815-8918-e0caeb578d13 tempest-VolumesListTestJSON-281567656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:29:09 devstack sudo[101109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:29:09 devstack sudo[101109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:29:09 devstack sudo[101099]: pam_unix(sudo:session): session closed for user root Sep 29 18:29:09 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-6de1b8c6-f525-422c-aac1-c229353c90f6 tempest-VolumesSnapshotListTestJSON-196598729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-c5ff8f71-e843-480d-b750-871233065ceb.1d9bb5f8-749a-457f-a354-e2f04243fb4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-c5ff8f71-e843-480d-b750-871233065ceb.947cff06-e794-4eef-be7f-12c939d4ebdc 1G" returned: 0 in 0.602s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:29:09 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-6de1b8c6-f525-422c-aac1-c229353c90f6 tempest-VolumesSnapshotListTestJSON-196598729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5ff8f71-e843-480d-b750-871233065ceb.1d9bb5f8-749a-457f-a354-e2f04243fb4b -F qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-c5ff8f71-e843-480d-b750-871233065ceb.947cff06-e794-4eef-be7f-12c939d4ebdc {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:29:09 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-46215bfa-1335-4687-a131-62ee3ee27c56 tempest-SnapshotsActionsTest-1013262860 None] Acquiring lock "cinder-d1eb3c76-f7d0-4969-af6d-3e9f9b051821-delete_snapshot" by "delete_snapshot" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:29:09 devstack sudo[101111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5ff8f71-e843-480d-b750-871233065ceb.1d9bb5f8-749a-457f-a354-e2f04243fb4b -F qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-c5ff8f71-e843-480d-b750-871233065ceb.947cff06-e794-4eef-be7f-12c939d4ebdc Sep 29 18:29:09 devstack sudo[101111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:29:09 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-46215bfa-1335-4687-a131-62ee3ee27c56 tempest-SnapshotsActionsTest-1013262860 None] Lock "cinder-d1eb3c76-f7d0-4969-af6d-3e9f9b051821-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:29:09 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-46215bfa-1335-4687-a131-62ee3ee27c56 tempest-SnapshotsActionsTest-1013262860 None] Acquiring lock "cinder-quobyte-3d93adb1-1c36-4157-b126-84bc227ec0f3" by "delete_snapshot" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:29:09 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-46215bfa-1335-4687-a131-62ee3ee27c56 tempest-SnapshotsActionsTest-1013262860 None] Lock "cinder-quobyte-3d93adb1-1c36-4157-b126-84bc227ec0f3" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:29:09 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-46215bfa-1335-4687-a131-62ee3ee27c56 tempest-SnapshotsActionsTest-1013262860 None] Acquiring lock "cinder-quobyte-d1eb3c76-f7d0-4969-af6d-3e9f9b051821" by "_delete_snapshot" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:29:09 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-46215bfa-1335-4687-a131-62ee3ee27c56 tempest-SnapshotsActionsTest-1013262860 None] Lock "cinder-quobyte-d1eb3c76-f7d0-4969-af6d-3e9f9b051821" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:29:09 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-46215bfa-1335-4687-a131-62ee3ee27c56 tempest-SnapshotsActionsTest-1013262860 None] Deleting offline snapshot d1eb3c76-f7d0-4969-af6d-3e9f9b051821 of volume 3d93adb1-1c36-4157-b126-84bc227ec0f3 {{(pid=86512) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 18:29:09 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-46215bfa-1335-4687-a131-62ee3ee27c56 tempest-SnapshotsActionsTest-1013262860 None] snapshot_file for this snap is: volume-3d93adb1-1c36-4157-b126-84bc227ec0f3.d1eb3c76-f7d0-4969-af6d-3e9f9b051821 {{(pid=86512) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 18:29:09 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[520dc26e-eb5d-46d1-894b-bb32ba813f40]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:29:09 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-46215bfa-1335-4687-a131-62ee3ee27c56 tempest-SnapshotsActionsTest-1013262860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-3d93adb1-1c36-4157-b126-84bc227ec0f3.d1eb3c76-f7d0-4969-af6d-3e9f9b051821 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:29:09 devstack sudo[101109]: pam_unix(sudo:session): session closed for user root Sep 29 18:29:09 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-ce13f2d1-e250-4815-8918-e0caeb578d13 tempest-VolumesListTestJSON-281567656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.310s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:29:09 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-ce13f2d1-e250-4815-8918-e0caeb578d13 tempest-VolumesListTestJSON-281567656 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:29:09 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-ce13f2d1-e250-4815-8918-e0caeb578d13 tempest-VolumesListTestJSON-281567656 None] Deleted volume successfully. Sep 29 18:29:09 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-ce13f2d1-e250-4815-8918-e0caeb578d13 tempest-VolumesListTestJSON-281567656 None] Lock "cinder-060084bf-4016-43be-b540-573dce76a46a-delete_volume" released by "delete_volume" :: held 1.403s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:29:09 devstack sudo[101113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-3d93adb1-1c36-4157-b126-84bc227ec0f3.d1eb3c76-f7d0-4969-af6d-3e9f9b051821 Sep 29 18:29:09 devstack sudo[101113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:29:09 devstack sudo[101111]: pam_unix(sudo:session): session closed for user root Sep 29 18:29:09 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-6de1b8c6-f525-422c-aac1-c229353c90f6 tempest-VolumesSnapshotListTestJSON-196598729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5ff8f71-e843-480d-b750-871233065ceb.1d9bb5f8-749a-457f-a354-e2f04243fb4b -F qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-c5ff8f71-e843-480d-b750-871233065ceb.947cff06-e794-4eef-be7f-12c939d4ebdc" returned: 0 in 0.392s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:29:09 devstack cinder-volume[86512]: WARNING cinder.volume.drivers.remotefs [None req-6de1b8c6-f525-422c-aac1-c229353c90f6 tempest-VolumesSnapshotListTestJSON-196598729 None] /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-c5ff8f71-e843-480d-b750-871233065ceb.947cff06-e794-4eef-be7f-12c939d4ebdc is being set with open permissions: ugo+rw Sep 29 18:29:09 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-6de1b8c6-f525-422c-aac1-c229353c90f6 tempest-VolumesSnapshotListTestJSON-196598729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-c5ff8f71-e843-480d-b750-871233065ceb.947cff06-e794-4eef-be7f-12c939d4ebdc {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:29:09 devstack sudo[101119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-c5ff8f71-e843-480d-b750-871233065ceb.947cff06-e794-4eef-be7f-12c939d4ebdc Sep 29 18:29:09 devstack sudo[101119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:29:10 devstack sudo[101113]: pam_unix(sudo:session): session closed for user root Sep 29 18:29:10 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-46215bfa-1335-4687-a131-62ee3ee27c56 tempest-SnapshotsActionsTest-1013262860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-3d93adb1-1c36-4157-b126-84bc227ec0f3.d1eb3c76-f7d0-4969-af6d-3e9f9b051821" returned: 0 in 0.420s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:29:10 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-46215bfa-1335-4687-a131-62ee3ee27c56 tempest-SnapshotsActionsTest-1013262860 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3d93adb1-1c36-4157-b126-84bc227ec0f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86512) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 18:29:10 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[58ebf233-6caf-4755-9cbf-523946ee9242]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:29:10 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-46215bfa-1335-4687-a131-62ee3ee27c56 tempest-SnapshotsActionsTest-1013262860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-3d93adb1-1c36-4157-b126-84bc227ec0f3 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:29:10 devstack sudo[101119]: pam_unix(sudo:session): session closed for user root Sep 29 18:29:10 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-6de1b8c6-f525-422c-aac1-c229353c90f6 tempest-VolumesSnapshotListTestJSON-196598729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-c5ff8f71-e843-480d-b750-871233065ceb.947cff06-e794-4eef-be7f-12c939d4ebdc" returned: 0 in 0.270s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:29:10 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-6de1b8c6-f525-422c-aac1-c229353c90f6 tempest-VolumesSnapshotListTestJSON-196598729 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.794s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:29:10 devstack cinder-volume[86512]: DEBUG dbcounter [-] [86512] Writing DB stats cinder:SELECT=185,cinder:UPDATE=224,cinder:DELETE=21,cinder:INSERT=58 {{(pid=86512) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 18:29:10 devstack cinder-volume[86512]: DEBUG dbcounter [-] [86512] Writing DB stats cinder:SELECT=177,cinder:UPDATE=242,cinder:INSERT=65,cinder:DELETE=18 {{(pid=86512) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 18:29:10 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-6de1b8c6-f525-422c-aac1-c229353c90f6 tempest-VolumesSnapshotListTestJSON-196598729 None] Create snapshot completed successfully Sep 29 18:29:10 devstack sudo[101125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-3d93adb1-1c36-4157-b126-84bc227ec0f3 Sep 29 18:29:10 devstack sudo[101125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:29:10 devstack sudo[101125]: pam_unix(sudo:session): session closed for user root Sep 29 18:29:10 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-46215bfa-1335-4687-a131-62ee3ee27c56 tempest-SnapshotsActionsTest-1013262860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-3d93adb1-1c36-4157-b126-84bc227ec0f3" returned: 0 in 0.401s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:29:10 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-46215bfa-1335-4687-a131-62ee3ee27c56 tempest-SnapshotsActionsTest-1013262860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-3d93adb1-1c36-4157-b126-84bc227ec0f3.d1eb3c76-f7d0-4969-af6d-3e9f9b051821 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:29:10 devstack sudo[101130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-3d93adb1-1c36-4157-b126-84bc227ec0f3.d1eb3c76-f7d0-4969-af6d-3e9f9b051821 Sep 29 18:29:10 devstack sudo[101130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:29:10 devstack sudo[101130]: pam_unix(sudo:session): session closed for user root Sep 29 18:29:10 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-46215bfa-1335-4687-a131-62ee3ee27c56 tempest-SnapshotsActionsTest-1013262860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-3d93adb1-1c36-4157-b126-84bc227ec0f3.d1eb3c76-f7d0-4969-af6d-3e9f9b051821" returned: 0 in 0.465s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:29:10 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-46215bfa-1335-4687-a131-62ee3ee27c56 tempest-SnapshotsActionsTest-1013262860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-3d93adb1-1c36-4157-b126-84bc227ec0f3.d1eb3c76-f7d0-4969-af6d-3e9f9b051821 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:29:11 devstack sudo[101135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-3d93adb1-1c36-4157-b126-84bc227ec0f3.d1eb3c76-f7d0-4969-af6d-3e9f9b051821 Sep 29 18:29:11 devstack sudo[101135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:29:11 devstack sudo[101135]: pam_unix(sudo:session): session closed for user root Sep 29 18:29:11 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-46215bfa-1335-4687-a131-62ee3ee27c56 tempest-SnapshotsActionsTest-1013262860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-3d93adb1-1c36-4157-b126-84bc227ec0f3.d1eb3c76-f7d0-4969-af6d-3e9f9b051821" returned: 0 in 0.297s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:29:11 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-46215bfa-1335-4687-a131-62ee3ee27c56 tempest-SnapshotsActionsTest-1013262860 None] Lock "cinder-quobyte-d1eb3c76-f7d0-4969-af6d-3e9f9b051821" released by "_delete_snapshot" :: held 1.746s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:29:11 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-46215bfa-1335-4687-a131-62ee3ee27c56 tempest-SnapshotsActionsTest-1013262860 None] Lock "cinder-quobyte-3d93adb1-1c36-4157-b126-84bc227ec0f3" released by "delete_snapshot" :: held 1.775s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:29:11 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-46215bfa-1335-4687-a131-62ee3ee27c56 tempest-SnapshotsActionsTest-1013262860 None] Created reservations ['aa19cfc2-c9c2-4f78-8a4c-7ad481999406', '20bddee2-7d2d-49e2-ac43-aca8b7f86043', '46e199c7-dbe5-4724-9097-0d7688aa7da6', '55a6204d-083f-4386-92c1-65508f72dfc8'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:29:11 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-46215bfa-1335-4687-a131-62ee3ee27c56 tempest-SnapshotsActionsTest-1013262860 None] Delete snapshot completed successfully. Sep 29 18:29:11 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-46215bfa-1335-4687-a131-62ee3ee27c56 tempest-SnapshotsActionsTest-1013262860 None] Lock "cinder-d1eb3c76-f7d0-4969-af6d-3e9f9b051821-delete_snapshot" released by "delete_snapshot" :: held 1.957s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:29:11 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-df61ee5a-ff53-4e40-bede-9ceff9d76a98 tempest-VolumesSnapshotListTestJSON-196598729 None] Acquiring lock "cinder-947cff06-e794-4eef-be7f-12c939d4ebdc-delete_snapshot" by "delete_snapshot" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:29:11 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-df61ee5a-ff53-4e40-bede-9ceff9d76a98 tempest-VolumesSnapshotListTestJSON-196598729 None] Lock "cinder-947cff06-e794-4eef-be7f-12c939d4ebdc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:29:11 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-df61ee5a-ff53-4e40-bede-9ceff9d76a98 tempest-VolumesSnapshotListTestJSON-196598729 None] Acquiring lock "cinder-quobyte-c5ff8f71-e843-480d-b750-871233065ceb" by "delete_snapshot" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:29:11 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-df61ee5a-ff53-4e40-bede-9ceff9d76a98 tempest-VolumesSnapshotListTestJSON-196598729 None] Lock "cinder-quobyte-c5ff8f71-e843-480d-b750-871233065ceb" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:29:11 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-df61ee5a-ff53-4e40-bede-9ceff9d76a98 tempest-VolumesSnapshotListTestJSON-196598729 None] Acquiring lock "cinder-quobyte-947cff06-e794-4eef-be7f-12c939d4ebdc" by "_delete_snapshot" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:29:11 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-df61ee5a-ff53-4e40-bede-9ceff9d76a98 tempest-VolumesSnapshotListTestJSON-196598729 None] Lock "cinder-quobyte-947cff06-e794-4eef-be7f-12c939d4ebdc" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:29:11 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-df61ee5a-ff53-4e40-bede-9ceff9d76a98 tempest-VolumesSnapshotListTestJSON-196598729 None] Deleting offline snapshot 947cff06-e794-4eef-be7f-12c939d4ebdc of volume c5ff8f71-e843-480d-b750-871233065ceb {{(pid=86512) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 18:29:11 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-df61ee5a-ff53-4e40-bede-9ceff9d76a98 tempest-VolumesSnapshotListTestJSON-196598729 None] snapshot_file for this snap is: volume-c5ff8f71-e843-480d-b750-871233065ceb.947cff06-e794-4eef-be7f-12c939d4ebdc {{(pid=86512) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 18:29:11 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a07ecb2-2943-4e10-b77f-255c7ba316e3]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:29:11 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-df61ee5a-ff53-4e40-bede-9ceff9d76a98 tempest-VolumesSnapshotListTestJSON-196598729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-c5ff8f71-e843-480d-b750-871233065ceb.947cff06-e794-4eef-be7f-12c939d4ebdc {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:29:11 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-6cbc77d3-2015-48a1-b260-306ae4a48a01 tempest-SnapshotsActionsTest-1013262860 None] Acquiring lock "cinder-3d93adb1-1c36-4157-b126-84bc227ec0f3-delete_volume" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:29:11 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-6cbc77d3-2015-48a1-b260-306ae4a48a01 tempest-SnapshotsActionsTest-1013262860 None] Lock "cinder-3d93adb1-1c36-4157-b126-84bc227ec0f3-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:29:11 devstack sudo[101138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-c5ff8f71-e843-480d-b750-871233065ceb.947cff06-e794-4eef-be7f-12c939d4ebdc Sep 29 18:29:11 devstack sudo[101138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:29:11 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-6cbc77d3-2015-48a1-b260-306ae4a48a01 tempest-SnapshotsActionsTest-1013262860 None] Acquiring lock "cinder-quobyte-3d93adb1-1c36-4157-b126-84bc227ec0f3" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:29:11 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-6cbc77d3-2015-48a1-b260-306ae4a48a01 tempest-SnapshotsActionsTest-1013262860 None] Lock "cinder-quobyte-3d93adb1-1c36-4157-b126-84bc227ec0f3" acquired by "delete_volume" :: waited 0.016s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:29:11 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[f80155cc-19cd-4a57-99a4-05f8aeca440f]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:29:11 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-6cbc77d3-2015-48a1-b260-306ae4a48a01 tempest-SnapshotsActionsTest-1013262860 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-3d93adb1-1c36-4157-b126-84bc227ec0f3 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:29:12 devstack sudo[101140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-3d93adb1-1c36-4157-b126-84bc227ec0f3 Sep 29 18:29:12 devstack sudo[101140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:29:12 devstack sudo[101138]: pam_unix(sudo:session): session closed for user root Sep 29 18:29:12 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-df61ee5a-ff53-4e40-bede-9ceff9d76a98 tempest-VolumesSnapshotListTestJSON-196598729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-c5ff8f71-e843-480d-b750-871233065ceb.947cff06-e794-4eef-be7f-12c939d4ebdc" returned: 0 in 0.406s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:29:12 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-df61ee5a-ff53-4e40-bede-9ceff9d76a98 tempest-VolumesSnapshotListTestJSON-196598729 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c5ff8f71-e843-480d-b750-871233065ceb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86512) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 18:29:12 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[a046bf2b-a4ac-4c95-b9f4-10aeaad1129e]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:29:12 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-df61ee5a-ff53-4e40-bede-9ceff9d76a98 tempest-VolumesSnapshotListTestJSON-196598729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-c5ff8f71-e843-480d-b750-871233065ceb.1d9bb5f8-749a-457f-a354-e2f04243fb4b {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:29:12 devstack sudo[101145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-c5ff8f71-e843-480d-b750-871233065ceb.1d9bb5f8-749a-457f-a354-e2f04243fb4b Sep 29 18:29:12 devstack sudo[101145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:29:12 devstack sudo[101140]: pam_unix(sudo:session): session closed for user root Sep 29 18:29:12 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-6cbc77d3-2015-48a1-b260-306ae4a48a01 tempest-SnapshotsActionsTest-1013262860 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-3d93adb1-1c36-4157-b126-84bc227ec0f3" returned: 0 in 0.405s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:29:12 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-6cbc77d3-2015-48a1-b260-306ae4a48a01 tempest-SnapshotsActionsTest-1013262860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-3d93adb1-1c36-4157-b126-84bc227ec0f3 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:29:12 devstack sudo[101150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-3d93adb1-1c36-4157-b126-84bc227ec0f3 Sep 29 18:29:12 devstack sudo[101150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:29:12 devstack sudo[101145]: pam_unix(sudo:session): session closed for user root Sep 29 18:29:12 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-df61ee5a-ff53-4e40-bede-9ceff9d76a98 tempest-VolumesSnapshotListTestJSON-196598729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-c5ff8f71-e843-480d-b750-871233065ceb.1d9bb5f8-749a-457f-a354-e2f04243fb4b" returned: 0 in 0.402s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:29:12 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-df61ee5a-ff53-4e40-bede-9ceff9d76a98 tempest-VolumesSnapshotListTestJSON-196598729 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c5ff8f71-e843-480d-b750-871233065ceb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86512) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 18:29:12 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-df61ee5a-ff53-4e40-bede-9ceff9d76a98 tempest-VolumesSnapshotListTestJSON-196598729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-c5ff8f71-e843-480d-b750-871233065ceb.947cff06-e794-4eef-be7f-12c939d4ebdc {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:29:12 devstack sudo[101156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-c5ff8f71-e843-480d-b750-871233065ceb.947cff06-e794-4eef-be7f-12c939d4ebdc Sep 29 18:29:12 devstack sudo[101156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:29:12 devstack sudo[101150]: pam_unix(sudo:session): session closed for user root Sep 29 18:29:12 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-6cbc77d3-2015-48a1-b260-306ae4a48a01 tempest-SnapshotsActionsTest-1013262860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-3d93adb1-1c36-4157-b126-84bc227ec0f3" returned: 0 in 0.272s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:29:12 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-6cbc77d3-2015-48a1-b260-306ae4a48a01 tempest-SnapshotsActionsTest-1013262860 None] Lock "cinder-quobyte-3d93adb1-1c36-4157-b126-84bc227ec0f3" released by "delete_volume" :: held 0.752s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:29:12 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-6cbc77d3-2015-48a1-b260-306ae4a48a01 tempest-SnapshotsActionsTest-1013262860 None] Created reservations ['480bb491-4c41-4cc0-8844-15e45b0ff9af', '757a2f36-2389-496b-9875-8d69bcf74f83', 'ec17a71f-13fd-48da-b581-648fe7c4b923', '430f1224-d53c-4857-a17b-d2ec1d175450'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:29:12 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-6cbc77d3-2015-48a1-b260-306ae4a48a01 tempest-SnapshotsActionsTest-1013262860 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:29:12 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-6cbc77d3-2015-48a1-b260-306ae4a48a01 tempest-SnapshotsActionsTest-1013262860 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:29:12 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-6cbc77d3-2015-48a1-b260-306ae4a48a01 tempest-SnapshotsActionsTest-1013262860 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:29:12 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-6cbc77d3-2015-48a1-b260-306ae4a48a01 tempest-SnapshotsActionsTest-1013262860 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:29:12 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-6cbc77d3-2015-48a1-b260-306ae4a48a01 tempest-SnapshotsActionsTest-1013262860 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:29:12 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-6cbc77d3-2015-48a1-b260-306ae4a48a01 tempest-SnapshotsActionsTest-1013262860 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:29:12 devstack sudo[101158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:29:12 devstack sudo[101158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:29:13 devstack sudo[101156]: pam_unix(sudo:session): session closed for user root Sep 29 18:29:13 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-df61ee5a-ff53-4e40-bede-9ceff9d76a98 tempest-VolumesSnapshotListTestJSON-196598729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-c5ff8f71-e843-480d-b750-871233065ceb.947cff06-e794-4eef-be7f-12c939d4ebdc" returned: 0 in 0.483s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:29:13 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-df61ee5a-ff53-4e40-bede-9ceff9d76a98 tempest-VolumesSnapshotListTestJSON-196598729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-c5ff8f71-e843-480d-b750-871233065ceb.947cff06-e794-4eef-be7f-12c939d4ebdc {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:29:13 devstack sudo[101158]: pam_unix(sudo:session): session closed for user root Sep 29 18:29:13 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-6cbc77d3-2015-48a1-b260-306ae4a48a01 tempest-SnapshotsActionsTest-1013262860 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.295s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:29:13 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-6cbc77d3-2015-48a1-b260-306ae4a48a01 tempest-SnapshotsActionsTest-1013262860 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:29:13 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-6cbc77d3-2015-48a1-b260-306ae4a48a01 tempest-SnapshotsActionsTest-1013262860 None] Deleted volume successfully. Sep 29 18:29:13 devstack sudo[101165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-c5ff8f71-e843-480d-b750-871233065ceb.947cff06-e794-4eef-be7f-12c939d4ebdc Sep 29 18:29:13 devstack sudo[101165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:29:13 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-6cbc77d3-2015-48a1-b260-306ae4a48a01 tempest-SnapshotsActionsTest-1013262860 None] Lock "cinder-3d93adb1-1c36-4157-b126-84bc227ec0f3-delete_volume" released by "delete_volume" :: held 1.284s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:29:13 devstack sudo[101165]: pam_unix(sudo:session): session closed for user root Sep 29 18:29:13 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-df61ee5a-ff53-4e40-bede-9ceff9d76a98 tempest-VolumesSnapshotListTestJSON-196598729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-c5ff8f71-e843-480d-b750-871233065ceb.947cff06-e794-4eef-be7f-12c939d4ebdc" returned: 0 in 0.279s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:29:13 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-df61ee5a-ff53-4e40-bede-9ceff9d76a98 tempest-VolumesSnapshotListTestJSON-196598729 None] Lock "cinder-quobyte-947cff06-e794-4eef-be7f-12c939d4ebdc" released by "_delete_snapshot" :: held 1.725s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:29:13 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-df61ee5a-ff53-4e40-bede-9ceff9d76a98 tempest-VolumesSnapshotListTestJSON-196598729 None] Lock "cinder-quobyte-c5ff8f71-e843-480d-b750-871233065ceb" released by "delete_snapshot" :: held 1.750s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:29:13 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-df61ee5a-ff53-4e40-bede-9ceff9d76a98 tempest-VolumesSnapshotListTestJSON-196598729 None] Created reservations ['7b330044-c12a-49a8-9ec2-b548f0e18e80', 'cbc1f6f5-9cf9-4df6-8b7d-6d0735363a41', '7f669503-78a3-4af7-a5bd-907f08fa9d73', '06779a8f-2443-4b25-a441-00693ef87729'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:29:13 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-df61ee5a-ff53-4e40-bede-9ceff9d76a98 tempest-VolumesSnapshotListTestJSON-196598729 None] Delete snapshot completed successfully. Sep 29 18:29:13 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-df61ee5a-ff53-4e40-bede-9ceff9d76a98 tempest-VolumesSnapshotListTestJSON-196598729 None] Lock "cinder-947cff06-e794-4eef-be7f-12c939d4ebdc-delete_snapshot" released by "delete_snapshot" :: held 1.914s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:29:13 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-f8bb1952-d461-444f-a118-6b5c035a6b6d tempest-VolumesSnapshotListTestJSON-196598729 None] Acquiring lock "cinder-1d9bb5f8-749a-457f-a354-e2f04243fb4b-delete_snapshot" by "delete_snapshot" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:29:13 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-f8bb1952-d461-444f-a118-6b5c035a6b6d tempest-VolumesSnapshotListTestJSON-196598729 None] Lock "cinder-1d9bb5f8-749a-457f-a354-e2f04243fb4b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:29:13 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-f8bb1952-d461-444f-a118-6b5c035a6b6d tempest-VolumesSnapshotListTestJSON-196598729 None] Acquiring lock "cinder-quobyte-c5ff8f71-e843-480d-b750-871233065ceb" by "delete_snapshot" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:29:13 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-f8bb1952-d461-444f-a118-6b5c035a6b6d tempest-VolumesSnapshotListTestJSON-196598729 None] Lock "cinder-quobyte-c5ff8f71-e843-480d-b750-871233065ceb" acquired by "delete_snapshot" :: waited 0.039s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:29:13 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-f8bb1952-d461-444f-a118-6b5c035a6b6d tempest-VolumesSnapshotListTestJSON-196598729 None] Acquiring lock "cinder-quobyte-1d9bb5f8-749a-457f-a354-e2f04243fb4b" by "_delete_snapshot" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:29:13 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-f8bb1952-d461-444f-a118-6b5c035a6b6d tempest-VolumesSnapshotListTestJSON-196598729 None] Lock "cinder-quobyte-1d9bb5f8-749a-457f-a354-e2f04243fb4b" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:29:13 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-f8bb1952-d461-444f-a118-6b5c035a6b6d tempest-VolumesSnapshotListTestJSON-196598729 None] Deleting offline snapshot 1d9bb5f8-749a-457f-a354-e2f04243fb4b of volume c5ff8f71-e843-480d-b750-871233065ceb {{(pid=86512) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 18:29:13 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-f8bb1952-d461-444f-a118-6b5c035a6b6d tempest-VolumesSnapshotListTestJSON-196598729 None] snapshot_file for this snap is: volume-c5ff8f71-e843-480d-b750-871233065ceb.1d9bb5f8-749a-457f-a354-e2f04243fb4b {{(pid=86512) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 18:29:13 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc668015-132c-4c3c-96e2-e143e337fe1b]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:29:13 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-f8bb1952-d461-444f-a118-6b5c035a6b6d tempest-VolumesSnapshotListTestJSON-196598729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-c5ff8f71-e843-480d-b750-871233065ceb.1d9bb5f8-749a-457f-a354-e2f04243fb4b {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:29:14 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c133076-4b5b-4ded-a333-0c0eeed0473a tempest-VolumesSnapshotNegativeTestJSON-1251531584 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86512) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:29:14 devstack sudo[101169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-c5ff8f71-e843-480d-b750-871233065ceb.1d9bb5f8-749a-457f-a354-e2f04243fb4b Sep 29 18:29:14 devstack sudo[101169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:29:14 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-9c133076-4b5b-4ded-a333-0c0eeed0473a tempest-VolumesSnapshotNegativeTestJSON-1251531584 None] Flow 'volume_create_manager' (8afd02b9-8a72-4d10-996d-764fe7152f47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:29:14 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-9c133076-4b5b-4ded-a333-0c0eeed0473a tempest-VolumesSnapshotNegativeTestJSON-1251531584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21d24896-e983-450f-ae9d-6c122d328799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:29:14 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-9c133076-4b5b-4ded-a333-0c0eeed0473a tempest-VolumesSnapshotNegativeTestJSON-1251531584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21d24896-e983-450f-ae9d-6c122d328799) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:29:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-520405795',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31ffad3c-fcfe-42a0-8b7b-c428427d4b63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1936c251fcc4f1989f4550aaa89c7a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:29:14Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:29:14Z,use_quota=True,user_id='552033ec30d140949139c999ed780200',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:29:14 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-9c133076-4b5b-4ded-a333-0c0eeed0473a tempest-VolumesSnapshotNegativeTestJSON-1251531584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4e530d5-edb8-48e0-83fc-e99164eec62c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:29:14 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-9c133076-4b5b-4ded-a333-0c0eeed0473a tempest-VolumesSnapshotNegativeTestJSON-1251531584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4e530d5-edb8-48e0-83fc-e99164eec62c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:29:14 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-9c133076-4b5b-4ded-a333-0c0eeed0473a tempest-VolumesSnapshotNegativeTestJSON-1251531584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50ecb63c-af0e-4470-b185-adca9b2a4e72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:29:14 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-9c133076-4b5b-4ded-a333-0c0eeed0473a tempest-VolumesSnapshotNegativeTestJSON-1251531584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50ecb63c-af0e-4470-b185-adca9b2a4e72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31ffad3c-fcfe-42a0-8b7b-c428427d4b63', 'volume_name': 'volume-31ffad3c-fcfe-42a0-8b7b-c428427d4b63', 'volume_size': 2}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:29:14 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-9c133076-4b5b-4ded-a333-0c0eeed0473a tempest-VolumesSnapshotNegativeTestJSON-1251531584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27357b3b-b290-44d8-8155-21a84ed09944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:29:14 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-9c133076-4b5b-4ded-a333-0c0eeed0473a tempest-VolumesSnapshotNegativeTestJSON-1251531584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27357b3b-b290-44d8-8155-21a84ed09944) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:29:14 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-9c133076-4b5b-4ded-a333-0c0eeed0473a tempest-VolumesSnapshotNegativeTestJSON-1251531584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a0c9f0b-29c2-4f7d-bc8f-53c9eacc1069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:29:14 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-9c133076-4b5b-4ded-a333-0c0eeed0473a tempest-VolumesSnapshotNegativeTestJSON-1251531584 None] Volume 31ffad3c-fcfe-42a0-8b7b-c428427d4b63: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31ffad3c-fcfe-42a0-8b7b-c428427d4b63', 'volume_size': 2} Sep 29 18:29:14 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-9c133076-4b5b-4ded-a333-0c0eeed0473a tempest-VolumesSnapshotNegativeTestJSON-1251531584 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:29:14 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-9c133076-4b5b-4ded-a333-0c0eeed0473a tempest-VolumesSnapshotNegativeTestJSON-1251531584 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:29:14 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-9c133076-4b5b-4ded-a333-0c0eeed0473a tempest-VolumesSnapshotNegativeTestJSON-1251531584 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:29:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-520405795',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31ffad3c-fcfe-42a0-8b7b-c428427d4b63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1936c251fcc4f1989f4550aaa89c7a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:29:14Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:29:14Z,use_quota=True,user_id='552033ec30d140949139c999ed780200',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)}" {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:29:14 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-9c133076-4b5b-4ded-a333-0c0eeed0473a tempest-VolumesSnapshotNegativeTestJSON-1251531584 None] Creating volume 31ffad3c-fcfe-42a0-8b7b-c428427d4b63 {{(pid=86512) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:29:14 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-9c133076-4b5b-4ded-a333-0c0eeed0473a tempest-VolumesSnapshotNegativeTestJSON-1251531584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:29:14 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-9c133076-4b5b-4ded-a333-0c0eeed0473a tempest-VolumesSnapshotNegativeTestJSON-1251531584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:29:14 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-9c133076-4b5b-4ded-a333-0c0eeed0473a tempest-VolumesSnapshotNegativeTestJSON-1251531584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:29:14 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-9c133076-4b5b-4ded-a333-0c0eeed0473a tempest-VolumesSnapshotNegativeTestJSON-1251531584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:29:14 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-9c133076-4b5b-4ded-a333-0c0eeed0473a tempest-VolumesSnapshotNegativeTestJSON-1251531584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:29:14 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-9c133076-4b5b-4ded-a333-0c0eeed0473a tempest-VolumesSnapshotNegativeTestJSON-1251531584 None] Selected osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 as target Quobyte volume. {{(pid=86512) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:29:14 devstack cinder-volume[86512]: INFO cinder.volume.drivers.remotefs [None req-9c133076-4b5b-4ded-a333-0c0eeed0473a tempest-VolumesSnapshotNegativeTestJSON-1251531584 None] casted to osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 Sep 29 18:29:14 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-9c133076-4b5b-4ded-a333-0c0eeed0473a tempest-VolumesSnapshotNegativeTestJSON-1251531584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-31ffad3c-fcfe-42a0-8b7b-c428427d4b63 2147483648 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:29:14 devstack sudo[101171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-31ffad3c-fcfe-42a0-8b7b-c428427d4b63 2147483648 Sep 29 18:29:14 devstack sudo[101171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:29:14 devstack sudo[101169]: pam_unix(sudo:session): session closed for user root Sep 29 18:29:14 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-f8bb1952-d461-444f-a118-6b5c035a6b6d tempest-VolumesSnapshotListTestJSON-196598729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-c5ff8f71-e843-480d-b750-871233065ceb.1d9bb5f8-749a-457f-a354-e2f04243fb4b" returned: 0 in 0.389s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:29:14 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-f8bb1952-d461-444f-a118-6b5c035a6b6d tempest-VolumesSnapshotListTestJSON-196598729 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c5ff8f71-e843-480d-b750-871233065ceb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86512) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 18:29:14 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[a83d23dc-82b5-4a34-b6cc-c915da9b3797]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:29:14 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-f8bb1952-d461-444f-a118-6b5c035a6b6d tempest-VolumesSnapshotListTestJSON-196598729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-c5ff8f71-e843-480d-b750-871233065ceb.6a91a30c-da00-4890-9a2b-afb6d118f2e6 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:29:14 devstack sudo[101178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-c5ff8f71-e843-480d-b750-871233065ceb.6a91a30c-da00-4890-9a2b-afb6d118f2e6 Sep 29 18:29:14 devstack sudo[101178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:29:14 devstack sudo[101171]: pam_unix(sudo:session): session closed for user root Sep 29 18:29:14 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-9c133076-4b5b-4ded-a333-0c0eeed0473a tempest-VolumesSnapshotNegativeTestJSON-1251531584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-31ffad3c-fcfe-42a0-8b7b-c428427d4b63 2147483648" returned: 0 in 0.590s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:29:14 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-9c133076-4b5b-4ded-a333-0c0eeed0473a tempest-VolumesSnapshotNegativeTestJSON-1251531584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-31ffad3c-fcfe-42a0-8b7b-c428427d4b63 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:29:14 devstack sudo[101184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-31ffad3c-fcfe-42a0-8b7b-c428427d4b63 Sep 29 18:29:14 devstack sudo[101184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:29:14 devstack sudo[101178]: pam_unix(sudo:session): session closed for user root Sep 29 18:29:14 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-f8bb1952-d461-444f-a118-6b5c035a6b6d tempest-VolumesSnapshotListTestJSON-196598729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-c5ff8f71-e843-480d-b750-871233065ceb.6a91a30c-da00-4890-9a2b-afb6d118f2e6" returned: 0 in 0.476s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:29:14 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-f8bb1952-d461-444f-a118-6b5c035a6b6d tempest-VolumesSnapshotListTestJSON-196598729 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c5ff8f71-e843-480d-b750-871233065ceb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86512) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 18:29:14 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-f8bb1952-d461-444f-a118-6b5c035a6b6d tempest-VolumesSnapshotListTestJSON-196598729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-c5ff8f71-e843-480d-b750-871233065ceb.1d9bb5f8-749a-457f-a354-e2f04243fb4b {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:29:14 devstack sudo[101188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-c5ff8f71-e843-480d-b750-871233065ceb.1d9bb5f8-749a-457f-a354-e2f04243fb4b Sep 29 18:29:14 devstack sudo[101188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:29:15 devstack sudo[101184]: pam_unix(sudo:session): session closed for user root Sep 29 18:29:15 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-9c133076-4b5b-4ded-a333-0c0eeed0473a tempest-VolumesSnapshotNegativeTestJSON-1251531584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-31ffad3c-fcfe-42a0-8b7b-c428427d4b63" returned: 0 in 0.325s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:29:15 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-9c133076-4b5b-4ded-a333-0c0eeed0473a tempest-VolumesSnapshotNegativeTestJSON-1251531584 None] <== create_volume: return (963ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'} {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:29:15 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-9c133076-4b5b-4ded-a333-0c0eeed0473a tempest-VolumesSnapshotNegativeTestJSON-1251531584 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.965s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:29:15 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-9c133076-4b5b-4ded-a333-0c0eeed0473a tempest-VolumesSnapshotNegativeTestJSON-1251531584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a0c9f0b-29c2-4f7d-bc8f-53c9eacc1069) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31ffad3c-fcfe-42a0-8b7b-c428427d4b63', 'volume_size': 2}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:29:15 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-9c133076-4b5b-4ded-a333-0c0eeed0473a tempest-VolumesSnapshotNegativeTestJSON-1251531584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f809714e-78d5-4565-9740-a4e0d497a5ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:29:15 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-9c133076-4b5b-4ded-a333-0c0eeed0473a tempest-VolumesSnapshotNegativeTestJSON-1251531584 None] Volume volume-31ffad3c-fcfe-42a0-8b7b-c428427d4b63 (31ffad3c-fcfe-42a0-8b7b-c428427d4b63): created successfully Sep 29 18:29:15 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-9c133076-4b5b-4ded-a333-0c0eeed0473a tempest-VolumesSnapshotNegativeTestJSON-1251531584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f809714e-78d5-4565-9740-a4e0d497a5ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:29:15 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-9c133076-4b5b-4ded-a333-0c0eeed0473a tempest-VolumesSnapshotNegativeTestJSON-1251531584 None] Flow 'volume_create_manager' (8afd02b9-8a72-4d10-996d-764fe7152f47) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:29:15 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-9c133076-4b5b-4ded-a333-0c0eeed0473a tempest-VolumesSnapshotNegativeTestJSON-1251531584 None] Created volume successfully. Sep 29 18:29:15 devstack sudo[101188]: pam_unix(sudo:session): session closed for user root Sep 29 18:29:15 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-f8bb1952-d461-444f-a118-6b5c035a6b6d tempest-VolumesSnapshotListTestJSON-196598729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-c5ff8f71-e843-480d-b750-871233065ceb.1d9bb5f8-749a-457f-a354-e2f04243fb4b" returned: 0 in 0.456s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:29:15 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-f8bb1952-d461-444f-a118-6b5c035a6b6d tempest-VolumesSnapshotListTestJSON-196598729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-c5ff8f71-e843-480d-b750-871233065ceb.1d9bb5f8-749a-457f-a354-e2f04243fb4b {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:29:15 devstack sudo[101195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-c5ff8f71-e843-480d-b750-871233065ceb.1d9bb5f8-749a-457f-a354-e2f04243fb4b Sep 29 18:29:15 devstack sudo[101195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:29:15 devstack sudo[101195]: pam_unix(sudo:session): session closed for user root Sep 29 18:29:15 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-f8bb1952-d461-444f-a118-6b5c035a6b6d tempest-VolumesSnapshotListTestJSON-196598729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-c5ff8f71-e843-480d-b750-871233065ceb.1d9bb5f8-749a-457f-a354-e2f04243fb4b" returned: 0 in 0.257s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:29:15 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-f8bb1952-d461-444f-a118-6b5c035a6b6d tempest-VolumesSnapshotListTestJSON-196598729 None] Lock "cinder-quobyte-1d9bb5f8-749a-457f-a354-e2f04243fb4b" released by "_delete_snapshot" :: held 1.737s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:29:15 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-f8bb1952-d461-444f-a118-6b5c035a6b6d tempest-VolumesSnapshotListTestJSON-196598729 None] Lock "cinder-quobyte-c5ff8f71-e843-480d-b750-871233065ceb" released by "delete_snapshot" :: held 1.769s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:29:15 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-f8bb1952-d461-444f-a118-6b5c035a6b6d tempest-VolumesSnapshotListTestJSON-196598729 None] Created reservations ['848adf5a-a2c2-435b-b65e-1bb4e1c34b39', '8cc95d45-a0fb-4ca5-a693-9e247806b396', '02be566e-befe-42bc-b6e0-1a1f5c5fdec0', 'b6d794ae-2b87-4521-ba17-a71faba9c531'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:29:15 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-f8bb1952-d461-444f-a118-6b5c035a6b6d tempest-VolumesSnapshotListTestJSON-196598729 None] Delete snapshot completed successfully. Sep 29 18:29:15 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-f8bb1952-d461-444f-a118-6b5c035a6b6d tempest-VolumesSnapshotListTestJSON-196598729 None] Lock "cinder-1d9bb5f8-749a-457f-a354-e2f04243fb4b-delete_snapshot" released by "delete_snapshot" :: held 1.958s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:29:15 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-32ce2a28-adaf-45f8-9c70-8ed947d9d086 tempest-VolumesSnapshotListTestJSON-196598729 None] Acquiring lock "cinder-6a91a30c-da00-4890-9a2b-afb6d118f2e6-delete_snapshot" by "delete_snapshot" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:29:16 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-32ce2a28-adaf-45f8-9c70-8ed947d9d086 tempest-VolumesSnapshotListTestJSON-196598729 None] Lock "cinder-6a91a30c-da00-4890-9a2b-afb6d118f2e6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:29:16 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-32ce2a28-adaf-45f8-9c70-8ed947d9d086 tempest-VolumesSnapshotListTestJSON-196598729 None] Acquiring lock "cinder-quobyte-c5ff8f71-e843-480d-b750-871233065ceb" by "delete_snapshot" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:29:16 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-32ce2a28-adaf-45f8-9c70-8ed947d9d086 tempest-VolumesSnapshotListTestJSON-196598729 None] Lock "cinder-quobyte-c5ff8f71-e843-480d-b750-871233065ceb" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:29:16 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-32ce2a28-adaf-45f8-9c70-8ed947d9d086 tempest-VolumesSnapshotListTestJSON-196598729 None] Acquiring lock "cinder-quobyte-6a91a30c-da00-4890-9a2b-afb6d118f2e6" by "_delete_snapshot" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:29:16 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-32ce2a28-adaf-45f8-9c70-8ed947d9d086 tempest-VolumesSnapshotListTestJSON-196598729 None] Lock "cinder-quobyte-6a91a30c-da00-4890-9a2b-afb6d118f2e6" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:29:16 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-32ce2a28-adaf-45f8-9c70-8ed947d9d086 tempest-VolumesSnapshotListTestJSON-196598729 None] Deleting offline snapshot 6a91a30c-da00-4890-9a2b-afb6d118f2e6 of volume c5ff8f71-e843-480d-b750-871233065ceb {{(pid=86512) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 18:29:16 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-32ce2a28-adaf-45f8-9c70-8ed947d9d086 tempest-VolumesSnapshotListTestJSON-196598729 None] snapshot_file for this snap is: volume-c5ff8f71-e843-480d-b750-871233065ceb.6a91a30c-da00-4890-9a2b-afb6d118f2e6 {{(pid=86512) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 18:29:16 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[417bf54b-e279-4299-ae59-0a7dc0d25a72]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:29:16 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-32ce2a28-adaf-45f8-9c70-8ed947d9d086 tempest-VolumesSnapshotListTestJSON-196598729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-c5ff8f71-e843-480d-b750-871233065ceb.6a91a30c-da00-4890-9a2b-afb6d118f2e6 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:29:16 devstack sudo[101198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-c5ff8f71-e843-480d-b750-871233065ceb.6a91a30c-da00-4890-9a2b-afb6d118f2e6 Sep 29 18:29:16 devstack sudo[101198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:29:16 devstack sudo[101198]: pam_unix(sudo:session): session closed for user root Sep 29 18:29:16 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-32ce2a28-adaf-45f8-9c70-8ed947d9d086 tempest-VolumesSnapshotListTestJSON-196598729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-c5ff8f71-e843-480d-b750-871233065ceb.6a91a30c-da00-4890-9a2b-afb6d118f2e6" returned: 0 in 0.406s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:29:16 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-32ce2a28-adaf-45f8-9c70-8ed947d9d086 tempest-VolumesSnapshotListTestJSON-196598729 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c5ff8f71-e843-480d-b750-871233065ceb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86512) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 18:29:16 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeba81f2-623e-45a3-b577-8fac180e8f5a]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:29:16 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-32ce2a28-adaf-45f8-9c70-8ed947d9d086 tempest-VolumesSnapshotListTestJSON-196598729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-c5ff8f71-e843-480d-b750-871233065ceb {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:29:16 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-773482a7-7f70-4daa-bf8a-0e18faf20492 tempest-VolumesSnapshotNegativeTestJSON-1251531584 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:29:16 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-773482a7-7f70-4daa-bf8a-0e18faf20492 tempest-VolumesSnapshotNegativeTestJSON-1251531584 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:29:16 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-773482a7-7f70-4daa-bf8a-0e18faf20492 tempest-VolumesSnapshotNegativeTestJSON-1251531584 None] Creating offline snapshot 8d34b410-8242-477e-88ae-8875a5492389 of volume 31ffad3c-fcfe-42a0-8b7b-c428427d4b63 {{(pid=86512) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 18:29:16 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[d323a809-6656-413f-8255-65551e3a8344]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:29:16 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-773482a7-7f70-4daa-bf8a-0e18faf20492 tempest-VolumesSnapshotNegativeTestJSON-1251531584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-31ffad3c-fcfe-42a0-8b7b-c428427d4b63 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:29:16 devstack sudo[101203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-c5ff8f71-e843-480d-b750-871233065ceb Sep 29 18:29:16 devstack sudo[101203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:29:16 devstack sudo[101204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-31ffad3c-fcfe-42a0-8b7b-c428427d4b63 Sep 29 18:29:16 devstack sudo[101204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:29:16 devstack sudo[101203]: pam_unix(sudo:session): session closed for user root Sep 29 18:29:16 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-32ce2a28-adaf-45f8-9c70-8ed947d9d086 tempest-VolumesSnapshotListTestJSON-196598729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-c5ff8f71-e843-480d-b750-871233065ceb" returned: 0 in 0.392s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:29:16 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-32ce2a28-adaf-45f8-9c70-8ed947d9d086 tempest-VolumesSnapshotListTestJSON-196598729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-c5ff8f71-e843-480d-b750-871233065ceb.6a91a30c-da00-4890-9a2b-afb6d118f2e6 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:29:16 devstack sudo[101212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-c5ff8f71-e843-480d-b750-871233065ceb.6a91a30c-da00-4890-9a2b-afb6d118f2e6 Sep 29 18:29:16 devstack sudo[101212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:29:17 devstack sudo[101204]: pam_unix(sudo:session): session closed for user root Sep 29 18:29:17 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-773482a7-7f70-4daa-bf8a-0e18faf20492 tempest-VolumesSnapshotNegativeTestJSON-1251531584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-31ffad3c-fcfe-42a0-8b7b-c428427d4b63" returned: 0 in 0.404s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:29:17 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-773482a7-7f70-4daa-bf8a-0e18faf20492 tempest-VolumesSnapshotNegativeTestJSON-1251531584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-31ffad3c-fcfe-42a0-8b7b-c428427d4b63,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-31ffad3c-fcfe-42a0-8b7b-c428427d4b63.8d34b410-8242-477e-88ae-8875a5492389 2G {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:29:17 devstack sudo[101215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-31ffad3c-fcfe-42a0-8b7b-c428427d4b63,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-31ffad3c-fcfe-42a0-8b7b-c428427d4b63.8d34b410-8242-477e-88ae-8875a5492389 2G Sep 29 18:29:17 devstack sudo[101215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:29:17 devstack sudo[101212]: pam_unix(sudo:session): session closed for user root Sep 29 18:29:17 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-32ce2a28-adaf-45f8-9c70-8ed947d9d086 tempest-VolumesSnapshotListTestJSON-196598729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-c5ff8f71-e843-480d-b750-871233065ceb.6a91a30c-da00-4890-9a2b-afb6d118f2e6" returned: 0 in 0.372s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:29:17 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-32ce2a28-adaf-45f8-9c70-8ed947d9d086 tempest-VolumesSnapshotListTestJSON-196598729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-c5ff8f71-e843-480d-b750-871233065ceb.6a91a30c-da00-4890-9a2b-afb6d118f2e6 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:29:17 devstack sudo[101223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-c5ff8f71-e843-480d-b750-871233065ceb.6a91a30c-da00-4890-9a2b-afb6d118f2e6 Sep 29 18:29:17 devstack sudo[101223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:29:17 devstack sudo[101215]: pam_unix(sudo:session): session closed for user root Sep 29 18:29:17 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-773482a7-7f70-4daa-bf8a-0e18faf20492 tempest-VolumesSnapshotNegativeTestJSON-1251531584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-31ffad3c-fcfe-42a0-8b7b-c428427d4b63,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-31ffad3c-fcfe-42a0-8b7b-c428427d4b63.8d34b410-8242-477e-88ae-8875a5492389 2G" returned: 0 in 0.478s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:29:17 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-773482a7-7f70-4daa-bf8a-0e18faf20492 tempest-VolumesSnapshotNegativeTestJSON-1251531584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31ffad3c-fcfe-42a0-8b7b-c428427d4b63 -F qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-31ffad3c-fcfe-42a0-8b7b-c428427d4b63.8d34b410-8242-477e-88ae-8875a5492389 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:29:17 devstack sudo[101226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31ffad3c-fcfe-42a0-8b7b-c428427d4b63 -F qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-31ffad3c-fcfe-42a0-8b7b-c428427d4b63.8d34b410-8242-477e-88ae-8875a5492389 Sep 29 18:29:17 devstack sudo[101226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:29:17 devstack sudo[101223]: pam_unix(sudo:session): session closed for user root Sep 29 18:29:17 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-32ce2a28-adaf-45f8-9c70-8ed947d9d086 tempest-VolumesSnapshotListTestJSON-196598729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-c5ff8f71-e843-480d-b750-871233065ceb.6a91a30c-da00-4890-9a2b-afb6d118f2e6" returned: 0 in 0.278s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:29:17 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-32ce2a28-adaf-45f8-9c70-8ed947d9d086 tempest-VolumesSnapshotListTestJSON-196598729 None] Lock "cinder-quobyte-6a91a30c-da00-4890-9a2b-afb6d118f2e6" released by "_delete_snapshot" :: held 1.598s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:29:17 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-32ce2a28-adaf-45f8-9c70-8ed947d9d086 tempest-VolumesSnapshotListTestJSON-196598729 None] Lock "cinder-quobyte-c5ff8f71-e843-480d-b750-871233065ceb" released by "delete_snapshot" :: held 1.638s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:29:17 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-32ce2a28-adaf-45f8-9c70-8ed947d9d086 tempest-VolumesSnapshotListTestJSON-196598729 None] Created reservations ['b667b9bb-0925-404d-b432-7d4a2acbe6bc', '9efda482-d456-4bf0-b8ee-c91d8b5824ff', 'ebb85dc9-95dc-4e7e-869b-eecad929f200', '0476bb39-4f5b-4dd0-9c7e-776f0fd25723'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:29:17 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-32ce2a28-adaf-45f8-9c70-8ed947d9d086 tempest-VolumesSnapshotListTestJSON-196598729 None] Delete snapshot completed successfully. Sep 29 18:29:17 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-32ce2a28-adaf-45f8-9c70-8ed947d9d086 tempest-VolumesSnapshotListTestJSON-196598729 None] Lock "cinder-6a91a30c-da00-4890-9a2b-afb6d118f2e6-delete_snapshot" released by "delete_snapshot" :: held 1.793s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:29:17 devstack sudo[101226]: pam_unix(sudo:session): session closed for user root Sep 29 18:29:17 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-773482a7-7f70-4daa-bf8a-0e18faf20492 tempest-VolumesSnapshotNegativeTestJSON-1251531584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31ffad3c-fcfe-42a0-8b7b-c428427d4b63 -F qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-31ffad3c-fcfe-42a0-8b7b-c428427d4b63.8d34b410-8242-477e-88ae-8875a5492389" returned: 0 in 0.332s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:29:17 devstack cinder-volume[86512]: WARNING cinder.volume.drivers.remotefs [None req-773482a7-7f70-4daa-bf8a-0e18faf20492 tempest-VolumesSnapshotNegativeTestJSON-1251531584 None] /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-31ffad3c-fcfe-42a0-8b7b-c428427d4b63.8d34b410-8242-477e-88ae-8875a5492389 is being set with open permissions: ugo+rw Sep 29 18:29:17 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-773482a7-7f70-4daa-bf8a-0e18faf20492 tempest-VolumesSnapshotNegativeTestJSON-1251531584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-31ffad3c-fcfe-42a0-8b7b-c428427d4b63.8d34b410-8242-477e-88ae-8875a5492389 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:29:17 devstack sudo[101232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-31ffad3c-fcfe-42a0-8b7b-c428427d4b63.8d34b410-8242-477e-88ae-8875a5492389 Sep 29 18:29:17 devstack sudo[101232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:29:18 devstack sudo[101232]: pam_unix(sudo:session): session closed for user root Sep 29 18:29:18 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-773482a7-7f70-4daa-bf8a-0e18faf20492 tempest-VolumesSnapshotNegativeTestJSON-1251531584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-31ffad3c-fcfe-42a0-8b7b-c428427d4b63.8d34b410-8242-477e-88ae-8875a5492389" returned: 0 in 0.241s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:29:18 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-773482a7-7f70-4daa-bf8a-0e18faf20492 tempest-VolumesSnapshotNegativeTestJSON-1251531584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-31ffad3c-fcfe-42a0-8b7b-c428427d4b63.info {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:29:18 devstack sudo[101235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-31ffad3c-fcfe-42a0-8b7b-c428427d4b63.info Sep 29 18:29:18 devstack sudo[101235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:29:18 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-b53ede20-15ee-4f67-90d5-fb7104ffb62a tempest-VolumesSnapshotListTestJSON-196598729 None] Acquiring lock "cinder-c5ff8f71-e843-480d-b750-871233065ceb-delete_volume" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:29:18 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-b53ede20-15ee-4f67-90d5-fb7104ffb62a tempest-VolumesSnapshotListTestJSON-196598729 None] Lock "cinder-c5ff8f71-e843-480d-b750-871233065ceb-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:29:18 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-b53ede20-15ee-4f67-90d5-fb7104ffb62a tempest-VolumesSnapshotListTestJSON-196598729 None] Acquiring lock "cinder-quobyte-c5ff8f71-e843-480d-b750-871233065ceb" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:29:18 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-b53ede20-15ee-4f67-90d5-fb7104ffb62a tempest-VolumesSnapshotListTestJSON-196598729 None] Lock "cinder-quobyte-c5ff8f71-e843-480d-b750-871233065ceb" acquired by "delete_volume" :: waited 0.015s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:29:18 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[46feca10-673b-4baa-a778-2ab623536a21]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:29:18 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-b53ede20-15ee-4f67-90d5-fb7104ffb62a tempest-VolumesSnapshotListTestJSON-196598729 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-c5ff8f71-e843-480d-b750-871233065ceb {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:29:18 devstack sudo[101235]: pam_unix(sudo:session): session closed for user root Sep 29 18:29:18 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-773482a7-7f70-4daa-bf8a-0e18faf20492 tempest-VolumesSnapshotNegativeTestJSON-1251531584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-31ffad3c-fcfe-42a0-8b7b-c428427d4b63.info" returned: 0 in 0.319s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:29:18 devstack cinder-volume[86512]: WARNING cinder.volume.drivers.remotefs [None req-773482a7-7f70-4daa-bf8a-0e18faf20492 tempest-VolumesSnapshotNegativeTestJSON-1251531584 None] /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-31ffad3c-fcfe-42a0-8b7b-c428427d4b63.info is being set with open permissions: ugo+rw Sep 29 18:29:18 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-773482a7-7f70-4daa-bf8a-0e18faf20492 tempest-VolumesSnapshotNegativeTestJSON-1251531584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-31ffad3c-fcfe-42a0-8b7b-c428427d4b63.info {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:29:18 devstack sudo[101239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-31ffad3c-fcfe-42a0-8b7b-c428427d4b63.info Sep 29 18:29:18 devstack sudo[101239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:29:18 devstack sudo[101238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-c5ff8f71-e843-480d-b750-871233065ceb Sep 29 18:29:18 devstack sudo[101238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:29:18 devstack sudo[101239]: pam_unix(sudo:session): session closed for user root Sep 29 18:29:18 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-773482a7-7f70-4daa-bf8a-0e18faf20492 tempest-VolumesSnapshotNegativeTestJSON-1251531584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-31ffad3c-fcfe-42a0-8b7b-c428427d4b63.info" returned: 0 in 0.269s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:29:18 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-773482a7-7f70-4daa-bf8a-0e18faf20492 tempest-VolumesSnapshotNegativeTestJSON-1251531584 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.160s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:29:18 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-773482a7-7f70-4daa-bf8a-0e18faf20492 tempest-VolumesSnapshotNegativeTestJSON-1251531584 None] Create snapshot completed successfully Sep 29 18:29:18 devstack sudo[101238]: pam_unix(sudo:session): session closed for user root Sep 29 18:29:18 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-b53ede20-15ee-4f67-90d5-fb7104ffb62a tempest-VolumesSnapshotListTestJSON-196598729 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-c5ff8f71-e843-480d-b750-871233065ceb" returned: 0 in 0.392s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:29:18 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-b53ede20-15ee-4f67-90d5-fb7104ffb62a tempest-VolumesSnapshotListTestJSON-196598729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-c5ff8f71-e843-480d-b750-871233065ceb {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:29:18 devstack sudo[101246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-c5ff8f71-e843-480d-b750-871233065ceb Sep 29 18:29:18 devstack sudo[101246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:29:19 devstack sudo[101246]: pam_unix(sudo:session): session closed for user root Sep 29 18:29:19 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-b53ede20-15ee-4f67-90d5-fb7104ffb62a tempest-VolumesSnapshotListTestJSON-196598729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-c5ff8f71-e843-480d-b750-871233065ceb" returned: 0 in 0.248s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:29:19 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-b53ede20-15ee-4f67-90d5-fb7104ffb62a tempest-VolumesSnapshotListTestJSON-196598729 None] Lock "cinder-quobyte-c5ff8f71-e843-480d-b750-871233065ceb" released by "delete_volume" :: held 0.712s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:29:19 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-b53ede20-15ee-4f67-90d5-fb7104ffb62a tempest-VolumesSnapshotListTestJSON-196598729 None] Created reservations ['988ba563-ab39-488a-9839-9e0cae953484', '132f8930-6a05-44d0-87dd-d9c598c83db8', '86a7e149-3ffd-4b62-861a-b76293fed5e4', '2ab30838-e47f-406c-bfa2-1d64a2d49170'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:29:19 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-b53ede20-15ee-4f67-90d5-fb7104ffb62a tempest-VolumesSnapshotListTestJSON-196598729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:29:19 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-b53ede20-15ee-4f67-90d5-fb7104ffb62a tempest-VolumesSnapshotListTestJSON-196598729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:29:19 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-b53ede20-15ee-4f67-90d5-fb7104ffb62a tempest-VolumesSnapshotListTestJSON-196598729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:29:19 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-b53ede20-15ee-4f67-90d5-fb7104ffb62a tempest-VolumesSnapshotListTestJSON-196598729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:29:19 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-b53ede20-15ee-4f67-90d5-fb7104ffb62a tempest-VolumesSnapshotListTestJSON-196598729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:29:19 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-b53ede20-15ee-4f67-90d5-fb7104ffb62a tempest-VolumesSnapshotListTestJSON-196598729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:29:19 devstack sudo[101249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:29:19 devstack sudo[101249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:29:19 devstack sudo[101249]: pam_unix(sudo:session): session closed for user root Sep 29 18:29:19 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-b53ede20-15ee-4f67-90d5-fb7104ffb62a tempest-VolumesSnapshotListTestJSON-196598729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.300s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:29:19 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-b53ede20-15ee-4f67-90d5-fb7104ffb62a tempest-VolumesSnapshotListTestJSON-196598729 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:29:19 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-b53ede20-15ee-4f67-90d5-fb7104ffb62a tempest-VolumesSnapshotListTestJSON-196598729 None] Deleted volume successfully. Sep 29 18:29:19 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-b53ede20-15ee-4f67-90d5-fb7104ffb62a tempest-VolumesSnapshotListTestJSON-196598729 None] Lock "cinder-c5ff8f71-e843-480d-b750-871233065ceb-delete_volume" released by "delete_volume" :: held 1.236s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:29:19 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-2d87c309-ebaf-48ed-a538-04b9141ee560 tempest-VolumesSnapshotNegativeTestJSON-1251531584 None] Acquiring lock "cinder-8d34b410-8242-477e-88ae-8875a5492389-delete_snapshot" by "delete_snapshot" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:29:19 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-2d87c309-ebaf-48ed-a538-04b9141ee560 tempest-VolumesSnapshotNegativeTestJSON-1251531584 None] Lock "cinder-8d34b410-8242-477e-88ae-8875a5492389-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:29:19 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-2d87c309-ebaf-48ed-a538-04b9141ee560 tempest-VolumesSnapshotNegativeTestJSON-1251531584 None] Acquiring lock "cinder-quobyte-31ffad3c-fcfe-42a0-8b7b-c428427d4b63" by "delete_snapshot" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:29:19 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-2d87c309-ebaf-48ed-a538-04b9141ee560 tempest-VolumesSnapshotNegativeTestJSON-1251531584 None] Lock "cinder-quobyte-31ffad3c-fcfe-42a0-8b7b-c428427d4b63" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:29:19 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-2d87c309-ebaf-48ed-a538-04b9141ee560 tempest-VolumesSnapshotNegativeTestJSON-1251531584 None] Acquiring lock "cinder-quobyte-8d34b410-8242-477e-88ae-8875a5492389" by "_delete_snapshot" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:29:19 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-2d87c309-ebaf-48ed-a538-04b9141ee560 tempest-VolumesSnapshotNegativeTestJSON-1251531584 None] Lock "cinder-quobyte-8d34b410-8242-477e-88ae-8875a5492389" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:29:19 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-2d87c309-ebaf-48ed-a538-04b9141ee560 tempest-VolumesSnapshotNegativeTestJSON-1251531584 None] Deleting offline snapshot 8d34b410-8242-477e-88ae-8875a5492389 of volume 31ffad3c-fcfe-42a0-8b7b-c428427d4b63 {{(pid=86512) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 18:29:19 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-2d87c309-ebaf-48ed-a538-04b9141ee560 tempest-VolumesSnapshotNegativeTestJSON-1251531584 None] snapshot_file for this snap is: volume-31ffad3c-fcfe-42a0-8b7b-c428427d4b63.8d34b410-8242-477e-88ae-8875a5492389 {{(pid=86512) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 18:29:19 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[a304dc74-91d9-4c14-acb1-241102520850]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:29:19 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-2d87c309-ebaf-48ed-a538-04b9141ee560 tempest-VolumesSnapshotNegativeTestJSON-1251531584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-31ffad3c-fcfe-42a0-8b7b-c428427d4b63.8d34b410-8242-477e-88ae-8875a5492389 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:29:19 devstack sudo[101252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-31ffad3c-fcfe-42a0-8b7b-c428427d4b63.8d34b410-8242-477e-88ae-8875a5492389 Sep 29 18:29:19 devstack sudo[101252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:29:20 devstack sudo[101252]: pam_unix(sudo:session): session closed for user root Sep 29 18:29:20 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-2d87c309-ebaf-48ed-a538-04b9141ee560 tempest-VolumesSnapshotNegativeTestJSON-1251531584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-31ffad3c-fcfe-42a0-8b7b-c428427d4b63.8d34b410-8242-477e-88ae-8875a5492389" returned: 0 in 0.382s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:29:20 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-2d87c309-ebaf-48ed-a538-04b9141ee560 tempest-VolumesSnapshotNegativeTestJSON-1251531584 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-31ffad3c-fcfe-42a0-8b7b-c428427d4b63(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86512) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 18:29:20 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bf8b54d-67b3-4788-86f7-40c72cf7aa30]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:29:20 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-2d87c309-ebaf-48ed-a538-04b9141ee560 tempest-VolumesSnapshotNegativeTestJSON-1251531584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-31ffad3c-fcfe-42a0-8b7b-c428427d4b63 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:29:20 devstack sudo[101257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-31ffad3c-fcfe-42a0-8b7b-c428427d4b63 Sep 29 18:29:20 devstack sudo[101257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:29:20 devstack sudo[101257]: pam_unix(sudo:session): session closed for user root Sep 29 18:29:20 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-2d87c309-ebaf-48ed-a538-04b9141ee560 tempest-VolumesSnapshotNegativeTestJSON-1251531584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-31ffad3c-fcfe-42a0-8b7b-c428427d4b63" returned: 0 in 0.416s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:29:20 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-2d87c309-ebaf-48ed-a538-04b9141ee560 tempest-VolumesSnapshotNegativeTestJSON-1251531584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-31ffad3c-fcfe-42a0-8b7b-c428427d4b63.8d34b410-8242-477e-88ae-8875a5492389 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:29:20 devstack sudo[101263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-31ffad3c-fcfe-42a0-8b7b-c428427d4b63.8d34b410-8242-477e-88ae-8875a5492389 Sep 29 18:29:20 devstack sudo[101263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:29:21 devstack sudo[101263]: pam_unix(sudo:session): session closed for user root Sep 29 18:29:21 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-2d87c309-ebaf-48ed-a538-04b9141ee560 tempest-VolumesSnapshotNegativeTestJSON-1251531584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-31ffad3c-fcfe-42a0-8b7b-c428427d4b63.8d34b410-8242-477e-88ae-8875a5492389" returned: 0 in 0.447s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:29:21 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-2d87c309-ebaf-48ed-a538-04b9141ee560 tempest-VolumesSnapshotNegativeTestJSON-1251531584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-31ffad3c-fcfe-42a0-8b7b-c428427d4b63.8d34b410-8242-477e-88ae-8875a5492389 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:29:21 devstack sudo[101268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-31ffad3c-fcfe-42a0-8b7b-c428427d4b63.8d34b410-8242-477e-88ae-8875a5492389 Sep 29 18:29:21 devstack sudo[101268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:29:21 devstack sudo[101268]: pam_unix(sudo:session): session closed for user root Sep 29 18:29:21 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-2d87c309-ebaf-48ed-a538-04b9141ee560 tempest-VolumesSnapshotNegativeTestJSON-1251531584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-31ffad3c-fcfe-42a0-8b7b-c428427d4b63.8d34b410-8242-477e-88ae-8875a5492389" returned: 0 in 0.254s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:29:21 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-2d87c309-ebaf-48ed-a538-04b9141ee560 tempest-VolumesSnapshotNegativeTestJSON-1251531584 None] Lock "cinder-quobyte-8d34b410-8242-477e-88ae-8875a5492389" released by "_delete_snapshot" :: held 1.634s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:29:21 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-2d87c309-ebaf-48ed-a538-04b9141ee560 tempest-VolumesSnapshotNegativeTestJSON-1251531584 None] Lock "cinder-quobyte-31ffad3c-fcfe-42a0-8b7b-c428427d4b63" released by "delete_snapshot" :: held 1.669s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:29:21 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-2d87c309-ebaf-48ed-a538-04b9141ee560 tempest-VolumesSnapshotNegativeTestJSON-1251531584 None] Created reservations ['70516797-2c41-48eb-b2c2-ae57a0227bec', '14721052-21b9-419d-9011-eb14e62d8c7e', '52340069-57fb-4e17-9852-b51cac9f87e6', '493dce63-6824-4a32-87f4-831cd8a48faf'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:29:21 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-2d87c309-ebaf-48ed-a538-04b9141ee560 tempest-VolumesSnapshotNegativeTestJSON-1251531584 None] Delete snapshot completed successfully. Sep 29 18:29:21 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-2d87c309-ebaf-48ed-a538-04b9141ee560 tempest-VolumesSnapshotNegativeTestJSON-1251531584 None] Lock "cinder-8d34b410-8242-477e-88ae-8875a5492389-delete_snapshot" released by "delete_snapshot" :: held 1.862s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:29:21 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-4febaa68-3382-4aef-a0b4-650be9906e96 tempest-VolumesSnapshotNegativeTestJSON-1251531584 None] Acquiring lock "cinder-31ffad3c-fcfe-42a0-8b7b-c428427d4b63-delete_volume" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:29:21 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-4febaa68-3382-4aef-a0b4-650be9906e96 tempest-VolumesSnapshotNegativeTestJSON-1251531584 None] Lock "cinder-31ffad3c-fcfe-42a0-8b7b-c428427d4b63-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:29:22 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-4febaa68-3382-4aef-a0b4-650be9906e96 tempest-VolumesSnapshotNegativeTestJSON-1251531584 None] Acquiring lock "cinder-quobyte-31ffad3c-fcfe-42a0-8b7b-c428427d4b63" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:29:22 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-4febaa68-3382-4aef-a0b4-650be9906e96 tempest-VolumesSnapshotNegativeTestJSON-1251531584 None] Lock "cinder-quobyte-31ffad3c-fcfe-42a0-8b7b-c428427d4b63" acquired by "delete_volume" :: waited 0.015s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:29:22 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[afdd30a4-f749-428d-a731-bd973a8f2b01]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:29:22 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-4febaa68-3382-4aef-a0b4-650be9906e96 tempest-VolumesSnapshotNegativeTestJSON-1251531584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-31ffad3c-fcfe-42a0-8b7b-c428427d4b63 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:29:22 devstack sudo[101272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-31ffad3c-fcfe-42a0-8b7b-c428427d4b63 Sep 29 18:29:22 devstack sudo[101272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:29:22 devstack sudo[101272]: pam_unix(sudo:session): session closed for user root Sep 29 18:29:22 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-4febaa68-3382-4aef-a0b4-650be9906e96 tempest-VolumesSnapshotNegativeTestJSON-1251531584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-31ffad3c-fcfe-42a0-8b7b-c428427d4b63" returned: 0 in 0.377s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:29:22 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-4febaa68-3382-4aef-a0b4-650be9906e96 tempest-VolumesSnapshotNegativeTestJSON-1251531584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-31ffad3c-fcfe-42a0-8b7b-c428427d4b63 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:29:22 devstack sudo[101277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-31ffad3c-fcfe-42a0-8b7b-c428427d4b63 Sep 29 18:29:22 devstack sudo[101277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:29:22 devstack sudo[101277]: pam_unix(sudo:session): session closed for user root Sep 29 18:29:22 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-4febaa68-3382-4aef-a0b4-650be9906e96 tempest-VolumesSnapshotNegativeTestJSON-1251531584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-31ffad3c-fcfe-42a0-8b7b-c428427d4b63" returned: 0 in 0.295s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:29:22 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-4febaa68-3382-4aef-a0b4-650be9906e96 tempest-VolumesSnapshotNegativeTestJSON-1251531584 None] Lock "cinder-quobyte-31ffad3c-fcfe-42a0-8b7b-c428427d4b63" released by "delete_volume" :: held 0.752s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:29:22 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-4febaa68-3382-4aef-a0b4-650be9906e96 tempest-VolumesSnapshotNegativeTestJSON-1251531584 None] Created reservations ['9f7019f0-1f75-43d4-8956-2583c0822fc3', '37d9a011-f532-4de7-9c28-0796891eeb2c', '685b6dca-d50f-44de-8989-7a8f749d393b', 'fc703b16-a4cd-4ca9-af32-0a50421f7d6b'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:29:22 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-4febaa68-3382-4aef-a0b4-650be9906e96 tempest-VolumesSnapshotNegativeTestJSON-1251531584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:29:22 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-4febaa68-3382-4aef-a0b4-650be9906e96 tempest-VolumesSnapshotNegativeTestJSON-1251531584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:29:22 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-4febaa68-3382-4aef-a0b4-650be9906e96 tempest-VolumesSnapshotNegativeTestJSON-1251531584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:29:22 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-4febaa68-3382-4aef-a0b4-650be9906e96 tempest-VolumesSnapshotNegativeTestJSON-1251531584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:29:22 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-4febaa68-3382-4aef-a0b4-650be9906e96 tempest-VolumesSnapshotNegativeTestJSON-1251531584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:29:22 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-4febaa68-3382-4aef-a0b4-650be9906e96 tempest-VolumesSnapshotNegativeTestJSON-1251531584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:29:22 devstack sudo[101280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:29:22 devstack sudo[101280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:29:23 devstack sudo[101280]: pam_unix(sudo:session): session closed for user root Sep 29 18:29:23 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-4febaa68-3382-4aef-a0b4-650be9906e96 tempest-VolumesSnapshotNegativeTestJSON-1251531584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.305s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:29:23 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-4febaa68-3382-4aef-a0b4-650be9906e96 tempest-VolumesSnapshotNegativeTestJSON-1251531584 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:29:23 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-4febaa68-3382-4aef-a0b4-650be9906e96 tempest-VolumesSnapshotNegativeTestJSON-1251531584 None] Deleted volume successfully. Sep 29 18:29:23 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-4febaa68-3382-4aef-a0b4-650be9906e96 tempest-VolumesSnapshotNegativeTestJSON-1251531584 None] Lock "cinder-31ffad3c-fcfe-42a0-8b7b-c428427d4b63-delete_volume" released by "delete_volume" :: held 1.291s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:29:32 devstack cinder-volume[86512]: DEBUG dbcounter [-] [86512] Writing DB stats cinder:DELETE=3,cinder:SELECT=53,cinder:INSERT=17,cinder:UPDATE=57 {{(pid=86512) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 18:29:33 devstack cinder-volume[86512]: DEBUG dbcounter [-] [86512] Writing DB stats cinder:SELECT=39,cinder:INSERT=17,cinder:UPDATE=55,cinder:DELETE=3 {{(pid=86512) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 18:29:44 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-179f22b3-539f-4ddd-9c74-1c8ff8c487f6 tempest-VolumeQuotasNegativeTestJSON-834484795 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86512) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:29:44 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-179f22b3-539f-4ddd-9c74-1c8ff8c487f6 tempest-VolumeQuotasNegativeTestJSON-834484795 None] Flow 'volume_create_manager' (8b158362-3269-46dd-bc54-181c52f11e07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:29:44 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-179f22b3-539f-4ddd-9c74-1c8ff8c487f6 tempest-VolumeQuotasNegativeTestJSON-834484795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7949614d-6215-4cd9-9381-185c200e52e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:29:44 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-179f22b3-539f-4ddd-9c74-1c8ff8c487f6 tempest-VolumeQuotasNegativeTestJSON-834484795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7949614d-6215-4cd9-9381-185c200e52e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:29:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1607411160',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5899cf2-666d-4861-a7f8-8cd66b35a712,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c21dfee19cec48f5b8229b3a9b94b4fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:29:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:29:44Z,use_quota=True,user_id='feeb2746e991473f84898cbd986233aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:29:44 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-179f22b3-539f-4ddd-9c74-1c8ff8c487f6 tempest-VolumeQuotasNegativeTestJSON-834484795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (431ad0c4-fc0d-4036-b768-b3190e4b9dc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:29:44 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-179f22b3-539f-4ddd-9c74-1c8ff8c487f6 tempest-VolumeQuotasNegativeTestJSON-834484795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (431ad0c4-fc0d-4036-b768-b3190e4b9dc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:29:44 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-179f22b3-539f-4ddd-9c74-1c8ff8c487f6 tempest-VolumeQuotasNegativeTestJSON-834484795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db5212e8-771f-45e9-8834-525ceeff7533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:29:44 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-179f22b3-539f-4ddd-9c74-1c8ff8c487f6 tempest-VolumeQuotasNegativeTestJSON-834484795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db5212e8-771f-45e9-8834-525ceeff7533) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5899cf2-666d-4861-a7f8-8cd66b35a712', 'volume_name': 'volume-c5899cf2-666d-4861-a7f8-8cd66b35a712', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:29:44 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-179f22b3-539f-4ddd-9c74-1c8ff8c487f6 tempest-VolumeQuotasNegativeTestJSON-834484795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (836813c3-cdcc-46d9-be05-f3d36e90498d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:29:44 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-179f22b3-539f-4ddd-9c74-1c8ff8c487f6 tempest-VolumeQuotasNegativeTestJSON-834484795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (836813c3-cdcc-46d9-be05-f3d36e90498d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:29:44 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-179f22b3-539f-4ddd-9c74-1c8ff8c487f6 tempest-VolumeQuotasNegativeTestJSON-834484795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6beb880c-1805-47e8-b41d-59f6493929e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:29:44 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-179f22b3-539f-4ddd-9c74-1c8ff8c487f6 tempest-VolumeQuotasNegativeTestJSON-834484795 None] Volume c5899cf2-666d-4861-a7f8-8cd66b35a712: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5899cf2-666d-4861-a7f8-8cd66b35a712', 'volume_size': 1} Sep 29 18:29:44 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-179f22b3-539f-4ddd-9c74-1c8ff8c487f6 tempest-VolumeQuotasNegativeTestJSON-834484795 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:29:44 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-179f22b3-539f-4ddd-9c74-1c8ff8c487f6 tempest-VolumeQuotasNegativeTestJSON-834484795 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:29:44 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-179f22b3-539f-4ddd-9c74-1c8ff8c487f6 tempest-VolumeQuotasNegativeTestJSON-834484795 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:29:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1607411160',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5899cf2-666d-4861-a7f8-8cd66b35a712,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c21dfee19cec48f5b8229b3a9b94b4fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:29:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:29:44Z,use_quota=True,user_id='feeb2746e991473f84898cbd986233aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)}" {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:29:44 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-179f22b3-539f-4ddd-9c74-1c8ff8c487f6 tempest-VolumeQuotasNegativeTestJSON-834484795 None] Creating volume c5899cf2-666d-4861-a7f8-8cd66b35a712 {{(pid=86512) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:29:44 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-179f22b3-539f-4ddd-9c74-1c8ff8c487f6 tempest-VolumeQuotasNegativeTestJSON-834484795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:29:44 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-179f22b3-539f-4ddd-9c74-1c8ff8c487f6 tempest-VolumeQuotasNegativeTestJSON-834484795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:29:44 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-179f22b3-539f-4ddd-9c74-1c8ff8c487f6 tempest-VolumeQuotasNegativeTestJSON-834484795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:29:44 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-179f22b3-539f-4ddd-9c74-1c8ff8c487f6 tempest-VolumeQuotasNegativeTestJSON-834484795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:29:44 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-179f22b3-539f-4ddd-9c74-1c8ff8c487f6 tempest-VolumeQuotasNegativeTestJSON-834484795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:29:44 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-179f22b3-539f-4ddd-9c74-1c8ff8c487f6 tempest-VolumeQuotasNegativeTestJSON-834484795 None] Selected osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 as target Quobyte volume. {{(pid=86512) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:29:44 devstack cinder-volume[86512]: INFO cinder.volume.drivers.remotefs [None req-179f22b3-539f-4ddd-9c74-1c8ff8c487f6 tempest-VolumeQuotasNegativeTestJSON-834484795 None] casted to osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 Sep 29 18:29:44 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-179f22b3-539f-4ddd-9c74-1c8ff8c487f6 tempest-VolumeQuotasNegativeTestJSON-834484795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-c5899cf2-666d-4861-a7f8-8cd66b35a712 1073741824 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:29:44 devstack sudo[101300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-c5899cf2-666d-4861-a7f8-8cd66b35a712 1073741824 Sep 29 18:29:44 devstack sudo[101300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:29:45 devstack sudo[101300]: pam_unix(sudo:session): session closed for user root Sep 29 18:29:45 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-179f22b3-539f-4ddd-9c74-1c8ff8c487f6 tempest-VolumeQuotasNegativeTestJSON-834484795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-c5899cf2-666d-4861-a7f8-8cd66b35a712 1073741824" returned: 0 in 0.687s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:29:45 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-179f22b3-539f-4ddd-9c74-1c8ff8c487f6 tempest-VolumeQuotasNegativeTestJSON-834484795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-c5899cf2-666d-4861-a7f8-8cd66b35a712 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:29:45 devstack sudo[101331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-c5899cf2-666d-4861-a7f8-8cd66b35a712 Sep 29 18:29:45 devstack sudo[101331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:29:45 devstack sudo[101331]: pam_unix(sudo:session): session closed for user root Sep 29 18:29:45 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-179f22b3-539f-4ddd-9c74-1c8ff8c487f6 tempest-VolumeQuotasNegativeTestJSON-834484795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-c5899cf2-666d-4861-a7f8-8cd66b35a712" returned: 0 in 0.297s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:29:45 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-179f22b3-539f-4ddd-9c74-1c8ff8c487f6 tempest-VolumeQuotasNegativeTestJSON-834484795 None] <== create_volume: return (1039ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'} {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:29:45 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-179f22b3-539f-4ddd-9c74-1c8ff8c487f6 tempest-VolumeQuotasNegativeTestJSON-834484795 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.042s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:29:45 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-179f22b3-539f-4ddd-9c74-1c8ff8c487f6 tempest-VolumeQuotasNegativeTestJSON-834484795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6beb880c-1805-47e8-b41d-59f6493929e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5899cf2-666d-4861-a7f8-8cd66b35a712', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:29:45 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-179f22b3-539f-4ddd-9c74-1c8ff8c487f6 tempest-VolumeQuotasNegativeTestJSON-834484795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95bc1192-d2b6-4bbf-afb3-a44e881b81f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:29:45 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-179f22b3-539f-4ddd-9c74-1c8ff8c487f6 tempest-VolumeQuotasNegativeTestJSON-834484795 None] Volume volume-c5899cf2-666d-4861-a7f8-8cd66b35a712 (c5899cf2-666d-4861-a7f8-8cd66b35a712): created successfully Sep 29 18:29:45 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-179f22b3-539f-4ddd-9c74-1c8ff8c487f6 tempest-VolumeQuotasNegativeTestJSON-834484795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95bc1192-d2b6-4bbf-afb3-a44e881b81f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:29:45 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-179f22b3-539f-4ddd-9c74-1c8ff8c487f6 tempest-VolumeQuotasNegativeTestJSON-834484795 None] Flow 'volume_create_manager' (8b158362-3269-46dd-bc54-181c52f11e07) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:29:45 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-179f22b3-539f-4ddd-9c74-1c8ff8c487f6 tempest-VolumeQuotasNegativeTestJSON-834484795 None] Created volume successfully. Sep 29 18:29:47 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-e96693b1-e4c8-49e4-9e9b-22a18b802506 tempest-VolumeQuotasNegativeTestJSON-834484795 None] Acquiring lock "cinder-c5899cf2-666d-4861-a7f8-8cd66b35a712-delete_volume" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:29:47 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-e96693b1-e4c8-49e4-9e9b-22a18b802506 tempest-VolumeQuotasNegativeTestJSON-834484795 None] Lock "cinder-c5899cf2-666d-4861-a7f8-8cd66b35a712-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:29:47 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-e96693b1-e4c8-49e4-9e9b-22a18b802506 tempest-VolumeQuotasNegativeTestJSON-834484795 None] Acquiring lock "cinder-quobyte-c5899cf2-666d-4861-a7f8-8cd66b35a712" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:29:47 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-e96693b1-e4c8-49e4-9e9b-22a18b802506 tempest-VolumeQuotasNegativeTestJSON-834484795 None] Lock "cinder-quobyte-c5899cf2-666d-4861-a7f8-8cd66b35a712" acquired by "delete_volume" :: waited 0.021s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:29:47 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[7380bdf6-92bc-42ad-9996-f84d867b480e]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:29:47 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-e96693b1-e4c8-49e4-9e9b-22a18b802506 tempest-VolumeQuotasNegativeTestJSON-834484795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-c5899cf2-666d-4861-a7f8-8cd66b35a712 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:29:47 devstack sudo[101335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-c5899cf2-666d-4861-a7f8-8cd66b35a712 Sep 29 18:29:47 devstack sudo[101335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:29:48 devstack sudo[101335]: pam_unix(sudo:session): session closed for user root Sep 29 18:29:48 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-e96693b1-e4c8-49e4-9e9b-22a18b802506 tempest-VolumeQuotasNegativeTestJSON-834484795 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-c5899cf2-666d-4861-a7f8-8cd66b35a712" returned: 0 in 0.398s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:29:48 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-e96693b1-e4c8-49e4-9e9b-22a18b802506 tempest-VolumeQuotasNegativeTestJSON-834484795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-c5899cf2-666d-4861-a7f8-8cd66b35a712 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:29:48 devstack sudo[101340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-c5899cf2-666d-4861-a7f8-8cd66b35a712 Sep 29 18:29:48 devstack sudo[101340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:29:48 devstack sudo[101340]: pam_unix(sudo:session): session closed for user root Sep 29 18:29:48 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-e96693b1-e4c8-49e4-9e9b-22a18b802506 tempest-VolumeQuotasNegativeTestJSON-834484795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-c5899cf2-666d-4861-a7f8-8cd66b35a712" returned: 0 in 0.263s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:29:48 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-e96693b1-e4c8-49e4-9e9b-22a18b802506 tempest-VolumeQuotasNegativeTestJSON-834484795 None] Lock "cinder-quobyte-c5899cf2-666d-4861-a7f8-8cd66b35a712" released by "delete_volume" :: held 0.718s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:29:48 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-e96693b1-e4c8-49e4-9e9b-22a18b802506 tempest-VolumeQuotasNegativeTestJSON-834484795 None] Created reservations ['e1389e14-cd43-47e2-8c3a-cff3aefcf539', 'e1f759aa-65b9-435e-877a-62defe656888', 'b36de202-af81-4dd7-9fdc-caf8e25d363d', 'a8a5d8fc-1f90-4e22-bb7e-36209bc3d09a'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:29:48 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-e96693b1-e4c8-49e4-9e9b-22a18b802506 tempest-VolumeQuotasNegativeTestJSON-834484795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:29:48 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-e96693b1-e4c8-49e4-9e9b-22a18b802506 tempest-VolumeQuotasNegativeTestJSON-834484795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:29:48 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-e96693b1-e4c8-49e4-9e9b-22a18b802506 tempest-VolumeQuotasNegativeTestJSON-834484795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:29:48 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-e96693b1-e4c8-49e4-9e9b-22a18b802506 tempest-VolumeQuotasNegativeTestJSON-834484795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:29:48 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-e96693b1-e4c8-49e4-9e9b-22a18b802506 tempest-VolumeQuotasNegativeTestJSON-834484795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:29:48 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-e96693b1-e4c8-49e4-9e9b-22a18b802506 tempest-VolumeQuotasNegativeTestJSON-834484795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:29:48 devstack sudo[101343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:29:48 devstack sudo[101343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:29:48 devstack sudo[101343]: pam_unix(sudo:session): session closed for user root Sep 29 18:29:48 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-e96693b1-e4c8-49e4-9e9b-22a18b802506 tempest-VolumeQuotasNegativeTestJSON-834484795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.313s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:29:48 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-e96693b1-e4c8-49e4-9e9b-22a18b802506 tempest-VolumeQuotasNegativeTestJSON-834484795 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:29:48 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-e96693b1-e4c8-49e4-9e9b-22a18b802506 tempest-VolumeQuotasNegativeTestJSON-834484795 None] Deleted volume successfully. Sep 29 18:29:48 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-e96693b1-e4c8-49e4-9e9b-22a18b802506 tempest-VolumeQuotasNegativeTestJSON-834484795 None] Lock "cinder-c5899cf2-666d-4861-a7f8-8cd66b35a712-delete_volume" released by "delete_volume" :: held 1.309s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:29:50 devstack cinder-volume[86512]: DEBUG oslo_service.periodic_task [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86512) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 18:29:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:29:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:29:50 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:29:50 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:29:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:29:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:29:50 devstack sudo[101349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:29:50 devstack sudo[101349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:29:51 devstack sudo[101349]: pam_unix(sudo:session): session closed for user root Sep 29 18:29:51 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.415s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:29:51 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:29:51 devstack cinder-volume[86512]: DEBUG oslo_service.periodic_task [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Running periodic task VolumeManager._thread_info {{(pid=86512) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 18:29:51 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] thread count: 29 {{(pid=86512) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 29 18:29:51 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] thread info: [<_MainThread(MainThread, started 135593654804608)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86512) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 29 18:29:58 devstack cinder-volume[86512]: DEBUG dbcounter [-] [86512] Writing DB stats cinder:SELECT=8,cinder:UPDATE=9,cinder:INSERT=4,cinder:DELETE=1 {{(pid=86512) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 18:29:58 devstack cinder-volume[86512]: DEBUG dbcounter [-] [86512] Writing DB stats cinder:UPDATE=13,cinder:SELECT=6,cinder:INSERT=1,cinder:DELETE=1 {{(pid=86512) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 18:30:03 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-5420f38e-4623-495a-b548-3cf86cea1168 tempest-TestInstancesWithCinderVolumes-816149194 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86512) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:30:03 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-5420f38e-4623-495a-b548-3cf86cea1168 tempest-TestInstancesWithCinderVolumes-816149194 None] Flow 'volume_create_manager' (e06a3eec-1b8d-4859-80f6-7ad999bb6d8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:30:03 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-5420f38e-4623-495a-b548-3cf86cea1168 tempest-TestInstancesWithCinderVolumes-816149194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32ee999f-b9c1-40a6-a75a-4795d7296571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:30:03 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-5420f38e-4623-495a-b548-3cf86cea1168 tempest-TestInstancesWithCinderVolumes-816149194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32ee999f-b9c1-40a6-a75a-4795d7296571) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:30:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-279301856',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=159b774d-834f-491a-8b11-2aad8a4f106d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='260563d088f94f15ba57c6db3a36aced',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:30:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:30:03Z,use_quota=True,user_id='b54cea09782c4524b3e4691172104075',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84d77fc3-9c10-42eb-811d-fab9e5cfe433),volume_type_id=84d77fc3-9c10-42eb-811d-fab9e5cfe433)' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:30:03 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-5420f38e-4623-495a-b548-3cf86cea1168 tempest-TestInstancesWithCinderVolumes-816149194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a031149-9f3c-454a-82b4-058816ff24c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:30:03 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-5420f38e-4623-495a-b548-3cf86cea1168 tempest-TestInstancesWithCinderVolumes-816149194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a031149-9f3c-454a-82b4-058816ff24c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:30:03 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-5420f38e-4623-495a-b548-3cf86cea1168 tempest-TestInstancesWithCinderVolumes-816149194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54c9a33c-4032-450f-95a7-6bab628c03ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:30:03 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-5420f38e-4623-495a-b548-3cf86cea1168 tempest-TestInstancesWithCinderVolumes-816149194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54c9a33c-4032-450f-95a7-6bab628c03ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '159b774d-834f-491a-8b11-2aad8a4f106d', 'volume_name': 'volume-159b774d-834f-491a-8b11-2aad8a4f106d', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:30:03 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-5420f38e-4623-495a-b548-3cf86cea1168 tempest-TestInstancesWithCinderVolumes-816149194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fc15cc0-a31f-4671-9836-fa1f6213a193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:30:03 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-5420f38e-4623-495a-b548-3cf86cea1168 tempest-TestInstancesWithCinderVolumes-816149194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fc15cc0-a31f-4671-9836-fa1f6213a193) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:30:03 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-5420f38e-4623-495a-b548-3cf86cea1168 tempest-TestInstancesWithCinderVolumes-816149194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72481255-ac19-40f9-8a29-691f483ba436) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:30:03 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-5420f38e-4623-495a-b548-3cf86cea1168 tempest-TestInstancesWithCinderVolumes-816149194 None] Volume 159b774d-834f-491a-8b11-2aad8a4f106d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-159b774d-834f-491a-8b11-2aad8a4f106d', 'volume_size': 1} Sep 29 18:30:03 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-5420f38e-4623-495a-b548-3cf86cea1168 tempest-TestInstancesWithCinderVolumes-816149194 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:30:03 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-5420f38e-4623-495a-b548-3cf86cea1168 tempest-TestInstancesWithCinderVolumes-816149194 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:30:03 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-5420f38e-4623-495a-b548-3cf86cea1168 tempest-TestInstancesWithCinderVolumes-816149194 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:30:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-279301856',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=159b774d-834f-491a-8b11-2aad8a4f106d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='260563d088f94f15ba57c6db3a36aced',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:30:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:30:03Z,use_quota=True,user_id='b54cea09782c4524b3e4691172104075',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84d77fc3-9c10-42eb-811d-fab9e5cfe433),volume_type_id=84d77fc3-9c10-42eb-811d-fab9e5cfe433)}" {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:30:03 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-5420f38e-4623-495a-b548-3cf86cea1168 tempest-TestInstancesWithCinderVolumes-816149194 None] Creating volume 159b774d-834f-491a-8b11-2aad8a4f106d {{(pid=86512) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:30:03 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-5420f38e-4623-495a-b548-3cf86cea1168 tempest-TestInstancesWithCinderVolumes-816149194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:30:03 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-5420f38e-4623-495a-b548-3cf86cea1168 tempest-TestInstancesWithCinderVolumes-816149194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:30:03 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-5420f38e-4623-495a-b548-3cf86cea1168 tempest-TestInstancesWithCinderVolumes-816149194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:30:03 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-5420f38e-4623-495a-b548-3cf86cea1168 tempest-TestInstancesWithCinderVolumes-816149194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:30:03 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-5420f38e-4623-495a-b548-3cf86cea1168 tempest-TestInstancesWithCinderVolumes-816149194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:30:03 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-5420f38e-4623-495a-b548-3cf86cea1168 tempest-TestInstancesWithCinderVolumes-816149194 None] Selected osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 as target Quobyte volume. {{(pid=86512) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:30:03 devstack cinder-volume[86512]: INFO cinder.volume.drivers.remotefs [None req-5420f38e-4623-495a-b548-3cf86cea1168 tempest-TestInstancesWithCinderVolumes-816149194 None] casted to osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 Sep 29 18:30:03 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-5420f38e-4623-495a-b548-3cf86cea1168 tempest-TestInstancesWithCinderVolumes-816149194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-159b774d-834f-491a-8b11-2aad8a4f106d 1073741824 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:30:03 devstack sudo[101461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-159b774d-834f-491a-8b11-2aad8a4f106d 1073741824 Sep 29 18:30:03 devstack sudo[101461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:30:03 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f9a4600-eef9-4523-a8ff-d5bb4622abff tempest-TestInstancesWithCinderVolumes-816149194 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86512) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:30:03 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-7f9a4600-eef9-4523-a8ff-d5bb4622abff tempest-TestInstancesWithCinderVolumes-816149194 None] Flow 'volume_create_manager' (e2c5d062-86c0-4d59-bbce-f0c955a87b07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:30:03 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-7f9a4600-eef9-4523-a8ff-d5bb4622abff tempest-TestInstancesWithCinderVolumes-816149194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26244b22-fb92-4ebc-b1b1-7c7a5f86cbdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:30:03 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-7f9a4600-eef9-4523-a8ff-d5bb4622abff tempest-TestInstancesWithCinderVolumes-816149194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26244b22-fb92-4ebc-b1b1-7c7a5f86cbdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:30:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2118839238',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9748846-2b0b-4e3f-bf30-1974b9da37dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='260563d088f94f15ba57c6db3a36aced',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:30:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:30:04Z,use_quota=True,user_id='b54cea09782c4524b3e4691172104075',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(556f3c5d-23b7-4c85-860f-4903eade44fd),volume_type_id=556f3c5d-23b7-4c85-860f-4903eade44fd)' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:30:03 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-7f9a4600-eef9-4523-a8ff-d5bb4622abff tempest-TestInstancesWithCinderVolumes-816149194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe15bfd7-b7b4-42b9-b696-3cd15e9947ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:30:03 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-7f9a4600-eef9-4523-a8ff-d5bb4622abff tempest-TestInstancesWithCinderVolumes-816149194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe15bfd7-b7b4-42b9-b696-3cd15e9947ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:30:03 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-7f9a4600-eef9-4523-a8ff-d5bb4622abff tempest-TestInstancesWithCinderVolumes-816149194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (720ba866-649d-4d0a-9675-db25e0b987d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:30:03 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-7f9a4600-eef9-4523-a8ff-d5bb4622abff tempest-TestInstancesWithCinderVolumes-816149194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (720ba866-649d-4d0a-9675-db25e0b987d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9748846-2b0b-4e3f-bf30-1974b9da37dd', 'volume_name': 'volume-c9748846-2b0b-4e3f-bf30-1974b9da37dd', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:30:03 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-7f9a4600-eef9-4523-a8ff-d5bb4622abff tempest-TestInstancesWithCinderVolumes-816149194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26f0c674-4028-4fb3-b5f1-2cfa09931017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:30:03 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-7f9a4600-eef9-4523-a8ff-d5bb4622abff tempest-TestInstancesWithCinderVolumes-816149194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26f0c674-4028-4fb3-b5f1-2cfa09931017) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:30:03 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-7f9a4600-eef9-4523-a8ff-d5bb4622abff tempest-TestInstancesWithCinderVolumes-816149194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f250590-48d6-482b-aacd-743208d6865f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:30:03 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-7f9a4600-eef9-4523-a8ff-d5bb4622abff tempest-TestInstancesWithCinderVolumes-816149194 None] Volume c9748846-2b0b-4e3f-bf30-1974b9da37dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9748846-2b0b-4e3f-bf30-1974b9da37dd', 'volume_size': 1} Sep 29 18:30:03 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-7f9a4600-eef9-4523-a8ff-d5bb4622abff tempest-TestInstancesWithCinderVolumes-816149194 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:30:04 devstack sudo[101461]: pam_unix(sudo:session): session closed for user root Sep 29 18:30:04 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-5420f38e-4623-495a-b548-3cf86cea1168 tempest-TestInstancesWithCinderVolumes-816149194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-159b774d-834f-491a-8b11-2aad8a4f106d 1073741824" returned: 0 in 0.657s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:30:04 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-5420f38e-4623-495a-b548-3cf86cea1168 tempest-TestInstancesWithCinderVolumes-816149194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-159b774d-834f-491a-8b11-2aad8a4f106d {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:30:04 devstack sudo[101468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-159b774d-834f-491a-8b11-2aad8a4f106d Sep 29 18:30:04 devstack sudo[101468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:30:04 devstack sudo[101468]: pam_unix(sudo:session): session closed for user root Sep 29 18:30:04 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-5420f38e-4623-495a-b548-3cf86cea1168 tempest-TestInstancesWithCinderVolumes-816149194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-159b774d-834f-491a-8b11-2aad8a4f106d" returned: 0 in 0.353s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:30:04 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-5420f38e-4623-495a-b548-3cf86cea1168 tempest-TestInstancesWithCinderVolumes-816149194 None] <== create_volume: return (1067ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'} {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:30:04 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-5420f38e-4623-495a-b548-3cf86cea1168 tempest-TestInstancesWithCinderVolumes-816149194 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.069s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:30:04 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-7f9a4600-eef9-4523-a8ff-d5bb4622abff tempest-TestInstancesWithCinderVolumes-816149194 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.542s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:30:04 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-7f9a4600-eef9-4523-a8ff-d5bb4622abff tempest-TestInstancesWithCinderVolumes-816149194 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:30:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2118839238',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9748846-2b0b-4e3f-bf30-1974b9da37dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='260563d088f94f15ba57c6db3a36aced',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:30:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:30:04Z,use_quota=True,user_id='b54cea09782c4524b3e4691172104075',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(556f3c5d-23b7-4c85-860f-4903eade44fd),volume_type_id=556f3c5d-23b7-4c85-860f-4903eade44fd)}" {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:30:04 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-7f9a4600-eef9-4523-a8ff-d5bb4622abff tempest-TestInstancesWithCinderVolumes-816149194 None] Creating volume c9748846-2b0b-4e3f-bf30-1974b9da37dd {{(pid=86512) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:30:04 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-7f9a4600-eef9-4523-a8ff-d5bb4622abff tempest-TestInstancesWithCinderVolumes-816149194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:30:04 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-7f9a4600-eef9-4523-a8ff-d5bb4622abff tempest-TestInstancesWithCinderVolumes-816149194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:30:04 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-7f9a4600-eef9-4523-a8ff-d5bb4622abff tempest-TestInstancesWithCinderVolumes-816149194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:30:04 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-7f9a4600-eef9-4523-a8ff-d5bb4622abff tempest-TestInstancesWithCinderVolumes-816149194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:30:04 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-7f9a4600-eef9-4523-a8ff-d5bb4622abff tempest-TestInstancesWithCinderVolumes-816149194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:30:04 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-7f9a4600-eef9-4523-a8ff-d5bb4622abff tempest-TestInstancesWithCinderVolumes-816149194 None] Selected osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 as target Quobyte volume. {{(pid=86512) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:30:04 devstack cinder-volume[86512]: INFO cinder.volume.drivers.remotefs [None req-7f9a4600-eef9-4523-a8ff-d5bb4622abff tempest-TestInstancesWithCinderVolumes-816149194 None] casted to osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 Sep 29 18:30:04 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-7f9a4600-eef9-4523-a8ff-d5bb4622abff tempest-TestInstancesWithCinderVolumes-816149194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-c9748846-2b0b-4e3f-bf30-1974b9da37dd 1073741824 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:30:04 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-5420f38e-4623-495a-b548-3cf86cea1168 tempest-TestInstancesWithCinderVolumes-816149194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72481255-ac19-40f9-8a29-691f483ba436) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-159b774d-834f-491a-8b11-2aad8a4f106d', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:30:04 devstack sudo[101471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-c9748846-2b0b-4e3f-bf30-1974b9da37dd 1073741824 Sep 29 18:30:04 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-5420f38e-4623-495a-b548-3cf86cea1168 tempest-TestInstancesWithCinderVolumes-816149194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48c21581-4b09-47a8-98cf-dffb570b159b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:30:04 devstack sudo[101471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:30:04 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-5420f38e-4623-495a-b548-3cf86cea1168 tempest-TestInstancesWithCinderVolumes-816149194 None] Volume volume-159b774d-834f-491a-8b11-2aad8a4f106d (159b774d-834f-491a-8b11-2aad8a4f106d): created successfully Sep 29 18:30:04 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-5420f38e-4623-495a-b548-3cf86cea1168 tempest-TestInstancesWithCinderVolumes-816149194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48c21581-4b09-47a8-98cf-dffb570b159b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:30:04 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-5420f38e-4623-495a-b548-3cf86cea1168 tempest-TestInstancesWithCinderVolumes-816149194 None] Flow 'volume_create_manager' (e06a3eec-1b8d-4859-80f6-7ad999bb6d8c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:30:04 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-5420f38e-4623-495a-b548-3cf86cea1168 tempest-TestInstancesWithCinderVolumes-816149194 None] Created volume successfully. Sep 29 18:30:04 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-8727dc54-d331-4af2-a31e-e7bed69a2ec9 tempest-TestInstancesWithCinderVolumes-816149194 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86512) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:30:04 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-8727dc54-d331-4af2-a31e-e7bed69a2ec9 tempest-TestInstancesWithCinderVolumes-816149194 None] Flow 'volume_create_manager' (c4cf7d16-4c3e-4560-b3b6-c116f1d530dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:30:04 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-8727dc54-d331-4af2-a31e-e7bed69a2ec9 tempest-TestInstancesWithCinderVolumes-816149194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (913eb627-7746-49af-ad0e-a589ed6b4d86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:30:04 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-8727dc54-d331-4af2-a31e-e7bed69a2ec9 tempest-TestInstancesWithCinderVolumes-816149194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (913eb627-7746-49af-ad0e-a589ed6b4d86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:30:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-903986496',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f13d6ea-91cb-4ee9-8e38-79d129c41391,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='260563d088f94f15ba57c6db3a36aced',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:30:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:30:05Z,use_quota=True,user_id='b54cea09782c4524b3e4691172104075',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b096ad88-f908-41a3-b4f4-b10b8c9735ad),volume_type_id=b096ad88-f908-41a3-b4f4-b10b8c9735ad)' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:30:04 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-8727dc54-d331-4af2-a31e-e7bed69a2ec9 tempest-TestInstancesWithCinderVolumes-816149194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cd05c6a-e9e8-40e7-9a23-2d401906d3c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:30:04 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-8727dc54-d331-4af2-a31e-e7bed69a2ec9 tempest-TestInstancesWithCinderVolumes-816149194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cd05c6a-e9e8-40e7-9a23-2d401906d3c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:30:04 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-8727dc54-d331-4af2-a31e-e7bed69a2ec9 tempest-TestInstancesWithCinderVolumes-816149194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (401fb964-94de-460d-b8cb-373f2646ede8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:30:04 devstack cinder-volume[86512]: DEBUG cinder.image.glance [None req-8727dc54-d331-4af2-a31e-e7bed69a2ec9 tempest-TestInstancesWithCinderVolumes-816149194 None] Creating Keystone auth plugin from conf {{(pid=86512) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 29 18:30:05 devstack sudo[101471]: pam_unix(sudo:session): session closed for user root Sep 29 18:30:05 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-7f9a4600-eef9-4523-a8ff-d5bb4622abff tempest-TestInstancesWithCinderVolumes-816149194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-c9748846-2b0b-4e3f-bf30-1974b9da37dd 1073741824" returned: 0 in 0.574s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:30:05 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-7f9a4600-eef9-4523-a8ff-d5bb4622abff tempest-TestInstancesWithCinderVolumes-816149194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-c9748846-2b0b-4e3f-bf30-1974b9da37dd {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:30:05 devstack sudo[101477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-c9748846-2b0b-4e3f-bf30-1974b9da37dd Sep 29 18:30:05 devstack sudo[101477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:30:05 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-8727dc54-d331-4af2-a31e-e7bed69a2ec9 tempest-TestInstancesWithCinderVolumes-816149194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (401fb964-94de-460d-b8cb-373f2646ede8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1f13d6ea-91cb-4ee9-8e38-79d129c41391', 'volume_name': 'volume-1f13d6ea-91cb-4ee9-8e38-79d129c41391', 'volume_size': 1, 'image_id': '1048dc80-bd02-4867-bb99-a1547edb3c5b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1048dc80-bd02-4867-bb99-a1547edb3c5b', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--613121068', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '260563d088f94f15ba57c6db3a36aced', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1048dc80-bd02-4867-bb99-a1547edb3c5b', 'created_at': datetime.datetime(2026, 9, 29, 16, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 16, 30, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1048dc80-bd02-4867-bb99-a1547edb3c5b/file', 'properties': {}}, 'image_service': }' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:30:05 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-8727dc54-d331-4af2-a31e-e7bed69a2ec9 tempest-TestInstancesWithCinderVolumes-816149194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4506b3bc-c8f6-4077-a693-95e9ea65908c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:30:05 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-8727dc54-d331-4af2-a31e-e7bed69a2ec9 tempest-TestInstancesWithCinderVolumes-816149194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4506b3bc-c8f6-4077-a693-95e9ea65908c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:30:05 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-8727dc54-d331-4af2-a31e-e7bed69a2ec9 tempest-TestInstancesWithCinderVolumes-816149194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7f8db9f-b987-4ed5-be11-6751d909876c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:30:05 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-8727dc54-d331-4af2-a31e-e7bed69a2ec9 tempest-TestInstancesWithCinderVolumes-816149194 None] Volume 1f13d6ea-91cb-4ee9-8e38-79d129c41391: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1f13d6ea-91cb-4ee9-8e38-79d129c41391', 'volume_size': 1, 'image_id': '1048dc80-bd02-4867-bb99-a1547edb3c5b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1048dc80-bd02-4867-bb99-a1547edb3c5b', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--613121068', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '260563d088f94f15ba57c6db3a36aced', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1048dc80-bd02-4867-bb99-a1547edb3c5b', 'created_at': datetime.datetime(2026, 9, 29, 16, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 16, 30, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1048dc80-bd02-4867-bb99-a1547edb3c5b/file', 'properties': {}}, 'image_service': } Sep 29 18:30:05 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-8727dc54-d331-4af2-a31e-e7bed69a2ec9 tempest-TestInstancesWithCinderVolumes-816149194 None] Trying to clone 1f13d6ea-91cb-4ee9-8e38-79d129c41391 from image 1048dc80-bd02-4867-bb99-a1547edb3c5b at location (None, [{'url': 'file:///opt/stack/data/glance/images/1048dc80-bd02-4867-bb99-a1547edb3c5b', 'metadata': {}}]). {{(pid=86512) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 29 18:30:05 devstack sudo[101477]: pam_unix(sudo:session): session closed for user root Sep 29 18:30:05 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-7f9a4600-eef9-4523-a8ff-d5bb4622abff tempest-TestInstancesWithCinderVolumes-816149194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-c9748846-2b0b-4e3f-bf30-1974b9da37dd" returned: 0 in 0.307s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:30:05 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-7f9a4600-eef9-4523-a8ff-d5bb4622abff tempest-TestInstancesWithCinderVolumes-816149194 None] <== create_volume: return (949ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'} {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:30:05 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-7f9a4600-eef9-4523-a8ff-d5bb4622abff tempest-TestInstancesWithCinderVolumes-816149194 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.953s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:30:05 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-7f9a4600-eef9-4523-a8ff-d5bb4622abff tempest-TestInstancesWithCinderVolumes-816149194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f250590-48d6-482b-aacd-743208d6865f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9748846-2b0b-4e3f-bf30-1974b9da37dd', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:30:05 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-7f9a4600-eef9-4523-a8ff-d5bb4622abff tempest-TestInstancesWithCinderVolumes-816149194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ad71333-4da1-4f83-9339-c4b67940296f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:30:05 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-7f9a4600-eef9-4523-a8ff-d5bb4622abff tempest-TestInstancesWithCinderVolumes-816149194 None] Volume volume-c9748846-2b0b-4e3f-bf30-1974b9da37dd (c9748846-2b0b-4e3f-bf30-1974b9da37dd): created successfully Sep 29 18:30:05 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-7f9a4600-eef9-4523-a8ff-d5bb4622abff tempest-TestInstancesWithCinderVolumes-816149194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ad71333-4da1-4f83-9339-c4b67940296f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:30:05 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-7f9a4600-eef9-4523-a8ff-d5bb4622abff tempest-TestInstancesWithCinderVolumes-816149194 None] Flow 'volume_create_manager' (e2c5d062-86c0-4d59-bbce-f0c955a87b07) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:30:05 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-7f9a4600-eef9-4523-a8ff-d5bb4622abff tempest-TestInstancesWithCinderVolumes-816149194 None] Created volume successfully. Sep 29 18:30:09 devstack cinder-volume[86512]: DEBUG cinder.image.image_utils [None req-8727dc54-d331-4af2-a31e-e7bed69a2ec9 tempest-TestInstancesWithCinderVolumes-816149194 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1048dc80-bd02-4867-bb99-a1547edb3c5b_wgo6qzyvdevstack@QuobyteHD, size 20.69 MB, duration 3.70 sec {{(pid=86512) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 29 18:30:09 devstack cinder-volume[86512]: INFO cinder.image.image_utils [None req-8727dc54-d331-4af2-a31e-e7bed69a2ec9 tempest-TestInstancesWithCinderVolumes-816149194 None] Image download 20.69 MB at 5.59 MB/s Sep 29 18:30:09 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[66d94602-d0be-412b-a86f-7b5b79fd3ff2]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:30:09 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-8727dc54-d331-4af2-a31e-e7bed69a2ec9 tempest-TestInstancesWithCinderVolumes-816149194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1048dc80-bd02-4867-bb99-a1547edb3c5b_wgo6qzyvdevstack@QuobyteHD {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:30:09 devstack sudo[101483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1048dc80-bd02-4867-bb99-a1547edb3c5b_wgo6qzyvdevstack@QuobyteHD Sep 29 18:30:09 devstack sudo[101483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:30:09 devstack sudo[101483]: pam_unix(sudo:session): session closed for user root Sep 29 18:30:09 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-8727dc54-d331-4af2-a31e-e7bed69a2ec9 tempest-TestInstancesWithCinderVolumes-816149194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1048dc80-bd02-4867-bb99-a1547edb3c5b_wgo6qzyvdevstack@QuobyteHD" returned: 0 in 0.438s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:30:09 devstack cinder-volume[86512]: DEBUG cinder.image.image_utils [None req-8727dc54-d331-4af2-a31e-e7bed69a2ec9 tempest-TestInstancesWithCinderVolumes-816149194 None] Temporary image 1048dc80-bd02-4867-bb99-a1547edb3c5b is fetched for user b54cea09782c4524b3e4691172104075. {{(pid=86512) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 29 18:30:09 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[419e0143-1905-4b98-8281-78be03ae59c8]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:30:09 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-8727dc54-d331-4af2-a31e-e7bed69a2ec9 tempest-TestInstancesWithCinderVolumes-816149194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1048dc80-bd02-4867-bb99-a1547edb3c5b_wgo6qzyvdevstack@QuobyteHD {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:30:09 devstack sudo[101489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1048dc80-bd02-4867-bb99-a1547edb3c5b_wgo6qzyvdevstack@QuobyteHD Sep 29 18:30:09 devstack sudo[101489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:30:10 devstack sudo[101489]: pam_unix(sudo:session): session closed for user root Sep 29 18:30:10 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-8727dc54-d331-4af2-a31e-e7bed69a2ec9 tempest-TestInstancesWithCinderVolumes-816149194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1048dc80-bd02-4867-bb99-a1547edb3c5b_wgo6qzyvdevstack@QuobyteHD" returned: 0 in 0.525s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:30:10 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-8727dc54-d331-4af2-a31e-e7bed69a2ec9 tempest-TestInstancesWithCinderVolumes-816149194 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:30:10 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-8727dc54-d331-4af2-a31e-e7bed69a2ec9 tempest-TestInstancesWithCinderVolumes-816149194 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:30:10 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-8727dc54-d331-4af2-a31e-e7bed69a2ec9 tempest-TestInstancesWithCinderVolumes-816149194 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:30:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-903986496',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f13d6ea-91cb-4ee9-8e38-79d129c41391,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='260563d088f94f15ba57c6db3a36aced',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:30:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:30:05Z,use_quota=True,user_id='b54cea09782c4524b3e4691172104075',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b096ad88-f908-41a3-b4f4-b10b8c9735ad),volume_type_id=b096ad88-f908-41a3-b4f4-b10b8c9735ad)}" {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:30:10 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-8727dc54-d331-4af2-a31e-e7bed69a2ec9 tempest-TestInstancesWithCinderVolumes-816149194 None] Creating volume 1f13d6ea-91cb-4ee9-8e38-79d129c41391 {{(pid=86512) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:30:10 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-8727dc54-d331-4af2-a31e-e7bed69a2ec9 tempest-TestInstancesWithCinderVolumes-816149194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:30:10 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-8727dc54-d331-4af2-a31e-e7bed69a2ec9 tempest-TestInstancesWithCinderVolumes-816149194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:30:10 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-8727dc54-d331-4af2-a31e-e7bed69a2ec9 tempest-TestInstancesWithCinderVolumes-816149194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:30:10 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-8727dc54-d331-4af2-a31e-e7bed69a2ec9 tempest-TestInstancesWithCinderVolumes-816149194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:30:10 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-8727dc54-d331-4af2-a31e-e7bed69a2ec9 tempest-TestInstancesWithCinderVolumes-816149194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:30:10 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-8727dc54-d331-4af2-a31e-e7bed69a2ec9 tempest-TestInstancesWithCinderVolumes-816149194 None] Selected osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 as target Quobyte volume. {{(pid=86512) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:30:10 devstack cinder-volume[86512]: INFO cinder.volume.drivers.remotefs [None req-8727dc54-d331-4af2-a31e-e7bed69a2ec9 tempest-TestInstancesWithCinderVolumes-816149194 None] casted to osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 Sep 29 18:30:10 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-8727dc54-d331-4af2-a31e-e7bed69a2ec9 tempest-TestInstancesWithCinderVolumes-816149194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-1f13d6ea-91cb-4ee9-8e38-79d129c41391 1073741824 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:30:10 devstack sudo[101495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-1f13d6ea-91cb-4ee9-8e38-79d129c41391 1073741824 Sep 29 18:30:10 devstack sudo[101495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:30:10 devstack sudo[101495]: pam_unix(sudo:session): session closed for user root Sep 29 18:30:10 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-8727dc54-d331-4af2-a31e-e7bed69a2ec9 tempest-TestInstancesWithCinderVolumes-816149194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-1f13d6ea-91cb-4ee9-8e38-79d129c41391 1073741824" returned: 0 in 0.533s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:30:10 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-8727dc54-d331-4af2-a31e-e7bed69a2ec9 tempest-TestInstancesWithCinderVolumes-816149194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-1f13d6ea-91cb-4ee9-8e38-79d129c41391 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:30:10 devstack sudo[101501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-1f13d6ea-91cb-4ee9-8e38-79d129c41391 Sep 29 18:30:10 devstack sudo[101501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:30:11 devstack sudo[101501]: pam_unix(sudo:session): session closed for user root Sep 29 18:30:11 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-8727dc54-d331-4af2-a31e-e7bed69a2ec9 tempest-TestInstancesWithCinderVolumes-816149194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-1f13d6ea-91cb-4ee9-8e38-79d129c41391" returned: 0 in 0.296s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:30:11 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-8727dc54-d331-4af2-a31e-e7bed69a2ec9 tempest-TestInstancesWithCinderVolumes-816149194 None] <== create_volume: return (898ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'} {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:30:11 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-8727dc54-d331-4af2-a31e-e7bed69a2ec9 tempest-TestInstancesWithCinderVolumes-816149194 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.901s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:30:11 devstack cinder-volume[86512]: DEBUG cinder.volume.volume_utils [None req-8727dc54-d331-4af2-a31e-e7bed69a2ec9 tempest-TestInstancesWithCinderVolumes-816149194 None] Attempting download of 1048dc80-bd02-4867-bb99-a1547edb3c5b ((None, [{'url': 'file:///opt/stack/data/glance/images/1048dc80-bd02-4867-bb99-a1547edb3c5b', 'metadata': {}}])) to volume 1f13d6ea-91cb-4ee9-8e38-79d129c41391. {{(pid=86512) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 29 18:30:11 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[28de7138-216d-4d94-93ec-cda81c87aeea]: (4, 'raw') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:30:11 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-8727dc54-d331-4af2-a31e-e7bed69a2ec9 tempest-TestInstancesWithCinderVolumes-816149194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1048dc80-bd02-4867-bb99-a1547edb3c5b_cirgh0t5 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:30:11 devstack sudo[101504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1048dc80-bd02-4867-bb99-a1547edb3c5b_cirgh0t5 Sep 29 18:30:11 devstack sudo[101504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:30:11 devstack sudo[101504]: pam_unix(sudo:session): session closed for user root Sep 29 18:30:11 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-8727dc54-d331-4af2-a31e-e7bed69a2ec9 tempest-TestInstancesWithCinderVolumes-816149194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1048dc80-bd02-4867-bb99-a1547edb3c5b_cirgh0t5" returned: 0 in 0.461s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:30:11 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-8727dc54-d331-4af2-a31e-e7bed69a2ec9 tempest-TestInstancesWithCinderVolumes-816149194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1048dc80-bd02-4867-bb99-a1547edb3c5b_cirgh0t5 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:30:11 devstack sudo[101524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1048dc80-bd02-4867-bb99-a1547edb3c5b_cirgh0t5 Sep 29 18:30:11 devstack sudo[101524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:30:11 devstack sudo[101524]: pam_unix(sudo:session): session closed for user root Sep 29 18:30:11 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-8727dc54-d331-4af2-a31e-e7bed69a2ec9 tempest-TestInstancesWithCinderVolumes-816149194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1048dc80-bd02-4867-bb99-a1547edb3c5b_cirgh0t5" returned: 1 in 0.347s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:30:11 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-8727dc54-d331-4af2-a31e-e7bed69a2ec9 tempest-TestInstancesWithCinderVolumes-816149194 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1048dc80-bd02-4867-bb99-a1547edb3c5b_cirgh0t5' failed. Not Retrying. {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 29 18:30:11 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[50b0aa70-b6e8-40ad-9580-558060e01346]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:30:11 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-8727dc54-d331-4af2-a31e-e7bed69a2ec9 tempest-TestInstancesWithCinderVolumes-816149194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1048dc80-bd02-4867-bb99-a1547edb3c5b_wgo6qzyvdevstack@QuobyteHD {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:30:12 devstack sudo[101528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1048dc80-bd02-4867-bb99-a1547edb3c5b_wgo6qzyvdevstack@QuobyteHD Sep 29 18:30:12 devstack sudo[101528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:30:12 devstack sudo[101528]: pam_unix(sudo:session): session closed for user root Sep 29 18:30:12 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-8727dc54-d331-4af2-a31e-e7bed69a2ec9 tempest-TestInstancesWithCinderVolumes-816149194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1048dc80-bd02-4867-bb99-a1547edb3c5b_wgo6qzyvdevstack@QuobyteHD" returned: 0 in 0.338s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:30:12 devstack cinder-volume[86512]: DEBUG cinder.image.image_utils [None req-8727dc54-d331-4af2-a31e-e7bed69a2ec9 tempest-TestInstancesWithCinderVolumes-816149194 None] 1048dc80-bd02-4867-bb99-a1547edb3c5b was qcow2, converting to qcow2 {{(pid=86512) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 29 18:30:12 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-8727dc54-d331-4af2-a31e-e7bed69a2ec9 tempest-TestInstancesWithCinderVolumes-816149194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1048dc80-bd02-4867-bb99-a1547edb3c5b_wgo6qzyvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-1f13d6ea-91cb-4ee9-8e38-79d129c41391 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:30:12 devstack sudo[101533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1048dc80-bd02-4867-bb99-a1547edb3c5b_wgo6qzyvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-1f13d6ea-91cb-4ee9-8e38-79d129c41391 Sep 29 18:30:12 devstack sudo[101533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:30:14 devstack sudo[101533]: pam_unix(sudo:session): session closed for user root Sep 29 18:30:14 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-8727dc54-d331-4af2-a31e-e7bed69a2ec9 tempest-TestInstancesWithCinderVolumes-816149194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1048dc80-bd02-4867-bb99-a1547edb3c5b_wgo6qzyvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-1f13d6ea-91cb-4ee9-8e38-79d129c41391" returned: 0 in 2.024s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:30:14 devstack cinder-volume[86512]: DEBUG cinder.image.image_utils [None req-8727dc54-d331-4af2-a31e-e7bed69a2ec9 tempest-TestInstancesWithCinderVolumes-816149194 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1048dc80-bd02-4867-bb99-a1547edb3c5b_wgo6qzyvdevstack@QuobyteHD, size 112.00 MB, duration 2.03 sec, destination /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-1f13d6ea-91cb-4ee9-8e38-79d129c41391 {{(pid=86512) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 29 18:30:14 devstack cinder-volume[86512]: INFO cinder.image.image_utils [None req-8727dc54-d331-4af2-a31e-e7bed69a2ec9 tempest-TestInstancesWithCinderVolumes-816149194 None] Converted 112.00 MB image at 55.29 MB/s Sep 29 18:30:14 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-8727dc54-d331-4af2-a31e-e7bed69a2ec9 tempest-TestInstancesWithCinderVolumes-816149194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-1f13d6ea-91cb-4ee9-8e38-79d129c41391 1G {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:30:14 devstack sudo[101546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-1f13d6ea-91cb-4ee9-8e38-79d129c41391 1G Sep 29 18:30:14 devstack sudo[101546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:30:14 devstack sudo[101546]: pam_unix(sudo:session): session closed for user root Sep 29 18:30:14 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-8727dc54-d331-4af2-a31e-e7bed69a2ec9 tempest-TestInstancesWithCinderVolumes-816149194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-1f13d6ea-91cb-4ee9-8e38-79d129c41391 1G" returned: 0 in 0.340s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:30:14 devstack cinder-volume[86512]: DEBUG cinder.volume.volume_utils [None req-8727dc54-d331-4af2-a31e-e7bed69a2ec9 tempest-TestInstancesWithCinderVolumes-816149194 None] Downloaded image 1048dc80-bd02-4867-bb99-a1547edb3c5b ((None, [{'url': 'file:///opt/stack/data/glance/images/1048dc80-bd02-4867-bb99-a1547edb3c5b', 'metadata': {}}])) to volume 1f13d6ea-91cb-4ee9-8e38-79d129c41391 successfully. {{(pid=86512) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 29 18:30:14 devstack cinder-volume[86512]: DEBUG cinder.image.image_utils [None req-8727dc54-d331-4af2-a31e-e7bed69a2ec9 tempest-TestInstancesWithCinderVolumes-816149194 None] Temporary image 1048dc80-bd02-4867-bb99-a1547edb3c5b for user b54cea09782c4524b3e4691172104075 is deleted. {{(pid=86512) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 29 18:30:14 devstack cinder-volume[86512]: DEBUG cinder.volume.volume_utils [None req-8727dc54-d331-4af2-a31e-e7bed69a2ec9 tempest-TestInstancesWithCinderVolumes-816149194 None] Marking volume 1f13d6ea-91cb-4ee9-8e38-79d129c41391 as bootable. {{(pid=86512) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 29 18:30:14 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-8727dc54-d331-4af2-a31e-e7bed69a2ec9 tempest-TestInstancesWithCinderVolumes-816149194 None] Copying metadata from image 1048dc80-bd02-4867-bb99-a1547edb3c5b to 1f13d6ea-91cb-4ee9-8e38-79d129c41391. {{(pid=86512) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 29 18:30:14 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-8727dc54-d331-4af2-a31e-e7bed69a2ec9 tempest-TestInstancesWithCinderVolumes-816149194 None] Creating volume glance metadata for volume 1f13d6ea-91cb-4ee9-8e38-79d129c41391 backed by image 1048dc80-bd02-4867-bb99-a1547edb3c5b with: {'image_id': '1048dc80-bd02-4867-bb99-a1547edb3c5b', 'image_name': 'tempest-scenario-img--613121068', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86512) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 29 18:30:14 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-8727dc54-d331-4af2-a31e-e7bed69a2ec9 tempest-TestInstancesWithCinderVolumes-816149194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7f8db9f-b987-4ed5-be11-6751d909876c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f13d6ea-91cb-4ee9-8e38-79d129c41391', 'volume_size': 1, 'image_id': '1048dc80-bd02-4867-bb99-a1547edb3c5b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1048dc80-bd02-4867-bb99-a1547edb3c5b', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--613121068', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '260563d088f94f15ba57c6db3a36aced', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1048dc80-bd02-4867-bb99-a1547edb3c5b', 'created_at': datetime.datetime(2026, 9, 29, 16, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 16, 30, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1048dc80-bd02-4867-bb99-a1547edb3c5b/file', 'properties': {}}, 'image_service': }' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:30:14 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-8727dc54-d331-4af2-a31e-e7bed69a2ec9 tempest-TestInstancesWithCinderVolumes-816149194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb0696ba-22e2-4b7e-a036-8dc066d03d37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:30:14 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-8727dc54-d331-4af2-a31e-e7bed69a2ec9 tempest-TestInstancesWithCinderVolumes-816149194 None] Volume volume-1f13d6ea-91cb-4ee9-8e38-79d129c41391 (1f13d6ea-91cb-4ee9-8e38-79d129c41391): created successfully Sep 29 18:30:14 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-8727dc54-d331-4af2-a31e-e7bed69a2ec9 tempest-TestInstancesWithCinderVolumes-816149194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb0696ba-22e2-4b7e-a036-8dc066d03d37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:30:14 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-8727dc54-d331-4af2-a31e-e7bed69a2ec9 tempest-TestInstancesWithCinderVolumes-816149194 None] Flow 'volume_create_manager' (c4cf7d16-4c3e-4560-b3b6-c116f1d530dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:30:14 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-8727dc54-d331-4af2-a31e-e7bed69a2ec9 tempest-TestInstancesWithCinderVolumes-816149194 None] Created volume successfully. Sep 29 18:30:18 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [req-9109a326-1a06-4992-864c-a856954f7d9a req-d43e1e6a-7d02-41e7-b702-0482047d85af tempest-TestInstancesWithCinderVolumes-816149194 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:30:18 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [req-9109a326-1a06-4992-864c-a856954f7d9a req-d43e1e6a-7d02-41e7-b702-0482047d85af tempest-TestInstancesWithCinderVolumes-816149194 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:30:18 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [req-9109a326-1a06-4992-864c-a856954f7d9a req-d43e1e6a-7d02-41e7-b702-0482047d85af tempest-TestInstancesWithCinderVolumes-816149194 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:30:18 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [req-9109a326-1a06-4992-864c-a856954f7d9a req-d43e1e6a-7d02-41e7-b702-0482047d85af tempest-TestInstancesWithCinderVolumes-816149194 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883', 'name': 'volume-1f13d6ea-91cb-4ee9-8e38-79d129c41391', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '159e2d72-85b5-4ff0-9828-e3a9d9163e8f', 'enforce_multipath': True} {{(pid=86512) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 29 18:30:18 devstack cinder-volume[86512]: INFO cinder.volume.manager [req-9109a326-1a06-4992-864c-a856954f7d9a req-d43e1e6a-7d02-41e7-b702-0482047d85af tempest-TestInstancesWithCinderVolumes-816149194 None] attachment_update completed successfully. Sep 29 18:30:25 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-47cf6fd8-1168-4014-9fdd-33cbd40bf442 tempest-TestServerVolumeAttachScenarioOldVersion-1707976372 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86512) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:30:25 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-47cf6fd8-1168-4014-9fdd-33cbd40bf442 tempest-TestServerVolumeAttachScenarioOldVersion-1707976372 None] Flow 'volume_create_manager' (ae4e01a5-3ba0-4f59-a088-e4bd6651337e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:30:25 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-47cf6fd8-1168-4014-9fdd-33cbd40bf442 tempest-TestServerVolumeAttachScenarioOldVersion-1707976372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21f76222-f03e-4eff-bc1d-d64bc82ffdab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:30:25 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-47cf6fd8-1168-4014-9fdd-33cbd40bf442 tempest-TestServerVolumeAttachScenarioOldVersion-1707976372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21f76222-f03e-4eff-bc1d-d64bc82ffdab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:30:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-107723524',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=332077dd-b21e-4528-b8d0-0ef586cbadcc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='555b7fbe184f441ba9246142badf5379',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:30:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:30:25Z,use_quota=True,user_id='8a00933ad7aa46be989985c4baa90020',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:30:25 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-47cf6fd8-1168-4014-9fdd-33cbd40bf442 tempest-TestServerVolumeAttachScenarioOldVersion-1707976372 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b25da97-25eb-4611-ac06-69b5867e852d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:30:25 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-47cf6fd8-1168-4014-9fdd-33cbd40bf442 tempest-TestServerVolumeAttachScenarioOldVersion-1707976372 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b25da97-25eb-4611-ac06-69b5867e852d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:30:25 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-47cf6fd8-1168-4014-9fdd-33cbd40bf442 tempest-TestServerVolumeAttachScenarioOldVersion-1707976372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (485ac900-b3cc-4255-93f6-680a549c4d88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:30:25 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-47cf6fd8-1168-4014-9fdd-33cbd40bf442 tempest-TestServerVolumeAttachScenarioOldVersion-1707976372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (485ac900-b3cc-4255-93f6-680a549c4d88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '332077dd-b21e-4528-b8d0-0ef586cbadcc', 'volume_name': 'volume-332077dd-b21e-4528-b8d0-0ef586cbadcc', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:30:25 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-47cf6fd8-1168-4014-9fdd-33cbd40bf442 tempest-TestServerVolumeAttachScenarioOldVersion-1707976372 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e42aa806-e00e-40ca-baf3-8c888d7d82f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:30:25 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-47cf6fd8-1168-4014-9fdd-33cbd40bf442 tempest-TestServerVolumeAttachScenarioOldVersion-1707976372 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e42aa806-e00e-40ca-baf3-8c888d7d82f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:30:25 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-47cf6fd8-1168-4014-9fdd-33cbd40bf442 tempest-TestServerVolumeAttachScenarioOldVersion-1707976372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27aac6cc-c26f-48e1-a93b-f931eef83a68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:30:25 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-47cf6fd8-1168-4014-9fdd-33cbd40bf442 tempest-TestServerVolumeAttachScenarioOldVersion-1707976372 None] Volume 332077dd-b21e-4528-b8d0-0ef586cbadcc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-332077dd-b21e-4528-b8d0-0ef586cbadcc', 'volume_size': 1} Sep 29 18:30:25 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-47cf6fd8-1168-4014-9fdd-33cbd40bf442 tempest-TestServerVolumeAttachScenarioOldVersion-1707976372 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:30:25 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-47cf6fd8-1168-4014-9fdd-33cbd40bf442 tempest-TestServerVolumeAttachScenarioOldVersion-1707976372 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:30:25 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-47cf6fd8-1168-4014-9fdd-33cbd40bf442 tempest-TestServerVolumeAttachScenarioOldVersion-1707976372 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:30:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-107723524',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=332077dd-b21e-4528-b8d0-0ef586cbadcc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='555b7fbe184f441ba9246142badf5379',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:30:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:30:25Z,use_quota=True,user_id='8a00933ad7aa46be989985c4baa90020',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)}" {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:30:25 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-47cf6fd8-1168-4014-9fdd-33cbd40bf442 tempest-TestServerVolumeAttachScenarioOldVersion-1707976372 None] Creating volume 332077dd-b21e-4528-b8d0-0ef586cbadcc {{(pid=86512) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:30:25 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-47cf6fd8-1168-4014-9fdd-33cbd40bf442 tempest-TestServerVolumeAttachScenarioOldVersion-1707976372 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:30:25 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-47cf6fd8-1168-4014-9fdd-33cbd40bf442 tempest-TestServerVolumeAttachScenarioOldVersion-1707976372 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:30:25 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-47cf6fd8-1168-4014-9fdd-33cbd40bf442 tempest-TestServerVolumeAttachScenarioOldVersion-1707976372 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:30:25 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-47cf6fd8-1168-4014-9fdd-33cbd40bf442 tempest-TestServerVolumeAttachScenarioOldVersion-1707976372 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:30:25 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-47cf6fd8-1168-4014-9fdd-33cbd40bf442 tempest-TestServerVolumeAttachScenarioOldVersion-1707976372 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:30:25 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-47cf6fd8-1168-4014-9fdd-33cbd40bf442 tempest-TestServerVolumeAttachScenarioOldVersion-1707976372 None] Selected osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 as target Quobyte volume. {{(pid=86512) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:30:25 devstack cinder-volume[86512]: INFO cinder.volume.drivers.remotefs [None req-47cf6fd8-1168-4014-9fdd-33cbd40bf442 tempest-TestServerVolumeAttachScenarioOldVersion-1707976372 None] casted to osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 Sep 29 18:30:25 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-47cf6fd8-1168-4014-9fdd-33cbd40bf442 tempest-TestServerVolumeAttachScenarioOldVersion-1707976372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-332077dd-b21e-4528-b8d0-0ef586cbadcc 1073741824 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:30:25 devstack sudo[102066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-332077dd-b21e-4528-b8d0-0ef586cbadcc 1073741824 Sep 29 18:30:25 devstack sudo[102066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:30:26 devstack sudo[102066]: pam_unix(sudo:session): session closed for user root Sep 29 18:30:26 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-47cf6fd8-1168-4014-9fdd-33cbd40bf442 tempest-TestServerVolumeAttachScenarioOldVersion-1707976372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-332077dd-b21e-4528-b8d0-0ef586cbadcc 1073741824" returned: 0 in 0.525s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:30:26 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-47cf6fd8-1168-4014-9fdd-33cbd40bf442 tempest-TestServerVolumeAttachScenarioOldVersion-1707976372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-332077dd-b21e-4528-b8d0-0ef586cbadcc {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:30:26 devstack sudo[102072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-332077dd-b21e-4528-b8d0-0ef586cbadcc Sep 29 18:30:26 devstack sudo[102072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:30:26 devstack sudo[102072]: pam_unix(sudo:session): session closed for user root Sep 29 18:30:26 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-47cf6fd8-1168-4014-9fdd-33cbd40bf442 tempest-TestServerVolumeAttachScenarioOldVersion-1707976372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-332077dd-b21e-4528-b8d0-0ef586cbadcc" returned: 0 in 0.351s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:30:26 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-47cf6fd8-1168-4014-9fdd-33cbd40bf442 tempest-TestServerVolumeAttachScenarioOldVersion-1707976372 None] <== create_volume: return (924ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'} {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:30:26 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-47cf6fd8-1168-4014-9fdd-33cbd40bf442 tempest-TestServerVolumeAttachScenarioOldVersion-1707976372 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.926s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:30:26 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-47cf6fd8-1168-4014-9fdd-33cbd40bf442 tempest-TestServerVolumeAttachScenarioOldVersion-1707976372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27aac6cc-c26f-48e1-a93b-f931eef83a68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-332077dd-b21e-4528-b8d0-0ef586cbadcc', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:30:26 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-47cf6fd8-1168-4014-9fdd-33cbd40bf442 tempest-TestServerVolumeAttachScenarioOldVersion-1707976372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c0d250d-13f4-493e-823a-7f754614690c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:30:26 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-47cf6fd8-1168-4014-9fdd-33cbd40bf442 tempest-TestServerVolumeAttachScenarioOldVersion-1707976372 None] Volume volume-332077dd-b21e-4528-b8d0-0ef586cbadcc (332077dd-b21e-4528-b8d0-0ef586cbadcc): created successfully Sep 29 18:30:26 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-47cf6fd8-1168-4014-9fdd-33cbd40bf442 tempest-TestServerVolumeAttachScenarioOldVersion-1707976372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c0d250d-13f4-493e-823a-7f754614690c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:30:26 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-47cf6fd8-1168-4014-9fdd-33cbd40bf442 tempest-TestServerVolumeAttachScenarioOldVersion-1707976372 None] Flow 'volume_create_manager' (ae4e01a5-3ba0-4f59-a088-e4bd6651337e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:30:26 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-47cf6fd8-1168-4014-9fdd-33cbd40bf442 tempest-TestServerVolumeAttachScenarioOldVersion-1707976372 None] Created volume successfully. Sep 29 18:30:29 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [req-12ec2faf-d551-47c4-8c37-2d633ebb577c req-41e20dca-1e4e-4dd1-babf-ce8857ccf025 tempest-TestServerVolumeAttachScenarioOldVersion-1707976372 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:30:29 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [req-12ec2faf-d551-47c4-8c37-2d633ebb577c req-41e20dca-1e4e-4dd1-babf-ce8857ccf025 tempest-TestServerVolumeAttachScenarioOldVersion-1707976372 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:30:29 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [req-12ec2faf-d551-47c4-8c37-2d633ebb577c req-41e20dca-1e4e-4dd1-babf-ce8857ccf025 tempest-TestServerVolumeAttachScenarioOldVersion-1707976372 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.027s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:30:29 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [req-12ec2faf-d551-47c4-8c37-2d633ebb577c req-41e20dca-1e4e-4dd1-babf-ce8857ccf025 tempest-TestServerVolumeAttachScenarioOldVersion-1707976372 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883', 'name': 'volume-332077dd-b21e-4528-b8d0-0ef586cbadcc', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5f804e0d-aee0-4a9e-92ee-70d3c5001783', 'enforce_multipath': True} {{(pid=86512) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 29 18:30:29 devstack cinder-volume[86512]: INFO cinder.volume.manager [req-12ec2faf-d551-47c4-8c37-2d633ebb577c req-41e20dca-1e4e-4dd1-babf-ce8857ccf025 tempest-TestServerVolumeAttachScenarioOldVersion-1707976372 None] attachment_update completed successfully. Sep 29 18:30:33 devstack cinder-volume[86512]: INFO cinder.volume.manager [req-6587540d-5152-4616-b0d9-5b374c57f0b7 req-1da755ae-f355-4076-bcf1-47a7b8f3495c tempest-TestServerVolumeAttachScenarioOldVersion-1707976372 None] Terminate volume connection completed successfully. Sep 29 18:30:33 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [req-6587540d-5152-4616-b0d9-5b374c57f0b7 req-1da755ae-f355-4076-bcf1-47a7b8f3495c tempest-TestServerVolumeAttachScenarioOldVersion-1707976372 None] Deleting attachment 5f804e0d-aee0-4a9e-92ee-70d3c5001783. {{(pid=86512) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 29 18:30:35 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-5de6d613-afad-483e-a754-a9c0ff1bdf7c tempest-TestServerVolumeAttachScenarioOldVersion-1707976372 None] Acquiring lock "cinder-332077dd-b21e-4528-b8d0-0ef586cbadcc-delete_volume" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:30:35 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-5de6d613-afad-483e-a754-a9c0ff1bdf7c tempest-TestServerVolumeAttachScenarioOldVersion-1707976372 None] Lock "cinder-332077dd-b21e-4528-b8d0-0ef586cbadcc-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:30:35 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-5de6d613-afad-483e-a754-a9c0ff1bdf7c tempest-TestServerVolumeAttachScenarioOldVersion-1707976372 None] Acquiring lock "cinder-quobyte-332077dd-b21e-4528-b8d0-0ef586cbadcc" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:30:35 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-5de6d613-afad-483e-a754-a9c0ff1bdf7c tempest-TestServerVolumeAttachScenarioOldVersion-1707976372 None] Lock "cinder-quobyte-332077dd-b21e-4528-b8d0-0ef586cbadcc" acquired by "delete_volume" :: waited 0.036s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:30:35 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[251994a3-cf02-4147-a861-fd12093c4744]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:30:35 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-5de6d613-afad-483e-a754-a9c0ff1bdf7c tempest-TestServerVolumeAttachScenarioOldVersion-1707976372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-332077dd-b21e-4528-b8d0-0ef586cbadcc {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:30:35 devstack sudo[102128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-332077dd-b21e-4528-b8d0-0ef586cbadcc Sep 29 18:30:35 devstack sudo[102128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:30:36 devstack sudo[102128]: pam_unix(sudo:session): session closed for user root Sep 29 18:30:36 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-5de6d613-afad-483e-a754-a9c0ff1bdf7c tempest-TestServerVolumeAttachScenarioOldVersion-1707976372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-332077dd-b21e-4528-b8d0-0ef586cbadcc" returned: 0 in 0.671s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:30:36 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-5de6d613-afad-483e-a754-a9c0ff1bdf7c tempest-TestServerVolumeAttachScenarioOldVersion-1707976372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-332077dd-b21e-4528-b8d0-0ef586cbadcc {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:30:36 devstack sudo[102134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-332077dd-b21e-4528-b8d0-0ef586cbadcc Sep 29 18:30:36 devstack sudo[102134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:30:36 devstack sudo[102134]: pam_unix(sudo:session): session closed for user root Sep 29 18:30:36 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-5de6d613-afad-483e-a754-a9c0ff1bdf7c tempest-TestServerVolumeAttachScenarioOldVersion-1707976372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-332077dd-b21e-4528-b8d0-0ef586cbadcc" returned: 0 in 0.382s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:30:36 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-5de6d613-afad-483e-a754-a9c0ff1bdf7c tempest-TestServerVolumeAttachScenarioOldVersion-1707976372 None] Lock "cinder-quobyte-332077dd-b21e-4528-b8d0-0ef586cbadcc" released by "delete_volume" :: held 1.145s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:30:36 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-5de6d613-afad-483e-a754-a9c0ff1bdf7c tempest-TestServerVolumeAttachScenarioOldVersion-1707976372 None] Created reservations ['ab0ece09-cb79-4d4f-8541-ff1c8c1d5e5e', 'c9d2a389-d2a8-4cc7-8228-a55fb869cf6a', 'a37682a2-59f6-4abf-9f2d-f856de5cc70f', '5ae6fa76-4bf4-4672-92da-d421bfd61f43'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:30:36 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-5de6d613-afad-483e-a754-a9c0ff1bdf7c tempest-TestServerVolumeAttachScenarioOldVersion-1707976372 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:30:36 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-5de6d613-afad-483e-a754-a9c0ff1bdf7c tempest-TestServerVolumeAttachScenarioOldVersion-1707976372 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:30:36 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-5de6d613-afad-483e-a754-a9c0ff1bdf7c tempest-TestServerVolumeAttachScenarioOldVersion-1707976372 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:30:36 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-5de6d613-afad-483e-a754-a9c0ff1bdf7c tempest-TestServerVolumeAttachScenarioOldVersion-1707976372 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:30:36 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-5de6d613-afad-483e-a754-a9c0ff1bdf7c tempest-TestServerVolumeAttachScenarioOldVersion-1707976372 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:30:36 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-5de6d613-afad-483e-a754-a9c0ff1bdf7c tempest-TestServerVolumeAttachScenarioOldVersion-1707976372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:30:36 devstack sudo[102139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:30:36 devstack sudo[102139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:30:37 devstack sudo[102139]: pam_unix(sudo:session): session closed for user root Sep 29 18:30:37 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-5de6d613-afad-483e-a754-a9c0ff1bdf7c tempest-TestServerVolumeAttachScenarioOldVersion-1707976372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.315s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:30:37 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-5de6d613-afad-483e-a754-a9c0ff1bdf7c tempest-TestServerVolumeAttachScenarioOldVersion-1707976372 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:30:37 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-5de6d613-afad-483e-a754-a9c0ff1bdf7c tempest-TestServerVolumeAttachScenarioOldVersion-1707976372 None] Deleted volume successfully. Sep 29 18:30:37 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-5de6d613-afad-483e-a754-a9c0ff1bdf7c tempest-TestServerVolumeAttachScenarioOldVersion-1707976372 None] Lock "cinder-332077dd-b21e-4528-b8d0-0ef586cbadcc-delete_volume" released by "delete_volume" :: held 1.781s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:30:43 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-5fc68eff-76e9-4b83-adea-1eb7d07e090c tempest-VolumesActionsTest-208535436 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86512) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:30:43 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-5fc68eff-76e9-4b83-adea-1eb7d07e090c tempest-VolumesActionsTest-208535436 None] Flow 'volume_create_manager' (d1f06d84-cdd4-4ca2-9a52-d25cfadb2f83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:30:43 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-5fc68eff-76e9-4b83-adea-1eb7d07e090c tempest-VolumesActionsTest-208535436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc1c16e9-e9a6-40f9-a81b-c97edd72c1e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:30:43 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-5fc68eff-76e9-4b83-adea-1eb7d07e090c tempest-VolumesActionsTest-208535436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc1c16e9-e9a6-40f9-a81b-c97edd72c1e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:30:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-77146603',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b015f297-365f-4ac3-b5f5-fcc1deefa41b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bd4ad9e97f14fc6981eee84025c56b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:30:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:30:43Z,use_quota=True,user_id='47d555d3cb7c4624bd2e857fd54661e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:30:43 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-5fc68eff-76e9-4b83-adea-1eb7d07e090c tempest-VolumesActionsTest-208535436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a024aa90-248a-4c79-a11f-54ca58e67779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:30:43 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-5fc68eff-76e9-4b83-adea-1eb7d07e090c tempest-VolumesActionsTest-208535436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a024aa90-248a-4c79-a11f-54ca58e67779) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:30:43 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-5fc68eff-76e9-4b83-adea-1eb7d07e090c tempest-VolumesActionsTest-208535436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3dd7ceb2-31f9-4c4a-80f6-50b1bebbf9a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:30:43 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-5fc68eff-76e9-4b83-adea-1eb7d07e090c tempest-VolumesActionsTest-208535436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3dd7ceb2-31f9-4c4a-80f6-50b1bebbf9a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b015f297-365f-4ac3-b5f5-fcc1deefa41b', 'volume_name': 'volume-b015f297-365f-4ac3-b5f5-fcc1deefa41b', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:30:43 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-5fc68eff-76e9-4b83-adea-1eb7d07e090c tempest-VolumesActionsTest-208535436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96537f1f-1cf5-4ac7-a1ea-143351181d34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:30:43 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-5fc68eff-76e9-4b83-adea-1eb7d07e090c tempest-VolumesActionsTest-208535436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96537f1f-1cf5-4ac7-a1ea-143351181d34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:30:43 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-5fc68eff-76e9-4b83-adea-1eb7d07e090c tempest-VolumesActionsTest-208535436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af8f635f-21b7-48c4-8f8e-21824f0f93b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:30:43 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-5fc68eff-76e9-4b83-adea-1eb7d07e090c tempest-VolumesActionsTest-208535436 None] Volume b015f297-365f-4ac3-b5f5-fcc1deefa41b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b015f297-365f-4ac3-b5f5-fcc1deefa41b', 'volume_size': 1} Sep 29 18:30:43 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-5fc68eff-76e9-4b83-adea-1eb7d07e090c tempest-VolumesActionsTest-208535436 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:30:43 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-5fc68eff-76e9-4b83-adea-1eb7d07e090c tempest-VolumesActionsTest-208535436 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:30:43 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-5fc68eff-76e9-4b83-adea-1eb7d07e090c tempest-VolumesActionsTest-208535436 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:30:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-77146603',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b015f297-365f-4ac3-b5f5-fcc1deefa41b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bd4ad9e97f14fc6981eee84025c56b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:30:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:30:43Z,use_quota=True,user_id='47d555d3cb7c4624bd2e857fd54661e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)}" {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:30:43 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-5fc68eff-76e9-4b83-adea-1eb7d07e090c tempest-VolumesActionsTest-208535436 None] Creating volume b015f297-365f-4ac3-b5f5-fcc1deefa41b {{(pid=86512) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:30:43 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-5fc68eff-76e9-4b83-adea-1eb7d07e090c tempest-VolumesActionsTest-208535436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:30:43 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-5fc68eff-76e9-4b83-adea-1eb7d07e090c tempest-VolumesActionsTest-208535436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:30:43 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-5fc68eff-76e9-4b83-adea-1eb7d07e090c tempest-VolumesActionsTest-208535436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:30:43 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-5fc68eff-76e9-4b83-adea-1eb7d07e090c tempest-VolumesActionsTest-208535436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:30:43 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-5fc68eff-76e9-4b83-adea-1eb7d07e090c tempest-VolumesActionsTest-208535436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:30:43 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-5fc68eff-76e9-4b83-adea-1eb7d07e090c tempest-VolumesActionsTest-208535436 None] Selected osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 as target Quobyte volume. {{(pid=86512) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:30:43 devstack cinder-volume[86512]: INFO cinder.volume.drivers.remotefs [None req-5fc68eff-76e9-4b83-adea-1eb7d07e090c tempest-VolumesActionsTest-208535436 None] casted to osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 Sep 29 18:30:43 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-5fc68eff-76e9-4b83-adea-1eb7d07e090c tempest-VolumesActionsTest-208535436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-b015f297-365f-4ac3-b5f5-fcc1deefa41b 1073741824 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:30:43 devstack sudo[102284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-b015f297-365f-4ac3-b5f5-fcc1deefa41b 1073741824 Sep 29 18:30:43 devstack sudo[102284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:30:43 devstack sudo[102284]: pam_unix(sudo:session): session closed for user root Sep 29 18:30:43 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-5fc68eff-76e9-4b83-adea-1eb7d07e090c tempest-VolumesActionsTest-208535436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-b015f297-365f-4ac3-b5f5-fcc1deefa41b 1073741824" returned: 0 in 0.609s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:30:43 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-5fc68eff-76e9-4b83-adea-1eb7d07e090c tempest-VolumesActionsTest-208535436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-b015f297-365f-4ac3-b5f5-fcc1deefa41b {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:30:43 devstack sudo[102291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-b015f297-365f-4ac3-b5f5-fcc1deefa41b Sep 29 18:30:43 devstack sudo[102291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:30:44 devstack sudo[102291]: pam_unix(sudo:session): session closed for user root Sep 29 18:30:44 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-5fc68eff-76e9-4b83-adea-1eb7d07e090c tempest-VolumesActionsTest-208535436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-b015f297-365f-4ac3-b5f5-fcc1deefa41b" returned: 0 in 0.275s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:30:44 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-5fc68eff-76e9-4b83-adea-1eb7d07e090c tempest-VolumesActionsTest-208535436 None] <== create_volume: return (940ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'} {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:30:44 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-5fc68eff-76e9-4b83-adea-1eb7d07e090c tempest-VolumesActionsTest-208535436 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.943s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:30:44 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-5fc68eff-76e9-4b83-adea-1eb7d07e090c tempest-VolumesActionsTest-208535436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af8f635f-21b7-48c4-8f8e-21824f0f93b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b015f297-365f-4ac3-b5f5-fcc1deefa41b', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:30:44 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-5fc68eff-76e9-4b83-adea-1eb7d07e090c tempest-VolumesActionsTest-208535436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (680ea4cd-c37c-4b0f-a4fa-bdbfedc00a6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:30:44 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-5fc68eff-76e9-4b83-adea-1eb7d07e090c tempest-VolumesActionsTest-208535436 None] Volume volume-b015f297-365f-4ac3-b5f5-fcc1deefa41b (b015f297-365f-4ac3-b5f5-fcc1deefa41b): created successfully Sep 29 18:30:44 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-5fc68eff-76e9-4b83-adea-1eb7d07e090c tempest-VolumesActionsTest-208535436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (680ea4cd-c37c-4b0f-a4fa-bdbfedc00a6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:30:44 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-5fc68eff-76e9-4b83-adea-1eb7d07e090c tempest-VolumesActionsTest-208535436 None] Flow 'volume_create_manager' (d1f06d84-cdd4-4ca2-9a52-d25cfadb2f83) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:30:44 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-5fc68eff-76e9-4b83-adea-1eb7d07e090c tempest-VolumesActionsTest-208535436 None] Created volume successfully. Sep 29 18:30:45 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-a9bb397d-a76b-404c-92ff-b59bef43b698 tempest-VolumesActionsTest-208535436 None] Acquiring lock "cinder-b015f297-365f-4ac3-b5f5-fcc1deefa41b" by "attach_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:30:45 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-a9bb397d-a76b-404c-92ff-b59bef43b698 tempest-VolumesActionsTest-208535436 None] Lock "cinder-b015f297-365f-4ac3-b5f5-fcc1deefa41b" acquired by "attach_volume" :: waited 0.019s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:30:45 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-a9bb397d-a76b-404c-92ff-b59bef43b698 tempest-VolumesActionsTest-208535436 None] Attaching volume b015f297-365f-4ac3-b5f5-fcc1deefa41b to instance d435fae0-2e58-4de4-9945-c712e4174f99 at mountpoint /dev/vdb on host None. Sep 29 18:30:45 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-a9bb397d-a76b-404c-92ff-b59bef43b698 tempest-VolumesActionsTest-208535436 None] Attach volume completed successfully. Sep 29 18:30:45 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-a9bb397d-a76b-404c-92ff-b59bef43b698 tempest-VolumesActionsTest-208535436 None] Lock "cinder-b015f297-365f-4ac3-b5f5-fcc1deefa41b" released by "attach_volume" :: held 0.197s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:30:46 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-91edab65-72df-4857-a8f2-4a3f255b9954 tempest-VolumesActionsTest-898359120 None] Terminate volume connection completed successfully. Sep 29 18:30:46 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-91edab65-72df-4857-a8f2-4a3f255b9954 tempest-VolumesActionsTest-898359120 None] Acquiring lock "cinder-b015f297-365f-4ac3-b5f5-fcc1deefa41b-detach_volume" by "detach_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:30:46 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-91edab65-72df-4857-a8f2-4a3f255b9954 tempest-VolumesActionsTest-898359120 None] Lock "cinder-b015f297-365f-4ac3-b5f5-fcc1deefa41b-detach_volume" acquired by "detach_volume" :: waited 0.025s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:30:46 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-91edab65-72df-4857-a8f2-4a3f255b9954 tempest-VolumesActionsTest-898359120 None] Detaching volume b015f297-365f-4ac3-b5f5-fcc1deefa41b from instance d435fae0-2e58-4de4-9945-c712e4174f99. Sep 29 18:30:46 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-91edab65-72df-4857-a8f2-4a3f255b9954 tempest-VolumesActionsTest-898359120 None] Detach volume completed successfully. Sep 29 18:30:46 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-91edab65-72df-4857-a8f2-4a3f255b9954 tempest-VolumesActionsTest-898359120 None] Lock "cinder-b015f297-365f-4ac3-b5f5-fcc1deefa41b-detach_volume" released by "detach_volume" :: held 0.077s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:30:46 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-35475323-7749-4ce1-9948-2120faba19e1 tempest-VolumesActionsTest-208535436 None] Acquiring lock "cinder-b015f297-365f-4ac3-b5f5-fcc1deefa41b-detach_volume" by "detach_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:30:46 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-35475323-7749-4ce1-9948-2120faba19e1 tempest-VolumesActionsTest-208535436 None] Lock "cinder-b015f297-365f-4ac3-b5f5-fcc1deefa41b-detach_volume" acquired by "detach_volume" :: waited 0.018s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:30:46 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-35475323-7749-4ce1-9948-2120faba19e1 tempest-VolumesActionsTest-208535436 None] Volume detach called, but volume not attached. Sep 29 18:30:46 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-35475323-7749-4ce1-9948-2120faba19e1 tempest-VolumesActionsTest-208535436 None] Lock "cinder-b015f297-365f-4ac3-b5f5-fcc1deefa41b-detach_volume" released by "detach_volume" :: held 0.019s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:30:46 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-3370dfd4-fb79-4808-852a-8e5ef43598eb tempest-VolumesActionsTest-208535436 None] Acquiring lock "cinder-b015f297-365f-4ac3-b5f5-fcc1deefa41b-delete_volume" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:30:46 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-3370dfd4-fb79-4808-852a-8e5ef43598eb tempest-VolumesActionsTest-208535436 None] Lock "cinder-b015f297-365f-4ac3-b5f5-fcc1deefa41b-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:30:46 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-3370dfd4-fb79-4808-852a-8e5ef43598eb tempest-VolumesActionsTest-208535436 None] Acquiring lock "cinder-quobyte-b015f297-365f-4ac3-b5f5-fcc1deefa41b" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:30:46 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-3370dfd4-fb79-4808-852a-8e5ef43598eb tempest-VolumesActionsTest-208535436 None] Lock "cinder-quobyte-b015f297-365f-4ac3-b5f5-fcc1deefa41b" acquired by "delete_volume" :: waited 0.024s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:30:46 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[7882b1a6-40ca-44e5-bde0-c791cb0853f3]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:30:46 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-3370dfd4-fb79-4808-852a-8e5ef43598eb tempest-VolumesActionsTest-208535436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-b015f297-365f-4ac3-b5f5-fcc1deefa41b {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:30:46 devstack sudo[102331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-b015f297-365f-4ac3-b5f5-fcc1deefa41b Sep 29 18:30:46 devstack sudo[102331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:30:47 devstack sudo[102331]: pam_unix(sudo:session): session closed for user root Sep 29 18:30:47 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-3370dfd4-fb79-4808-852a-8e5ef43598eb tempest-VolumesActionsTest-208535436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-b015f297-365f-4ac3-b5f5-fcc1deefa41b" returned: 0 in 0.463s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:30:47 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-3370dfd4-fb79-4808-852a-8e5ef43598eb tempest-VolumesActionsTest-208535436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-b015f297-365f-4ac3-b5f5-fcc1deefa41b {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:30:47 devstack sudo[102336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-b015f297-365f-4ac3-b5f5-fcc1deefa41b Sep 29 18:30:47 devstack sudo[102336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:30:47 devstack sudo[102336]: pam_unix(sudo:session): session closed for user root Sep 29 18:30:47 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-3370dfd4-fb79-4808-852a-8e5ef43598eb tempest-VolumesActionsTest-208535436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-b015f297-365f-4ac3-b5f5-fcc1deefa41b" returned: 0 in 0.279s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:30:47 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-3370dfd4-fb79-4808-852a-8e5ef43598eb tempest-VolumesActionsTest-208535436 None] Lock "cinder-quobyte-b015f297-365f-4ac3-b5f5-fcc1deefa41b" released by "delete_volume" :: held 0.811s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:30:47 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-3370dfd4-fb79-4808-852a-8e5ef43598eb tempest-VolumesActionsTest-208535436 None] Created reservations ['930aeec9-9444-42e4-bf15-3b03bd90a1f1', '96bde05a-39c5-40a5-b22a-60c7fbae28fd', 'c0b82b50-7fb4-4ccc-ad68-0e37d6718d37', '2e072805-f8da-400e-8f22-4749db20b081'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:30:47 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-3370dfd4-fb79-4808-852a-8e5ef43598eb tempest-VolumesActionsTest-208535436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:30:47 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-3370dfd4-fb79-4808-852a-8e5ef43598eb tempest-VolumesActionsTest-208535436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:30:47 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-3370dfd4-fb79-4808-852a-8e5ef43598eb tempest-VolumesActionsTest-208535436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:30:47 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-3370dfd4-fb79-4808-852a-8e5ef43598eb tempest-VolumesActionsTest-208535436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:30:47 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-3370dfd4-fb79-4808-852a-8e5ef43598eb tempest-VolumesActionsTest-208535436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:30:47 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-3370dfd4-fb79-4808-852a-8e5ef43598eb tempest-VolumesActionsTest-208535436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:30:47 devstack sudo[102339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:30:47 devstack sudo[102339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:30:48 devstack sudo[102339]: pam_unix(sudo:session): session closed for user root Sep 29 18:30:48 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-3370dfd4-fb79-4808-852a-8e5ef43598eb tempest-VolumesActionsTest-208535436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.445s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:30:48 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-3370dfd4-fb79-4808-852a-8e5ef43598eb tempest-VolumesActionsTest-208535436 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:30:48 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-3370dfd4-fb79-4808-852a-8e5ef43598eb tempest-VolumesActionsTest-208535436 None] Deleted volume successfully. Sep 29 18:30:48 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-3370dfd4-fb79-4808-852a-8e5ef43598eb tempest-VolumesActionsTest-208535436 None] Lock "cinder-b015f297-365f-4ac3-b5f5-fcc1deefa41b-delete_volume" released by "delete_volume" :: held 1.558s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:30:50 devstack cinder-volume[86512]: DEBUG oslo_service.periodic_task [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86512) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 18:30:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:30:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:30:50 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:30:50 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:30:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:30:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:30:50 devstack sudo[102370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:30:50 devstack sudo[102370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:30:50 devstack sudo[102370]: pam_unix(sudo:session): session closed for user root Sep 29 18:30:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.290s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:30:50 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:30:50 devstack cinder-volume[86512]: DEBUG oslo_service.periodic_task [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Running periodic task VolumeManager._thread_info {{(pid=86512) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 18:30:50 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] thread count: 29 {{(pid=86512) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 29 18:30:50 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] thread info: [<_MainThread(MainThread, started 135593654804608)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86512) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 29 18:30:51 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-caf8b0cf-b6f7-4ec0-8d34-1eb824683318 tempest-VolumesActionsTest-208535436 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86512) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:30:51 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-caf8b0cf-b6f7-4ec0-8d34-1eb824683318 tempest-VolumesActionsTest-208535436 None] Flow 'volume_create_manager' (bcc0f3a0-265b-43b7-a8cc-6e604a4041b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:30:51 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-caf8b0cf-b6f7-4ec0-8d34-1eb824683318 tempest-VolumesActionsTest-208535436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86367681-c63a-4fd3-ac7d-85f327a0cec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:30:51 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-caf8b0cf-b6f7-4ec0-8d34-1eb824683318 tempest-VolumesActionsTest-208535436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86367681-c63a-4fd3-ac7d-85f327a0cec0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:30:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1612405904',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7923aab9-2108-4eba-b84c-07e845112d69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bd4ad9e97f14fc6981eee84025c56b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:30:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:30:52Z,use_quota=True,user_id='47d555d3cb7c4624bd2e857fd54661e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:30:51 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-caf8b0cf-b6f7-4ec0-8d34-1eb824683318 tempest-VolumesActionsTest-208535436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (621b2b19-1d38-4795-a597-132ec4aa0f86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:30:51 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-caf8b0cf-b6f7-4ec0-8d34-1eb824683318 tempest-VolumesActionsTest-208535436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (621b2b19-1d38-4795-a597-132ec4aa0f86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:30:51 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-caf8b0cf-b6f7-4ec0-8d34-1eb824683318 tempest-VolumesActionsTest-208535436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9765729e-e578-4253-ab4f-76088206872c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:30:51 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-caf8b0cf-b6f7-4ec0-8d34-1eb824683318 tempest-VolumesActionsTest-208535436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9765729e-e578-4253-ab4f-76088206872c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7923aab9-2108-4eba-b84c-07e845112d69', 'volume_name': 'volume-7923aab9-2108-4eba-b84c-07e845112d69', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:30:51 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-caf8b0cf-b6f7-4ec0-8d34-1eb824683318 tempest-VolumesActionsTest-208535436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31f8f900-bb5f-4cf4-8532-281ad76764f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:30:51 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-caf8b0cf-b6f7-4ec0-8d34-1eb824683318 tempest-VolumesActionsTest-208535436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31f8f900-bb5f-4cf4-8532-281ad76764f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:30:52 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-caf8b0cf-b6f7-4ec0-8d34-1eb824683318 tempest-VolumesActionsTest-208535436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e47994e9-4470-4c72-9a01-c12821495b0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:30:52 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-caf8b0cf-b6f7-4ec0-8d34-1eb824683318 tempest-VolumesActionsTest-208535436 None] Volume 7923aab9-2108-4eba-b84c-07e845112d69: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7923aab9-2108-4eba-b84c-07e845112d69', 'volume_size': 1} Sep 29 18:30:52 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-caf8b0cf-b6f7-4ec0-8d34-1eb824683318 tempest-VolumesActionsTest-208535436 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:30:52 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-caf8b0cf-b6f7-4ec0-8d34-1eb824683318 tempest-VolumesActionsTest-208535436 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:30:52 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-caf8b0cf-b6f7-4ec0-8d34-1eb824683318 tempest-VolumesActionsTest-208535436 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:30:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1612405904',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7923aab9-2108-4eba-b84c-07e845112d69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bd4ad9e97f14fc6981eee84025c56b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:30:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:30:52Z,use_quota=True,user_id='47d555d3cb7c4624bd2e857fd54661e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)}" {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:30:52 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-caf8b0cf-b6f7-4ec0-8d34-1eb824683318 tempest-VolumesActionsTest-208535436 None] Creating volume 7923aab9-2108-4eba-b84c-07e845112d69 {{(pid=86512) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:30:52 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-caf8b0cf-b6f7-4ec0-8d34-1eb824683318 tempest-VolumesActionsTest-208535436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:30:52 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-caf8b0cf-b6f7-4ec0-8d34-1eb824683318 tempest-VolumesActionsTest-208535436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:30:52 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-caf8b0cf-b6f7-4ec0-8d34-1eb824683318 tempest-VolumesActionsTest-208535436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:30:52 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-caf8b0cf-b6f7-4ec0-8d34-1eb824683318 tempest-VolumesActionsTest-208535436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:30:52 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-caf8b0cf-b6f7-4ec0-8d34-1eb824683318 tempest-VolumesActionsTest-208535436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:30:52 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-caf8b0cf-b6f7-4ec0-8d34-1eb824683318 tempest-VolumesActionsTest-208535436 None] Selected osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 as target Quobyte volume. {{(pid=86512) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:30:52 devstack cinder-volume[86512]: INFO cinder.volume.drivers.remotefs [None req-caf8b0cf-b6f7-4ec0-8d34-1eb824683318 tempest-VolumesActionsTest-208535436 None] casted to osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 Sep 29 18:30:52 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-caf8b0cf-b6f7-4ec0-8d34-1eb824683318 tempest-VolumesActionsTest-208535436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7923aab9-2108-4eba-b84c-07e845112d69 1073741824 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:30:52 devstack sudo[102374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7923aab9-2108-4eba-b84c-07e845112d69 1073741824 Sep 29 18:30:52 devstack sudo[102374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:30:52 devstack sudo[102374]: pam_unix(sudo:session): session closed for user root Sep 29 18:30:52 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-caf8b0cf-b6f7-4ec0-8d34-1eb824683318 tempest-VolumesActionsTest-208535436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7923aab9-2108-4eba-b84c-07e845112d69 1073741824" returned: 0 in 0.500s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:30:52 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-caf8b0cf-b6f7-4ec0-8d34-1eb824683318 tempest-VolumesActionsTest-208535436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7923aab9-2108-4eba-b84c-07e845112d69 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:30:52 devstack sudo[102379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7923aab9-2108-4eba-b84c-07e845112d69 Sep 29 18:30:52 devstack sudo[102379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:30:52 devstack sudo[102379]: pam_unix(sudo:session): session closed for user root Sep 29 18:30:52 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-caf8b0cf-b6f7-4ec0-8d34-1eb824683318 tempest-VolumesActionsTest-208535436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7923aab9-2108-4eba-b84c-07e845112d69" returned: 0 in 0.281s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:30:52 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-caf8b0cf-b6f7-4ec0-8d34-1eb824683318 tempest-VolumesActionsTest-208535436 None] <== create_volume: return (836ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'} {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:30:52 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-caf8b0cf-b6f7-4ec0-8d34-1eb824683318 tempest-VolumesActionsTest-208535436 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.838s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:30:52 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-caf8b0cf-b6f7-4ec0-8d34-1eb824683318 tempest-VolumesActionsTest-208535436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e47994e9-4470-4c72-9a01-c12821495b0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7923aab9-2108-4eba-b84c-07e845112d69', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:30:52 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-caf8b0cf-b6f7-4ec0-8d34-1eb824683318 tempest-VolumesActionsTest-208535436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cb8ea6d-30ba-478c-b74b-d0d7423b5489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:30:52 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-caf8b0cf-b6f7-4ec0-8d34-1eb824683318 tempest-VolumesActionsTest-208535436 None] Volume volume-7923aab9-2108-4eba-b84c-07e845112d69 (7923aab9-2108-4eba-b84c-07e845112d69): created successfully Sep 29 18:30:52 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-caf8b0cf-b6f7-4ec0-8d34-1eb824683318 tempest-VolumesActionsTest-208535436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cb8ea6d-30ba-478c-b74b-d0d7423b5489) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:30:52 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-caf8b0cf-b6f7-4ec0-8d34-1eb824683318 tempest-VolumesActionsTest-208535436 None] Flow 'volume_create_manager' (bcc0f3a0-265b-43b7-a8cc-6e604a4041b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:30:52 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-caf8b0cf-b6f7-4ec0-8d34-1eb824683318 tempest-VolumesActionsTest-208535436 None] Created volume successfully. Sep 29 18:30:54 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-5b4a90dd-ba5d-4380-9150-c580ad010ed4 tempest-VolumesActionsTest-898359120 None] Acquiring lock "cinder-7923aab9-2108-4eba-b84c-07e845112d69-delete_volume" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:30:54 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-5b4a90dd-ba5d-4380-9150-c580ad010ed4 tempest-VolumesActionsTest-898359120 None] Lock "cinder-7923aab9-2108-4eba-b84c-07e845112d69-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:30:54 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-5b4a90dd-ba5d-4380-9150-c580ad010ed4 tempest-VolumesActionsTest-898359120 None] Acquiring lock "cinder-quobyte-7923aab9-2108-4eba-b84c-07e845112d69" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:30:54 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-5b4a90dd-ba5d-4380-9150-c580ad010ed4 tempest-VolumesActionsTest-898359120 None] Lock "cinder-quobyte-7923aab9-2108-4eba-b84c-07e845112d69" acquired by "delete_volume" :: waited 0.014s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:30:54 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb96e3eb-ea23-4db4-b72b-1310a009d54a]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:30:54 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-5b4a90dd-ba5d-4380-9150-c580ad010ed4 tempest-VolumesActionsTest-898359120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7923aab9-2108-4eba-b84c-07e845112d69 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:30:54 devstack sudo[102389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7923aab9-2108-4eba-b84c-07e845112d69 Sep 29 18:30:54 devstack sudo[102389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:30:54 devstack sudo[102389]: pam_unix(sudo:session): session closed for user root Sep 29 18:30:54 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-5b4a90dd-ba5d-4380-9150-c580ad010ed4 tempest-VolumesActionsTest-898359120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7923aab9-2108-4eba-b84c-07e845112d69" returned: 0 in 0.408s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:30:54 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-5b4a90dd-ba5d-4380-9150-c580ad010ed4 tempest-VolumesActionsTest-898359120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7923aab9-2108-4eba-b84c-07e845112d69 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:30:54 devstack sudo[102395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7923aab9-2108-4eba-b84c-07e845112d69 Sep 29 18:30:54 devstack sudo[102395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:30:54 devstack sudo[102395]: pam_unix(sudo:session): session closed for user root Sep 29 18:30:54 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-5b4a90dd-ba5d-4380-9150-c580ad010ed4 tempest-VolumesActionsTest-898359120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7923aab9-2108-4eba-b84c-07e845112d69" returned: 0 in 0.254s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:30:54 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-5b4a90dd-ba5d-4380-9150-c580ad010ed4 tempest-VolumesActionsTest-898359120 None] Lock "cinder-quobyte-7923aab9-2108-4eba-b84c-07e845112d69" released by "delete_volume" :: held 0.714s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:30:54 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-5b4a90dd-ba5d-4380-9150-c580ad010ed4 tempest-VolumesActionsTest-898359120 None] Created reservations ['a27f8078-6dbe-4bfa-9f7e-a54c409c4ffe', 'ab1cb3c6-830d-4811-8c80-7c22b08e39df', '34735e70-f171-4b61-ad39-ded7c63ecaba', '7a86d0a5-f3b8-49b3-8c10-1b67dd64866e'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:30:55 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-5b4a90dd-ba5d-4380-9150-c580ad010ed4 tempest-VolumesActionsTest-898359120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:30:55 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-5b4a90dd-ba5d-4380-9150-c580ad010ed4 tempest-VolumesActionsTest-898359120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:30:55 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-5b4a90dd-ba5d-4380-9150-c580ad010ed4 tempest-VolumesActionsTest-898359120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:30:55 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-5b4a90dd-ba5d-4380-9150-c580ad010ed4 tempest-VolumesActionsTest-898359120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:30:55 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-5b4a90dd-ba5d-4380-9150-c580ad010ed4 tempest-VolumesActionsTest-898359120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:30:55 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-5b4a90dd-ba5d-4380-9150-c580ad010ed4 tempest-VolumesActionsTest-898359120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:30:55 devstack sudo[102399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:30:55 devstack sudo[102399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:30:55 devstack sudo[102399]: pam_unix(sudo:session): session closed for user root Sep 29 18:30:55 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-5b4a90dd-ba5d-4380-9150-c580ad010ed4 tempest-VolumesActionsTest-898359120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.259s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:30:55 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-5b4a90dd-ba5d-4380-9150-c580ad010ed4 tempest-VolumesActionsTest-898359120 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:30:55 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-5b4a90dd-ba5d-4380-9150-c580ad010ed4 tempest-VolumesActionsTest-898359120 None] Deleted volume successfully. Sep 29 18:30:55 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-5b4a90dd-ba5d-4380-9150-c580ad010ed4 tempest-VolumesActionsTest-898359120 None] Lock "cinder-7923aab9-2108-4eba-b84c-07e845112d69-delete_volume" released by "delete_volume" :: held 1.219s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:30:55 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-41a8a003-5796-4ee2-bfa6-940a5767d237 tempest-VolumesActionsTest-208535436 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86512) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:30:55 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-41a8a003-5796-4ee2-bfa6-940a5767d237 tempest-VolumesActionsTest-208535436 None] Flow 'volume_create_manager' (a8017d58-4bd0-4793-99f5-fd24a5845de1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:30:55 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-41a8a003-5796-4ee2-bfa6-940a5767d237 tempest-VolumesActionsTest-208535436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6deefc7-cec5-4e5c-b63d-fe67d9794361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:30:55 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-41a8a003-5796-4ee2-bfa6-940a5767d237 tempest-VolumesActionsTest-208535436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6deefc7-cec5-4e5c-b63d-fe67d9794361) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:30:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-930186679',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88c5cda9-3df6-4dc3-b87a-6fbf3614e0b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bd4ad9e97f14fc6981eee84025c56b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:30:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:30:56Z,use_quota=True,user_id='47d555d3cb7c4624bd2e857fd54661e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:30:55 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-41a8a003-5796-4ee2-bfa6-940a5767d237 tempest-VolumesActionsTest-208535436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8764e38c-ee07-4cdc-a8ec-a0d5e59e327e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:30:55 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-41a8a003-5796-4ee2-bfa6-940a5767d237 tempest-VolumesActionsTest-208535436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8764e38c-ee07-4cdc-a8ec-a0d5e59e327e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:30:56 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-41a8a003-5796-4ee2-bfa6-940a5767d237 tempest-VolumesActionsTest-208535436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ba1aa18-3a40-4292-9dbc-ea19e63b8175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:30:56 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-41a8a003-5796-4ee2-bfa6-940a5767d237 tempest-VolumesActionsTest-208535436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ba1aa18-3a40-4292-9dbc-ea19e63b8175) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88c5cda9-3df6-4dc3-b87a-6fbf3614e0b2', 'volume_name': 'volume-88c5cda9-3df6-4dc3-b87a-6fbf3614e0b2', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:30:56 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-41a8a003-5796-4ee2-bfa6-940a5767d237 tempest-VolumesActionsTest-208535436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc7dd1b2-f7b4-4fb2-a9b2-5cac9d25410d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:30:56 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-41a8a003-5796-4ee2-bfa6-940a5767d237 tempest-VolumesActionsTest-208535436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc7dd1b2-f7b4-4fb2-a9b2-5cac9d25410d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:30:56 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-41a8a003-5796-4ee2-bfa6-940a5767d237 tempest-VolumesActionsTest-208535436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d547acb-352f-48d9-9ba1-7222ee6c44bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:30:56 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-41a8a003-5796-4ee2-bfa6-940a5767d237 tempest-VolumesActionsTest-208535436 None] Volume 88c5cda9-3df6-4dc3-b87a-6fbf3614e0b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88c5cda9-3df6-4dc3-b87a-6fbf3614e0b2', 'volume_size': 1} Sep 29 18:30:56 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-41a8a003-5796-4ee2-bfa6-940a5767d237 tempest-VolumesActionsTest-208535436 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:30:56 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-41a8a003-5796-4ee2-bfa6-940a5767d237 tempest-VolumesActionsTest-208535436 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:30:56 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-41a8a003-5796-4ee2-bfa6-940a5767d237 tempest-VolumesActionsTest-208535436 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:30:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-930186679',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88c5cda9-3df6-4dc3-b87a-6fbf3614e0b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bd4ad9e97f14fc6981eee84025c56b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:30:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:30:56Z,use_quota=True,user_id='47d555d3cb7c4624bd2e857fd54661e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)}" {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:30:56 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-41a8a003-5796-4ee2-bfa6-940a5767d237 tempest-VolumesActionsTest-208535436 None] Creating volume 88c5cda9-3df6-4dc3-b87a-6fbf3614e0b2 {{(pid=86512) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:30:56 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-41a8a003-5796-4ee2-bfa6-940a5767d237 tempest-VolumesActionsTest-208535436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:30:56 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-41a8a003-5796-4ee2-bfa6-940a5767d237 tempest-VolumesActionsTest-208535436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:30:56 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-41a8a003-5796-4ee2-bfa6-940a5767d237 tempest-VolumesActionsTest-208535436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:30:56 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-41a8a003-5796-4ee2-bfa6-940a5767d237 tempest-VolumesActionsTest-208535436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:30:56 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-41a8a003-5796-4ee2-bfa6-940a5767d237 tempest-VolumesActionsTest-208535436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:30:56 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-41a8a003-5796-4ee2-bfa6-940a5767d237 tempest-VolumesActionsTest-208535436 None] Selected osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 as target Quobyte volume. {{(pid=86512) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:30:56 devstack cinder-volume[86512]: INFO cinder.volume.drivers.remotefs [None req-41a8a003-5796-4ee2-bfa6-940a5767d237 tempest-VolumesActionsTest-208535436 None] casted to osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 Sep 29 18:30:56 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-41a8a003-5796-4ee2-bfa6-940a5767d237 tempest-VolumesActionsTest-208535436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-88c5cda9-3df6-4dc3-b87a-6fbf3614e0b2 1073741824 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:30:56 devstack sudo[102418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-88c5cda9-3df6-4dc3-b87a-6fbf3614e0b2 1073741824 Sep 29 18:30:56 devstack sudo[102418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:30:56 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [req-e587ec2c-bbb8-4e7a-a8c3-93d2c578ffe7 req-815a0bb0-0f9a-4474-ac85-b6429bcd1cb3 tempest-TestInstancesWithCinderVolumes-816149194 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:30:56 devstack sudo[102418]: pam_unix(sudo:session): session closed for user root Sep 29 18:30:56 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-41a8a003-5796-4ee2-bfa6-940a5767d237 tempest-VolumesActionsTest-208535436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-88c5cda9-3df6-4dc3-b87a-6fbf3614e0b2 1073741824" returned: 0 in 0.475s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:30:56 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-41a8a003-5796-4ee2-bfa6-940a5767d237 tempest-VolumesActionsTest-208535436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-88c5cda9-3df6-4dc3-b87a-6fbf3614e0b2 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:30:56 devstack sudo[102427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-88c5cda9-3df6-4dc3-b87a-6fbf3614e0b2 Sep 29 18:30:56 devstack sudo[102427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:30:56 devstack sudo[102427]: pam_unix(sudo:session): session closed for user root Sep 29 18:30:56 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-41a8a003-5796-4ee2-bfa6-940a5767d237 tempest-VolumesActionsTest-208535436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-88c5cda9-3df6-4dc3-b87a-6fbf3614e0b2" returned: 0 in 0.254s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:30:56 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-41a8a003-5796-4ee2-bfa6-940a5767d237 tempest-VolumesActionsTest-208535436 None] <== create_volume: return (779ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'} {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:30:56 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-41a8a003-5796-4ee2-bfa6-940a5767d237 tempest-VolumesActionsTest-208535436 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.783s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:30:56 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [req-e587ec2c-bbb8-4e7a-a8c3-93d2c578ffe7 req-815a0bb0-0f9a-4474-ac85-b6429bcd1cb3 tempest-TestInstancesWithCinderVolumes-816149194 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.601s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:30:56 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-41a8a003-5796-4ee2-bfa6-940a5767d237 tempest-VolumesActionsTest-208535436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d547acb-352f-48d9-9ba1-7222ee6c44bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88c5cda9-3df6-4dc3-b87a-6fbf3614e0b2', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:30:56 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-41a8a003-5796-4ee2-bfa6-940a5767d237 tempest-VolumesActionsTest-208535436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8866bdd-a93f-457e-b5d0-6c18db823e58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:30:56 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [req-e587ec2c-bbb8-4e7a-a8c3-93d2c578ffe7 req-815a0bb0-0f9a-4474-ac85-b6429bcd1cb3 tempest-TestInstancesWithCinderVolumes-816149194 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.027s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:30:56 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-41a8a003-5796-4ee2-bfa6-940a5767d237 tempest-VolumesActionsTest-208535436 None] Volume volume-88c5cda9-3df6-4dc3-b87a-6fbf3614e0b2 (88c5cda9-3df6-4dc3-b87a-6fbf3614e0b2): created successfully Sep 29 18:30:56 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-41a8a003-5796-4ee2-bfa6-940a5767d237 tempest-VolumesActionsTest-208535436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8866bdd-a93f-457e-b5d0-6c18db823e58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:30:56 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-41a8a003-5796-4ee2-bfa6-940a5767d237 tempest-VolumesActionsTest-208535436 None] Flow 'volume_create_manager' (a8017d58-4bd0-4793-99f5-fd24a5845de1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:30:56 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-41a8a003-5796-4ee2-bfa6-940a5767d237 tempest-VolumesActionsTest-208535436 None] Created volume successfully. Sep 29 18:30:56 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [req-e587ec2c-bbb8-4e7a-a8c3-93d2c578ffe7 req-815a0bb0-0f9a-4474-ac85-b6429bcd1cb3 tempest-TestInstancesWithCinderVolumes-816149194 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883', 'name': 'volume-159b774d-834f-491a-8b11-2aad8a4f106d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd8f46fb6-1807-4325-b030-ed8104c770b3', 'enforce_multipath': True} {{(pid=86512) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 29 18:30:56 devstack cinder-volume[86512]: INFO cinder.volume.manager [req-e587ec2c-bbb8-4e7a-a8c3-93d2c578ffe7 req-815a0bb0-0f9a-4474-ac85-b6429bcd1cb3 tempest-TestInstancesWithCinderVolumes-816149194 None] attachment_update completed successfully. Sep 29 18:30:58 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-1961ea0c-e767-45f6-a4c5-ab5f28805e90 tempest-VolumesActionsTest-898359120 None] Acquiring lock "cinder-88c5cda9-3df6-4dc3-b87a-6fbf3614e0b2-delete_volume" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:30:58 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-1961ea0c-e767-45f6-a4c5-ab5f28805e90 tempest-VolumesActionsTest-898359120 None] Lock "cinder-88c5cda9-3df6-4dc3-b87a-6fbf3614e0b2-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:30:58 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-1961ea0c-e767-45f6-a4c5-ab5f28805e90 tempest-VolumesActionsTest-898359120 None] Acquiring lock "cinder-quobyte-88c5cda9-3df6-4dc3-b87a-6fbf3614e0b2" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:30:58 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-1961ea0c-e767-45f6-a4c5-ab5f28805e90 tempest-VolumesActionsTest-898359120 None] Lock "cinder-quobyte-88c5cda9-3df6-4dc3-b87a-6fbf3614e0b2" acquired by "delete_volume" :: waited 0.016s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:30:58 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[808dc7e8-369c-4c5f-b5ec-09de2f4926df]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:30:58 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-1961ea0c-e767-45f6-a4c5-ab5f28805e90 tempest-VolumesActionsTest-898359120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-88c5cda9-3df6-4dc3-b87a-6fbf3614e0b2 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:30:58 devstack sudo[102439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-88c5cda9-3df6-4dc3-b87a-6fbf3614e0b2 Sep 29 18:30:58 devstack sudo[102439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:30:58 devstack sudo[102439]: pam_unix(sudo:session): session closed for user root Sep 29 18:30:58 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-1961ea0c-e767-45f6-a4c5-ab5f28805e90 tempest-VolumesActionsTest-898359120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-88c5cda9-3df6-4dc3-b87a-6fbf3614e0b2" returned: 0 in 0.461s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:30:58 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-1961ea0c-e767-45f6-a4c5-ab5f28805e90 tempest-VolumesActionsTest-898359120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-88c5cda9-3df6-4dc3-b87a-6fbf3614e0b2 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:30:58 devstack sudo[102450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-88c5cda9-3df6-4dc3-b87a-6fbf3614e0b2 Sep 29 18:30:58 devstack sudo[102450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:30:59 devstack sudo[102450]: pam_unix(sudo:session): session closed for user root Sep 29 18:30:59 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-1961ea0c-e767-45f6-a4c5-ab5f28805e90 tempest-VolumesActionsTest-898359120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-88c5cda9-3df6-4dc3-b87a-6fbf3614e0b2" returned: 0 in 0.281s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:30:59 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-1961ea0c-e767-45f6-a4c5-ab5f28805e90 tempest-VolumesActionsTest-898359120 None] Lock "cinder-quobyte-88c5cda9-3df6-4dc3-b87a-6fbf3614e0b2" released by "delete_volume" :: held 0.794s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:30:59 devstack cinder-volume[86512]: DEBUG dbcounter [-] [86512] Writing DB stats cinder:SELECT=61,cinder:UPDATE=57,cinder:INSERT=13,cinder:DELETE=4 {{(pid=86512) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 18:30:59 devstack cinder-volume[86512]: DEBUG dbcounter [-] [86512] Writing DB stats cinder:SELECT=69,cinder:UPDATE=54,cinder:INSERT=17,cinder:DELETE=6 {{(pid=86512) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 18:30:59 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-1961ea0c-e767-45f6-a4c5-ab5f28805e90 tempest-VolumesActionsTest-898359120 None] Created reservations ['f083c578-1cb5-412e-845f-3d9e7e3b6897', '41588a20-0970-49d9-a2f2-db67a1e4339f', '6ca70213-721a-4c46-a5ae-4a17c0edd045', '76b79ec4-cf1e-49fc-b847-acb9bb0f3756'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:30:59 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-1961ea0c-e767-45f6-a4c5-ab5f28805e90 tempest-VolumesActionsTest-898359120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:30:59 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-1961ea0c-e767-45f6-a4c5-ab5f28805e90 tempest-VolumesActionsTest-898359120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:30:59 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-1961ea0c-e767-45f6-a4c5-ab5f28805e90 tempest-VolumesActionsTest-898359120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:30:59 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-1961ea0c-e767-45f6-a4c5-ab5f28805e90 tempest-VolumesActionsTest-898359120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:30:59 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-1961ea0c-e767-45f6-a4c5-ab5f28805e90 tempest-VolumesActionsTest-898359120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:30:59 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-1961ea0c-e767-45f6-a4c5-ab5f28805e90 tempest-VolumesActionsTest-898359120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:30:59 devstack sudo[102453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:30:59 devstack sudo[102453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:30:59 devstack sudo[102453]: pam_unix(sudo:session): session closed for user root Sep 29 18:30:59 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-1961ea0c-e767-45f6-a4c5-ab5f28805e90 tempest-VolumesActionsTest-898359120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.325s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:30:59 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-1961ea0c-e767-45f6-a4c5-ab5f28805e90 tempest-VolumesActionsTest-898359120 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:30:59 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-1961ea0c-e767-45f6-a4c5-ab5f28805e90 tempest-VolumesActionsTest-898359120 None] Deleted volume successfully. Sep 29 18:30:59 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-1961ea0c-e767-45f6-a4c5-ab5f28805e90 tempest-VolumesActionsTest-898359120 None] Lock "cinder-88c5cda9-3df6-4dc3-b87a-6fbf3614e0b2-delete_volume" released by "delete_volume" :: held 1.412s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:30:59 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [req-30be8c71-1c48-4de2-aac3-c3e93bde41a3 req-1d73191a-a8c1-41f5-8430-881552f5855a tempest-TestInstancesWithCinderVolumes-816149194 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:30:59 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [req-30be8c71-1c48-4de2-aac3-c3e93bde41a3 req-1d73191a-a8c1-41f5-8430-881552f5855a tempest-TestInstancesWithCinderVolumes-816149194 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:30:59 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [req-30be8c71-1c48-4de2-aac3-c3e93bde41a3 req-1d73191a-a8c1-41f5-8430-881552f5855a tempest-TestInstancesWithCinderVolumes-816149194 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:30:59 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [req-30be8c71-1c48-4de2-aac3-c3e93bde41a3 req-1d73191a-a8c1-41f5-8430-881552f5855a tempest-TestInstancesWithCinderVolumes-816149194 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883', 'name': 'volume-c9748846-2b0b-4e3f-bf30-1974b9da37dd', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '77cc7d6f-56a4-4853-8537-54102ec24738', 'enforce_multipath': True} {{(pid=86512) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 29 18:30:59 devstack cinder-volume[86512]: INFO cinder.volume.manager [req-30be8c71-1c48-4de2-aac3-c3e93bde41a3 req-1d73191a-a8c1-41f5-8430-881552f5855a tempest-TestInstancesWithCinderVolumes-816149194 None] attachment_update completed successfully. Sep 29 18:31:00 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0101766-30fa-46cb-9d65-ff2c13a23a4c tempest-VolumesActionsTest-208535436 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86512) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:31:00 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d0101766-30fa-46cb-9d65-ff2c13a23a4c tempest-VolumesActionsTest-208535436 None] Flow 'volume_create_manager' (0fdee585-842e-40a6-8007-9a7d49aab3c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:31:00 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d0101766-30fa-46cb-9d65-ff2c13a23a4c tempest-VolumesActionsTest-208535436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb8c5b1f-757c-4b2f-9acf-385073bb1d81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:31:00 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d0101766-30fa-46cb-9d65-ff2c13a23a4c tempest-VolumesActionsTest-208535436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb8c5b1f-757c-4b2f-9acf-385073bb1d81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:31:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1524834049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6c79742-76fe-4497-9a4f-e772c8d0dfe0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bd4ad9e97f14fc6981eee84025c56b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:31:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:31:00Z,use_quota=True,user_id='47d555d3cb7c4624bd2e857fd54661e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:31:00 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d0101766-30fa-46cb-9d65-ff2c13a23a4c tempest-VolumesActionsTest-208535436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0bb3d42-3eca-4dec-b86c-409850f79e40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:31:00 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d0101766-30fa-46cb-9d65-ff2c13a23a4c tempest-VolumesActionsTest-208535436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0bb3d42-3eca-4dec-b86c-409850f79e40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:31:00 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d0101766-30fa-46cb-9d65-ff2c13a23a4c tempest-VolumesActionsTest-208535436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b55f004-f3ac-4091-922f-dac7418e14a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:31:00 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d0101766-30fa-46cb-9d65-ff2c13a23a4c tempest-VolumesActionsTest-208535436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b55f004-f3ac-4091-922f-dac7418e14a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6c79742-76fe-4497-9a4f-e772c8d0dfe0', 'volume_name': 'volume-a6c79742-76fe-4497-9a4f-e772c8d0dfe0', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:31:00 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d0101766-30fa-46cb-9d65-ff2c13a23a4c tempest-VolumesActionsTest-208535436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (184cea88-7349-40bd-b94f-047ef185e33f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:31:00 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d0101766-30fa-46cb-9d65-ff2c13a23a4c tempest-VolumesActionsTest-208535436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (184cea88-7349-40bd-b94f-047ef185e33f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:31:00 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d0101766-30fa-46cb-9d65-ff2c13a23a4c tempest-VolumesActionsTest-208535436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6269684f-4f77-4863-a4b9-9353f35c38e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:31:00 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-d0101766-30fa-46cb-9d65-ff2c13a23a4c tempest-VolumesActionsTest-208535436 None] Volume a6c79742-76fe-4497-9a4f-e772c8d0dfe0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6c79742-76fe-4497-9a4f-e772c8d0dfe0', 'volume_size': 1} Sep 29 18:31:00 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-d0101766-30fa-46cb-9d65-ff2c13a23a4c tempest-VolumesActionsTest-208535436 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:31:00 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-d0101766-30fa-46cb-9d65-ff2c13a23a4c tempest-VolumesActionsTest-208535436 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:31:00 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-d0101766-30fa-46cb-9d65-ff2c13a23a4c tempest-VolumesActionsTest-208535436 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:31:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1524834049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6c79742-76fe-4497-9a4f-e772c8d0dfe0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bd4ad9e97f14fc6981eee84025c56b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:31:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:31:00Z,use_quota=True,user_id='47d555d3cb7c4624bd2e857fd54661e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)}" {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:31:00 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-d0101766-30fa-46cb-9d65-ff2c13a23a4c tempest-VolumesActionsTest-208535436 None] Creating volume a6c79742-76fe-4497-9a4f-e772c8d0dfe0 {{(pid=86512) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:31:00 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-d0101766-30fa-46cb-9d65-ff2c13a23a4c tempest-VolumesActionsTest-208535436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:31:00 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-d0101766-30fa-46cb-9d65-ff2c13a23a4c tempest-VolumesActionsTest-208535436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:31:00 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-d0101766-30fa-46cb-9d65-ff2c13a23a4c tempest-VolumesActionsTest-208535436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:31:00 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-d0101766-30fa-46cb-9d65-ff2c13a23a4c tempest-VolumesActionsTest-208535436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:31:00 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-d0101766-30fa-46cb-9d65-ff2c13a23a4c tempest-VolumesActionsTest-208535436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:31:00 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-d0101766-30fa-46cb-9d65-ff2c13a23a4c tempest-VolumesActionsTest-208535436 None] Selected osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 as target Quobyte volume. {{(pid=86512) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:31:00 devstack cinder-volume[86512]: INFO cinder.volume.drivers.remotefs [None req-d0101766-30fa-46cb-9d65-ff2c13a23a4c tempest-VolumesActionsTest-208535436 None] casted to osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 Sep 29 18:31:00 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-d0101766-30fa-46cb-9d65-ff2c13a23a4c tempest-VolumesActionsTest-208535436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a6c79742-76fe-4497-9a4f-e772c8d0dfe0 1073741824 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:31:00 devstack sudo[102468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a6c79742-76fe-4497-9a4f-e772c8d0dfe0 1073741824 Sep 29 18:31:00 devstack sudo[102468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:31:00 devstack sudo[102468]: pam_unix(sudo:session): session closed for user root Sep 29 18:31:00 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-d0101766-30fa-46cb-9d65-ff2c13a23a4c tempest-VolumesActionsTest-208535436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a6c79742-76fe-4497-9a4f-e772c8d0dfe0 1073741824" returned: 0 in 0.565s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:31:00 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-d0101766-30fa-46cb-9d65-ff2c13a23a4c tempest-VolumesActionsTest-208535436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a6c79742-76fe-4497-9a4f-e772c8d0dfe0 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:31:00 devstack sudo[102475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a6c79742-76fe-4497-9a4f-e772c8d0dfe0 Sep 29 18:31:00 devstack sudo[102475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:31:00 devstack sudo[102475]: pam_unix(sudo:session): session closed for user root Sep 29 18:31:00 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-d0101766-30fa-46cb-9d65-ff2c13a23a4c tempest-VolumesActionsTest-208535436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a6c79742-76fe-4497-9a4f-e772c8d0dfe0" returned: 0 in 0.269s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:31:00 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-d0101766-30fa-46cb-9d65-ff2c13a23a4c tempest-VolumesActionsTest-208535436 None] <== create_volume: return (883ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'} {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:31:00 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-d0101766-30fa-46cb-9d65-ff2c13a23a4c tempest-VolumesActionsTest-208535436 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.885s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:31:01 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d0101766-30fa-46cb-9d65-ff2c13a23a4c tempest-VolumesActionsTest-208535436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6269684f-4f77-4863-a4b9-9353f35c38e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6c79742-76fe-4497-9a4f-e772c8d0dfe0', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:31:01 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d0101766-30fa-46cb-9d65-ff2c13a23a4c tempest-VolumesActionsTest-208535436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09ea117e-9b2e-4451-b2fa-03ccdc8bd810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:31:01 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-d0101766-30fa-46cb-9d65-ff2c13a23a4c tempest-VolumesActionsTest-208535436 None] Volume volume-a6c79742-76fe-4497-9a4f-e772c8d0dfe0 (a6c79742-76fe-4497-9a4f-e772c8d0dfe0): created successfully Sep 29 18:31:01 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d0101766-30fa-46cb-9d65-ff2c13a23a4c tempest-VolumesActionsTest-208535436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09ea117e-9b2e-4451-b2fa-03ccdc8bd810) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:31:01 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d0101766-30fa-46cb-9d65-ff2c13a23a4c tempest-VolumesActionsTest-208535436 None] Flow 'volume_create_manager' (0fdee585-842e-40a6-8007-9a7d49aab3c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:31:01 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-d0101766-30fa-46cb-9d65-ff2c13a23a4c tempest-VolumesActionsTest-208535436 None] Created volume successfully. Sep 29 18:31:02 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-7b8c5966-977e-42ef-b63f-0c2420e3c2bc tempest-VolumesActionsTest-898359120 None] Acquiring lock "cinder-a6c79742-76fe-4497-9a4f-e772c8d0dfe0-delete_volume" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:31:02 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-7b8c5966-977e-42ef-b63f-0c2420e3c2bc tempest-VolumesActionsTest-898359120 None] Lock "cinder-a6c79742-76fe-4497-9a4f-e772c8d0dfe0-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:31:02 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-7b8c5966-977e-42ef-b63f-0c2420e3c2bc tempest-VolumesActionsTest-898359120 None] Acquiring lock "cinder-quobyte-a6c79742-76fe-4497-9a4f-e772c8d0dfe0" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:31:02 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-7b8c5966-977e-42ef-b63f-0c2420e3c2bc tempest-VolumesActionsTest-898359120 None] Lock "cinder-quobyte-a6c79742-76fe-4497-9a4f-e772c8d0dfe0" acquired by "delete_volume" :: waited 0.020s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:31:02 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b7c1d55-fb83-4d09-887b-b36cd6dbf80c]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:31:02 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-7b8c5966-977e-42ef-b63f-0c2420e3c2bc tempest-VolumesActionsTest-898359120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a6c79742-76fe-4497-9a4f-e772c8d0dfe0 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:31:02 devstack sudo[102486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a6c79742-76fe-4497-9a4f-e772c8d0dfe0 Sep 29 18:31:02 devstack sudo[102486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:31:02 devstack sudo[102486]: pam_unix(sudo:session): session closed for user root Sep 29 18:31:02 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-7b8c5966-977e-42ef-b63f-0c2420e3c2bc tempest-VolumesActionsTest-898359120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a6c79742-76fe-4497-9a4f-e772c8d0dfe0" returned: 0 in 0.419s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:31:02 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-7b8c5966-977e-42ef-b63f-0c2420e3c2bc tempest-VolumesActionsTest-898359120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a6c79742-76fe-4497-9a4f-e772c8d0dfe0 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:31:02 devstack sudo[102491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a6c79742-76fe-4497-9a4f-e772c8d0dfe0 Sep 29 18:31:02 devstack sudo[102491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:31:03 devstack sudo[102491]: pam_unix(sudo:session): session closed for user root Sep 29 18:31:03 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-7b8c5966-977e-42ef-b63f-0c2420e3c2bc tempest-VolumesActionsTest-898359120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a6c79742-76fe-4497-9a4f-e772c8d0dfe0" returned: 0 in 0.297s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:31:03 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-7b8c5966-977e-42ef-b63f-0c2420e3c2bc tempest-VolumesActionsTest-898359120 None] Lock "cinder-quobyte-a6c79742-76fe-4497-9a4f-e772c8d0dfe0" released by "delete_volume" :: held 0.782s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:31:03 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-7b8c5966-977e-42ef-b63f-0c2420e3c2bc tempest-VolumesActionsTest-898359120 None] Created reservations ['b23be451-465f-4247-b0a4-404f13c7a3b0', '1e495cbb-481f-43d5-8f29-fbb0076d4634', '665ec8b7-2aa3-467a-995c-0f929f1f7a28', 'd4f0b80b-1d50-4c7f-bd65-e7c0a837bcb6'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:31:03 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-7b8c5966-977e-42ef-b63f-0c2420e3c2bc tempest-VolumesActionsTest-898359120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:31:03 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-7b8c5966-977e-42ef-b63f-0c2420e3c2bc tempest-VolumesActionsTest-898359120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:31:03 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-7b8c5966-977e-42ef-b63f-0c2420e3c2bc tempest-VolumesActionsTest-898359120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:31:03 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-7b8c5966-977e-42ef-b63f-0c2420e3c2bc tempest-VolumesActionsTest-898359120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:31:03 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-7b8c5966-977e-42ef-b63f-0c2420e3c2bc tempest-VolumesActionsTest-898359120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:31:03 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-7b8c5966-977e-42ef-b63f-0c2420e3c2bc tempest-VolumesActionsTest-898359120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:31:03 devstack sudo[102494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:31:03 devstack sudo[102494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:31:03 devstack sudo[102494]: pam_unix(sudo:session): session closed for user root Sep 29 18:31:03 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-7b8c5966-977e-42ef-b63f-0c2420e3c2bc tempest-VolumesActionsTest-898359120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.349s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:31:03 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-7b8c5966-977e-42ef-b63f-0c2420e3c2bc tempest-VolumesActionsTest-898359120 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:31:03 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-7b8c5966-977e-42ef-b63f-0c2420e3c2bc tempest-VolumesActionsTest-898359120 None] Deleted volume successfully. Sep 29 18:31:03 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-7b8c5966-977e-42ef-b63f-0c2420e3c2bc tempest-VolumesActionsTest-898359120 None] Lock "cinder-a6c79742-76fe-4497-9a4f-e772c8d0dfe0-delete_volume" released by "delete_volume" :: held 1.427s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:31:04 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa7624c5-1b01-4016-93e6-930c704d2d23 tempest-VolumesActionsTest-208535436 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86512) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:31:04 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-aa7624c5-1b01-4016-93e6-930c704d2d23 tempest-VolumesActionsTest-208535436 None] Flow 'volume_create_manager' (7ad9a44e-8bb5-4b2f-99cc-7741a1b44177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:31:04 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-aa7624c5-1b01-4016-93e6-930c704d2d23 tempest-VolumesActionsTest-208535436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (006d74eb-eb51-4990-ac98-2f5229d3f27d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:31:04 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-aa7624c5-1b01-4016-93e6-930c704d2d23 tempest-VolumesActionsTest-208535436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (006d74eb-eb51-4990-ac98-2f5229d3f27d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:31:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-396479999',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae3ecebf-36b3-49a1-8c7f-f5d151651706,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bd4ad9e97f14fc6981eee84025c56b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:31:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:31:04Z,use_quota=True,user_id='47d555d3cb7c4624bd2e857fd54661e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:31:04 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-aa7624c5-1b01-4016-93e6-930c704d2d23 tempest-VolumesActionsTest-208535436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b74a413-53d9-4d90-a439-57cdc05dda9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:31:04 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-aa7624c5-1b01-4016-93e6-930c704d2d23 tempest-VolumesActionsTest-208535436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b74a413-53d9-4d90-a439-57cdc05dda9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:31:04 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-aa7624c5-1b01-4016-93e6-930c704d2d23 tempest-VolumesActionsTest-208535436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9241438a-747c-4f6f-90fa-d5f0d6e6c874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:31:04 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-aa7624c5-1b01-4016-93e6-930c704d2d23 tempest-VolumesActionsTest-208535436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9241438a-747c-4f6f-90fa-d5f0d6e6c874) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae3ecebf-36b3-49a1-8c7f-f5d151651706', 'volume_name': 'volume-ae3ecebf-36b3-49a1-8c7f-f5d151651706', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:31:04 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-aa7624c5-1b01-4016-93e6-930c704d2d23 tempest-VolumesActionsTest-208535436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ed0d3b9-fe55-4435-b40f-1fe2332d7dbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:31:04 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-aa7624c5-1b01-4016-93e6-930c704d2d23 tempest-VolumesActionsTest-208535436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ed0d3b9-fe55-4435-b40f-1fe2332d7dbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:31:04 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-aa7624c5-1b01-4016-93e6-930c704d2d23 tempest-VolumesActionsTest-208535436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eed21945-a113-41e9-9968-43ac35e12549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:31:04 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-aa7624c5-1b01-4016-93e6-930c704d2d23 tempest-VolumesActionsTest-208535436 None] Volume ae3ecebf-36b3-49a1-8c7f-f5d151651706: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae3ecebf-36b3-49a1-8c7f-f5d151651706', 'volume_size': 1} Sep 29 18:31:04 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-aa7624c5-1b01-4016-93e6-930c704d2d23 tempest-VolumesActionsTest-208535436 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:31:04 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-aa7624c5-1b01-4016-93e6-930c704d2d23 tempest-VolumesActionsTest-208535436 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:31:04 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-aa7624c5-1b01-4016-93e6-930c704d2d23 tempest-VolumesActionsTest-208535436 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:31:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-396479999',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae3ecebf-36b3-49a1-8c7f-f5d151651706,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bd4ad9e97f14fc6981eee84025c56b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:31:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:31:04Z,use_quota=True,user_id='47d555d3cb7c4624bd2e857fd54661e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)}" {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:31:04 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-aa7624c5-1b01-4016-93e6-930c704d2d23 tempest-VolumesActionsTest-208535436 None] Creating volume ae3ecebf-36b3-49a1-8c7f-f5d151651706 {{(pid=86512) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:31:04 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-aa7624c5-1b01-4016-93e6-930c704d2d23 tempest-VolumesActionsTest-208535436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:31:04 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-aa7624c5-1b01-4016-93e6-930c704d2d23 tempest-VolumesActionsTest-208535436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:31:04 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-aa7624c5-1b01-4016-93e6-930c704d2d23 tempest-VolumesActionsTest-208535436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:31:04 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-aa7624c5-1b01-4016-93e6-930c704d2d23 tempest-VolumesActionsTest-208535436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:31:04 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-aa7624c5-1b01-4016-93e6-930c704d2d23 tempest-VolumesActionsTest-208535436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:31:04 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-aa7624c5-1b01-4016-93e6-930c704d2d23 tempest-VolumesActionsTest-208535436 None] Selected osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 as target Quobyte volume. {{(pid=86512) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:31:04 devstack cinder-volume[86512]: INFO cinder.volume.drivers.remotefs [None req-aa7624c5-1b01-4016-93e6-930c704d2d23 tempest-VolumesActionsTest-208535436 None] casted to osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 Sep 29 18:31:04 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-aa7624c5-1b01-4016-93e6-930c704d2d23 tempest-VolumesActionsTest-208535436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ae3ecebf-36b3-49a1-8c7f-f5d151651706 1073741824 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:31:04 devstack sudo[102502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ae3ecebf-36b3-49a1-8c7f-f5d151651706 1073741824 Sep 29 18:31:04 devstack sudo[102502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:31:05 devstack sudo[102502]: pam_unix(sudo:session): session closed for user root Sep 29 18:31:05 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-aa7624c5-1b01-4016-93e6-930c704d2d23 tempest-VolumesActionsTest-208535436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ae3ecebf-36b3-49a1-8c7f-f5d151651706 1073741824" returned: 0 in 0.526s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:31:05 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-aa7624c5-1b01-4016-93e6-930c704d2d23 tempest-VolumesActionsTest-208535436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ae3ecebf-36b3-49a1-8c7f-f5d151651706 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:31:05 devstack sudo[102520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ae3ecebf-36b3-49a1-8c7f-f5d151651706 Sep 29 18:31:05 devstack sudo[102520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:31:05 devstack sudo[102520]: pam_unix(sudo:session): session closed for user root Sep 29 18:31:05 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-aa7624c5-1b01-4016-93e6-930c704d2d23 tempest-VolumesActionsTest-208535436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ae3ecebf-36b3-49a1-8c7f-f5d151651706" returned: 0 in 0.318s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:31:05 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-aa7624c5-1b01-4016-93e6-930c704d2d23 tempest-VolumesActionsTest-208535436 None] <== create_volume: return (902ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'} {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:31:05 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-aa7624c5-1b01-4016-93e6-930c704d2d23 tempest-VolumesActionsTest-208535436 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.907s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:31:05 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-aa7624c5-1b01-4016-93e6-930c704d2d23 tempest-VolumesActionsTest-208535436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eed21945-a113-41e9-9968-43ac35e12549) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae3ecebf-36b3-49a1-8c7f-f5d151651706', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:31:05 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-aa7624c5-1b01-4016-93e6-930c704d2d23 tempest-VolumesActionsTest-208535436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5f322ca-5e57-4ddc-b190-1df323137c92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:31:05 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-aa7624c5-1b01-4016-93e6-930c704d2d23 tempest-VolumesActionsTest-208535436 None] Volume volume-ae3ecebf-36b3-49a1-8c7f-f5d151651706 (ae3ecebf-36b3-49a1-8c7f-f5d151651706): created successfully Sep 29 18:31:05 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-aa7624c5-1b01-4016-93e6-930c704d2d23 tempest-VolumesActionsTest-208535436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5f322ca-5e57-4ddc-b190-1df323137c92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:31:05 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-aa7624c5-1b01-4016-93e6-930c704d2d23 tempest-VolumesActionsTest-208535436 None] Flow 'volume_create_manager' (7ad9a44e-8bb5-4b2f-99cc-7741a1b44177) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:31:05 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-aa7624c5-1b01-4016-93e6-930c704d2d23 tempest-VolumesActionsTest-208535436 None] Created volume successfully. Sep 29 18:31:06 devstack cinder-volume[86512]: INFO cinder.volume.manager [req-fe1e074f-25a7-4502-adb0-06a3acecc5c2 req-a04ceb27-2d94-47be-af10-41281fc3b148 tempest-TestInstancesWithCinderVolumes-816149194 None] Terminate volume connection completed successfully. Sep 29 18:31:06 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [req-fe1e074f-25a7-4502-adb0-06a3acecc5c2 req-a04ceb27-2d94-47be-af10-41281fc3b148 tempest-TestInstancesWithCinderVolumes-816149194 None] Deleting attachment d8f46fb6-1807-4325-b030-ed8104c770b3. {{(pid=86512) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 29 18:31:06 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-8ddd0f21-dce4-4054-b7d6-2161b375b3aa tempest-VolumesActionsTest-898359120 None] Acquiring lock "cinder-ae3ecebf-36b3-49a1-8c7f-f5d151651706-delete_volume" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:31:06 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-8ddd0f21-dce4-4054-b7d6-2161b375b3aa tempest-VolumesActionsTest-898359120 None] Lock "cinder-ae3ecebf-36b3-49a1-8c7f-f5d151651706-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:31:06 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-8ddd0f21-dce4-4054-b7d6-2161b375b3aa tempest-VolumesActionsTest-898359120 None] Acquiring lock "cinder-quobyte-ae3ecebf-36b3-49a1-8c7f-f5d151651706" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:31:06 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-8ddd0f21-dce4-4054-b7d6-2161b375b3aa tempest-VolumesActionsTest-898359120 None] Lock "cinder-quobyte-ae3ecebf-36b3-49a1-8c7f-f5d151651706" acquired by "delete_volume" :: waited 0.028s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:31:06 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[053ba0f7-97ea-4021-bde9-c737e955c184]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:31:06 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-8ddd0f21-dce4-4054-b7d6-2161b375b3aa tempest-VolumesActionsTest-898359120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ae3ecebf-36b3-49a1-8c7f-f5d151651706 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:31:07 devstack sudo[102537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ae3ecebf-36b3-49a1-8c7f-f5d151651706 Sep 29 18:31:07 devstack sudo[102537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:31:07 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-8f2a434d-9d48-45bf-beab-8186269322ee tempest-TestInstancesWithCinderVolumes-816149194 None] Acquiring lock "cinder-159b774d-834f-491a-8b11-2aad8a4f106d-delete_volume" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:31:07 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-8f2a434d-9d48-45bf-beab-8186269322ee tempest-TestInstancesWithCinderVolumes-816149194 None] Lock "cinder-159b774d-834f-491a-8b11-2aad8a4f106d-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:31:07 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-8f2a434d-9d48-45bf-beab-8186269322ee tempest-TestInstancesWithCinderVolumes-816149194 None] Acquiring lock "cinder-quobyte-159b774d-834f-491a-8b11-2aad8a4f106d" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:31:07 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-8f2a434d-9d48-45bf-beab-8186269322ee tempest-TestInstancesWithCinderVolumes-816149194 None] Lock "cinder-quobyte-159b774d-834f-491a-8b11-2aad8a4f106d" acquired by "delete_volume" :: waited 0.024s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:31:07 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[480cbbad-5db7-4f06-a48b-037fdbdf2ea8]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:31:07 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-8f2a434d-9d48-45bf-beab-8186269322ee tempest-TestInstancesWithCinderVolumes-816149194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-159b774d-834f-491a-8b11-2aad8a4f106d {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:31:07 devstack sudo[102537]: pam_unix(sudo:session): session closed for user root Sep 29 18:31:07 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-8ddd0f21-dce4-4054-b7d6-2161b375b3aa tempest-VolumesActionsTest-898359120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ae3ecebf-36b3-49a1-8c7f-f5d151651706" returned: 0 in 0.497s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:31:07 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-8ddd0f21-dce4-4054-b7d6-2161b375b3aa tempest-VolumesActionsTest-898359120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ae3ecebf-36b3-49a1-8c7f-f5d151651706 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:31:07 devstack sudo[102543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-159b774d-834f-491a-8b11-2aad8a4f106d Sep 29 18:31:07 devstack sudo[102543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:31:07 devstack sudo[102547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ae3ecebf-36b3-49a1-8c7f-f5d151651706 Sep 29 18:31:07 devstack sudo[102547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:31:07 devstack sudo[102547]: pam_unix(sudo:session): session closed for user root Sep 29 18:31:07 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-8ddd0f21-dce4-4054-b7d6-2161b375b3aa tempest-VolumesActionsTest-898359120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ae3ecebf-36b3-49a1-8c7f-f5d151651706" returned: 0 in 0.445s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:31:07 devstack sudo[102543]: pam_unix(sudo:session): session closed for user root Sep 29 18:31:07 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-8f2a434d-9d48-45bf-beab-8186269322ee tempest-TestInstancesWithCinderVolumes-816149194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-159b774d-834f-491a-8b11-2aad8a4f106d" returned: 0 in 0.641s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:31:07 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-8f2a434d-9d48-45bf-beab-8186269322ee tempest-TestInstancesWithCinderVolumes-816149194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-159b774d-834f-491a-8b11-2aad8a4f106d {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:31:07 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-8ddd0f21-dce4-4054-b7d6-2161b375b3aa tempest-VolumesActionsTest-898359120 None] Lock "cinder-quobyte-ae3ecebf-36b3-49a1-8c7f-f5d151651706" released by "delete_volume" :: held 1.093s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:31:07 devstack sudo[102554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-159b774d-834f-491a-8b11-2aad8a4f106d Sep 29 18:31:07 devstack sudo[102554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:31:07 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-8ddd0f21-dce4-4054-b7d6-2161b375b3aa tempest-VolumesActionsTest-898359120 None] Created reservations ['3e99006f-a855-4b1d-ae21-f12c4ccc62d2', 'ec455011-f9b5-47cd-80ab-1ab9f2c28b62', 'b13226c3-8267-400e-8f3a-d9690e5150e9', '6d566de9-a672-4c6a-8688-8f1a2352e6bd'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:31:08 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-8ddd0f21-dce4-4054-b7d6-2161b375b3aa tempest-VolumesActionsTest-898359120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:31:08 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-8ddd0f21-dce4-4054-b7d6-2161b375b3aa tempest-VolumesActionsTest-898359120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:31:08 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-8ddd0f21-dce4-4054-b7d6-2161b375b3aa tempest-VolumesActionsTest-898359120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:31:08 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-8ddd0f21-dce4-4054-b7d6-2161b375b3aa tempest-VolumesActionsTest-898359120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:31:08 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-8ddd0f21-dce4-4054-b7d6-2161b375b3aa tempest-VolumesActionsTest-898359120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:31:08 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-8ddd0f21-dce4-4054-b7d6-2161b375b3aa tempest-VolumesActionsTest-898359120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:31:08 devstack sudo[102556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:31:08 devstack sudo[102556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:31:08 devstack sudo[102554]: pam_unix(sudo:session): session closed for user root Sep 29 18:31:08 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-8f2a434d-9d48-45bf-beab-8186269322ee tempest-TestInstancesWithCinderVolumes-816149194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-159b774d-834f-491a-8b11-2aad8a4f106d" returned: 0 in 0.337s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:31:08 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-8f2a434d-9d48-45bf-beab-8186269322ee tempest-TestInstancesWithCinderVolumes-816149194 None] Lock "cinder-quobyte-159b774d-834f-491a-8b11-2aad8a4f106d" released by "delete_volume" :: held 1.048s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:31:08 devstack cinder-volume[86512]: WARNING cinder.quota [None req-8f2a434d-9d48-45bf-beab-8186269322ee tempest-TestInstancesWithCinderVolumes-816149194 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-718919350-1882825012 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-718919350-1882825012, it is now deprecated. Please use the default quota class for default quota. Sep 29 18:31:08 devstack cinder-volume[86512]: WARNING cinder.quota [None req-8f2a434d-9d48-45bf-beab-8186269322ee tempest-TestInstancesWithCinderVolumes-816149194 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-718919350-1882825012 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-718919350-1882825012, it is now deprecated. Please use the default quota class for default quota. Sep 29 18:31:08 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-8f2a434d-9d48-45bf-beab-8186269322ee tempest-TestInstancesWithCinderVolumes-816149194 None] Created reservations ['c10fa51a-b351-4810-9a3c-827a1e270839', '2f4ae998-053e-433e-812c-4bc9ae385e83', '38a63283-a77d-4784-86f5-1b13e3b50024', '4c18b8b0-f0c0-4611-8d42-d7c874274dce'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:31:08 devstack sudo[102556]: pam_unix(sudo:session): session closed for user root Sep 29 18:31:08 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-8ddd0f21-dce4-4054-b7d6-2161b375b3aa tempest-VolumesActionsTest-898359120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.338s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:31:08 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-8ddd0f21-dce4-4054-b7d6-2161b375b3aa tempest-VolumesActionsTest-898359120 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:31:08 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-8ddd0f21-dce4-4054-b7d6-2161b375b3aa tempest-VolumesActionsTest-898359120 None] Deleted volume successfully. Sep 29 18:31:08 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-8f2a434d-9d48-45bf-beab-8186269322ee tempest-TestInstancesWithCinderVolumes-816149194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:31:08 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-8f2a434d-9d48-45bf-beab-8186269322ee tempest-TestInstancesWithCinderVolumes-816149194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:31:08 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-8f2a434d-9d48-45bf-beab-8186269322ee tempest-TestInstancesWithCinderVolumes-816149194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:31:08 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-8f2a434d-9d48-45bf-beab-8186269322ee tempest-TestInstancesWithCinderVolumes-816149194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:31:08 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-8f2a434d-9d48-45bf-beab-8186269322ee tempest-TestInstancesWithCinderVolumes-816149194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:31:08 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-8f2a434d-9d48-45bf-beab-8186269322ee tempest-TestInstancesWithCinderVolumes-816149194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:31:08 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-8ddd0f21-dce4-4054-b7d6-2161b375b3aa tempest-VolumesActionsTest-898359120 None] Lock "cinder-ae3ecebf-36b3-49a1-8c7f-f5d151651706-delete_volume" released by "delete_volume" :: held 1.785s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:31:08 devstack sudo[102560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:31:08 devstack sudo[102560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:31:08 devstack sudo[102560]: pam_unix(sudo:session): session closed for user root Sep 29 18:31:08 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-8f2a434d-9d48-45bf-beab-8186269322ee tempest-TestInstancesWithCinderVolumes-816149194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.310s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:31:08 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-8f2a434d-9d48-45bf-beab-8186269322ee tempest-TestInstancesWithCinderVolumes-816149194 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:31:08 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-8f2a434d-9d48-45bf-beab-8186269322ee tempest-TestInstancesWithCinderVolumes-816149194 None] Deleted volume successfully. Sep 29 18:31:08 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-8f2a434d-9d48-45bf-beab-8186269322ee tempest-TestInstancesWithCinderVolumes-816149194 None] Lock "cinder-159b774d-834f-491a-8b11-2aad8a4f106d-delete_volume" released by "delete_volume" :: held 1.665s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:31:09 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf260148-add7-4798-95ef-f663ebd00327 tempest-VolumesActionsTest-208535436 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86512) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:31:09 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-cf260148-add7-4798-95ef-f663ebd00327 tempest-VolumesActionsTest-208535436 None] Flow 'volume_create_manager' (68e5a60c-83eb-4a47-9851-249d8629e07a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:31:09 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-cf260148-add7-4798-95ef-f663ebd00327 tempest-VolumesActionsTest-208535436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ee1934d-074f-4105-b32b-b75ca43ec58c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:31:09 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-cf260148-add7-4798-95ef-f663ebd00327 tempest-VolumesActionsTest-208535436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ee1934d-074f-4105-b32b-b75ca43ec58c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:31:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1698222575',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5da59068-85a7-4c30-8329-17b34c10bfc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bd4ad9e97f14fc6981eee84025c56b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:31:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:31:10Z,use_quota=True,user_id='47d555d3cb7c4624bd2e857fd54661e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:31:09 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-cf260148-add7-4798-95ef-f663ebd00327 tempest-VolumesActionsTest-208535436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b61050b1-d50a-4779-95d8-559469761338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:31:09 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-cf260148-add7-4798-95ef-f663ebd00327 tempest-VolumesActionsTest-208535436 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b61050b1-d50a-4779-95d8-559469761338) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:31:09 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-cf260148-add7-4798-95ef-f663ebd00327 tempest-VolumesActionsTest-208535436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfb0fe16-d094-4556-b625-b0e4cb40a73c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:31:09 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-cf260148-add7-4798-95ef-f663ebd00327 tempest-VolumesActionsTest-208535436 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfb0fe16-d094-4556-b625-b0e4cb40a73c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5da59068-85a7-4c30-8329-17b34c10bfc7', 'volume_name': 'volume-5da59068-85a7-4c30-8329-17b34c10bfc7', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:31:09 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-cf260148-add7-4798-95ef-f663ebd00327 tempest-VolumesActionsTest-208535436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88e99d89-ab6b-4a02-aee2-3f524cced615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:31:09 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-cf260148-add7-4798-95ef-f663ebd00327 tempest-VolumesActionsTest-208535436 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88e99d89-ab6b-4a02-aee2-3f524cced615) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:31:09 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-cf260148-add7-4798-95ef-f663ebd00327 tempest-VolumesActionsTest-208535436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d847334-8504-4c6a-b224-9c5ddb1eac4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:31:09 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-cf260148-add7-4798-95ef-f663ebd00327 tempest-VolumesActionsTest-208535436 None] Volume 5da59068-85a7-4c30-8329-17b34c10bfc7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5da59068-85a7-4c30-8329-17b34c10bfc7', 'volume_size': 1} Sep 29 18:31:09 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-cf260148-add7-4798-95ef-f663ebd00327 tempest-VolumesActionsTest-208535436 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:31:09 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-cf260148-add7-4798-95ef-f663ebd00327 tempest-VolumesActionsTest-208535436 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:31:09 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-cf260148-add7-4798-95ef-f663ebd00327 tempest-VolumesActionsTest-208535436 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:31:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1698222575',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5da59068-85a7-4c30-8329-17b34c10bfc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4bd4ad9e97f14fc6981eee84025c56b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:31:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:31:10Z,use_quota=True,user_id='47d555d3cb7c4624bd2e857fd54661e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)}" {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:31:09 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-cf260148-add7-4798-95ef-f663ebd00327 tempest-VolumesActionsTest-208535436 None] Creating volume 5da59068-85a7-4c30-8329-17b34c10bfc7 {{(pid=86512) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:31:09 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-cf260148-add7-4798-95ef-f663ebd00327 tempest-VolumesActionsTest-208535436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:31:09 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-cf260148-add7-4798-95ef-f663ebd00327 tempest-VolumesActionsTest-208535436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:31:09 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-cf260148-add7-4798-95ef-f663ebd00327 tempest-VolumesActionsTest-208535436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:31:09 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-cf260148-add7-4798-95ef-f663ebd00327 tempest-VolumesActionsTest-208535436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:31:09 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-cf260148-add7-4798-95ef-f663ebd00327 tempest-VolumesActionsTest-208535436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:31:09 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-cf260148-add7-4798-95ef-f663ebd00327 tempest-VolumesActionsTest-208535436 None] Selected osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 as target Quobyte volume. {{(pid=86512) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:31:09 devstack cinder-volume[86512]: INFO cinder.volume.drivers.remotefs [None req-cf260148-add7-4798-95ef-f663ebd00327 tempest-VolumesActionsTest-208535436 None] casted to osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 Sep 29 18:31:09 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-cf260148-add7-4798-95ef-f663ebd00327 tempest-VolumesActionsTest-208535436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-5da59068-85a7-4c30-8329-17b34c10bfc7 1073741824 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:31:09 devstack sudo[102567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-5da59068-85a7-4c30-8329-17b34c10bfc7 1073741824 Sep 29 18:31:09 devstack sudo[102567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:31:10 devstack sudo[102567]: pam_unix(sudo:session): session closed for user root Sep 29 18:31:10 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-cf260148-add7-4798-95ef-f663ebd00327 tempest-VolumesActionsTest-208535436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-5da59068-85a7-4c30-8329-17b34c10bfc7 1073741824" returned: 0 in 0.489s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:31:10 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-cf260148-add7-4798-95ef-f663ebd00327 tempest-VolumesActionsTest-208535436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-5da59068-85a7-4c30-8329-17b34c10bfc7 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:31:10 devstack sudo[102584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-5da59068-85a7-4c30-8329-17b34c10bfc7 Sep 29 18:31:10 devstack sudo[102584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:31:10 devstack sudo[102584]: pam_unix(sudo:session): session closed for user root Sep 29 18:31:10 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-cf260148-add7-4798-95ef-f663ebd00327 tempest-VolumesActionsTest-208535436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-5da59068-85a7-4c30-8329-17b34c10bfc7" returned: 0 in 0.275s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:31:10 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-cf260148-add7-4798-95ef-f663ebd00327 tempest-VolumesActionsTest-208535436 None] <== create_volume: return (813ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'} {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:31:10 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-cf260148-add7-4798-95ef-f663ebd00327 tempest-VolumesActionsTest-208535436 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.816s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:31:10 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-cf260148-add7-4798-95ef-f663ebd00327 tempest-VolumesActionsTest-208535436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d847334-8504-4c6a-b224-9c5ddb1eac4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5da59068-85a7-4c30-8329-17b34c10bfc7', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:31:10 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-cf260148-add7-4798-95ef-f663ebd00327 tempest-VolumesActionsTest-208535436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (808cd80a-f6f3-4eea-b01e-61328dd5dc64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:31:10 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-cf260148-add7-4798-95ef-f663ebd00327 tempest-VolumesActionsTest-208535436 None] Volume volume-5da59068-85a7-4c30-8329-17b34c10bfc7 (5da59068-85a7-4c30-8329-17b34c10bfc7): created successfully Sep 29 18:31:10 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-cf260148-add7-4798-95ef-f663ebd00327 tempest-VolumesActionsTest-208535436 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (808cd80a-f6f3-4eea-b01e-61328dd5dc64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:31:10 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-cf260148-add7-4798-95ef-f663ebd00327 tempest-VolumesActionsTest-208535436 None] Flow 'volume_create_manager' (68e5a60c-83eb-4a47-9851-249d8629e07a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:31:10 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-cf260148-add7-4798-95ef-f663ebd00327 tempest-VolumesActionsTest-208535436 None] Created volume successfully. Sep 29 18:31:11 devstack cinder-volume[86512]: INFO cinder.volume.manager [req-0afd4b64-c761-4470-a4d8-4e17c1129221 req-99844f77-237e-4afa-91e3-9f0011a100b7 tempest-TestInstancesWithCinderVolumes-816149194 None] Terminate volume connection completed successfully. Sep 29 18:31:11 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [req-0afd4b64-c761-4470-a4d8-4e17c1129221 req-99844f77-237e-4afa-91e3-9f0011a100b7 tempest-TestInstancesWithCinderVolumes-816149194 None] Deleting attachment 77cc7d6f-56a4-4853-8537-54102ec24738. {{(pid=86512) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 29 18:31:12 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-1fa3b106-2296-46db-b626-a471fe29fedd tempest-TestInstancesWithCinderVolumes-816149194 None] Acquiring lock "cinder-c9748846-2b0b-4e3f-bf30-1974b9da37dd-delete_volume" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:31:12 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-1fa3b106-2296-46db-b626-a471fe29fedd tempest-TestInstancesWithCinderVolumes-816149194 None] Lock "cinder-c9748846-2b0b-4e3f-bf30-1974b9da37dd-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:31:12 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-1fa3b106-2296-46db-b626-a471fe29fedd tempest-TestInstancesWithCinderVolumes-816149194 None] Acquiring lock "cinder-quobyte-c9748846-2b0b-4e3f-bf30-1974b9da37dd" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:31:12 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-1fa3b106-2296-46db-b626-a471fe29fedd tempest-TestInstancesWithCinderVolumes-816149194 None] Lock "cinder-quobyte-c9748846-2b0b-4e3f-bf30-1974b9da37dd" acquired by "delete_volume" :: waited 0.022s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:31:12 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[21e2c7df-83f5-4084-8f7c-3dc8017d7fcd]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:31:12 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-1fa3b106-2296-46db-b626-a471fe29fedd tempest-TestInstancesWithCinderVolumes-816149194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-c9748846-2b0b-4e3f-bf30-1974b9da37dd {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:31:12 devstack sudo[102598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-c9748846-2b0b-4e3f-bf30-1974b9da37dd Sep 29 18:31:12 devstack sudo[102598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:31:12 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-75eaf980-a59d-4fb6-a482-e85e0448e95b tempest-VolumesActionsTest-208535436 None] Acquiring lock "cinder-5da59068-85a7-4c30-8329-17b34c10bfc7-delete_volume" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:31:12 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-75eaf980-a59d-4fb6-a482-e85e0448e95b tempest-VolumesActionsTest-208535436 None] Lock "cinder-5da59068-85a7-4c30-8329-17b34c10bfc7-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:31:12 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-75eaf980-a59d-4fb6-a482-e85e0448e95b tempest-VolumesActionsTest-208535436 None] Acquiring lock "cinder-quobyte-5da59068-85a7-4c30-8329-17b34c10bfc7" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:31:12 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-75eaf980-a59d-4fb6-a482-e85e0448e95b tempest-VolumesActionsTest-208535436 None] Lock "cinder-quobyte-5da59068-85a7-4c30-8329-17b34c10bfc7" acquired by "delete_volume" :: waited 0.019s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:31:12 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa0d7480-1f30-486d-a689-0e4811e21a8b]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:31:12 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-75eaf980-a59d-4fb6-a482-e85e0448e95b tempest-VolumesActionsTest-208535436 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-5da59068-85a7-4c30-8329-17b34c10bfc7 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:31:12 devstack sudo[102600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-5da59068-85a7-4c30-8329-17b34c10bfc7 Sep 29 18:31:12 devstack sudo[102600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:31:12 devstack sudo[102598]: pam_unix(sudo:session): session closed for user root Sep 29 18:31:12 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-1fa3b106-2296-46db-b626-a471fe29fedd tempest-TestInstancesWithCinderVolumes-816149194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-c9748846-2b0b-4e3f-bf30-1974b9da37dd" returned: 0 in 0.462s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:31:12 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-1fa3b106-2296-46db-b626-a471fe29fedd tempest-TestInstancesWithCinderVolumes-816149194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-c9748846-2b0b-4e3f-bf30-1974b9da37dd {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:31:12 devstack sudo[102606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-c9748846-2b0b-4e3f-bf30-1974b9da37dd Sep 29 18:31:12 devstack sudo[102606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:31:13 devstack sudo[102606]: pam_unix(sudo:session): session closed for user root Sep 29 18:31:13 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-1fa3b106-2296-46db-b626-a471fe29fedd tempest-TestInstancesWithCinderVolumes-816149194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-c9748846-2b0b-4e3f-bf30-1974b9da37dd" returned: 0 in 0.319s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:31:13 devstack sudo[102600]: pam_unix(sudo:session): session closed for user root Sep 29 18:31:13 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-75eaf980-a59d-4fb6-a482-e85e0448e95b tempest-VolumesActionsTest-208535436 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-5da59068-85a7-4c30-8329-17b34c10bfc7" returned: 0 in 0.500s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:31:13 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-75eaf980-a59d-4fb6-a482-e85e0448e95b tempest-VolumesActionsTest-208535436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-5da59068-85a7-4c30-8329-17b34c10bfc7 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:31:13 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-1fa3b106-2296-46db-b626-a471fe29fedd tempest-TestInstancesWithCinderVolumes-816149194 None] Lock "cinder-quobyte-c9748846-2b0b-4e3f-bf30-1974b9da37dd" released by "delete_volume" :: held 0.860s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:31:13 devstack sudo[102612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-5da59068-85a7-4c30-8329-17b34c10bfc7 Sep 29 18:31:13 devstack sudo[102612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:31:13 devstack cinder-volume[86512]: WARNING cinder.quota [None req-1fa3b106-2296-46db-b626-a471fe29fedd tempest-TestInstancesWithCinderVolumes-816149194 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1170605634-1226189810 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1170605634-1226189810, it is now deprecated. Please use the default quota class for default quota. Sep 29 18:31:13 devstack cinder-volume[86512]: WARNING cinder.quota [None req-1fa3b106-2296-46db-b626-a471fe29fedd tempest-TestInstancesWithCinderVolumes-816149194 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1170605634-1226189810 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1170605634-1226189810, it is now deprecated. Please use the default quota class for default quota. Sep 29 18:31:13 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-1fa3b106-2296-46db-b626-a471fe29fedd tempest-TestInstancesWithCinderVolumes-816149194 None] Created reservations ['abafa0c5-9f39-41a0-a4e3-ce159c2b80de', '55d987e1-9ede-458a-a900-b0ae82b68740', '151d8f9d-eddc-42c0-a28f-f88ac119130f', 'ac95bd1c-f3da-49c7-9b36-efe778668602'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:31:13 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-1fa3b106-2296-46db-b626-a471fe29fedd tempest-TestInstancesWithCinderVolumes-816149194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:31:13 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-1fa3b106-2296-46db-b626-a471fe29fedd tempest-TestInstancesWithCinderVolumes-816149194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:31:13 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-1fa3b106-2296-46db-b626-a471fe29fedd tempest-TestInstancesWithCinderVolumes-816149194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:31:13 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-1fa3b106-2296-46db-b626-a471fe29fedd tempest-TestInstancesWithCinderVolumes-816149194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:31:13 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-1fa3b106-2296-46db-b626-a471fe29fedd tempest-TestInstancesWithCinderVolumes-816149194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:31:13 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-1fa3b106-2296-46db-b626-a471fe29fedd tempest-TestInstancesWithCinderVolumes-816149194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:31:13 devstack sudo[102614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:31:13 devstack sudo[102614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:31:13 devstack sudo[102612]: pam_unix(sudo:session): session closed for user root Sep 29 18:31:13 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-75eaf980-a59d-4fb6-a482-e85e0448e95b tempest-VolumesActionsTest-208535436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-5da59068-85a7-4c30-8329-17b34c10bfc7" returned: 0 in 0.309s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:31:13 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-75eaf980-a59d-4fb6-a482-e85e0448e95b tempest-VolumesActionsTest-208535436 None] Lock "cinder-quobyte-5da59068-85a7-4c30-8329-17b34c10bfc7" released by "delete_volume" :: held 0.866s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:31:13 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-75eaf980-a59d-4fb6-a482-e85e0448e95b tempest-VolumesActionsTest-208535436 None] Created reservations ['3f9efb4c-5a63-4a3b-b35c-e7e0a4ec04a4', '1a7bd0e8-1a9f-437f-ab8d-c202ef3baf71', '01795aa8-51b9-48a5-8171-e22671b3cff8', '63fd2ff3-4648-45c9-bafb-61d6437b62aa'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:31:13 devstack sudo[102614]: pam_unix(sudo:session): session closed for user root Sep 29 18:31:13 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-1fa3b106-2296-46db-b626-a471fe29fedd tempest-TestInstancesWithCinderVolumes-816149194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.380s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:31:13 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-1fa3b106-2296-46db-b626-a471fe29fedd tempest-TestInstancesWithCinderVolumes-816149194 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:31:13 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-1fa3b106-2296-46db-b626-a471fe29fedd tempest-TestInstancesWithCinderVolumes-816149194 None] Deleted volume successfully. Sep 29 18:31:13 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-1fa3b106-2296-46db-b626-a471fe29fedd tempest-TestInstancesWithCinderVolumes-816149194 None] Lock "cinder-c9748846-2b0b-4e3f-bf30-1974b9da37dd-delete_volume" released by "delete_volume" :: held 1.572s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:31:13 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-75eaf980-a59d-4fb6-a482-e85e0448e95b tempest-VolumesActionsTest-208535436 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:31:13 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-75eaf980-a59d-4fb6-a482-e85e0448e95b tempest-VolumesActionsTest-208535436 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:31:13 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-75eaf980-a59d-4fb6-a482-e85e0448e95b tempest-VolumesActionsTest-208535436 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:31:13 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-75eaf980-a59d-4fb6-a482-e85e0448e95b tempest-VolumesActionsTest-208535436 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:31:13 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-75eaf980-a59d-4fb6-a482-e85e0448e95b tempest-VolumesActionsTest-208535436 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:31:13 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-75eaf980-a59d-4fb6-a482-e85e0448e95b tempest-VolumesActionsTest-208535436 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:31:13 devstack sudo[102620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:31:13 devstack sudo[102620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:31:14 devstack sudo[102620]: pam_unix(sudo:session): session closed for user root Sep 29 18:31:14 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-75eaf980-a59d-4fb6-a482-e85e0448e95b tempest-VolumesActionsTest-208535436 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.275s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:31:14 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-75eaf980-a59d-4fb6-a482-e85e0448e95b tempest-VolumesActionsTest-208535436 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:31:14 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-75eaf980-a59d-4fb6-a482-e85e0448e95b tempest-VolumesActionsTest-208535436 None] Deleted volume successfully. Sep 29 18:31:14 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-75eaf980-a59d-4fb6-a482-e85e0448e95b tempest-VolumesActionsTest-208535436 None] Lock "cinder-5da59068-85a7-4c30-8329-17b34c10bfc7-delete_volume" released by "delete_volume" :: held 1.669s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:31:20 devstack cinder-volume[86512]: INFO cinder.volume.manager [req-48788b93-ec07-4017-9422-ae426188d930 req-4e69cf12-6fd1-45c5-8496-0881ced33d82 tempest-TestInstancesWithCinderVolumes-816149194 None] Terminate volume connection completed successfully. Sep 29 18:31:20 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [req-48788b93-ec07-4017-9422-ae426188d930 req-4e69cf12-6fd1-45c5-8496-0881ced33d82 tempest-TestInstancesWithCinderVolumes-816149194 None] Deleting attachment 159e2d72-85b5-4ff0-9828-e3a9d9163e8f. {{(pid=86512) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 29 18:31:22 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-29b6843a-4f5f-4f18-8265-36a1a75f5528 tempest-TestServerVolumeAttachmentScenario-403056258 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86512) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:31:22 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-29b6843a-4f5f-4f18-8265-36a1a75f5528 tempest-TestServerVolumeAttachmentScenario-403056258 None] Flow 'volume_create_manager' (8da22041-aed5-49f7-ad0e-0a5073447067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:31:22 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-29b6843a-4f5f-4f18-8265-36a1a75f5528 tempest-TestServerVolumeAttachmentScenario-403056258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17565e5e-7df9-4523-ba5f-5229ce2339ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:31:22 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-29b6843a-4f5f-4f18-8265-36a1a75f5528 tempest-TestServerVolumeAttachmentScenario-403056258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17565e5e-7df9-4523-ba5f-5229ce2339ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:31:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1173733165',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33d2a5fc-198e-4c35-80a5-491e6db3b5a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ebe9b89a52a40718c3b06e6826b357a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:31:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:31:22Z,use_quota=True,user_id='c70919bd73b046c9aedbda0879ee7263',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:31:22 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-29b6843a-4f5f-4f18-8265-36a1a75f5528 tempest-TestServerVolumeAttachmentScenario-403056258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2836cd71-2791-413c-88f1-7700dfa79483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:31:22 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-29b6843a-4f5f-4f18-8265-36a1a75f5528 tempest-TestServerVolumeAttachmentScenario-403056258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2836cd71-2791-413c-88f1-7700dfa79483) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:31:22 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-29b6843a-4f5f-4f18-8265-36a1a75f5528 tempest-TestServerVolumeAttachmentScenario-403056258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3599538-0fbb-49be-874c-13e96395ed18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:31:22 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-29b6843a-4f5f-4f18-8265-36a1a75f5528 tempest-TestServerVolumeAttachmentScenario-403056258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3599538-0fbb-49be-874c-13e96395ed18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33d2a5fc-198e-4c35-80a5-491e6db3b5a9', 'volume_name': 'volume-33d2a5fc-198e-4c35-80a5-491e6db3b5a9', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:31:22 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-29b6843a-4f5f-4f18-8265-36a1a75f5528 tempest-TestServerVolumeAttachmentScenario-403056258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (576d31cb-a5f5-4df3-8f75-13741da1746b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:31:22 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-29b6843a-4f5f-4f18-8265-36a1a75f5528 tempest-TestServerVolumeAttachmentScenario-403056258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (576d31cb-a5f5-4df3-8f75-13741da1746b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:31:22 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-29b6843a-4f5f-4f18-8265-36a1a75f5528 tempest-TestServerVolumeAttachmentScenario-403056258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d7713d9-1c95-4595-a32a-ad5e08859f38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:31:22 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-29b6843a-4f5f-4f18-8265-36a1a75f5528 tempest-TestServerVolumeAttachmentScenario-403056258 None] Volume 33d2a5fc-198e-4c35-80a5-491e6db3b5a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33d2a5fc-198e-4c35-80a5-491e6db3b5a9', 'volume_size': 1} Sep 29 18:31:22 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-29b6843a-4f5f-4f18-8265-36a1a75f5528 tempest-TestServerVolumeAttachmentScenario-403056258 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:31:22 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-29b6843a-4f5f-4f18-8265-36a1a75f5528 tempest-TestServerVolumeAttachmentScenario-403056258 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:31:22 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-29b6843a-4f5f-4f18-8265-36a1a75f5528 tempest-TestServerVolumeAttachmentScenario-403056258 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:31:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1173733165',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33d2a5fc-198e-4c35-80a5-491e6db3b5a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ebe9b89a52a40718c3b06e6826b357a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:31:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:31:22Z,use_quota=True,user_id='c70919bd73b046c9aedbda0879ee7263',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)}" {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:31:22 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-29b6843a-4f5f-4f18-8265-36a1a75f5528 tempest-TestServerVolumeAttachmentScenario-403056258 None] Creating volume 33d2a5fc-198e-4c35-80a5-491e6db3b5a9 {{(pid=86512) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:31:22 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-29b6843a-4f5f-4f18-8265-36a1a75f5528 tempest-TestServerVolumeAttachmentScenario-403056258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:31:22 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-29b6843a-4f5f-4f18-8265-36a1a75f5528 tempest-TestServerVolumeAttachmentScenario-403056258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:31:22 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-29b6843a-4f5f-4f18-8265-36a1a75f5528 tempest-TestServerVolumeAttachmentScenario-403056258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:31:22 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-29b6843a-4f5f-4f18-8265-36a1a75f5528 tempest-TestServerVolumeAttachmentScenario-403056258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:31:22 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-29b6843a-4f5f-4f18-8265-36a1a75f5528 tempest-TestServerVolumeAttachmentScenario-403056258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:31:22 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-29b6843a-4f5f-4f18-8265-36a1a75f5528 tempest-TestServerVolumeAttachmentScenario-403056258 None] Selected osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 as target Quobyte volume. {{(pid=86512) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:31:22 devstack cinder-volume[86512]: INFO cinder.volume.drivers.remotefs [None req-29b6843a-4f5f-4f18-8265-36a1a75f5528 tempest-TestServerVolumeAttachmentScenario-403056258 None] casted to osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 Sep 29 18:31:22 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-29b6843a-4f5f-4f18-8265-36a1a75f5528 tempest-TestServerVolumeAttachmentScenario-403056258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-33d2a5fc-198e-4c35-80a5-491e6db3b5a9 1073741824 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:31:22 devstack sudo[102654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-33d2a5fc-198e-4c35-80a5-491e6db3b5a9 1073741824 Sep 29 18:31:22 devstack sudo[102654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:31:22 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-c042c559-e004-46dc-a093-9234a67b9a04 tempest-TestInstancesWithCinderVolumes-816149194 None] Acquiring lock "cinder-1f13d6ea-91cb-4ee9-8e38-79d129c41391-delete_volume" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:31:22 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-c042c559-e004-46dc-a093-9234a67b9a04 tempest-TestInstancesWithCinderVolumes-816149194 None] Lock "cinder-1f13d6ea-91cb-4ee9-8e38-79d129c41391-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:31:22 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-c042c559-e004-46dc-a093-9234a67b9a04 tempest-TestInstancesWithCinderVolumes-816149194 None] Acquiring lock "cinder-quobyte-1f13d6ea-91cb-4ee9-8e38-79d129c41391" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:31:22 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-c042c559-e004-46dc-a093-9234a67b9a04 tempest-TestInstancesWithCinderVolumes-816149194 None] Lock "cinder-quobyte-1f13d6ea-91cb-4ee9-8e38-79d129c41391" acquired by "delete_volume" :: waited 0.022s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:31:22 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7777020-d2a2-415c-a1d5-745715623200]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:31:22 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-c042c559-e004-46dc-a093-9234a67b9a04 tempest-TestInstancesWithCinderVolumes-816149194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-1f13d6ea-91cb-4ee9-8e38-79d129c41391 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:31:22 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-4978bd5e-b8fc-489c-8547-d221023b07fe tempest-TestServerVolumeAttachmentScenario-403056258 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86512) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:31:22 devstack sudo[102656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-1f13d6ea-91cb-4ee9-8e38-79d129c41391 Sep 29 18:31:22 devstack sudo[102656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:31:23 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-4978bd5e-b8fc-489c-8547-d221023b07fe tempest-TestServerVolumeAttachmentScenario-403056258 None] Flow 'volume_create_manager' (1e883da9-fefc-418c-b813-d1f5ef3dc852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:31:23 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-4978bd5e-b8fc-489c-8547-d221023b07fe tempest-TestServerVolumeAttachmentScenario-403056258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf3f7729-666b-4d3c-818e-b0356573c45f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:31:23 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-4978bd5e-b8fc-489c-8547-d221023b07fe tempest-TestServerVolumeAttachmentScenario-403056258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf3f7729-666b-4d3c-818e-b0356573c45f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:31:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-278421505',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6348706c-c2c9-495e-b5ad-9d7bdbcb3dea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ebe9b89a52a40718c3b06e6826b357a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:31:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:31:23Z,use_quota=True,user_id='c70919bd73b046c9aedbda0879ee7263',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:31:23 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-4978bd5e-b8fc-489c-8547-d221023b07fe tempest-TestServerVolumeAttachmentScenario-403056258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f4ef5f5-ba5b-42e1-9af1-f89703e88d65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:31:23 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-4978bd5e-b8fc-489c-8547-d221023b07fe tempest-TestServerVolumeAttachmentScenario-403056258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f4ef5f5-ba5b-42e1-9af1-f89703e88d65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:31:23 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-4978bd5e-b8fc-489c-8547-d221023b07fe tempest-TestServerVolumeAttachmentScenario-403056258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd824a15-94fa-41d3-b195-d7f2e06adfef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:31:23 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-4978bd5e-b8fc-489c-8547-d221023b07fe tempest-TestServerVolumeAttachmentScenario-403056258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd824a15-94fa-41d3-b195-d7f2e06adfef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6348706c-c2c9-495e-b5ad-9d7bdbcb3dea', 'volume_name': 'volume-6348706c-c2c9-495e-b5ad-9d7bdbcb3dea', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:31:23 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-4978bd5e-b8fc-489c-8547-d221023b07fe tempest-TestServerVolumeAttachmentScenario-403056258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bf8b2e9-31b5-4f50-b0b2-baf4ab1791f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:31:23 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-4978bd5e-b8fc-489c-8547-d221023b07fe tempest-TestServerVolumeAttachmentScenario-403056258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bf8b2e9-31b5-4f50-b0b2-baf4ab1791f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:31:23 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-4978bd5e-b8fc-489c-8547-d221023b07fe tempest-TestServerVolumeAttachmentScenario-403056258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23268c80-ef76-4d64-a872-fdf8630f0f89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:31:23 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-4978bd5e-b8fc-489c-8547-d221023b07fe tempest-TestServerVolumeAttachmentScenario-403056258 None] Volume 6348706c-c2c9-495e-b5ad-9d7bdbcb3dea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6348706c-c2c9-495e-b5ad-9d7bdbcb3dea', 'volume_size': 1} Sep 29 18:31:23 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-4978bd5e-b8fc-489c-8547-d221023b07fe tempest-TestServerVolumeAttachmentScenario-403056258 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:31:23 devstack sudo[102654]: pam_unix(sudo:session): session closed for user root Sep 29 18:31:23 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-29b6843a-4f5f-4f18-8265-36a1a75f5528 tempest-TestServerVolumeAttachmentScenario-403056258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-33d2a5fc-198e-4c35-80a5-491e6db3b5a9 1073741824" returned: 0 in 0.669s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:31:23 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-29b6843a-4f5f-4f18-8265-36a1a75f5528 tempest-TestServerVolumeAttachmentScenario-403056258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-33d2a5fc-198e-4c35-80a5-491e6db3b5a9 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:31:23 devstack sudo[102664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-33d2a5fc-198e-4c35-80a5-491e6db3b5a9 Sep 29 18:31:23 devstack sudo[102664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:31:23 devstack sudo[102656]: pam_unix(sudo:session): session closed for user root Sep 29 18:31:23 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-c042c559-e004-46dc-a093-9234a67b9a04 tempest-TestInstancesWithCinderVolumes-816149194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-1f13d6ea-91cb-4ee9-8e38-79d129c41391" returned: 0 in 0.492s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:31:23 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-c042c559-e004-46dc-a093-9234a67b9a04 tempest-TestInstancesWithCinderVolumes-816149194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-1f13d6ea-91cb-4ee9-8e38-79d129c41391 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:31:23 devstack sudo[102668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-1f13d6ea-91cb-4ee9-8e38-79d129c41391 Sep 29 18:31:23 devstack sudo[102668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:31:23 devstack sudo[102664]: pam_unix(sudo:session): session closed for user root Sep 29 18:31:23 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-29b6843a-4f5f-4f18-8265-36a1a75f5528 tempest-TestServerVolumeAttachmentScenario-403056258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-33d2a5fc-198e-4c35-80a5-491e6db3b5a9" returned: 0 in 0.371s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:31:23 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-29b6843a-4f5f-4f18-8265-36a1a75f5528 tempest-TestServerVolumeAttachmentScenario-403056258 None] <== create_volume: return (1105ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'} {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:31:23 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-29b6843a-4f5f-4f18-8265-36a1a75f5528 tempest-TestServerVolumeAttachmentScenario-403056258 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.108s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:31:23 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-4978bd5e-b8fc-489c-8547-d221023b07fe tempest-TestServerVolumeAttachmentScenario-403056258 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.457s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:31:23 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-4978bd5e-b8fc-489c-8547-d221023b07fe tempest-TestServerVolumeAttachmentScenario-403056258 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:31:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-278421505',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6348706c-c2c9-495e-b5ad-9d7bdbcb3dea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ebe9b89a52a40718c3b06e6826b357a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:31:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:31:23Z,use_quota=True,user_id='c70919bd73b046c9aedbda0879ee7263',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)}" {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:31:23 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-4978bd5e-b8fc-489c-8547-d221023b07fe tempest-TestServerVolumeAttachmentScenario-403056258 None] Creating volume 6348706c-c2c9-495e-b5ad-9d7bdbcb3dea {{(pid=86512) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:31:23 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-4978bd5e-b8fc-489c-8547-d221023b07fe tempest-TestServerVolumeAttachmentScenario-403056258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:31:23 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-4978bd5e-b8fc-489c-8547-d221023b07fe tempest-TestServerVolumeAttachmentScenario-403056258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:31:23 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-4978bd5e-b8fc-489c-8547-d221023b07fe tempest-TestServerVolumeAttachmentScenario-403056258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:31:23 devstack sudo[102668]: pam_unix(sudo:session): session closed for user root Sep 29 18:31:23 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-4978bd5e-b8fc-489c-8547-d221023b07fe tempest-TestServerVolumeAttachmentScenario-403056258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:31:23 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-4978bd5e-b8fc-489c-8547-d221023b07fe tempest-TestServerVolumeAttachmentScenario-403056258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:31:23 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-4978bd5e-b8fc-489c-8547-d221023b07fe tempest-TestServerVolumeAttachmentScenario-403056258 None] Selected osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 as target Quobyte volume. {{(pid=86512) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:31:23 devstack cinder-volume[86512]: INFO cinder.volume.drivers.remotefs [None req-4978bd5e-b8fc-489c-8547-d221023b07fe tempest-TestServerVolumeAttachmentScenario-403056258 None] casted to osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 Sep 29 18:31:23 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-4978bd5e-b8fc-489c-8547-d221023b07fe tempest-TestServerVolumeAttachmentScenario-403056258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-6348706c-c2c9-495e-b5ad-9d7bdbcb3dea 1073741824 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:31:23 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-c042c559-e004-46dc-a093-9234a67b9a04 tempest-TestInstancesWithCinderVolumes-816149194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-1f13d6ea-91cb-4ee9-8e38-79d129c41391" returned: 0 in 0.330s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:31:23 devstack sudo[102673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-6348706c-c2c9-495e-b5ad-9d7bdbcb3dea 1073741824 Sep 29 18:31:23 devstack sudo[102673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:31:23 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-29b6843a-4f5f-4f18-8265-36a1a75f5528 tempest-TestServerVolumeAttachmentScenario-403056258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d7713d9-1c95-4595-a32a-ad5e08859f38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33d2a5fc-198e-4c35-80a5-491e6db3b5a9', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:31:23 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-29b6843a-4f5f-4f18-8265-36a1a75f5528 tempest-TestServerVolumeAttachmentScenario-403056258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (baaa3c5e-8d1c-42c3-ae4f-8ec6b5342e19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:31:23 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-c042c559-e004-46dc-a093-9234a67b9a04 tempest-TestInstancesWithCinderVolumes-816149194 None] Lock "cinder-quobyte-1f13d6ea-91cb-4ee9-8e38-79d129c41391" released by "delete_volume" :: held 0.926s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:31:23 devstack cinder-volume[86512]: WARNING cinder.quota [None req-c042c559-e004-46dc-a093-9234a67b9a04 tempest-TestInstancesWithCinderVolumes-816149194 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-478206526-1229252000 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-478206526-1229252000, it is now deprecated. Please use the default quota class for default quota. Sep 29 18:31:23 devstack cinder-volume[86512]: WARNING cinder.quota [None req-c042c559-e004-46dc-a093-9234a67b9a04 tempest-TestInstancesWithCinderVolumes-816149194 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-478206526-1229252000 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-478206526-1229252000, it is now deprecated. Please use the default quota class for default quota. Sep 29 18:31:23 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-29b6843a-4f5f-4f18-8265-36a1a75f5528 tempest-TestServerVolumeAttachmentScenario-403056258 None] Volume volume-33d2a5fc-198e-4c35-80a5-491e6db3b5a9 (33d2a5fc-198e-4c35-80a5-491e6db3b5a9): created successfully Sep 29 18:31:23 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-29b6843a-4f5f-4f18-8265-36a1a75f5528 tempest-TestServerVolumeAttachmentScenario-403056258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (baaa3c5e-8d1c-42c3-ae4f-8ec6b5342e19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:31:23 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-29b6843a-4f5f-4f18-8265-36a1a75f5528 tempest-TestServerVolumeAttachmentScenario-403056258 None] Flow 'volume_create_manager' (8da22041-aed5-49f7-ad0e-0a5073447067) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:31:23 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-29b6843a-4f5f-4f18-8265-36a1a75f5528 tempest-TestServerVolumeAttachmentScenario-403056258 None] Created volume successfully. Sep 29 18:31:23 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-c042c559-e004-46dc-a093-9234a67b9a04 tempest-TestInstancesWithCinderVolumes-816149194 None] Created reservations ['ede24524-e6f0-4442-a46c-b8d6dc35b9f4', '0006e986-e320-48ec-b71c-20973fa0cb34', '452bcea4-dabb-4ecb-bac2-4ca19c880bbf', 'aeb7caec-c4c3-4e77-89c7-21151fe5dba4'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:31:23 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-c042c559-e004-46dc-a093-9234a67b9a04 tempest-TestInstancesWithCinderVolumes-816149194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:31:23 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-c042c559-e004-46dc-a093-9234a67b9a04 tempest-TestInstancesWithCinderVolumes-816149194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:31:23 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-c042c559-e004-46dc-a093-9234a67b9a04 tempest-TestInstancesWithCinderVolumes-816149194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:31:23 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-c042c559-e004-46dc-a093-9234a67b9a04 tempest-TestInstancesWithCinderVolumes-816149194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:31:23 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-c042c559-e004-46dc-a093-9234a67b9a04 tempest-TestInstancesWithCinderVolumes-816149194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:31:23 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-c042c559-e004-46dc-a093-9234a67b9a04 tempest-TestInstancesWithCinderVolumes-816149194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:31:23 devstack sudo[102678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:31:23 devstack sudo[102678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:31:24 devstack sudo[102678]: pam_unix(sudo:session): session closed for user root Sep 29 18:31:24 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-c042c559-e004-46dc-a093-9234a67b9a04 tempest-TestInstancesWithCinderVolumes-816149194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.305s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:31:24 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-c042c559-e004-46dc-a093-9234a67b9a04 tempest-TestInstancesWithCinderVolumes-816149194 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:31:24 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-c042c559-e004-46dc-a093-9234a67b9a04 tempest-TestInstancesWithCinderVolumes-816149194 None] Deleted volume successfully. Sep 29 18:31:24 devstack sudo[102673]: pam_unix(sudo:session): session closed for user root Sep 29 18:31:24 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-4978bd5e-b8fc-489c-8547-d221023b07fe tempest-TestServerVolumeAttachmentScenario-403056258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-6348706c-c2c9-495e-b5ad-9d7bdbcb3dea 1073741824" returned: 0 in 0.640s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:31:24 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-c042c559-e004-46dc-a093-9234a67b9a04 tempest-TestInstancesWithCinderVolumes-816149194 None] Lock "cinder-1f13d6ea-91cb-4ee9-8e38-79d129c41391-delete_volume" released by "delete_volume" :: held 1.606s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:31:24 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-4978bd5e-b8fc-489c-8547-d221023b07fe tempest-TestServerVolumeAttachmentScenario-403056258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-6348706c-c2c9-495e-b5ad-9d7bdbcb3dea {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:31:24 devstack sudo[102685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-6348706c-c2c9-495e-b5ad-9d7bdbcb3dea Sep 29 18:31:24 devstack sudo[102685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:31:24 devstack sudo[102685]: pam_unix(sudo:session): session closed for user root Sep 29 18:31:24 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-4978bd5e-b8fc-489c-8547-d221023b07fe tempest-TestServerVolumeAttachmentScenario-403056258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-6348706c-c2c9-495e-b5ad-9d7bdbcb3dea" returned: 0 in 0.273s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:31:24 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-4978bd5e-b8fc-489c-8547-d221023b07fe tempest-TestServerVolumeAttachmentScenario-403056258 None] <== create_volume: return (965ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'} {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:31:24 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-4978bd5e-b8fc-489c-8547-d221023b07fe tempest-TestServerVolumeAttachmentScenario-403056258 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.968s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:31:24 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-4978bd5e-b8fc-489c-8547-d221023b07fe tempest-TestServerVolumeAttachmentScenario-403056258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23268c80-ef76-4d64-a872-fdf8630f0f89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6348706c-c2c9-495e-b5ad-9d7bdbcb3dea', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:31:24 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-4978bd5e-b8fc-489c-8547-d221023b07fe tempest-TestServerVolumeAttachmentScenario-403056258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e22f0de7-f2e8-436a-b168-666f25f7b685) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:31:24 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-4978bd5e-b8fc-489c-8547-d221023b07fe tempest-TestServerVolumeAttachmentScenario-403056258 None] Volume volume-6348706c-c2c9-495e-b5ad-9d7bdbcb3dea (6348706c-c2c9-495e-b5ad-9d7bdbcb3dea): created successfully Sep 29 18:31:24 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-4978bd5e-b8fc-489c-8547-d221023b07fe tempest-TestServerVolumeAttachmentScenario-403056258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e22f0de7-f2e8-436a-b168-666f25f7b685) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:31:24 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-4978bd5e-b8fc-489c-8547-d221023b07fe tempest-TestServerVolumeAttachmentScenario-403056258 None] Flow 'volume_create_manager' (1e883da9-fefc-418c-b813-d1f5ef3dc852) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:31:24 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-4978bd5e-b8fc-489c-8547-d221023b07fe tempest-TestServerVolumeAttachmentScenario-403056258 None] Created volume successfully. Sep 29 18:31:34 devstack cinder-volume[86512]: DEBUG dbcounter [-] [86512] Writing DB stats cinder:UPDATE=72,cinder:SELECT=50,cinder:DELETE=8,cinder:INSERT=17 {{(pid=86512) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 18:31:34 devstack cinder-volume[86512]: DEBUG dbcounter [-] [86512] Writing DB stats cinder:SELECT=55,cinder:INSERT=16,cinder:UPDATE=72,cinder:DELETE=4 {{(pid=86512) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 18:31:50 devstack cinder-volume[86512]: DEBUG oslo_service.periodic_task [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86512) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 18:31:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:31:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:31:50 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:31:50 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:31:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:31:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:31:50 devstack sudo[102877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:31:50 devstack sudo[102877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:31:50 devstack sudo[102877]: pam_unix(sudo:session): session closed for user root Sep 29 18:31:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.283s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:31:50 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:31:50 devstack cinder-volume[86512]: DEBUG oslo_service.periodic_task [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Running periodic task VolumeManager._thread_info {{(pid=86512) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 18:31:50 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] thread count: 29 {{(pid=86512) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 29 18:31:50 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] thread info: [<_MainThread(MainThread, started 135593654804608)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86512) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 29 18:31:56 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b101090-3725-4edd-9841-e8b057229d83 tempest-VolumesActionsTest-229141369 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86512) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:31:56 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-1b101090-3725-4edd-9841-e8b057229d83 tempest-VolumesActionsTest-229141369 None] Flow 'volume_create_manager' (63990488-355d-4013-9742-e6e2779c18db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:31:56 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-1b101090-3725-4edd-9841-e8b057229d83 tempest-VolumesActionsTest-229141369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35a30311-a93c-47e1-a615-b981f3940c43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:31:56 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-1b101090-3725-4edd-9841-e8b057229d83 tempest-VolumesActionsTest-229141369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35a30311-a93c-47e1-a615-b981f3940c43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:31:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-326076958',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb3e7c0e-0fa2-472c-92ae-ed2bcea6c85c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6051d85c96664187b418c7f8d9bea489',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:31:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:31:57Z,use_quota=True,user_id='26df5f8923494907a7b3fc0a108af224',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:31:56 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-1b101090-3725-4edd-9841-e8b057229d83 tempest-VolumesActionsTest-229141369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2dc977dc-31c9-4daf-9d35-a8f19557561a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:31:56 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-1b101090-3725-4edd-9841-e8b057229d83 tempest-VolumesActionsTest-229141369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2dc977dc-31c9-4daf-9d35-a8f19557561a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:31:56 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-1b101090-3725-4edd-9841-e8b057229d83 tempest-VolumesActionsTest-229141369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93e198c1-5d6f-47fc-9202-68f7b7a57889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:31:56 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-1b101090-3725-4edd-9841-e8b057229d83 tempest-VolumesActionsTest-229141369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93e198c1-5d6f-47fc-9202-68f7b7a57889) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb3e7c0e-0fa2-472c-92ae-ed2bcea6c85c', 'volume_name': 'volume-eb3e7c0e-0fa2-472c-92ae-ed2bcea6c85c', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:31:56 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-1b101090-3725-4edd-9841-e8b057229d83 tempest-VolumesActionsTest-229141369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eed31bff-98a7-468d-a1bc-5c73f8b7b2b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:31:56 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-1b101090-3725-4edd-9841-e8b057229d83 tempest-VolumesActionsTest-229141369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eed31bff-98a7-468d-a1bc-5c73f8b7b2b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:31:56 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-1b101090-3725-4edd-9841-e8b057229d83 tempest-VolumesActionsTest-229141369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (287d8300-96cc-4a9b-8a97-60b085105e2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:31:56 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-1b101090-3725-4edd-9841-e8b057229d83 tempest-VolumesActionsTest-229141369 None] Volume eb3e7c0e-0fa2-472c-92ae-ed2bcea6c85c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb3e7c0e-0fa2-472c-92ae-ed2bcea6c85c', 'volume_size': 1} Sep 29 18:31:56 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-1b101090-3725-4edd-9841-e8b057229d83 tempest-VolumesActionsTest-229141369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:31:56 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-1b101090-3725-4edd-9841-e8b057229d83 tempest-VolumesActionsTest-229141369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:31:56 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-1b101090-3725-4edd-9841-e8b057229d83 tempest-VolumesActionsTest-229141369 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:31:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-326076958',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb3e7c0e-0fa2-472c-92ae-ed2bcea6c85c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6051d85c96664187b418c7f8d9bea489',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:31:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:31:57Z,use_quota=True,user_id='26df5f8923494907a7b3fc0a108af224',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)}" {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:31:56 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-1b101090-3725-4edd-9841-e8b057229d83 tempest-VolumesActionsTest-229141369 None] Creating volume eb3e7c0e-0fa2-472c-92ae-ed2bcea6c85c {{(pid=86512) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:31:56 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-1b101090-3725-4edd-9841-e8b057229d83 tempest-VolumesActionsTest-229141369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:31:56 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-1b101090-3725-4edd-9841-e8b057229d83 tempest-VolumesActionsTest-229141369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:31:56 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-1b101090-3725-4edd-9841-e8b057229d83 tempest-VolumesActionsTest-229141369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:31:56 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-1b101090-3725-4edd-9841-e8b057229d83 tempest-VolumesActionsTest-229141369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:31:56 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-1b101090-3725-4edd-9841-e8b057229d83 tempest-VolumesActionsTest-229141369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:31:56 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-1b101090-3725-4edd-9841-e8b057229d83 tempest-VolumesActionsTest-229141369 None] Selected osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 as target Quobyte volume. {{(pid=86512) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:31:56 devstack cinder-volume[86512]: INFO cinder.volume.drivers.remotefs [None req-1b101090-3725-4edd-9841-e8b057229d83 tempest-VolumesActionsTest-229141369 None] casted to osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 Sep 29 18:31:56 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-1b101090-3725-4edd-9841-e8b057229d83 tempest-VolumesActionsTest-229141369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-eb3e7c0e-0fa2-472c-92ae-ed2bcea6c85c 1073741824 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:31:56 devstack sudo[102887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-eb3e7c0e-0fa2-472c-92ae-ed2bcea6c85c 1073741824 Sep 29 18:31:56 devstack sudo[102887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:31:57 devstack sudo[102887]: pam_unix(sudo:session): session closed for user root Sep 29 18:31:57 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-1b101090-3725-4edd-9841-e8b057229d83 tempest-VolumesActionsTest-229141369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-eb3e7c0e-0fa2-472c-92ae-ed2bcea6c85c 1073741824" returned: 0 in 0.601s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:31:57 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-1b101090-3725-4edd-9841-e8b057229d83 tempest-VolumesActionsTest-229141369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-eb3e7c0e-0fa2-472c-92ae-ed2bcea6c85c {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:31:57 devstack sudo[102893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-eb3e7c0e-0fa2-472c-92ae-ed2bcea6c85c Sep 29 18:31:57 devstack sudo[102893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:31:57 devstack sudo[102893]: pam_unix(sudo:session): session closed for user root Sep 29 18:31:57 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-1b101090-3725-4edd-9841-e8b057229d83 tempest-VolumesActionsTest-229141369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-eb3e7c0e-0fa2-472c-92ae-ed2bcea6c85c" returned: 0 in 0.332s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:31:57 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-1b101090-3725-4edd-9841-e8b057229d83 tempest-VolumesActionsTest-229141369 None] <== create_volume: return (996ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'} {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:31:57 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-1b101090-3725-4edd-9841-e8b057229d83 tempest-VolumesActionsTest-229141369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:31:57 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-1b101090-3725-4edd-9841-e8b057229d83 tempest-VolumesActionsTest-229141369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (287d8300-96cc-4a9b-8a97-60b085105e2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb3e7c0e-0fa2-472c-92ae-ed2bcea6c85c', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:31:57 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-1b101090-3725-4edd-9841-e8b057229d83 tempest-VolumesActionsTest-229141369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (280a88a8-1bc6-4515-8d74-b69557d3f8d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:31:57 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-1b101090-3725-4edd-9841-e8b057229d83 tempest-VolumesActionsTest-229141369 None] Volume volume-eb3e7c0e-0fa2-472c-92ae-ed2bcea6c85c (eb3e7c0e-0fa2-472c-92ae-ed2bcea6c85c): created successfully Sep 29 18:31:57 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-1b101090-3725-4edd-9841-e8b057229d83 tempest-VolumesActionsTest-229141369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (280a88a8-1bc6-4515-8d74-b69557d3f8d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:31:57 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-1b101090-3725-4edd-9841-e8b057229d83 tempest-VolumesActionsTest-229141369 None] Flow 'volume_create_manager' (63990488-355d-4013-9742-e6e2779c18db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:31:57 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-1b101090-3725-4edd-9841-e8b057229d83 tempest-VolumesActionsTest-229141369 None] Created volume successfully. Sep 29 18:32:00 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [req-761e71ac-6567-401a-a2ab-b23b0411b5d8 req-ee35debf-9e57-4a8a-bf2d-b0a01b96d5aa tempest-TestServerVolumeAttachmentScenario-403056258 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:32:00 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [req-761e71ac-6567-401a-a2ab-b23b0411b5d8 req-ee35debf-9e57-4a8a-bf2d-b0a01b96d5aa tempest-TestServerVolumeAttachmentScenario-403056258 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:32:00 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [req-761e71ac-6567-401a-a2ab-b23b0411b5d8 req-ee35debf-9e57-4a8a-bf2d-b0a01b96d5aa tempest-TestServerVolumeAttachmentScenario-403056258 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:32:00 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [req-761e71ac-6567-401a-a2ab-b23b0411b5d8 req-ee35debf-9e57-4a8a-bf2d-b0a01b96d5aa tempest-TestServerVolumeAttachmentScenario-403056258 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883', 'name': 'volume-33d2a5fc-198e-4c35-80a5-491e6db3b5a9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '607c476e-48ca-4a6e-9ecf-161d0f93255c', 'enforce_multipath': True} {{(pid=86512) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 29 18:32:00 devstack cinder-volume[86512]: INFO cinder.volume.manager [req-761e71ac-6567-401a-a2ab-b23b0411b5d8 req-ee35debf-9e57-4a8a-bf2d-b0a01b96d5aa tempest-TestServerVolumeAttachmentScenario-403056258 None] attachment_update completed successfully. Sep 29 18:32:05 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [req-453f30be-0460-4617-9e4d-1eea434a0d8a req-3a3d7c0b-3788-4be8-a0b7-1a799ab189e6 tempest-TestServerVolumeAttachmentScenario-403056258 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:32:05 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [req-453f30be-0460-4617-9e4d-1eea434a0d8a req-3a3d7c0b-3788-4be8-a0b7-1a799ab189e6 tempest-TestServerVolumeAttachmentScenario-403056258 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:32:05 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [req-453f30be-0460-4617-9e4d-1eea434a0d8a req-3a3d7c0b-3788-4be8-a0b7-1a799ab189e6 tempest-TestServerVolumeAttachmentScenario-403056258 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.010s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:32:05 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [req-453f30be-0460-4617-9e4d-1eea434a0d8a req-3a3d7c0b-3788-4be8-a0b7-1a799ab189e6 tempest-TestServerVolumeAttachmentScenario-403056258 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883', 'name': 'volume-6348706c-c2c9-495e-b5ad-9d7bdbcb3dea', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '21eb28aa-986b-4a19-806c-e4de641ff8dc', 'enforce_multipath': True} {{(pid=86512) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 29 18:32:05 devstack cinder-volume[86512]: INFO cinder.volume.manager [req-453f30be-0460-4617-9e4d-1eea434a0d8a req-3a3d7c0b-3788-4be8-a0b7-1a799ab189e6 tempest-TestServerVolumeAttachmentScenario-403056258 None] attachment_update completed successfully. Sep 29 18:32:08 devstack cinder-volume[86512]: INFO cinder.volume.manager [req-1d666cfb-d282-4f97-98bc-8c57a61b8e96 req-0ba12ce4-3b77-476c-8cc7-736f134d1edf tempest-TestServerVolumeAttachmentScenario-403056258 None] Terminate volume connection completed successfully. Sep 29 18:32:08 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [req-1d666cfb-d282-4f97-98bc-8c57a61b8e96 req-0ba12ce4-3b77-476c-8cc7-736f134d1edf tempest-TestServerVolumeAttachmentScenario-403056258 None] Deleting attachment 21eb28aa-986b-4a19-806c-e4de641ff8dc. {{(pid=86512) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 29 18:32:09 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-839bcb31-bc57-4e8a-8b1d-9394eb6ea6ba tempest-VolumesActionsTest-229141369 None] Acquiring lock "cinder-eb3e7c0e-0fa2-472c-92ae-ed2bcea6c85c" by "attach_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:32:09 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-839bcb31-bc57-4e8a-8b1d-9394eb6ea6ba tempest-VolumesActionsTest-229141369 None] Lock "cinder-eb3e7c0e-0fa2-472c-92ae-ed2bcea6c85c" acquired by "attach_volume" :: waited 0.029s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:32:09 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-839bcb31-bc57-4e8a-8b1d-9394eb6ea6ba tempest-VolumesActionsTest-229141369 None] Attaching volume eb3e7c0e-0fa2-472c-92ae-ed2bcea6c85c to instance fa4e089e-9fc4-475b-bb34-38f8d43a4766 at mountpoint /dev/vdb on host None. Sep 29 18:32:09 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-839bcb31-bc57-4e8a-8b1d-9394eb6ea6ba tempest-VolumesActionsTest-229141369 None] Attach volume completed successfully. Sep 29 18:32:09 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-839bcb31-bc57-4e8a-8b1d-9394eb6ea6ba tempest-VolumesActionsTest-229141369 None] Lock "cinder-eb3e7c0e-0fa2-472c-92ae-ed2bcea6c85c" released by "attach_volume" :: held 0.153s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:32:09 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-61a07287-0853-4954-8e38-44ef05e8dfd1 tempest-VolumesActionsTest-229141369 None] Acquiring lock "cinder-eb3e7c0e-0fa2-472c-92ae-ed2bcea6c85c-detach_volume" by "detach_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:32:09 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-61a07287-0853-4954-8e38-44ef05e8dfd1 tempest-VolumesActionsTest-229141369 None] Lock "cinder-eb3e7c0e-0fa2-472c-92ae-ed2bcea6c85c-detach_volume" acquired by "detach_volume" :: waited 0.022s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:32:09 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-61a07287-0853-4954-8e38-44ef05e8dfd1 tempest-VolumesActionsTest-229141369 None] Detaching volume eb3e7c0e-0fa2-472c-92ae-ed2bcea6c85c from instance fa4e089e-9fc4-475b-bb34-38f8d43a4766. Sep 29 18:32:09 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-61a07287-0853-4954-8e38-44ef05e8dfd1 tempest-VolumesActionsTest-229141369 None] Detach volume completed successfully. Sep 29 18:32:10 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-61a07287-0853-4954-8e38-44ef05e8dfd1 tempest-VolumesActionsTest-229141369 None] Lock "cinder-eb3e7c0e-0fa2-472c-92ae-ed2bcea6c85c-detach_volume" released by "detach_volume" :: held 0.125s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:32:10 devstack cinder-volume[86512]: INFO cinder.volume.manager [req-159515b2-a41e-4660-848f-f378d2553bc4 req-9ed2b7ec-dd8a-4402-a5ba-098384f0baaa tempest-TestServerVolumeAttachmentScenario-403056258 None] Terminate volume connection completed successfully. Sep 29 18:32:10 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [req-159515b2-a41e-4660-848f-f378d2553bc4 req-9ed2b7ec-dd8a-4402-a5ba-098384f0baaa tempest-TestServerVolumeAttachmentScenario-403056258 None] Deleting attachment 607c476e-48ca-4a6e-9ecf-161d0f93255c. {{(pid=86512) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 29 18:32:11 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-a143932d-2de4-4d76-807e-140e53015509 tempest-TestShelveInstance-22798712 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86512) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:32:11 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-a143932d-2de4-4d76-807e-140e53015509 tempest-TestShelveInstance-22798712 None] Flow 'volume_create_manager' (38cd0a17-d75d-4ad5-b1ce-614084d154a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:32:11 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-a143932d-2de4-4d76-807e-140e53015509 tempest-TestShelveInstance-22798712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e5b78e4-f503-4ed2-9bd2-35a13f2bebf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:32:11 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-a143932d-2de4-4d76-807e-140e53015509 tempest-TestShelveInstance-22798712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e5b78e4-f503-4ed2-9bd2-35a13f2bebf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:32:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-2031919157',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83546d33-b4e2-47f0-a157-0ecd5376f3b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03f3b713bda44003a111e67dfa04572d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:32:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:32:11Z,use_quota=True,user_id='b21b321c7881471696f9e403c9c1e2ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:32:11 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-a143932d-2de4-4d76-807e-140e53015509 tempest-TestShelveInstance-22798712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b25b8c6e-812d-47d7-a2a1-3147cc3974b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:32:11 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-a143932d-2de4-4d76-807e-140e53015509 tempest-TestShelveInstance-22798712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b25b8c6e-812d-47d7-a2a1-3147cc3974b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:32:11 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-a143932d-2de4-4d76-807e-140e53015509 tempest-TestShelveInstance-22798712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b84bc2d3-5236-4117-b89c-dfdd5de1ba3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:32:11 devstack cinder-volume[86512]: DEBUG cinder.image.glance [None req-a143932d-2de4-4d76-807e-140e53015509 tempest-TestShelveInstance-22798712 None] Creating Keystone auth plugin from conf {{(pid=86512) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 29 18:32:12 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-a143932d-2de4-4d76-807e-140e53015509 tempest-TestShelveInstance-22798712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b84bc2d3-5236-4117-b89c-dfdd5de1ba3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '83546d33-b4e2-47f0-a157-0ecd5376f3b7', 'volume_name': 'volume-83546d33-b4e2-47f0-a157-0ecd5376f3b7', 'volume_size': 1, 'image_id': 'd8ebca63-1178-4b36-a1a2-e10949cbc87f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d8ebca63-1178-4b36-a1a2-e10949cbc87f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '987aeb00888a4b9bb9954392d91b8741', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd8ebca63-1178-4b36-a1a2-e10949cbc87f', 'created_at': datetime.datetime(2026, 9, 29, 16, 11, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 16, 11, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d8ebca63-1178-4b36-a1a2-e10949cbc87f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:32:12 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-a143932d-2de4-4d76-807e-140e53015509 tempest-TestShelveInstance-22798712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c7f92b3-6558-46ce-8bc0-a7e3be9aa6db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:32:12 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-a143932d-2de4-4d76-807e-140e53015509 tempest-TestShelveInstance-22798712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c7f92b3-6558-46ce-8bc0-a7e3be9aa6db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:32:12 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-a143932d-2de4-4d76-807e-140e53015509 tempest-TestShelveInstance-22798712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (573963b5-0397-4613-921d-9ac4338901a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:32:12 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-a143932d-2de4-4d76-807e-140e53015509 tempest-TestShelveInstance-22798712 None] Volume 83546d33-b4e2-47f0-a157-0ecd5376f3b7: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-83546d33-b4e2-47f0-a157-0ecd5376f3b7', 'volume_size': 1, 'image_id': 'd8ebca63-1178-4b36-a1a2-e10949cbc87f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d8ebca63-1178-4b36-a1a2-e10949cbc87f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '987aeb00888a4b9bb9954392d91b8741', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd8ebca63-1178-4b36-a1a2-e10949cbc87f', 'created_at': datetime.datetime(2026, 9, 29, 16, 11, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 16, 11, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d8ebca63-1178-4b36-a1a2-e10949cbc87f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 29 18:32:12 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-a143932d-2de4-4d76-807e-140e53015509 tempest-TestShelveInstance-22798712 None] Trying to clone 83546d33-b4e2-47f0-a157-0ecd5376f3b7 from image d8ebca63-1178-4b36-a1a2-e10949cbc87f at location (None, [{'url': 'file:///opt/stack/data/glance/images/d8ebca63-1178-4b36-a1a2-e10949cbc87f', 'metadata': {}}]). {{(pid=86512) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 29 18:32:12 devstack cinder-volume[86512]: DEBUG cinder.image.image_utils [None req-a143932d-2de4-4d76-807e-140e53015509 tempest-TestShelveInstance-22798712 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d8ebca63-1178-4b36-a1a2-e10949cbc87f_z_2cwdt7devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86512) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 29 18:32:12 devstack cinder-volume[86512]: INFO cinder.image.image_utils [None req-a143932d-2de4-4d76-807e-140e53015509 tempest-TestShelveInstance-22798712 None] Image download 20.69 MB at 20.69 MB/s Sep 29 18:32:12 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaa24713-4308-4a40-9368-3ea10986aeed]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:32:12 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a143932d-2de4-4d76-807e-140e53015509 tempest-TestShelveInstance-22798712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d8ebca63-1178-4b36-a1a2-e10949cbc87f_z_2cwdt7devstack@QuobyteHD {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:32:12 devstack sudo[103527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d8ebca63-1178-4b36-a1a2-e10949cbc87f_z_2cwdt7devstack@QuobyteHD Sep 29 18:32:12 devstack sudo[103527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:32:13 devstack sudo[103527]: pam_unix(sudo:session): session closed for user root Sep 29 18:32:13 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a143932d-2de4-4d76-807e-140e53015509 tempest-TestShelveInstance-22798712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d8ebca63-1178-4b36-a1a2-e10949cbc87f_z_2cwdt7devstack@QuobyteHD" returned: 0 in 0.520s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:32:13 devstack cinder-volume[86512]: DEBUG cinder.image.image_utils [None req-a143932d-2de4-4d76-807e-140e53015509 tempest-TestShelveInstance-22798712 None] Temporary image d8ebca63-1178-4b36-a1a2-e10949cbc87f is fetched for user b21b321c7881471696f9e403c9c1e2ad. {{(pid=86512) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 29 18:32:13 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[da16efa3-7f23-4d88-bbc0-d3de372422ab]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:32:13 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a143932d-2de4-4d76-807e-140e53015509 tempest-TestShelveInstance-22798712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d8ebca63-1178-4b36-a1a2-e10949cbc87f_z_2cwdt7devstack@QuobyteHD {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:32:13 devstack sudo[103533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d8ebca63-1178-4b36-a1a2-e10949cbc87f_z_2cwdt7devstack@QuobyteHD Sep 29 18:32:13 devstack sudo[103533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:32:13 devstack sudo[103533]: pam_unix(sudo:session): session closed for user root Sep 29 18:32:13 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a143932d-2de4-4d76-807e-140e53015509 tempest-TestShelveInstance-22798712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d8ebca63-1178-4b36-a1a2-e10949cbc87f_z_2cwdt7devstack@QuobyteHD" returned: 0 in 0.371s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:32:13 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-a143932d-2de4-4d76-807e-140e53015509 tempest-TestShelveInstance-22798712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:32:13 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-a143932d-2de4-4d76-807e-140e53015509 tempest-TestShelveInstance-22798712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:32:13 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-a143932d-2de4-4d76-807e-140e53015509 tempest-TestShelveInstance-22798712 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:32:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-2031919157',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83546d33-b4e2-47f0-a157-0ecd5376f3b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03f3b713bda44003a111e67dfa04572d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:32:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:32:11Z,use_quota=True,user_id='b21b321c7881471696f9e403c9c1e2ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)}" {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:32:13 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-a143932d-2de4-4d76-807e-140e53015509 tempest-TestShelveInstance-22798712 None] Creating volume 83546d33-b4e2-47f0-a157-0ecd5376f3b7 {{(pid=86512) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:32:13 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-a143932d-2de4-4d76-807e-140e53015509 tempest-TestShelveInstance-22798712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:32:13 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-a143932d-2de4-4d76-807e-140e53015509 tempest-TestShelveInstance-22798712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:32:13 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-a143932d-2de4-4d76-807e-140e53015509 tempest-TestShelveInstance-22798712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:32:13 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-a143932d-2de4-4d76-807e-140e53015509 tempest-TestShelveInstance-22798712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:32:13 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-a143932d-2de4-4d76-807e-140e53015509 tempest-TestShelveInstance-22798712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:32:13 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-a143932d-2de4-4d76-807e-140e53015509 tempest-TestShelveInstance-22798712 None] Selected osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 as target Quobyte volume. {{(pid=86512) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:32:13 devstack cinder-volume[86512]: INFO cinder.volume.drivers.remotefs [None req-a143932d-2de4-4d76-807e-140e53015509 tempest-TestShelveInstance-22798712 None] casted to osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 Sep 29 18:32:13 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a143932d-2de4-4d76-807e-140e53015509 tempest-TestShelveInstance-22798712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-83546d33-b4e2-47f0-a157-0ecd5376f3b7 1073741824 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:32:13 devstack sudo[103539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-83546d33-b4e2-47f0-a157-0ecd5376f3b7 1073741824 Sep 29 18:32:13 devstack sudo[103539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:32:14 devstack sudo[103539]: pam_unix(sudo:session): session closed for user root Sep 29 18:32:14 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a143932d-2de4-4d76-807e-140e53015509 tempest-TestShelveInstance-22798712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-83546d33-b4e2-47f0-a157-0ecd5376f3b7 1073741824" returned: 0 in 0.502s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:32:14 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a143932d-2de4-4d76-807e-140e53015509 tempest-TestShelveInstance-22798712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-83546d33-b4e2-47f0-a157-0ecd5376f3b7 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:32:14 devstack sudo[103549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-83546d33-b4e2-47f0-a157-0ecd5376f3b7 Sep 29 18:32:14 devstack sudo[103549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:32:14 devstack sudo[103549]: pam_unix(sudo:session): session closed for user root Sep 29 18:32:14 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a143932d-2de4-4d76-807e-140e53015509 tempest-TestShelveInstance-22798712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-83546d33-b4e2-47f0-a157-0ecd5376f3b7" returned: 0 in 0.298s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:32:14 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-a143932d-2de4-4d76-807e-140e53015509 tempest-TestShelveInstance-22798712 None] <== create_volume: return (880ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'} {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:32:14 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-a143932d-2de4-4d76-807e-140e53015509 tempest-TestShelveInstance-22798712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.883s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:32:14 devstack cinder-volume[86512]: DEBUG cinder.volume.volume_utils [None req-a143932d-2de4-4d76-807e-140e53015509 tempest-TestShelveInstance-22798712 None] Attempting download of d8ebca63-1178-4b36-a1a2-e10949cbc87f ((None, [{'url': 'file:///opt/stack/data/glance/images/d8ebca63-1178-4b36-a1a2-e10949cbc87f', 'metadata': {}}])) to volume 83546d33-b4e2-47f0-a157-0ecd5376f3b7. {{(pid=86512) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 29 18:32:14 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[d31ba2e7-6624-4249-bb11-4f04ecfae26c]: (4, 'raw') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:32:14 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a143932d-2de4-4d76-807e-140e53015509 tempest-TestShelveInstance-22798712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d8ebca63-1178-4b36-a1a2-e10949cbc87f_w75neiju {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:32:14 devstack sudo[103553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d8ebca63-1178-4b36-a1a2-e10949cbc87f_w75neiju Sep 29 18:32:14 devstack sudo[103553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:32:14 devstack sudo[103553]: pam_unix(sudo:session): session closed for user root Sep 29 18:32:14 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a143932d-2de4-4d76-807e-140e53015509 tempest-TestShelveInstance-22798712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d8ebca63-1178-4b36-a1a2-e10949cbc87f_w75neiju" returned: 0 in 0.383s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:32:14 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a143932d-2de4-4d76-807e-140e53015509 tempest-TestShelveInstance-22798712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d8ebca63-1178-4b36-a1a2-e10949cbc87f_w75neiju {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:32:15 devstack sudo[103557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d8ebca63-1178-4b36-a1a2-e10949cbc87f_w75neiju Sep 29 18:32:15 devstack sudo[103557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:32:15 devstack sudo[103557]: pam_unix(sudo:session): session closed for user root Sep 29 18:32:15 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a143932d-2de4-4d76-807e-140e53015509 tempest-TestShelveInstance-22798712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d8ebca63-1178-4b36-a1a2-e10949cbc87f_w75neiju" returned: 1 in 0.365s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:32:15 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a143932d-2de4-4d76-807e-140e53015509 tempest-TestShelveInstance-22798712 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d8ebca63-1178-4b36-a1a2-e10949cbc87f_w75neiju' failed. Not Retrying. {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 29 18:32:15 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[24a001e4-0b07-489d-bc67-b29728cf3dc9]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:32:15 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a143932d-2de4-4d76-807e-140e53015509 tempest-TestShelveInstance-22798712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d8ebca63-1178-4b36-a1a2-e10949cbc87f_z_2cwdt7devstack@QuobyteHD {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:32:15 devstack sudo[103561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d8ebca63-1178-4b36-a1a2-e10949cbc87f_z_2cwdt7devstack@QuobyteHD Sep 29 18:32:15 devstack sudo[103561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:32:15 devstack sudo[103561]: pam_unix(sudo:session): session closed for user root Sep 29 18:32:15 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a143932d-2de4-4d76-807e-140e53015509 tempest-TestShelveInstance-22798712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d8ebca63-1178-4b36-a1a2-e10949cbc87f_z_2cwdt7devstack@QuobyteHD" returned: 0 in 0.374s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:32:15 devstack cinder-volume[86512]: DEBUG cinder.image.image_utils [None req-a143932d-2de4-4d76-807e-140e53015509 tempest-TestShelveInstance-22798712 None] d8ebca63-1178-4b36-a1a2-e10949cbc87f was qcow2, converting to qcow2 {{(pid=86512) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 29 18:32:15 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a143932d-2de4-4d76-807e-140e53015509 tempest-TestShelveInstance-22798712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d8ebca63-1178-4b36-a1a2-e10949cbc87f_z_2cwdt7devstack@QuobyteHD /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-83546d33-b4e2-47f0-a157-0ecd5376f3b7 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:32:15 devstack sudo[103569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d8ebca63-1178-4b36-a1a2-e10949cbc87f_z_2cwdt7devstack@QuobyteHD /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-83546d33-b4e2-47f0-a157-0ecd5376f3b7 Sep 29 18:32:15 devstack sudo[103569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:32:17 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-4066ee31-46d2-41a2-9e9d-2ee21c8284cc tempest-TestServerVolumeAttachmentScenario-403056258 None] Acquiring lock "cinder-6348706c-c2c9-495e-b5ad-9d7bdbcb3dea-delete_volume" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:32:17 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-4066ee31-46d2-41a2-9e9d-2ee21c8284cc tempest-TestServerVolumeAttachmentScenario-403056258 None] Lock "cinder-6348706c-c2c9-495e-b5ad-9d7bdbcb3dea-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:32:17 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-4066ee31-46d2-41a2-9e9d-2ee21c8284cc tempest-TestServerVolumeAttachmentScenario-403056258 None] Acquiring lock "cinder-quobyte-6348706c-c2c9-495e-b5ad-9d7bdbcb3dea" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:32:17 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-4066ee31-46d2-41a2-9e9d-2ee21c8284cc tempest-TestServerVolumeAttachmentScenario-403056258 None] Lock "cinder-quobyte-6348706c-c2c9-495e-b5ad-9d7bdbcb3dea" acquired by "delete_volume" :: waited 0.018s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:32:17 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[59f25809-6df4-4474-98bc-43353e881a12]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:32:17 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-4066ee31-46d2-41a2-9e9d-2ee21c8284cc tempest-TestServerVolumeAttachmentScenario-403056258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-6348706c-c2c9-495e-b5ad-9d7bdbcb3dea {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:32:17 devstack sudo[103590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-6348706c-c2c9-495e-b5ad-9d7bdbcb3dea Sep 29 18:32:17 devstack sudo[103590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:32:17 devstack sudo[103590]: pam_unix(sudo:session): session closed for user root Sep 29 18:32:17 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-4066ee31-46d2-41a2-9e9d-2ee21c8284cc tempest-TestServerVolumeAttachmentScenario-403056258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-6348706c-c2c9-495e-b5ad-9d7bdbcb3dea" returned: 0 in 0.421s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:32:17 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-4066ee31-46d2-41a2-9e9d-2ee21c8284cc tempest-TestServerVolumeAttachmentScenario-403056258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-6348706c-c2c9-495e-b5ad-9d7bdbcb3dea {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:32:17 devstack sudo[103596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-6348706c-c2c9-495e-b5ad-9d7bdbcb3dea Sep 29 18:32:17 devstack sudo[103596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:32:17 devstack sudo[103596]: pam_unix(sudo:session): session closed for user root Sep 29 18:32:17 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-4066ee31-46d2-41a2-9e9d-2ee21c8284cc tempest-TestServerVolumeAttachmentScenario-403056258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-6348706c-c2c9-495e-b5ad-9d7bdbcb3dea" returned: 0 in 0.321s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:32:17 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-4066ee31-46d2-41a2-9e9d-2ee21c8284cc tempest-TestServerVolumeAttachmentScenario-403056258 None] Lock "cinder-quobyte-6348706c-c2c9-495e-b5ad-9d7bdbcb3dea" released by "delete_volume" :: held 0.805s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:32:18 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-4066ee31-46d2-41a2-9e9d-2ee21c8284cc tempest-TestServerVolumeAttachmentScenario-403056258 None] Created reservations ['f0658410-02c6-47dc-9e5f-eecef455a653', '365b66be-f1ac-4044-9afb-9914292dd6af', '690706d6-61e2-4d11-ac4f-28583c046f00', '0cf4a33c-d346-4a24-a56f-62cc864d801a'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:32:18 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-4066ee31-46d2-41a2-9e9d-2ee21c8284cc tempest-TestServerVolumeAttachmentScenario-403056258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:32:18 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-4066ee31-46d2-41a2-9e9d-2ee21c8284cc tempest-TestServerVolumeAttachmentScenario-403056258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:32:18 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-4066ee31-46d2-41a2-9e9d-2ee21c8284cc tempest-TestServerVolumeAttachmentScenario-403056258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:32:18 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-4066ee31-46d2-41a2-9e9d-2ee21c8284cc tempest-TestServerVolumeAttachmentScenario-403056258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:32:18 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-4066ee31-46d2-41a2-9e9d-2ee21c8284cc tempest-TestServerVolumeAttachmentScenario-403056258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:32:18 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-4066ee31-46d2-41a2-9e9d-2ee21c8284cc tempest-TestServerVolumeAttachmentScenario-403056258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:32:18 devstack sudo[103600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:32:18 devstack sudo[103600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:32:18 devstack sudo[103569]: pam_unix(sudo:session): session closed for user root Sep 29 18:32:18 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a143932d-2de4-4d76-807e-140e53015509 tempest-TestShelveInstance-22798712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d8ebca63-1178-4b36-a1a2-e10949cbc87f_z_2cwdt7devstack@QuobyteHD /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-83546d33-b4e2-47f0-a157-0ecd5376f3b7" returned: 0 in 2.475s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:32:18 devstack cinder-volume[86512]: DEBUG cinder.image.image_utils [None req-a143932d-2de4-4d76-807e-140e53015509 tempest-TestShelveInstance-22798712 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d8ebca63-1178-4b36-a1a2-e10949cbc87f_z_2cwdt7devstack@QuobyteHD, size 112.00 MB, duration 2.48 sec, destination /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-83546d33-b4e2-47f0-a157-0ecd5376f3b7 {{(pid=86512) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 29 18:32:18 devstack cinder-volume[86512]: INFO cinder.image.image_utils [None req-a143932d-2de4-4d76-807e-140e53015509 tempest-TestShelveInstance-22798712 None] Converted 112.00 MB image at 45.22 MB/s Sep 29 18:32:18 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a143932d-2de4-4d76-807e-140e53015509 tempest-TestShelveInstance-22798712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-83546d33-b4e2-47f0-a157-0ecd5376f3b7 1G {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:32:18 devstack sudo[103602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-83546d33-b4e2-47f0-a157-0ecd5376f3b7 1G Sep 29 18:32:18 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-c4181824-de7b-412d-91f0-fb7de9f3ec19 tempest-TestServerVolumeAttachmentScenario-403056258 None] Acquiring lock "cinder-33d2a5fc-198e-4c35-80a5-491e6db3b5a9-delete_volume" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:32:18 devstack sudo[103602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:32:18 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-c4181824-de7b-412d-91f0-fb7de9f3ec19 tempest-TestServerVolumeAttachmentScenario-403056258 None] Lock "cinder-33d2a5fc-198e-4c35-80a5-491e6db3b5a9-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:32:18 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-c4181824-de7b-412d-91f0-fb7de9f3ec19 tempest-TestServerVolumeAttachmentScenario-403056258 None] Acquiring lock "cinder-quobyte-33d2a5fc-198e-4c35-80a5-491e6db3b5a9" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:32:18 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-c4181824-de7b-412d-91f0-fb7de9f3ec19 tempest-TestServerVolumeAttachmentScenario-403056258 None] Lock "cinder-quobyte-33d2a5fc-198e-4c35-80a5-491e6db3b5a9" acquired by "delete_volume" :: waited 0.018s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:32:18 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b8a6c54-a113-4ada-b872-2e1d918ad84f]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:32:18 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-c4181824-de7b-412d-91f0-fb7de9f3ec19 tempest-TestServerVolumeAttachmentScenario-403056258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-33d2a5fc-198e-4c35-80a5-491e6db3b5a9 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:32:18 devstack sudo[103600]: pam_unix(sudo:session): session closed for user root Sep 29 18:32:18 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-4066ee31-46d2-41a2-9e9d-2ee21c8284cc tempest-TestServerVolumeAttachmentScenario-403056258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.576s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:32:18 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-4066ee31-46d2-41a2-9e9d-2ee21c8284cc tempest-TestServerVolumeAttachmentScenario-403056258 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:32:18 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-4066ee31-46d2-41a2-9e9d-2ee21c8284cc tempest-TestServerVolumeAttachmentScenario-403056258 None] Deleted volume successfully. Sep 29 18:32:18 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-4066ee31-46d2-41a2-9e9d-2ee21c8284cc tempest-TestServerVolumeAttachmentScenario-403056258 None] Lock "cinder-6348706c-c2c9-495e-b5ad-9d7bdbcb3dea-delete_volume" released by "delete_volume" :: held 1.662s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:32:18 devstack sudo[103607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-33d2a5fc-198e-4c35-80a5-491e6db3b5a9 Sep 29 18:32:18 devstack sudo[103607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:32:18 devstack sudo[103602]: pam_unix(sudo:session): session closed for user root Sep 29 18:32:18 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a143932d-2de4-4d76-807e-140e53015509 tempest-TestShelveInstance-22798712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-83546d33-b4e2-47f0-a157-0ecd5376f3b7 1G" returned: 0 in 0.714s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:32:18 devstack cinder-volume[86512]: DEBUG cinder.volume.volume_utils [None req-a143932d-2de4-4d76-807e-140e53015509 tempest-TestShelveInstance-22798712 None] Downloaded image d8ebca63-1178-4b36-a1a2-e10949cbc87f ((None, [{'url': 'file:///opt/stack/data/glance/images/d8ebca63-1178-4b36-a1a2-e10949cbc87f', 'metadata': {}}])) to volume 83546d33-b4e2-47f0-a157-0ecd5376f3b7 successfully. {{(pid=86512) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 29 18:32:18 devstack cinder-volume[86512]: DEBUG cinder.image.image_utils [None req-a143932d-2de4-4d76-807e-140e53015509 tempest-TestShelveInstance-22798712 None] Temporary image d8ebca63-1178-4b36-a1a2-e10949cbc87f for user b21b321c7881471696f9e403c9c1e2ad is deleted. {{(pid=86512) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 29 18:32:18 devstack cinder-volume[86512]: DEBUG cinder.volume.volume_utils [None req-a143932d-2de4-4d76-807e-140e53015509 tempest-TestShelveInstance-22798712 None] Marking volume 83546d33-b4e2-47f0-a157-0ecd5376f3b7 as bootable. {{(pid=86512) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 29 18:32:18 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-a143932d-2de4-4d76-807e-140e53015509 tempest-TestShelveInstance-22798712 None] Copying metadata from image d8ebca63-1178-4b36-a1a2-e10949cbc87f to 83546d33-b4e2-47f0-a157-0ecd5376f3b7. {{(pid=86512) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 29 18:32:18 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-a143932d-2de4-4d76-807e-140e53015509 tempest-TestShelveInstance-22798712 None] Creating volume glance metadata for volume 83546d33-b4e2-47f0-a157-0ecd5376f3b7 backed by image d8ebca63-1178-4b36-a1a2-e10949cbc87f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'd8ebca63-1178-4b36-a1a2-e10949cbc87f', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86512) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 29 18:32:19 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-a143932d-2de4-4d76-807e-140e53015509 tempest-TestShelveInstance-22798712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (573963b5-0397-4613-921d-9ac4338901a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83546d33-b4e2-47f0-a157-0ecd5376f3b7', 'volume_size': 1, 'image_id': 'd8ebca63-1178-4b36-a1a2-e10949cbc87f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d8ebca63-1178-4b36-a1a2-e10949cbc87f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '987aeb00888a4b9bb9954392d91b8741', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd8ebca63-1178-4b36-a1a2-e10949cbc87f', 'created_at': datetime.datetime(2026, 9, 29, 16, 11, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 16, 11, 56, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d8ebca63-1178-4b36-a1a2-e10949cbc87f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:32:19 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-a143932d-2de4-4d76-807e-140e53015509 tempest-TestShelveInstance-22798712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b0dee71-d738-4f55-a765-e33f6645f208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:32:19 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-a143932d-2de4-4d76-807e-140e53015509 tempest-TestShelveInstance-22798712 None] Volume volume-83546d33-b4e2-47f0-a157-0ecd5376f3b7 (83546d33-b4e2-47f0-a157-0ecd5376f3b7): created successfully Sep 29 18:32:19 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-a143932d-2de4-4d76-807e-140e53015509 tempest-TestShelveInstance-22798712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b0dee71-d738-4f55-a765-e33f6645f208) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:32:19 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-a143932d-2de4-4d76-807e-140e53015509 tempest-TestShelveInstance-22798712 None] Flow 'volume_create_manager' (38cd0a17-d75d-4ad5-b1ce-614084d154a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:32:19 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-a143932d-2de4-4d76-807e-140e53015509 tempest-TestShelveInstance-22798712 None] Created volume successfully. Sep 29 18:32:19 devstack sudo[103607]: pam_unix(sudo:session): session closed for user root Sep 29 18:32:19 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-c4181824-de7b-412d-91f0-fb7de9f3ec19 tempest-TestServerVolumeAttachmentScenario-403056258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-33d2a5fc-198e-4c35-80a5-491e6db3b5a9" returned: 0 in 0.851s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:32:19 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-c4181824-de7b-412d-91f0-fb7de9f3ec19 tempest-TestServerVolumeAttachmentScenario-403056258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-33d2a5fc-198e-4c35-80a5-491e6db3b5a9 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:32:19 devstack sudo[103664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-33d2a5fc-198e-4c35-80a5-491e6db3b5a9 Sep 29 18:32:19 devstack sudo[103664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:32:19 devstack sudo[103664]: pam_unix(sudo:session): session closed for user root Sep 29 18:32:19 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-c4181824-de7b-412d-91f0-fb7de9f3ec19 tempest-TestServerVolumeAttachmentScenario-403056258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-33d2a5fc-198e-4c35-80a5-491e6db3b5a9" returned: 0 in 0.382s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:32:19 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-c4181824-de7b-412d-91f0-fb7de9f3ec19 tempest-TestServerVolumeAttachmentScenario-403056258 None] Lock "cinder-quobyte-33d2a5fc-198e-4c35-80a5-491e6db3b5a9" released by "delete_volume" :: held 1.314s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:32:19 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-c4181824-de7b-412d-91f0-fb7de9f3ec19 tempest-TestServerVolumeAttachmentScenario-403056258 None] Created reservations ['56728dd1-5390-44dc-88fb-dbd369d7cc86', '224ed044-6b21-4b38-b86f-6d66f9034660', 'edd56d82-2166-49a6-9e98-165f909d955f', '7c661b22-7c14-4b0b-8877-095a49b9ead4'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:32:19 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-c4181824-de7b-412d-91f0-fb7de9f3ec19 tempest-TestServerVolumeAttachmentScenario-403056258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:32:19 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-c4181824-de7b-412d-91f0-fb7de9f3ec19 tempest-TestServerVolumeAttachmentScenario-403056258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:32:19 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-c4181824-de7b-412d-91f0-fb7de9f3ec19 tempest-TestServerVolumeAttachmentScenario-403056258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:32:19 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-c4181824-de7b-412d-91f0-fb7de9f3ec19 tempest-TestServerVolumeAttachmentScenario-403056258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:32:19 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-c4181824-de7b-412d-91f0-fb7de9f3ec19 tempest-TestServerVolumeAttachmentScenario-403056258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:32:19 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-c4181824-de7b-412d-91f0-fb7de9f3ec19 tempest-TestServerVolumeAttachmentScenario-403056258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:32:19 devstack sudo[103690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:32:19 devstack sudo[103690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:32:20 devstack sudo[103690]: pam_unix(sudo:session): session closed for user root Sep 29 18:32:20 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-c4181824-de7b-412d-91f0-fb7de9f3ec19 tempest-TestServerVolumeAttachmentScenario-403056258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.258s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:32:20 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-c4181824-de7b-412d-91f0-fb7de9f3ec19 tempest-TestServerVolumeAttachmentScenario-403056258 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:32:20 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-c4181824-de7b-412d-91f0-fb7de9f3ec19 tempest-TestServerVolumeAttachmentScenario-403056258 None] Deleted volume successfully. Sep 29 18:32:20 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-c4181824-de7b-412d-91f0-fb7de9f3ec19 tempest-TestServerVolumeAttachmentScenario-403056258 None] Lock "cinder-33d2a5fc-198e-4c35-80a5-491e6db3b5a9-delete_volume" released by "delete_volume" :: held 1.895s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:32:23 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-97a33797-8612-4717-9131-4d138fadaf1c tempest-VolumesActionsTest-229141369 None] Acquiring lock "cinder-eb3e7c0e-0fa2-472c-92ae-ed2bcea6c85c" by "attach_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:32:23 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-97a33797-8612-4717-9131-4d138fadaf1c tempest-VolumesActionsTest-229141369 None] Lock "cinder-eb3e7c0e-0fa2-472c-92ae-ed2bcea6c85c" acquired by "attach_volume" :: waited 0.047s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:32:23 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-97a33797-8612-4717-9131-4d138fadaf1c tempest-VolumesActionsTest-229141369 None] Attaching volume eb3e7c0e-0fa2-472c-92ae-ed2bcea6c85c to instance 4a41e2b3-3994-4616-af68-300e56919077 at mountpoint /dev/vdb on host None. Sep 29 18:32:23 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-97a33797-8612-4717-9131-4d138fadaf1c tempest-VolumesActionsTest-229141369 None] Attach volume completed successfully. Sep 29 18:32:23 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-97a33797-8612-4717-9131-4d138fadaf1c tempest-VolumesActionsTest-229141369 None] Lock "cinder-eb3e7c0e-0fa2-472c-92ae-ed2bcea6c85c" released by "attach_volume" :: held 0.189s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:32:23 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [req-ba08fc5d-16bf-49c5-a2d1-8e5c99402e49 req-ed83c668-c6b7-4fd8-a1fe-4a35e030f8eb tempest-TestShelveInstance-22798712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:32:23 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [req-ba08fc5d-16bf-49c5-a2d1-8e5c99402e49 req-ed83c668-c6b7-4fd8-a1fe-4a35e030f8eb tempest-TestShelveInstance-22798712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:32:23 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [req-ba08fc5d-16bf-49c5-a2d1-8e5c99402e49 req-ed83c668-c6b7-4fd8-a1fe-4a35e030f8eb tempest-TestShelveInstance-22798712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:32:23 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [req-ba08fc5d-16bf-49c5-a2d1-8e5c99402e49 req-ed83c668-c6b7-4fd8-a1fe-4a35e030f8eb tempest-TestShelveInstance-22798712 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883', 'name': 'volume-83546d33-b4e2-47f0-a157-0ecd5376f3b7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ba00abeb-13ce-4a6e-87f7-3cb9f721669c', 'enforce_multipath': True} {{(pid=86512) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 29 18:32:23 devstack cinder-volume[86512]: INFO cinder.volume.manager [req-ba08fc5d-16bf-49c5-a2d1-8e5c99402e49 req-ed83c668-c6b7-4fd8-a1fe-4a35e030f8eb tempest-TestShelveInstance-22798712 None] attachment_update completed successfully. Sep 29 18:32:23 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-6dff913e-f936-4c56-b56e-30b201172c68 tempest-VolumesActionsTest-229141369 None] Acquiring lock "cinder-eb3e7c0e-0fa2-472c-92ae-ed2bcea6c85c-detach_volume" by "detach_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:32:24 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-6dff913e-f936-4c56-b56e-30b201172c68 tempest-VolumesActionsTest-229141369 None] Lock "cinder-eb3e7c0e-0fa2-472c-92ae-ed2bcea6c85c-detach_volume" acquired by "detach_volume" :: waited 0.032s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:32:24 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-6dff913e-f936-4c56-b56e-30b201172c68 tempest-VolumesActionsTest-229141369 None] Detaching volume eb3e7c0e-0fa2-472c-92ae-ed2bcea6c85c from instance 4a41e2b3-3994-4616-af68-300e56919077. Sep 29 18:32:24 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-6dff913e-f936-4c56-b56e-30b201172c68 tempest-VolumesActionsTest-229141369 None] Detach volume completed successfully. Sep 29 18:32:24 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-6dff913e-f936-4c56-b56e-30b201172c68 tempest-VolumesActionsTest-229141369 None] Lock "cinder-eb3e7c0e-0fa2-472c-92ae-ed2bcea6c85c-detach_volume" released by "detach_volume" :: held 0.084s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:32:30 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-98eb43da-54c0-4e76-81a0-7f04f1a94fe1 tempest-VolumesActionsTest-229141369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:32:30 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-98eb43da-54c0-4e76-81a0-7f04f1a94fe1 tempest-VolumesActionsTest-229141369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:32:30 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[e96ab7be-6d6d-4522-9daa-f9465e35d847]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:32:30 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-98eb43da-54c0-4e76-81a0-7f04f1a94fe1 tempest-VolumesActionsTest-229141369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-eb3e7c0e-0fa2-472c-92ae-ed2bcea6c85c {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:32:30 devstack sudo[104241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-eb3e7c0e-0fa2-472c-92ae-ed2bcea6c85c Sep 29 18:32:30 devstack sudo[104241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:32:31 devstack sudo[104241]: pam_unix(sudo:session): session closed for user root Sep 29 18:32:31 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-98eb43da-54c0-4e76-81a0-7f04f1a94fe1 tempest-VolumesActionsTest-229141369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-eb3e7c0e-0fa2-472c-92ae-ed2bcea6c85c" returned: 0 in 0.539s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:32:31 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[6909b203-18fb-49f3-9447-a2e55e140b3e]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:32:31 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-98eb43da-54c0-4e76-81a0-7f04f1a94fe1 tempest-VolumesActionsTest-229141369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-eb3e7c0e-0fa2-472c-92ae-ed2bcea6c85c {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:32:31 devstack sudo[104246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-eb3e7c0e-0fa2-472c-92ae-ed2bcea6c85c Sep 29 18:32:31 devstack sudo[104246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:32:31 devstack sudo[104246]: pam_unix(sudo:session): session closed for user root Sep 29 18:32:31 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-98eb43da-54c0-4e76-81a0-7f04f1a94fe1 tempest-VolumesActionsTest-229141369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-eb3e7c0e-0fa2-472c-92ae-ed2bcea6c85c" returned: 0 in 0.426s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:32:31 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-98eb43da-54c0-4e76-81a0-7f04f1a94fe1 tempest-VolumesActionsTest-229141369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-eb3e7c0e-0fa2-472c-92ae-ed2bcea6c85c /opt/stack/data/cinder/conversion/eb3e7c0e-0fa2-472c-92ae-ed2bcea6c85c.temp_image.9e53dbac-9417-4034-8859-34f63cd976ddrwt5cve1.img {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:32:31 devstack sudo[104251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-eb3e7c0e-0fa2-472c-92ae-ed2bcea6c85c /opt/stack/data/cinder/conversion/eb3e7c0e-0fa2-472c-92ae-ed2bcea6c85c.temp_image.9e53dbac-9417-4034-8859-34f63cd976ddrwt5cve1.img Sep 29 18:32:31 devstack sudo[104251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:32:34 devstack cinder-volume[86512]: DEBUG dbcounter [-] [86512] Writing DB stats cinder:SELECT=61,cinder:UPDATE=31,cinder:DELETE=2,cinder:INSERT=17 {{(pid=86512) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 18:32:41 devstack cinder-volume[86512]: DEBUG dbcounter [-] [86512] Writing DB stats cinder:UPDATE=38,cinder:SELECT=53,cinder:INSERT=10,cinder:DELETE=2 {{(pid=86512) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 18:32:42 devstack sudo[104251]: pam_unix(sudo:session): session closed for user root Sep 29 18:32:42 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-98eb43da-54c0-4e76-81a0-7f04f1a94fe1 tempest-VolumesActionsTest-229141369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-eb3e7c0e-0fa2-472c-92ae-ed2bcea6c85c /opt/stack/data/cinder/conversion/eb3e7c0e-0fa2-472c-92ae-ed2bcea6c85c.temp_image.9e53dbac-9417-4034-8859-34f63cd976ddrwt5cve1.img" returned: 0 in 10.736s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:32:42 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[191e7b16-5e70-487b-9d42-c14e465d409c]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:32:42 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-98eb43da-54c0-4e76-81a0-7f04f1a94fe1 tempest-VolumesActionsTest-229141369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-eb3e7c0e-0fa2-472c-92ae-ed2bcea6c85c {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:32:42 devstack sudo[104271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-eb3e7c0e-0fa2-472c-92ae-ed2bcea6c85c Sep 29 18:32:42 devstack sudo[104271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:32:42 devstack sudo[104271]: pam_unix(sudo:session): session closed for user root Sep 29 18:32:42 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-98eb43da-54c0-4e76-81a0-7f04f1a94fe1 tempest-VolumesActionsTest-229141369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-eb3e7c0e-0fa2-472c-92ae-ed2bcea6c85c" returned: 0 in 0.624s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:32:42 devstack cinder-volume[86512]: DEBUG cinder.image.image_utils [None req-98eb43da-54c0-4e76-81a0-7f04f1a94fe1 tempest-VolumesActionsTest-229141369 None] Image conversion details: src /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-eb3e7c0e-0fa2-472c-92ae-ed2bcea6c85c, size 1024.00 MB, duration 10.74 sec, destination /opt/stack/data/cinder/conversion/eb3e7c0e-0fa2-472c-92ae-ed2bcea6c85c.temp_image.9e53dbac-9417-4034-8859-34f63cd976ddrwt5cve1.img {{(pid=86512) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 29 18:32:42 devstack cinder-volume[86512]: INFO cinder.image.image_utils [None req-98eb43da-54c0-4e76-81a0-7f04f1a94fe1 tempest-VolumesActionsTest-229141369 None] Converted 1024.00 MB image at 95.34 MB/s Sep 29 18:32:42 devstack cinder-volume[86512]: DEBUG cinder.image.image_utils [None req-98eb43da-54c0-4e76-81a0-7f04f1a94fe1 tempest-VolumesActionsTest-229141369 None] 9e53dbac-9417-4034-8859-34f63cd976dd was raw, no need to convert to raw {{(pid=86512) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Sep 29 18:32:43 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-50273e9f-7e88-42bb-9388-0c01f66f8332 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86512) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:32:43 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-50273e9f-7e88-42bb-9388-0c01f66f8332 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Flow 'volume_create_manager' (beb00f14-5a48-46d3-bc40-fe0283758f64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:32:43 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-50273e9f-7e88-42bb-9388-0c01f66f8332 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c9c44eb-0177-4436-8041-a7a7eff9fc83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:32:43 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-50273e9f-7e88-42bb-9388-0c01f66f8332 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c9c44eb-0177-4436-8041-a7a7eff9fc83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:32:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1966657760',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb10d71b-117b-455f-bb34-869f65c2d7dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='557fbd60c0994399b05bf9740c51f23d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:32:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:32:43Z,use_quota=True,user_id='6333ec991d084ba5996e1c513b2d1851',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:32:43 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-50273e9f-7e88-42bb-9388-0c01f66f8332 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5cbb79c-01cd-48d5-a9f4-c001687cae5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:32:43 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-50273e9f-7e88-42bb-9388-0c01f66f8332 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5cbb79c-01cd-48d5-a9f4-c001687cae5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:32:43 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-50273e9f-7e88-42bb-9388-0c01f66f8332 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (558710c1-dbb4-469d-9320-87bbba8bfc9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:32:43 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-50273e9f-7e88-42bb-9388-0c01f66f8332 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (558710c1-dbb4-469d-9320-87bbba8bfc9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb10d71b-117b-455f-bb34-869f65c2d7dc', 'volume_name': 'volume-cb10d71b-117b-455f-bb34-869f65c2d7dc', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:32:43 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-50273e9f-7e88-42bb-9388-0c01f66f8332 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a1605a0-96a7-44e6-bd11-2e78bed4002e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:32:43 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-50273e9f-7e88-42bb-9388-0c01f66f8332 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a1605a0-96a7-44e6-bd11-2e78bed4002e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:32:43 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-50273e9f-7e88-42bb-9388-0c01f66f8332 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e326eca-ee4b-4687-a8df-5274b2dc5b11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:32:43 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-50273e9f-7e88-42bb-9388-0c01f66f8332 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Volume cb10d71b-117b-455f-bb34-869f65c2d7dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb10d71b-117b-455f-bb34-869f65c2d7dc', 'volume_size': 1} Sep 29 18:32:43 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-50273e9f-7e88-42bb-9388-0c01f66f8332 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:32:50 devstack cinder-volume[86512]: DEBUG oslo_service.periodic_task [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86512) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 18:32:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:32:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:32:50 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:32:50 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:32:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:32:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:32:50 devstack sudo[104353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:32:50 devstack sudo[104353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:32:50 devstack sudo[104353]: pam_unix(sudo:session): session closed for user root Sep 29 18:32:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.265s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:32:50 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:32:50 devstack cinder-volume[86512]: DEBUG oslo_service.periodic_task [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Running periodic task VolumeManager._thread_info {{(pid=86512) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 18:32:50 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] thread count: 29 {{(pid=86512) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 29 18:32:50 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] thread info: [<_MainThread(MainThread, started 135593654804608)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86512) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 29 18:32:53 devstack cinder-volume[86512]: DEBUG dbcounter [-] [86512] Writing DB stats cinder:UPDATE=1 {{(pid=86512) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 18:32:53 devstack cinder-volume[86512]: DEBUG dbcounter [-] [86512] Writing DB stats cinder:SELECT=4 {{(pid=86512) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 18:33:02 devstack cinder-volume[86512]: INFO cinder.volume.manager [req-c0f6d232-03a7-43b9-b519-a0d93379f6d9 req-fdc0ccff-f046-43aa-8dd3-67fbe8d7285e tempest-TestShelveInstance-22798712 None] Terminate volume connection completed successfully. Sep 29 18:33:02 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [req-c0f6d232-03a7-43b9-b519-a0d93379f6d9 req-fdc0ccff-f046-43aa-8dd3-67fbe8d7285e tempest-TestShelveInstance-22798712 None] Deleting attachment ba00abeb-13ce-4a6e-87f7-3cb9f721669c. {{(pid=86512) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 29 18:33:02 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-98eb43da-54c0-4e76-81a0-7f04f1a94fe1 tempest-VolumesActionsTest-229141369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 32.450s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:33:02 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-98eb43da-54c0-4e76-81a0-7f04f1a94fe1 tempest-VolumesActionsTest-229141369 None] Uploaded volume to glance image-id: 9e53dbac-9417-4034-8859-34f63cd976dd. {{(pid=86512) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 29 18:33:02 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-50273e9f-7e88-42bb-9388-0c01f66f8332 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 19.785s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:33:02 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-50273e9f-7e88-42bb-9388-0c01f66f8332 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:32:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1966657760',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb10d71b-117b-455f-bb34-869f65c2d7dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='557fbd60c0994399b05bf9740c51f23d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:32:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:32:43Z,use_quota=True,user_id='6333ec991d084ba5996e1c513b2d1851',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)}" {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:33:02 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-50273e9f-7e88-42bb-9388-0c01f66f8332 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Creating volume cb10d71b-117b-455f-bb34-869f65c2d7dc {{(pid=86512) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:33:02 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-50273e9f-7e88-42bb-9388-0c01f66f8332 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:33:02 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-50273e9f-7e88-42bb-9388-0c01f66f8332 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:33:02 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-50273e9f-7e88-42bb-9388-0c01f66f8332 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:33:02 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-50273e9f-7e88-42bb-9388-0c01f66f8332 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:33:03 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-50273e9f-7e88-42bb-9388-0c01f66f8332 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:33:03 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-50273e9f-7e88-42bb-9388-0c01f66f8332 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Selected osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 as target Quobyte volume. {{(pid=86512) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:33:03 devstack cinder-volume[86512]: INFO cinder.volume.drivers.remotefs [None req-50273e9f-7e88-42bb-9388-0c01f66f8332 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] casted to osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 Sep 29 18:33:03 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-50273e9f-7e88-42bb-9388-0c01f66f8332 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-cb10d71b-117b-455f-bb34-869f65c2d7dc 1073741824 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:33:03 devstack sudo[104398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-cb10d71b-117b-455f-bb34-869f65c2d7dc 1073741824 Sep 29 18:33:03 devstack sudo[104398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:33:03 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-98eb43da-54c0-4e76-81a0-7f04f1a94fe1 tempest-VolumesActionsTest-229141369 None] Copy volume to image completed successfully. Sep 29 18:33:03 devstack sudo[104398]: pam_unix(sudo:session): session closed for user root Sep 29 18:33:03 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-50273e9f-7e88-42bb-9388-0c01f66f8332 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-cb10d71b-117b-455f-bb34-869f65c2d7dc 1073741824" returned: 0 in 0.556s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:33:03 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-50273e9f-7e88-42bb-9388-0c01f66f8332 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-cb10d71b-117b-455f-bb34-869f65c2d7dc {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:33:03 devstack sudo[104407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-cb10d71b-117b-455f-bb34-869f65c2d7dc Sep 29 18:33:03 devstack sudo[104407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:33:03 devstack sudo[104407]: pam_unix(sudo:session): session closed for user root Sep 29 18:33:03 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-50273e9f-7e88-42bb-9388-0c01f66f8332 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-cb10d71b-117b-455f-bb34-869f65c2d7dc" returned: 0 in 0.282s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:33:03 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-50273e9f-7e88-42bb-9388-0c01f66f8332 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] <== create_volume: return (881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'} {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:33:03 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-50273e9f-7e88-42bb-9388-0c01f66f8332 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.885s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:33:03 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-50273e9f-7e88-42bb-9388-0c01f66f8332 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e326eca-ee4b-4687-a8df-5274b2dc5b11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb10d71b-117b-455f-bb34-869f65c2d7dc', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:33:03 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-50273e9f-7e88-42bb-9388-0c01f66f8332 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78efa0ab-f5a4-4271-ba85-53e2f39de269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:33:03 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-50273e9f-7e88-42bb-9388-0c01f66f8332 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Volume volume-cb10d71b-117b-455f-bb34-869f65c2d7dc (cb10d71b-117b-455f-bb34-869f65c2d7dc): created successfully Sep 29 18:33:03 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-50273e9f-7e88-42bb-9388-0c01f66f8332 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78efa0ab-f5a4-4271-ba85-53e2f39de269) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:33:03 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-50273e9f-7e88-42bb-9388-0c01f66f8332 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Flow 'volume_create_manager' (beb00f14-5a48-46d3-bc40-fe0283758f64) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:33:03 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-50273e9f-7e88-42bb-9388-0c01f66f8332 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Created volume successfully. Sep 29 18:33:04 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-a8af13e7-c82a-4dfc-a887-b44132cc4fa1 tempest-VolumesActionsTest-229141369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:33:04 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-a8af13e7-c82a-4dfc-a887-b44132cc4fa1 tempest-VolumesActionsTest-229141369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:33:04 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[521181a9-6250-43da-9592-42f02f36e292]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:33:04 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a8af13e7-c82a-4dfc-a887-b44132cc4fa1 tempest-VolumesActionsTest-229141369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-eb3e7c0e-0fa2-472c-92ae-ed2bcea6c85c {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:33:04 devstack sudo[104418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-eb3e7c0e-0fa2-472c-92ae-ed2bcea6c85c Sep 29 18:33:04 devstack sudo[104418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:33:04 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [req-60975088-3260-44dd-a114-53584b7b4097 req-fbfc2cf7-9c3c-47e9-a72e-382ffda8f2b2 tempest-TestShelveInstance-22798712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:33:04 devstack sudo[104418]: pam_unix(sudo:session): session closed for user root Sep 29 18:33:04 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a8af13e7-c82a-4dfc-a887-b44132cc4fa1 tempest-VolumesActionsTest-229141369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-eb3e7c0e-0fa2-472c-92ae-ed2bcea6c85c" returned: 0 in 0.378s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:33:04 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[81ab4ed0-b1a6-40a2-8c94-bacfc00ff8c4]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:33:04 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a8af13e7-c82a-4dfc-a887-b44132cc4fa1 tempest-VolumesActionsTest-229141369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-eb3e7c0e-0fa2-472c-92ae-ed2bcea6c85c {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:33:04 devstack sudo[104424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-eb3e7c0e-0fa2-472c-92ae-ed2bcea6c85c Sep 29 18:33:04 devstack sudo[104424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:33:05 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0c701c0-9d1a-4805-b7be-4a12a5f8c6c3 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86512) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:33:05 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-a0c701c0-9d1a-4805-b7be-4a12a5f8c6c3 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Flow 'volume_create_manager' (f06293fd-6aaf-4099-bfbb-8df082b00b5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:33:05 devstack sudo[104424]: pam_unix(sudo:session): session closed for user root Sep 29 18:33:05 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-a0c701c0-9d1a-4805-b7be-4a12a5f8c6c3 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74cfa1f1-07c2-4b92-a43f-b6da352022c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:33:05 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a8af13e7-c82a-4dfc-a887-b44132cc4fa1 tempest-VolumesActionsTest-229141369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-eb3e7c0e-0fa2-472c-92ae-ed2bcea6c85c" returned: 0 in 0.410s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:33:05 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a8af13e7-c82a-4dfc-a887-b44132cc4fa1 tempest-VolumesActionsTest-229141369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-eb3e7c0e-0fa2-472c-92ae-ed2bcea6c85c /opt/stack/data/cinder/conversion/eb3e7c0e-0fa2-472c-92ae-ed2bcea6c85c.temp_image.3920ed0d-38ca-4464-ab18-b3d93a6e5716hfkii54c.img {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:33:05 devstack sudo[104429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-eb3e7c0e-0fa2-472c-92ae-ed2bcea6c85c /opt/stack/data/cinder/conversion/eb3e7c0e-0fa2-472c-92ae-ed2bcea6c85c.temp_image.3920ed0d-38ca-4464-ab18-b3d93a6e5716hfkii54c.img Sep 29 18:33:05 devstack sudo[104429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:33:05 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-a0c701c0-9d1a-4805-b7be-4a12a5f8c6c3 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74cfa1f1-07c2-4b92-a43f-b6da352022c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:33:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1909961073',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=279dc378-976b-4704-bb67-153dc11bf69d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='557fbd60c0994399b05bf9740c51f23d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:33:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:33:05Z,use_quota=True,user_id='6333ec991d084ba5996e1c513b2d1851',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:33:05 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-a0c701c0-9d1a-4805-b7be-4a12a5f8c6c3 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (015281d0-07f9-463d-9317-3615a156611e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:33:05 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-a0c701c0-9d1a-4805-b7be-4a12a5f8c6c3 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (015281d0-07f9-463d-9317-3615a156611e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:33:05 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-a0c701c0-9d1a-4805-b7be-4a12a5f8c6c3 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c06da792-f49a-4d12-b1b1-eac296baef75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:33:05 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-a0c701c0-9d1a-4805-b7be-4a12a5f8c6c3 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c06da792-f49a-4d12-b1b1-eac296baef75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '279dc378-976b-4704-bb67-153dc11bf69d', 'volume_name': 'volume-279dc378-976b-4704-bb67-153dc11bf69d', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:33:05 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-a0c701c0-9d1a-4805-b7be-4a12a5f8c6c3 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ca750fd-30f1-4482-b781-bd99788198a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:33:05 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-a0c701c0-9d1a-4805-b7be-4a12a5f8c6c3 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ca750fd-30f1-4482-b781-bd99788198a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:33:05 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-a0c701c0-9d1a-4805-b7be-4a12a5f8c6c3 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00b2475b-ee32-4868-9937-69f6c3d00c5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:33:05 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-a0c701c0-9d1a-4805-b7be-4a12a5f8c6c3 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Volume 279dc378-976b-4704-bb67-153dc11bf69d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-279dc378-976b-4704-bb67-153dc11bf69d', 'volume_size': 1} Sep 29 18:33:05 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-a0c701c0-9d1a-4805-b7be-4a12a5f8c6c3 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:33:05 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0e9db10-d14a-47f9-badb-85e5c79d229d tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86512) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:33:05 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-c0e9db10-d14a-47f9-badb-85e5c79d229d tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Flow 'volume_create_manager' (947772f1-9b09-44fb-9368-3745c7f030ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:33:05 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-c0e9db10-d14a-47f9-badb-85e5c79d229d tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e6bc63f-6d96-43b8-beeb-7e541bd6555d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:33:05 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-c0e9db10-d14a-47f9-badb-85e5c79d229d tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e6bc63f-6d96-43b8-beeb-7e541bd6555d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:33:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1123293413',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=baca38fd-a3e8-4ddf-92e2-2e643d38eb73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='557fbd60c0994399b05bf9740c51f23d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:33:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:33:05Z,use_quota=True,user_id='6333ec991d084ba5996e1c513b2d1851',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:33:05 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-c0e9db10-d14a-47f9-badb-85e5c79d229d tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63733354-f6a4-4a20-b059-a5bf2774fea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:33:05 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-c0e9db10-d14a-47f9-badb-85e5c79d229d tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63733354-f6a4-4a20-b059-a5bf2774fea7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:33:05 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-c0e9db10-d14a-47f9-badb-85e5c79d229d tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a835867-1879-4c0d-98ee-8f4c19a16f6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:33:05 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-c0e9db10-d14a-47f9-badb-85e5c79d229d tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a835867-1879-4c0d-98ee-8f4c19a16f6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'baca38fd-a3e8-4ddf-92e2-2e643d38eb73', 'volume_name': 'volume-baca38fd-a3e8-4ddf-92e2-2e643d38eb73', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:33:05 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-c0e9db10-d14a-47f9-badb-85e5c79d229d tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04cc079d-27d3-41ca-8c02-9f55c1210a7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:33:05 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-c0e9db10-d14a-47f9-badb-85e5c79d229d tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04cc079d-27d3-41ca-8c02-9f55c1210a7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:33:05 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-c0e9db10-d14a-47f9-badb-85e5c79d229d tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cff50150-42e3-4cb4-8f4b-fc0d17a105a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:33:05 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-c0e9db10-d14a-47f9-badb-85e5c79d229d tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Volume baca38fd-a3e8-4ddf-92e2-2e643d38eb73: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-baca38fd-a3e8-4ddf-92e2-2e643d38eb73', 'volume_size': 1} Sep 29 18:33:05 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-c0e9db10-d14a-47f9-badb-85e5c79d229d tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:33:06 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-7fb69303-a488-496b-90c2-e6974c31ef7a tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86512) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:33:06 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-7fb69303-a488-496b-90c2-e6974c31ef7a tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Flow 'volume_create_manager' (5dfc126f-9cea-4b0f-bee5-0002e1a59332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:33:06 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-7fb69303-a488-496b-90c2-e6974c31ef7a tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (713f43f3-2ac7-409a-8a6a-836d88b637eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:33:06 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-7fb69303-a488-496b-90c2-e6974c31ef7a tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (713f43f3-2ac7-409a-8a6a-836d88b637eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:33:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1741712627',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eebe3387-bd58-4fe1-b526-035cf4a86dfb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='557fbd60c0994399b05bf9740c51f23d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:33:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:33:06Z,use_quota=True,user_id='6333ec991d084ba5996e1c513b2d1851',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:33:06 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-7fb69303-a488-496b-90c2-e6974c31ef7a tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fef9c056-ab53-4a7f-9a12-b117e8a54ce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:33:06 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-7fb69303-a488-496b-90c2-e6974c31ef7a tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fef9c056-ab53-4a7f-9a12-b117e8a54ce8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:33:06 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-7fb69303-a488-496b-90c2-e6974c31ef7a tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c43b12b3-1fcf-4de5-8d91-89e5128ec8ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:33:06 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-7fb69303-a488-496b-90c2-e6974c31ef7a tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c43b12b3-1fcf-4de5-8d91-89e5128ec8ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eebe3387-bd58-4fe1-b526-035cf4a86dfb', 'volume_name': 'volume-eebe3387-bd58-4fe1-b526-035cf4a86dfb', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:33:06 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-7fb69303-a488-496b-90c2-e6974c31ef7a tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a08f8f32-5535-4ce4-8091-7e89d865a8c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:33:06 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-7fb69303-a488-496b-90c2-e6974c31ef7a tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a08f8f32-5535-4ce4-8091-7e89d865a8c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:33:06 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-7fb69303-a488-496b-90c2-e6974c31ef7a tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a070386e-6184-416e-9507-307eb78cb266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:33:06 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-7fb69303-a488-496b-90c2-e6974c31ef7a tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Volume eebe3387-bd58-4fe1-b526-035cf4a86dfb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eebe3387-bd58-4fe1-b526-035cf4a86dfb', 'volume_size': 1} Sep 29 18:33:06 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-7fb69303-a488-496b-90c2-e6974c31ef7a tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:33:07 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-efb9cb62-a863-44c7-807e-fc5e1fb6f483 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86512) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:33:07 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-efb9cb62-a863-44c7-807e-fc5e1fb6f483 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Flow 'volume_create_manager' (b6c54554-2e81-4465-84c2-9a19e4e7c805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:33:07 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-efb9cb62-a863-44c7-807e-fc5e1fb6f483 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (632138db-755d-4b6d-8452-3a9018ed201b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:33:07 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-efb9cb62-a863-44c7-807e-fc5e1fb6f483 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (632138db-755d-4b6d-8452-3a9018ed201b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:33:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1867786875',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08a1c0bc-5c6c-4564-a1f0-a54747f1e0f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='557fbd60c0994399b05bf9740c51f23d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:33:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:33:07Z,use_quota=True,user_id='6333ec991d084ba5996e1c513b2d1851',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:33:07 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-efb9cb62-a863-44c7-807e-fc5e1fb6f483 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (728cd544-0ea2-4e9b-942c-1011177cda8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:33:07 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-efb9cb62-a863-44c7-807e-fc5e1fb6f483 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (728cd544-0ea2-4e9b-942c-1011177cda8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:33:07 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-efb9cb62-a863-44c7-807e-fc5e1fb6f483 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8059e536-625b-436c-ad9c-4731f6081fda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:33:07 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-efb9cb62-a863-44c7-807e-fc5e1fb6f483 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8059e536-625b-436c-ad9c-4731f6081fda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08a1c0bc-5c6c-4564-a1f0-a54747f1e0f7', 'volume_name': 'volume-08a1c0bc-5c6c-4564-a1f0-a54747f1e0f7', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:33:07 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-efb9cb62-a863-44c7-807e-fc5e1fb6f483 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0368ef9-0c78-457e-9eee-780307e58999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:33:07 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-efb9cb62-a863-44c7-807e-fc5e1fb6f483 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0368ef9-0c78-457e-9eee-780307e58999) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:33:07 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-efb9cb62-a863-44c7-807e-fc5e1fb6f483 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ec37bdf-4cde-4faf-8a37-606b823cf6e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:33:07 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-efb9cb62-a863-44c7-807e-fc5e1fb6f483 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Volume 08a1c0bc-5c6c-4564-a1f0-a54747f1e0f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08a1c0bc-5c6c-4564-a1f0-a54747f1e0f7', 'volume_size': 1} Sep 29 18:33:07 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-efb9cb62-a863-44c7-807e-fc5e1fb6f483 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:33:07 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e30c393-463c-4cbf-b056-9fe49ba2e58d tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86512) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:33:07 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-6e30c393-463c-4cbf-b056-9fe49ba2e58d tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Flow 'volume_create_manager' (c8a4598c-1818-48d1-863b-a9399fcd0e31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:33:07 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-6e30c393-463c-4cbf-b056-9fe49ba2e58d tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9104cf0b-6035-4391-8f0e-5caa6e96c437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:33:07 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-6e30c393-463c-4cbf-b056-9fe49ba2e58d tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9104cf0b-6035-4391-8f0e-5caa6e96c437) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:33:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1811838714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aee5a9a8-b373-4f37-b156-b9a0f41db038,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='557fbd60c0994399b05bf9740c51f23d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:33:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:33:08Z,use_quota=True,user_id='6333ec991d084ba5996e1c513b2d1851',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:33:07 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-6e30c393-463c-4cbf-b056-9fe49ba2e58d tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab0a990b-1cff-45da-97e0-e43048f651bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:33:08 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-6e30c393-463c-4cbf-b056-9fe49ba2e58d tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab0a990b-1cff-45da-97e0-e43048f651bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:33:08 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-6e30c393-463c-4cbf-b056-9fe49ba2e58d tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8d8e93c-6b5b-4496-ae43-8cecddcc4f5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:33:08 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-6e30c393-463c-4cbf-b056-9fe49ba2e58d tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8d8e93c-6b5b-4496-ae43-8cecddcc4f5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aee5a9a8-b373-4f37-b156-b9a0f41db038', 'volume_name': 'volume-aee5a9a8-b373-4f37-b156-b9a0f41db038', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:33:08 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-6e30c393-463c-4cbf-b056-9fe49ba2e58d tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0934bd34-af95-4660-94ba-9253866a9093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:33:08 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-6e30c393-463c-4cbf-b056-9fe49ba2e58d tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0934bd34-af95-4660-94ba-9253866a9093) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:33:08 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-6e30c393-463c-4cbf-b056-9fe49ba2e58d tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da1559a8-1138-4e45-9bf5-4487da9d6146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:33:08 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-6e30c393-463c-4cbf-b056-9fe49ba2e58d tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Volume aee5a9a8-b373-4f37-b156-b9a0f41db038: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aee5a9a8-b373-4f37-b156-b9a0f41db038', 'volume_size': 1} Sep 29 18:33:08 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-6e30c393-463c-4cbf-b056-9fe49ba2e58d tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:33:11 devstack sudo[104429]: pam_unix(sudo:session): session closed for user root Sep 29 18:33:11 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a8af13e7-c82a-4dfc-a887-b44132cc4fa1 tempest-VolumesActionsTest-229141369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-eb3e7c0e-0fa2-472c-92ae-ed2bcea6c85c /opt/stack/data/cinder/conversion/eb3e7c0e-0fa2-472c-92ae-ed2bcea6c85c.temp_image.3920ed0d-38ca-4464-ab18-b3d93a6e5716hfkii54c.img" returned: 0 in 6.343s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:33:11 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ba7ec5b-92ed-48e4-8fa9-d9112698fdba]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:33:11 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a8af13e7-c82a-4dfc-a887-b44132cc4fa1 tempest-VolumesActionsTest-229141369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-eb3e7c0e-0fa2-472c-92ae-ed2bcea6c85c {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:33:11 devstack sudo[104442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-eb3e7c0e-0fa2-472c-92ae-ed2bcea6c85c Sep 29 18:33:11 devstack sudo[104442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:33:11 devstack sudo[104442]: pam_unix(sudo:session): session closed for user root Sep 29 18:33:11 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a8af13e7-c82a-4dfc-a887-b44132cc4fa1 tempest-VolumesActionsTest-229141369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-eb3e7c0e-0fa2-472c-92ae-ed2bcea6c85c" returned: 0 in 0.498s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:33:11 devstack cinder-volume[86512]: DEBUG cinder.image.image_utils [None req-a8af13e7-c82a-4dfc-a887-b44132cc4fa1 tempest-VolumesActionsTest-229141369 None] Image conversion details: src /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-eb3e7c0e-0fa2-472c-92ae-ed2bcea6c85c, size 1024.00 MB, duration 6.34 sec, destination /opt/stack/data/cinder/conversion/eb3e7c0e-0fa2-472c-92ae-ed2bcea6c85c.temp_image.3920ed0d-38ca-4464-ab18-b3d93a6e5716hfkii54c.img {{(pid=86512) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 29 18:33:11 devstack cinder-volume[86512]: INFO cinder.image.image_utils [None req-a8af13e7-c82a-4dfc-a887-b44132cc4fa1 tempest-VolumesActionsTest-229141369 None] Converted 1024.00 MB image at 161.41 MB/s Sep 29 18:33:11 devstack cinder-volume[86512]: DEBUG cinder.image.image_utils [None req-a8af13e7-c82a-4dfc-a887-b44132cc4fa1 tempest-VolumesActionsTest-229141369 None] 3920ed0d-38ca-4464-ab18-b3d93a6e5716 was raw, converting to qcow2 {{(pid=86512) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1203}} Sep 29 18:33:11 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6db33e0-42b9-44c5-b74e-22cebaa53002]: (4, 'raw') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:33:11 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a8af13e7-c82a-4dfc-a887-b44132cc4fa1 tempest-VolumesActionsTest-229141369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/eb3e7c0e-0fa2-472c-92ae-ed2bcea6c85c.temp_image.3920ed0d-38ca-4464-ab18-b3d93a6e5716hfkii54c.img {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:33:12 devstack sudo[104447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/eb3e7c0e-0fa2-472c-92ae-ed2bcea6c85c.temp_image.3920ed0d-38ca-4464-ab18-b3d93a6e5716hfkii54c.img Sep 29 18:33:12 devstack sudo[104447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:33:12 devstack sudo[104447]: pam_unix(sudo:session): session closed for user root Sep 29 18:33:12 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a8af13e7-c82a-4dfc-a887-b44132cc4fa1 tempest-VolumesActionsTest-229141369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/eb3e7c0e-0fa2-472c-92ae-ed2bcea6c85c.temp_image.3920ed0d-38ca-4464-ab18-b3d93a6e5716hfkii54c.img" returned: 0 in 0.328s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:33:12 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a8af13e7-c82a-4dfc-a887-b44132cc4fa1 tempest-VolumesActionsTest-229141369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/eb3e7c0e-0fa2-472c-92ae-ed2bcea6c85c.temp_image.3920ed0d-38ca-4464-ab18-b3d93a6e5716hfkii54c.img {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:33:12 devstack sudo[104451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/eb3e7c0e-0fa2-472c-92ae-ed2bcea6c85c.temp_image.3920ed0d-38ca-4464-ab18-b3d93a6e5716hfkii54c.img Sep 29 18:33:12 devstack sudo[104451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:33:12 devstack sudo[104451]: pam_unix(sudo:session): session closed for user root Sep 29 18:33:12 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a8af13e7-c82a-4dfc-a887-b44132cc4fa1 tempest-VolumesActionsTest-229141369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/eb3e7c0e-0fa2-472c-92ae-ed2bcea6c85c.temp_image.3920ed0d-38ca-4464-ab18-b3d93a6e5716hfkii54c.img" returned: 1 in 0.309s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:33:12 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a8af13e7-c82a-4dfc-a887-b44132cc4fa1 tempest-VolumesActionsTest-229141369 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/eb3e7c0e-0fa2-472c-92ae-ed2bcea6c85c.temp_image.3920ed0d-38ca-4464-ab18-b3d93a6e5716hfkii54c.img' failed. Not Retrying. {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 29 18:33:12 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a8af13e7-c82a-4dfc-a887-b44132cc4fa1 tempest-VolumesActionsTest-229141369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/eb3e7c0e-0fa2-472c-92ae-ed2bcea6c85c.temp_image.3920ed0d-38ca-4464-ab18-b3d93a6e5716hfkii54c.img /opt/stack/data/cinder/conversion/vol_upload_mrd2wv_b {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:33:12 devstack sudo[104456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/eb3e7c0e-0fa2-472c-92ae-ed2bcea6c85c.temp_image.3920ed0d-38ca-4464-ab18-b3d93a6e5716hfkii54c.img /opt/stack/data/cinder/conversion/vol_upload_mrd2wv_b Sep 29 18:33:12 devstack sudo[104456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:33:13 devstack sudo[104456]: pam_unix(sudo:session): session closed for user root Sep 29 18:33:13 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a8af13e7-c82a-4dfc-a887-b44132cc4fa1 tempest-VolumesActionsTest-229141369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/eb3e7c0e-0fa2-472c-92ae-ed2bcea6c85c.temp_image.3920ed0d-38ca-4464-ab18-b3d93a6e5716hfkii54c.img /opt/stack/data/cinder/conversion/vol_upload_mrd2wv_b" returned: 0 in 0.391s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:33:13 devstack cinder-volume[86512]: DEBUG cinder.image.image_utils [None req-a8af13e7-c82a-4dfc-a887-b44132cc4fa1 tempest-VolumesActionsTest-229141369 None] Image conversion details: src /opt/stack/data/cinder/conversion/eb3e7c0e-0fa2-472c-92ae-ed2bcea6c85c.temp_image.3920ed0d-38ca-4464-ab18-b3d93a6e5716hfkii54c.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_mrd2wv_b {{(pid=86512) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 29 18:33:13 devstack cinder-volume[86512]: INFO cinder.image.image_utils [None req-a8af13e7-c82a-4dfc-a887-b44132cc4fa1 tempest-VolumesActionsTest-229141369 None] Converted 1024.00 MB image at 1024.00 MB/s Sep 29 18:33:13 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[d51a16b7-9bb3-4b4a-b512-96ca61320ab0]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:33:13 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a8af13e7-c82a-4dfc-a887-b44132cc4fa1 tempest-VolumesActionsTest-229141369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_mrd2wv_b {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:33:13 devstack sudo[104462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_mrd2wv_b Sep 29 18:33:13 devstack sudo[104462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:33:13 devstack sudo[104462]: pam_unix(sudo:session): session closed for user root Sep 29 18:33:13 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a8af13e7-c82a-4dfc-a887-b44132cc4fa1 tempest-VolumesActionsTest-229141369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_mrd2wv_b" returned: 0 in 0.324s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:33:14 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-a8af13e7-c82a-4dfc-a887-b44132cc4fa1 tempest-VolumesActionsTest-229141369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 10.278s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:33:14 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-a8af13e7-c82a-4dfc-a887-b44132cc4fa1 tempest-VolumesActionsTest-229141369 None] Uploaded volume to glance image-id: 3920ed0d-38ca-4464-ab18-b3d93a6e5716. {{(pid=86512) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 29 18:33:14 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [req-60975088-3260-44dd-a114-53584b7b4097 req-fbfc2cf7-9c3c-47e9-a72e-382ffda8f2b2 tempest-TestShelveInstance-22798712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 10.144s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:33:14 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [req-60975088-3260-44dd-a114-53584b7b4097 req-fbfc2cf7-9c3c-47e9-a72e-382ffda8f2b2 tempest-TestShelveInstance-22798712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:33:14 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-a0c701c0-9d1a-4805-b7be-4a12a5f8c6c3 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.415s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:33:14 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-a0c701c0-9d1a-4805-b7be-4a12a5f8c6c3 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:33:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1909961073',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=279dc378-976b-4704-bb67-153dc11bf69d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='557fbd60c0994399b05bf9740c51f23d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:33:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:33:05Z,use_quota=True,user_id='6333ec991d084ba5996e1c513b2d1851',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)}" {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:33:14 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-a0c701c0-9d1a-4805-b7be-4a12a5f8c6c3 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Creating volume 279dc378-976b-4704-bb67-153dc11bf69d {{(pid=86512) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:33:14 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-a0c701c0-9d1a-4805-b7be-4a12a5f8c6c3 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:33:14 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-a0c701c0-9d1a-4805-b7be-4a12a5f8c6c3 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:33:14 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-a0c701c0-9d1a-4805-b7be-4a12a5f8c6c3 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:33:14 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-a0c701c0-9d1a-4805-b7be-4a12a5f8c6c3 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:33:14 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-a0c701c0-9d1a-4805-b7be-4a12a5f8c6c3 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:33:14 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-a0c701c0-9d1a-4805-b7be-4a12a5f8c6c3 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Selected osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 as target Quobyte volume. {{(pid=86512) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:33:14 devstack cinder-volume[86512]: INFO cinder.volume.drivers.remotefs [None req-a0c701c0-9d1a-4805-b7be-4a12a5f8c6c3 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] casted to osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 Sep 29 18:33:14 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a0c701c0-9d1a-4805-b7be-4a12a5f8c6c3 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-279dc378-976b-4704-bb67-153dc11bf69d 1073741824 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:33:14 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-a8af13e7-c82a-4dfc-a887-b44132cc4fa1 tempest-VolumesActionsTest-229141369 None] Copy volume to image completed successfully. Sep 29 18:33:14 devstack sudo[104468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-279dc378-976b-4704-bb67-153dc11bf69d 1073741824 Sep 29 18:33:14 devstack sudo[104468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:33:14 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [req-60975088-3260-44dd-a114-53584b7b4097 req-fbfc2cf7-9c3c-47e9-a72e-382ffda8f2b2 tempest-TestShelveInstance-22798712 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883', 'name': 'volume-83546d33-b4e2-47f0-a157-0ecd5376f3b7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ac1732fa-91b8-44f9-b3cc-f1450d098029', 'enforce_multipath': True} {{(pid=86512) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 29 18:33:14 devstack cinder-volume[86512]: INFO cinder.volume.manager [req-60975088-3260-44dd-a114-53584b7b4097 req-fbfc2cf7-9c3c-47e9-a72e-382ffda8f2b2 tempest-TestShelveInstance-22798712 None] attachment_update completed successfully. Sep 29 18:33:15 devstack sudo[104468]: pam_unix(sudo:session): session closed for user root Sep 29 18:33:15 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a0c701c0-9d1a-4805-b7be-4a12a5f8c6c3 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-279dc378-976b-4704-bb67-153dc11bf69d 1073741824" returned: 0 in 0.522s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:33:15 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a0c701c0-9d1a-4805-b7be-4a12a5f8c6c3 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-279dc378-976b-4704-bb67-153dc11bf69d {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:33:15 devstack sudo[104473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-279dc378-976b-4704-bb67-153dc11bf69d Sep 29 18:33:15 devstack sudo[104473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:33:15 devstack sudo[104473]: pam_unix(sudo:session): session closed for user root Sep 29 18:33:15 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a0c701c0-9d1a-4805-b7be-4a12a5f8c6c3 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-279dc378-976b-4704-bb67-153dc11bf69d" returned: 0 in 0.320s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:33:15 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-a0c701c0-9d1a-4805-b7be-4a12a5f8c6c3 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] <== create_volume: return (953ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'} {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:33:15 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-a0c701c0-9d1a-4805-b7be-4a12a5f8c6c3 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.959s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:33:15 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-c0e9db10-d14a-47f9-badb-85e5c79d229d tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.891s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:33:15 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-c0e9db10-d14a-47f9-badb-85e5c79d229d tempest-CreateVolumesFromSourceVolumeTest-847005671 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:33:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1123293413',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=baca38fd-a3e8-4ddf-92e2-2e643d38eb73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='557fbd60c0994399b05bf9740c51f23d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:33:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:33:05Z,use_quota=True,user_id='6333ec991d084ba5996e1c513b2d1851',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)}" {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:33:15 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-c0e9db10-d14a-47f9-badb-85e5c79d229d tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Creating volume baca38fd-a3e8-4ddf-92e2-2e643d38eb73 {{(pid=86512) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:33:15 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-c0e9db10-d14a-47f9-badb-85e5c79d229d tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:33:15 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-c0e9db10-d14a-47f9-badb-85e5c79d229d tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:33:15 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-c0e9db10-d14a-47f9-badb-85e5c79d229d tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:33:15 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-c0e9db10-d14a-47f9-badb-85e5c79d229d tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:33:15 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-c0e9db10-d14a-47f9-badb-85e5c79d229d tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:33:15 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-c0e9db10-d14a-47f9-badb-85e5c79d229d tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Selected osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 as target Quobyte volume. {{(pid=86512) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:33:15 devstack cinder-volume[86512]: INFO cinder.volume.drivers.remotefs [None req-c0e9db10-d14a-47f9-badb-85e5c79d229d tempest-CreateVolumesFromSourceVolumeTest-847005671 None] casted to osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 Sep 29 18:33:15 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-c0e9db10-d14a-47f9-badb-85e5c79d229d tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-baca38fd-a3e8-4ddf-92e2-2e643d38eb73 1073741824 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:33:15 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-a0c701c0-9d1a-4805-b7be-4a12a5f8c6c3 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00b2475b-ee32-4868-9937-69f6c3d00c5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-279dc378-976b-4704-bb67-153dc11bf69d', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:33:15 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-a0c701c0-9d1a-4805-b7be-4a12a5f8c6c3 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77c0954d-f126-4afa-9cc4-ae8376fe63c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:33:15 devstack sudo[104476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-baca38fd-a3e8-4ddf-92e2-2e643d38eb73 1073741824 Sep 29 18:33:15 devstack sudo[104476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:33:15 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-a0c701c0-9d1a-4805-b7be-4a12a5f8c6c3 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Volume volume-279dc378-976b-4704-bb67-153dc11bf69d (279dc378-976b-4704-bb67-153dc11bf69d): created successfully Sep 29 18:33:15 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-a0c701c0-9d1a-4805-b7be-4a12a5f8c6c3 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77c0954d-f126-4afa-9cc4-ae8376fe63c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:33:15 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-a0c701c0-9d1a-4805-b7be-4a12a5f8c6c3 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Flow 'volume_create_manager' (f06293fd-6aaf-4099-bfbb-8df082b00b5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:33:15 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-3b43e010-7c5f-4eba-b1b5-5d4298ae687a tempest-VolumesActionsTest-229141369 None] Acquiring lock "cinder-eb3e7c0e-0fa2-472c-92ae-ed2bcea6c85c-delete_volume" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:33:15 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-3b43e010-7c5f-4eba-b1b5-5d4298ae687a tempest-VolumesActionsTest-229141369 None] Lock "cinder-eb3e7c0e-0fa2-472c-92ae-ed2bcea6c85c-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:33:15 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-a0c701c0-9d1a-4805-b7be-4a12a5f8c6c3 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Created volume successfully. Sep 29 18:33:15 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-3b43e010-7c5f-4eba-b1b5-5d4298ae687a tempest-VolumesActionsTest-229141369 None] Acquiring lock "cinder-quobyte-eb3e7c0e-0fa2-472c-92ae-ed2bcea6c85c" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:33:15 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-3b43e010-7c5f-4eba-b1b5-5d4298ae687a tempest-VolumesActionsTest-229141369 None] Lock "cinder-quobyte-eb3e7c0e-0fa2-472c-92ae-ed2bcea6c85c" acquired by "delete_volume" :: waited 0.018s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:33:15 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c426d0d-7ee4-4ea7-a432-709f8184e6a9]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:33:15 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-3b43e010-7c5f-4eba-b1b5-5d4298ae687a tempest-VolumesActionsTest-229141369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-eb3e7c0e-0fa2-472c-92ae-ed2bcea6c85c {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:33:15 devstack sudo[104478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-eb3e7c0e-0fa2-472c-92ae-ed2bcea6c85c Sep 29 18:33:15 devstack sudo[104478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:33:16 devstack sudo[104476]: pam_unix(sudo:session): session closed for user root Sep 29 18:33:16 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-c0e9db10-d14a-47f9-badb-85e5c79d229d tempest-CreateVolumesFromSourceVolumeTest-847005671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-baca38fd-a3e8-4ddf-92e2-2e643d38eb73 1073741824" returned: 0 in 0.550s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:33:16 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-c0e9db10-d14a-47f9-badb-85e5c79d229d tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-baca38fd-a3e8-4ddf-92e2-2e643d38eb73 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:33:16 devstack sudo[104487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-baca38fd-a3e8-4ddf-92e2-2e643d38eb73 Sep 29 18:33:16 devstack sudo[104487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:33:16 devstack sudo[104478]: pam_unix(sudo:session): session closed for user root Sep 29 18:33:16 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-3b43e010-7c5f-4eba-b1b5-5d4298ae687a tempest-VolumesActionsTest-229141369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-eb3e7c0e-0fa2-472c-92ae-ed2bcea6c85c" returned: 0 in 0.399s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:33:16 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-3b43e010-7c5f-4eba-b1b5-5d4298ae687a tempest-VolumesActionsTest-229141369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-eb3e7c0e-0fa2-472c-92ae-ed2bcea6c85c {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:33:16 devstack sudo[104489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-eb3e7c0e-0fa2-472c-92ae-ed2bcea6c85c Sep 29 18:33:16 devstack sudo[104489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:33:16 devstack sudo[104487]: pam_unix(sudo:session): session closed for user root Sep 29 18:33:16 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-c0e9db10-d14a-47f9-badb-85e5c79d229d tempest-CreateVolumesFromSourceVolumeTest-847005671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-baca38fd-a3e8-4ddf-92e2-2e643d38eb73" returned: 0 in 0.286s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:33:16 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-c0e9db10-d14a-47f9-badb-85e5c79d229d tempest-CreateVolumesFromSourceVolumeTest-847005671 None] <== create_volume: return (886ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'} {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:33:16 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-c0e9db10-d14a-47f9-badb-85e5c79d229d tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.892s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:33:16 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-7fb69303-a488-496b-90c2-e6974c31ef7a tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.718s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:33:16 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-7fb69303-a488-496b-90c2-e6974c31ef7a tempest-CreateVolumesFromSourceVolumeTest-847005671 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:33:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1741712627',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eebe3387-bd58-4fe1-b526-035cf4a86dfb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='557fbd60c0994399b05bf9740c51f23d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:33:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:33:06Z,use_quota=True,user_id='6333ec991d084ba5996e1c513b2d1851',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)}" {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:33:16 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-7fb69303-a488-496b-90c2-e6974c31ef7a tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Creating volume eebe3387-bd58-4fe1-b526-035cf4a86dfb {{(pid=86512) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:33:16 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-7fb69303-a488-496b-90c2-e6974c31ef7a tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:33:16 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-7fb69303-a488-496b-90c2-e6974c31ef7a tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:33:16 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-7fb69303-a488-496b-90c2-e6974c31ef7a tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:33:16 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-7fb69303-a488-496b-90c2-e6974c31ef7a tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:33:16 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-7fb69303-a488-496b-90c2-e6974c31ef7a tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:33:16 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-7fb69303-a488-496b-90c2-e6974c31ef7a tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Selected osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 as target Quobyte volume. {{(pid=86512) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:33:16 devstack cinder-volume[86512]: INFO cinder.volume.drivers.remotefs [None req-7fb69303-a488-496b-90c2-e6974c31ef7a tempest-CreateVolumesFromSourceVolumeTest-847005671 None] casted to osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 Sep 29 18:33:16 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-7fb69303-a488-496b-90c2-e6974c31ef7a tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-eebe3387-bd58-4fe1-b526-035cf4a86dfb 1073741824 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:33:16 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-c0e9db10-d14a-47f9-badb-85e5c79d229d tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cff50150-42e3-4cb4-8f4b-fc0d17a105a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-baca38fd-a3e8-4ddf-92e2-2e643d38eb73', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:33:16 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-c0e9db10-d14a-47f9-badb-85e5c79d229d tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (617de1d5-35f7-4295-b269-f98ddc7762d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:33:16 devstack sudo[104493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-eebe3387-bd58-4fe1-b526-035cf4a86dfb 1073741824 Sep 29 18:33:16 devstack sudo[104493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:33:16 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-c0e9db10-d14a-47f9-badb-85e5c79d229d tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Volume volume-baca38fd-a3e8-4ddf-92e2-2e643d38eb73 (baca38fd-a3e8-4ddf-92e2-2e643d38eb73): created successfully Sep 29 18:33:16 devstack sudo[104489]: pam_unix(sudo:session): session closed for user root Sep 29 18:33:16 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-c0e9db10-d14a-47f9-badb-85e5c79d229d tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (617de1d5-35f7-4295-b269-f98ddc7762d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:33:16 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-c0e9db10-d14a-47f9-badb-85e5c79d229d tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Flow 'volume_create_manager' (947772f1-9b09-44fb-9368-3745c7f030ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:33:16 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-3b43e010-7c5f-4eba-b1b5-5d4298ae687a tempest-VolumesActionsTest-229141369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-eb3e7c0e-0fa2-472c-92ae-ed2bcea6c85c" returned: 0 in 0.328s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:33:16 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-3b43e010-7c5f-4eba-b1b5-5d4298ae687a tempest-VolumesActionsTest-229141369 None] Lock "cinder-quobyte-eb3e7c0e-0fa2-472c-92ae-ed2bcea6c85c" released by "delete_volume" :: held 0.779s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:33:16 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-c0e9db10-d14a-47f9-badb-85e5c79d229d tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Created volume successfully. Sep 29 18:33:16 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-3b43e010-7c5f-4eba-b1b5-5d4298ae687a tempest-VolumesActionsTest-229141369 None] Created reservations ['a6f12495-3d11-4217-ba01-37184b19777c', '04573409-9196-417d-9a26-e406fc1678bb', '87c0dca0-e998-4ed1-8090-c3b03b718324', 'd929ca8d-e31f-4dfe-ae3f-f7a137f0c747'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:33:16 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-3b43e010-7c5f-4eba-b1b5-5d4298ae687a tempest-VolumesActionsTest-229141369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:33:16 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-3b43e010-7c5f-4eba-b1b5-5d4298ae687a tempest-VolumesActionsTest-229141369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:33:16 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-3b43e010-7c5f-4eba-b1b5-5d4298ae687a tempest-VolumesActionsTest-229141369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:33:16 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-3b43e010-7c5f-4eba-b1b5-5d4298ae687a tempest-VolumesActionsTest-229141369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:33:16 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-3b43e010-7c5f-4eba-b1b5-5d4298ae687a tempest-VolumesActionsTest-229141369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:33:16 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-3b43e010-7c5f-4eba-b1b5-5d4298ae687a tempest-VolumesActionsTest-229141369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:33:16 devstack sudo[104496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:33:16 devstack sudo[104496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:33:17 devstack sudo[104496]: pam_unix(sudo:session): session closed for user root Sep 29 18:33:17 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-3b43e010-7c5f-4eba-b1b5-5d4298ae687a tempest-VolumesActionsTest-229141369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.308s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:33:17 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-3b43e010-7c5f-4eba-b1b5-5d4298ae687a tempest-VolumesActionsTest-229141369 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:33:17 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-3b43e010-7c5f-4eba-b1b5-5d4298ae687a tempest-VolumesActionsTest-229141369 None] Deleted volume successfully. Sep 29 18:33:17 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-3b43e010-7c5f-4eba-b1b5-5d4298ae687a tempest-VolumesActionsTest-229141369 None] Lock "cinder-eb3e7c0e-0fa2-472c-92ae-ed2bcea6c85c-delete_volume" released by "delete_volume" :: held 1.352s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:33:17 devstack sudo[104493]: pam_unix(sudo:session): session closed for user root Sep 29 18:33:17 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-7fb69303-a488-496b-90c2-e6974c31ef7a tempest-CreateVolumesFromSourceVolumeTest-847005671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-eebe3387-bd58-4fe1-b526-035cf4a86dfb 1073741824" returned: 0 in 0.609s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:33:17 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-7fb69303-a488-496b-90c2-e6974c31ef7a tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-eebe3387-bd58-4fe1-b526-035cf4a86dfb {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:33:17 devstack sudo[104503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-eebe3387-bd58-4fe1-b526-035cf4a86dfb Sep 29 18:33:17 devstack sudo[104503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:33:17 devstack sudo[104503]: pam_unix(sudo:session): session closed for user root Sep 29 18:33:17 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-7fb69303-a488-496b-90c2-e6974c31ef7a tempest-CreateVolumesFromSourceVolumeTest-847005671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-eebe3387-bd58-4fe1-b526-035cf4a86dfb" returned: 0 in 0.285s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:33:17 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-7fb69303-a488-496b-90c2-e6974c31ef7a tempest-CreateVolumesFromSourceVolumeTest-847005671 None] <== create_volume: return (944ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'} {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:33:17 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-7fb69303-a488-496b-90c2-e6974c31ef7a tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.949s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:33:17 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-efb9cb62-a863-44c7-807e-fc5e1fb6f483 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.139s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:33:17 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-efb9cb62-a863-44c7-807e-fc5e1fb6f483 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:33:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1867786875',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08a1c0bc-5c6c-4564-a1f0-a54747f1e0f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='557fbd60c0994399b05bf9740c51f23d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:33:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:33:07Z,use_quota=True,user_id='6333ec991d084ba5996e1c513b2d1851',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)}" {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:33:17 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-efb9cb62-a863-44c7-807e-fc5e1fb6f483 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Creating volume 08a1c0bc-5c6c-4564-a1f0-a54747f1e0f7 {{(pid=86512) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:33:17 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-efb9cb62-a863-44c7-807e-fc5e1fb6f483 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:33:17 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-efb9cb62-a863-44c7-807e-fc5e1fb6f483 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:33:17 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-efb9cb62-a863-44c7-807e-fc5e1fb6f483 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:33:17 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-efb9cb62-a863-44c7-807e-fc5e1fb6f483 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:33:17 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-efb9cb62-a863-44c7-807e-fc5e1fb6f483 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:33:17 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-efb9cb62-a863-44c7-807e-fc5e1fb6f483 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Selected osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 as target Quobyte volume. {{(pid=86512) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:33:17 devstack cinder-volume[86512]: INFO cinder.volume.drivers.remotefs [None req-efb9cb62-a863-44c7-807e-fc5e1fb6f483 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] casted to osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 Sep 29 18:33:17 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-efb9cb62-a863-44c7-807e-fc5e1fb6f483 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-08a1c0bc-5c6c-4564-a1f0-a54747f1e0f7 1073741824 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:33:17 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-7fb69303-a488-496b-90c2-e6974c31ef7a tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a070386e-6184-416e-9507-307eb78cb266) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eebe3387-bd58-4fe1-b526-035cf4a86dfb', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:33:17 devstack sudo[104507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-08a1c0bc-5c6c-4564-a1f0-a54747f1e0f7 1073741824 Sep 29 18:33:17 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-7fb69303-a488-496b-90c2-e6974c31ef7a tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (152cadca-8eeb-4795-951e-f152893803c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:33:17 devstack sudo[104507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:33:17 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-7fb69303-a488-496b-90c2-e6974c31ef7a tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Volume volume-eebe3387-bd58-4fe1-b526-035cf4a86dfb (eebe3387-bd58-4fe1-b526-035cf4a86dfb): created successfully Sep 29 18:33:17 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-7fb69303-a488-496b-90c2-e6974c31ef7a tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (152cadca-8eeb-4795-951e-f152893803c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:33:17 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-7fb69303-a488-496b-90c2-e6974c31ef7a tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Flow 'volume_create_manager' (5dfc126f-9cea-4b0f-bee5-0002e1a59332) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:33:17 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-7fb69303-a488-496b-90c2-e6974c31ef7a tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Created volume successfully. Sep 29 18:33:18 devstack sudo[104507]: pam_unix(sudo:session): session closed for user root Sep 29 18:33:18 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-efb9cb62-a863-44c7-807e-fc5e1fb6f483 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-08a1c0bc-5c6c-4564-a1f0-a54747f1e0f7 1073741824" returned: 0 in 0.919s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:33:18 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-efb9cb62-a863-44c7-807e-fc5e1fb6f483 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-08a1c0bc-5c6c-4564-a1f0-a54747f1e0f7 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:33:18 devstack sudo[104960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-08a1c0bc-5c6c-4564-a1f0-a54747f1e0f7 Sep 29 18:33:18 devstack sudo[104960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:33:18 devstack sudo[104960]: pam_unix(sudo:session): session closed for user root Sep 29 18:33:18 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-efb9cb62-a863-44c7-807e-fc5e1fb6f483 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-08a1c0bc-5c6c-4564-a1f0-a54747f1e0f7" returned: 0 in 0.497s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:33:18 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-efb9cb62-a863-44c7-807e-fc5e1fb6f483 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] <== create_volume: return (1499ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'} {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:33:18 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-efb9cb62-a863-44c7-807e-fc5e1fb6f483 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.512s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:33:18 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-6e30c393-463c-4cbf-b056-9fe49ba2e58d tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.867s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:33:18 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-6e30c393-463c-4cbf-b056-9fe49ba2e58d tempest-CreateVolumesFromSourceVolumeTest-847005671 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:33:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1811838714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aee5a9a8-b373-4f37-b156-b9a0f41db038,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='557fbd60c0994399b05bf9740c51f23d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:33:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:33:08Z,use_quota=True,user_id='6333ec991d084ba5996e1c513b2d1851',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)}" {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:33:18 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-6e30c393-463c-4cbf-b056-9fe49ba2e58d tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Creating volume aee5a9a8-b373-4f37-b156-b9a0f41db038 {{(pid=86512) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:33:18 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-6e30c393-463c-4cbf-b056-9fe49ba2e58d tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:33:18 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-6e30c393-463c-4cbf-b056-9fe49ba2e58d tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:33:18 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-6e30c393-463c-4cbf-b056-9fe49ba2e58d tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:33:18 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-6e30c393-463c-4cbf-b056-9fe49ba2e58d tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:33:18 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-6e30c393-463c-4cbf-b056-9fe49ba2e58d tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:33:18 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-6e30c393-463c-4cbf-b056-9fe49ba2e58d tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Selected osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 as target Quobyte volume. {{(pid=86512) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:33:18 devstack cinder-volume[86512]: INFO cinder.volume.drivers.remotefs [None req-6e30c393-463c-4cbf-b056-9fe49ba2e58d tempest-CreateVolumesFromSourceVolumeTest-847005671 None] casted to osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 Sep 29 18:33:18 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-6e30c393-463c-4cbf-b056-9fe49ba2e58d tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-aee5a9a8-b373-4f37-b156-b9a0f41db038 1073741824 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:33:18 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-efb9cb62-a863-44c7-807e-fc5e1fb6f483 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ec37bdf-4cde-4faf-8a37-606b823cf6e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08a1c0bc-5c6c-4564-a1f0-a54747f1e0f7', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:33:18 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-efb9cb62-a863-44c7-807e-fc5e1fb6f483 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (874656e3-8185-45cb-afad-f86a577bcc74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:33:18 devstack sudo[104982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-aee5a9a8-b373-4f37-b156-b9a0f41db038 1073741824 Sep 29 18:33:18 devstack sudo[104982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:33:19 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-efb9cb62-a863-44c7-807e-fc5e1fb6f483 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Volume volume-08a1c0bc-5c6c-4564-a1f0-a54747f1e0f7 (08a1c0bc-5c6c-4564-a1f0-a54747f1e0f7): created successfully Sep 29 18:33:19 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-efb9cb62-a863-44c7-807e-fc5e1fb6f483 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (874656e3-8185-45cb-afad-f86a577bcc74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:33:19 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-efb9cb62-a863-44c7-807e-fc5e1fb6f483 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Flow 'volume_create_manager' (b6c54554-2e81-4465-84c2-9a19e4e7c805) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:33:19 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-efb9cb62-a863-44c7-807e-fc5e1fb6f483 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Created volume successfully. Sep 29 18:33:19 devstack sudo[104982]: pam_unix(sudo:session): session closed for user root Sep 29 18:33:19 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-6e30c393-463c-4cbf-b056-9fe49ba2e58d tempest-CreateVolumesFromSourceVolumeTest-847005671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-aee5a9a8-b373-4f37-b156-b9a0f41db038 1073741824" returned: 0 in 0.571s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:33:19 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-6e30c393-463c-4cbf-b056-9fe49ba2e58d tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-aee5a9a8-b373-4f37-b156-b9a0f41db038 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:33:19 devstack sudo[105005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-aee5a9a8-b373-4f37-b156-b9a0f41db038 Sep 29 18:33:19 devstack sudo[105005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:33:19 devstack sudo[105005]: pam_unix(sudo:session): session closed for user root Sep 29 18:33:19 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-6e30c393-463c-4cbf-b056-9fe49ba2e58d tempest-CreateVolumesFromSourceVolumeTest-847005671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-aee5a9a8-b373-4f37-b156-b9a0f41db038" returned: 0 in 0.311s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:33:19 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-6e30c393-463c-4cbf-b056-9fe49ba2e58d tempest-CreateVolumesFromSourceVolumeTest-847005671 None] <== create_volume: return (934ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'} {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:33:19 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-6e30c393-463c-4cbf-b056-9fe49ba2e58d tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.938s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:33:19 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-6e30c393-463c-4cbf-b056-9fe49ba2e58d tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da1559a8-1138-4e45-9bf5-4487da9d6146) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aee5a9a8-b373-4f37-b156-b9a0f41db038', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:33:19 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-6e30c393-463c-4cbf-b056-9fe49ba2e58d tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c3034f7-3bf3-4e3f-b3e8-b06899318dec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:33:19 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-6e30c393-463c-4cbf-b056-9fe49ba2e58d tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Volume volume-aee5a9a8-b373-4f37-b156-b9a0f41db038 (aee5a9a8-b373-4f37-b156-b9a0f41db038): created successfully Sep 29 18:33:19 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-6e30c393-463c-4cbf-b056-9fe49ba2e58d tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c3034f7-3bf3-4e3f-b3e8-b06899318dec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:33:19 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-6e30c393-463c-4cbf-b056-9fe49ba2e58d tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Flow 'volume_create_manager' (c8a4598c-1818-48d1-863b-a9399fcd0e31) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:33:19 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-6e30c393-463c-4cbf-b056-9fe49ba2e58d tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Created volume successfully. Sep 29 18:33:21 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-06db2064-9243-4b3f-a6d6-d7999384a158 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Acquiring lock "cinder-aee5a9a8-b373-4f37-b156-b9a0f41db038-delete_volume" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:33:21 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-06db2064-9243-4b3f-a6d6-d7999384a158 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Lock "cinder-aee5a9a8-b373-4f37-b156-b9a0f41db038-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:33:21 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-06db2064-9243-4b3f-a6d6-d7999384a158 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Acquiring lock "cinder-quobyte-aee5a9a8-b373-4f37-b156-b9a0f41db038" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:33:21 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-06db2064-9243-4b3f-a6d6-d7999384a158 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Lock "cinder-quobyte-aee5a9a8-b373-4f37-b156-b9a0f41db038" acquired by "delete_volume" :: waited 0.019s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:33:21 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ed5d2d5-0950-4562-8ef7-fe747eb22299]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:33:21 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-06db2064-9243-4b3f-a6d6-d7999384a158 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-aee5a9a8-b373-4f37-b156-b9a0f41db038 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:33:21 devstack sudo[105020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-aee5a9a8-b373-4f37-b156-b9a0f41db038 Sep 29 18:33:21 devstack sudo[105020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:33:21 devstack sudo[105020]: pam_unix(sudo:session): session closed for user root Sep 29 18:33:21 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-06db2064-9243-4b3f-a6d6-d7999384a158 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-aee5a9a8-b373-4f37-b156-b9a0f41db038" returned: 0 in 0.584s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:33:21 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-06db2064-9243-4b3f-a6d6-d7999384a158 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-aee5a9a8-b373-4f37-b156-b9a0f41db038 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:33:21 devstack sudo[105026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-aee5a9a8-b373-4f37-b156-b9a0f41db038 Sep 29 18:33:21 devstack sudo[105026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:33:21 devstack sudo[105026]: pam_unix(sudo:session): session closed for user root Sep 29 18:33:21 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-06db2064-9243-4b3f-a6d6-d7999384a158 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-aee5a9a8-b373-4f37-b156-b9a0f41db038" returned: 0 in 0.289s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:33:21 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-06db2064-9243-4b3f-a6d6-d7999384a158 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Lock "cinder-quobyte-aee5a9a8-b373-4f37-b156-b9a0f41db038" released by "delete_volume" :: held 0.919s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:33:22 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-06db2064-9243-4b3f-a6d6-d7999384a158 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Created reservations ['a66c155e-8b5b-4517-9f5e-d8bb7901b876', '73d5be60-f9f5-4f69-9dcd-d015c0484235', '7f2359d1-3dee-42c1-9920-4d92038a8f0d', '92779942-04a5-46c4-a848-6c05d46af00e'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:33:22 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-06db2064-9243-4b3f-a6d6-d7999384a158 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:33:22 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-06db2064-9243-4b3f-a6d6-d7999384a158 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:33:22 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-06db2064-9243-4b3f-a6d6-d7999384a158 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:33:22 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-06db2064-9243-4b3f-a6d6-d7999384a158 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:33:22 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-06db2064-9243-4b3f-a6d6-d7999384a158 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:33:22 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-06db2064-9243-4b3f-a6d6-d7999384a158 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:33:22 devstack sudo[105030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:33:22 devstack sudo[105030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:33:22 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-a78e46e9-ff7a-4ec4-9a4b-2883b4c65c94 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Acquiring lock "cinder-08a1c0bc-5c6c-4564-a1f0-a54747f1e0f7-delete_volume" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:33:22 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-a78e46e9-ff7a-4ec4-9a4b-2883b4c65c94 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Lock "cinder-08a1c0bc-5c6c-4564-a1f0-a54747f1e0f7-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:33:22 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-a78e46e9-ff7a-4ec4-9a4b-2883b4c65c94 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Acquiring lock "cinder-quobyte-08a1c0bc-5c6c-4564-a1f0-a54747f1e0f7" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:33:22 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-a78e46e9-ff7a-4ec4-9a4b-2883b4c65c94 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Lock "cinder-quobyte-08a1c0bc-5c6c-4564-a1f0-a54747f1e0f7" acquired by "delete_volume" :: waited 0.029s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:33:22 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[a84b1f71-4df9-404c-a2e6-5adb9a5028ca]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:33:22 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a78e46e9-ff7a-4ec4-9a4b-2883b4c65c94 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-08a1c0bc-5c6c-4564-a1f0-a54747f1e0f7 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:33:22 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-06db2064-9243-4b3f-a6d6-d7999384a158 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.398s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:33:22 devstack sudo[105030]: pam_unix(sudo:session): session closed for user root Sep 29 18:33:22 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-06db2064-9243-4b3f-a6d6-d7999384a158 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:33:22 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-06db2064-9243-4b3f-a6d6-d7999384a158 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Deleted volume successfully. Sep 29 18:33:22 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-06db2064-9243-4b3f-a6d6-d7999384a158 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Lock "cinder-aee5a9a8-b373-4f37-b156-b9a0f41db038-delete_volume" released by "delete_volume" :: held 1.572s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:33:22 devstack sudo[105032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-08a1c0bc-5c6c-4564-a1f0-a54747f1e0f7 Sep 29 18:33:22 devstack sudo[105032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:33:22 devstack sudo[105032]: pam_unix(sudo:session): session closed for user root Sep 29 18:33:23 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a78e46e9-ff7a-4ec4-9a4b-2883b4c65c94 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-08a1c0bc-5c6c-4564-a1f0-a54747f1e0f7" returned: 0 in 0.533s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:33:23 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a78e46e9-ff7a-4ec4-9a4b-2883b4c65c94 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-08a1c0bc-5c6c-4564-a1f0-a54747f1e0f7 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:33:23 devstack sudo[105039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-08a1c0bc-5c6c-4564-a1f0-a54747f1e0f7 Sep 29 18:33:23 devstack sudo[105039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:33:23 devstack sudo[105039]: pam_unix(sudo:session): session closed for user root Sep 29 18:33:23 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a78e46e9-ff7a-4ec4-9a4b-2883b4c65c94 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-08a1c0bc-5c6c-4564-a1f0-a54747f1e0f7" returned: 0 in 0.308s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:33:23 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-a78e46e9-ff7a-4ec4-9a4b-2883b4c65c94 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Lock "cinder-quobyte-08a1c0bc-5c6c-4564-a1f0-a54747f1e0f7" released by "delete_volume" :: held 0.943s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:33:23 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-a78e46e9-ff7a-4ec4-9a4b-2883b4c65c94 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Created reservations ['f7517cf8-7dba-4253-8f01-997ee14658c1', 'd947c681-4ff8-4fc0-9f33-b277881fece9', 'b2cea622-ed90-4c1b-8164-440e4540aa58', '97ffdba4-752f-45d7-bbe6-c7e918050fb4'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:33:23 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-a78e46e9-ff7a-4ec4-9a4b-2883b4c65c94 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:33:23 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-a78e46e9-ff7a-4ec4-9a4b-2883b4c65c94 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:33:23 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-a78e46e9-ff7a-4ec4-9a4b-2883b4c65c94 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:33:23 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-a78e46e9-ff7a-4ec4-9a4b-2883b4c65c94 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:33:23 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-a78e46e9-ff7a-4ec4-9a4b-2883b4c65c94 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:33:23 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a78e46e9-ff7a-4ec4-9a4b-2883b4c65c94 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:33:23 devstack sudo[105042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:33:23 devstack sudo[105042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:33:23 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-62c15dab-e633-4ff3-b02d-68851cd6b641 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Acquiring lock "cinder-eebe3387-bd58-4fe1-b526-035cf4a86dfb-delete_volume" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:33:23 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-62c15dab-e633-4ff3-b02d-68851cd6b641 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Lock "cinder-eebe3387-bd58-4fe1-b526-035cf4a86dfb-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:33:23 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-62c15dab-e633-4ff3-b02d-68851cd6b641 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Acquiring lock "cinder-quobyte-eebe3387-bd58-4fe1-b526-035cf4a86dfb" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:33:23 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-62c15dab-e633-4ff3-b02d-68851cd6b641 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Lock "cinder-quobyte-eebe3387-bd58-4fe1-b526-035cf4a86dfb" acquired by "delete_volume" :: waited 0.035s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:33:23 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[29f502d2-e601-4c59-9faf-ef22d46488fa]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:33:23 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-62c15dab-e633-4ff3-b02d-68851cd6b641 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-eebe3387-bd58-4fe1-b526-035cf4a86dfb {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:33:23 devstack sudo[105042]: pam_unix(sudo:session): session closed for user root Sep 29 18:33:23 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a78e46e9-ff7a-4ec4-9a4b-2883b4c65c94 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.340s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:33:23 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-a78e46e9-ff7a-4ec4-9a4b-2883b4c65c94 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:33:23 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-a78e46e9-ff7a-4ec4-9a4b-2883b4c65c94 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Deleted volume successfully. Sep 29 18:33:23 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-a78e46e9-ff7a-4ec4-9a4b-2883b4c65c94 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Lock "cinder-08a1c0bc-5c6c-4564-a1f0-a54747f1e0f7-delete_volume" released by "delete_volume" :: held 1.582s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:33:23 devstack sudo[105044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-eebe3387-bd58-4fe1-b526-035cf4a86dfb Sep 29 18:33:23 devstack sudo[105044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:33:24 devstack sudo[105044]: pam_unix(sudo:session): session closed for user root Sep 29 18:33:24 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-62c15dab-e633-4ff3-b02d-68851cd6b641 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-eebe3387-bd58-4fe1-b526-035cf4a86dfb" returned: 0 in 0.507s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:33:24 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-62c15dab-e633-4ff3-b02d-68851cd6b641 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-eebe3387-bd58-4fe1-b526-035cf4a86dfb {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:33:24 devstack sudo[105054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-eebe3387-bd58-4fe1-b526-035cf4a86dfb Sep 29 18:33:24 devstack sudo[105054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:33:24 devstack sudo[105054]: pam_unix(sudo:session): session closed for user root Sep 29 18:33:24 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-62c15dab-e633-4ff3-b02d-68851cd6b641 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-eebe3387-bd58-4fe1-b526-035cf4a86dfb" returned: 0 in 0.321s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:33:24 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-62c15dab-e633-4ff3-b02d-68851cd6b641 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Lock "cinder-quobyte-eebe3387-bd58-4fe1-b526-035cf4a86dfb" released by "delete_volume" :: held 0.881s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:33:24 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-62c15dab-e633-4ff3-b02d-68851cd6b641 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Created reservations ['fa481fe7-d2ef-4d33-8956-869494945ff1', '3298b60a-b66d-4629-98c1-8441c3dc27e0', '21c295a8-af89-4171-9336-01cc0fa85653', '87125c99-c63d-417f-bcf3-b78ede44e5d1'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:33:24 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-62c15dab-e633-4ff3-b02d-68851cd6b641 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:33:24 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-62c15dab-e633-4ff3-b02d-68851cd6b641 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:33:24 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-62c15dab-e633-4ff3-b02d-68851cd6b641 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:33:24 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-62c15dab-e633-4ff3-b02d-68851cd6b641 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:33:24 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-62c15dab-e633-4ff3-b02d-68851cd6b641 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:33:24 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-62c15dab-e633-4ff3-b02d-68851cd6b641 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:33:24 devstack sudo[105058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:33:24 devstack sudo[105058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:33:24 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-31b0298c-8ce2-49ee-b1b4-f915867485a0 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Acquiring lock "cinder-baca38fd-a3e8-4ddf-92e2-2e643d38eb73-delete_volume" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:33:24 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-31b0298c-8ce2-49ee-b1b4-f915867485a0 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Lock "cinder-baca38fd-a3e8-4ddf-92e2-2e643d38eb73-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:33:25 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-31b0298c-8ce2-49ee-b1b4-f915867485a0 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Acquiring lock "cinder-quobyte-baca38fd-a3e8-4ddf-92e2-2e643d38eb73" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:33:25 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-31b0298c-8ce2-49ee-b1b4-f915867485a0 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Lock "cinder-quobyte-baca38fd-a3e8-4ddf-92e2-2e643d38eb73" acquired by "delete_volume" :: waited 0.028s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:33:25 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[b56ca817-840d-4f62-abde-5d60eaebddca]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:33:25 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-31b0298c-8ce2-49ee-b1b4-f915867485a0 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-baca38fd-a3e8-4ddf-92e2-2e643d38eb73 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:33:25 devstack sudo[105060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-baca38fd-a3e8-4ddf-92e2-2e643d38eb73 Sep 29 18:33:25 devstack sudo[105060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:33:25 devstack sudo[105058]: pam_unix(sudo:session): session closed for user root Sep 29 18:33:25 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-62c15dab-e633-4ff3-b02d-68851cd6b641 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.523s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:33:25 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-62c15dab-e633-4ff3-b02d-68851cd6b641 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:33:25 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-62c15dab-e633-4ff3-b02d-68851cd6b641 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Deleted volume successfully. Sep 29 18:33:25 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-62c15dab-e633-4ff3-b02d-68851cd6b641 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Lock "cinder-eebe3387-bd58-4fe1-b526-035cf4a86dfb-delete_volume" released by "delete_volume" :: held 1.779s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:33:25 devstack sudo[105060]: pam_unix(sudo:session): session closed for user root Sep 29 18:33:25 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-31b0298c-8ce2-49ee-b1b4-f915867485a0 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-baca38fd-a3e8-4ddf-92e2-2e643d38eb73" returned: 0 in 0.493s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:33:25 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-31b0298c-8ce2-49ee-b1b4-f915867485a0 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-baca38fd-a3e8-4ddf-92e2-2e643d38eb73 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:33:25 devstack sudo[105066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-baca38fd-a3e8-4ddf-92e2-2e643d38eb73 Sep 29 18:33:25 devstack sudo[105066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:33:25 devstack sudo[105066]: pam_unix(sudo:session): session closed for user root Sep 29 18:33:25 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-31b0298c-8ce2-49ee-b1b4-f915867485a0 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-baca38fd-a3e8-4ddf-92e2-2e643d38eb73" returned: 0 in 0.316s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:33:25 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-31b0298c-8ce2-49ee-b1b4-f915867485a0 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Lock "cinder-quobyte-baca38fd-a3e8-4ddf-92e2-2e643d38eb73" released by "delete_volume" :: held 0.875s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:33:26 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-31b0298c-8ce2-49ee-b1b4-f915867485a0 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Created reservations ['9cce9998-dde1-43fb-9d15-0dda7d59520f', '789d0d6e-4832-4898-b67d-cde11e9e803d', '129d4bf4-d72b-43a5-9ec0-de38754e67f3', '36036fea-1621-43f2-b95f-aab0f8d457ab'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:33:26 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-31b0298c-8ce2-49ee-b1b4-f915867485a0 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:33:26 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-31b0298c-8ce2-49ee-b1b4-f915867485a0 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:33:26 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-31b0298c-8ce2-49ee-b1b4-f915867485a0 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:33:26 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-31b0298c-8ce2-49ee-b1b4-f915867485a0 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:33:26 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-31b0298c-8ce2-49ee-b1b4-f915867485a0 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:33:26 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-31b0298c-8ce2-49ee-b1b4-f915867485a0 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:33:26 devstack sudo[105069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:33:26 devstack sudo[105069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:33:26 devstack sudo[105069]: pam_unix(sudo:session): session closed for user root Sep 29 18:33:26 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-31b0298c-8ce2-49ee-b1b4-f915867485a0 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.308s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:33:26 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-31b0298c-8ce2-49ee-b1b4-f915867485a0 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:33:26 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-31b0298c-8ce2-49ee-b1b4-f915867485a0 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Deleted volume successfully. Sep 29 18:33:26 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-31b0298c-8ce2-49ee-b1b4-f915867485a0 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Lock "cinder-baca38fd-a3e8-4ddf-92e2-2e643d38eb73-delete_volume" released by "delete_volume" :: held 1.526s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:33:27 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-26f35b59-3563-40e3-adae-7404f29c4200 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Acquiring lock "cinder-279dc378-976b-4704-bb67-153dc11bf69d-delete_volume" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:33:27 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-26f35b59-3563-40e3-adae-7404f29c4200 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Lock "cinder-279dc378-976b-4704-bb67-153dc11bf69d-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:33:27 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-26f35b59-3563-40e3-adae-7404f29c4200 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Acquiring lock "cinder-quobyte-279dc378-976b-4704-bb67-153dc11bf69d" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:33:27 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-26f35b59-3563-40e3-adae-7404f29c4200 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Lock "cinder-quobyte-279dc378-976b-4704-bb67-153dc11bf69d" acquired by "delete_volume" :: waited 0.024s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:33:27 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[9976f298-9272-4ba1-9869-2a5dd05fb41e]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:33:27 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-26f35b59-3563-40e3-adae-7404f29c4200 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-279dc378-976b-4704-bb67-153dc11bf69d {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:33:27 devstack sudo[105072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-279dc378-976b-4704-bb67-153dc11bf69d Sep 29 18:33:27 devstack sudo[105072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:33:27 devstack sudo[105072]: pam_unix(sudo:session): session closed for user root Sep 29 18:33:27 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-26f35b59-3563-40e3-adae-7404f29c4200 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-279dc378-976b-4704-bb67-153dc11bf69d" returned: 0 in 0.437s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:33:27 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-26f35b59-3563-40e3-adae-7404f29c4200 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-279dc378-976b-4704-bb67-153dc11bf69d {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:33:27 devstack sudo[105077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-279dc378-976b-4704-bb67-153dc11bf69d Sep 29 18:33:27 devstack sudo[105077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:33:28 devstack sudo[105077]: pam_unix(sudo:session): session closed for user root Sep 29 18:33:28 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-26f35b59-3563-40e3-adae-7404f29c4200 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-279dc378-976b-4704-bb67-153dc11bf69d" returned: 0 in 0.278s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:33:28 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-26f35b59-3563-40e3-adae-7404f29c4200 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Lock "cinder-quobyte-279dc378-976b-4704-bb67-153dc11bf69d" released by "delete_volume" :: held 0.768s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:33:28 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-26f35b59-3563-40e3-adae-7404f29c4200 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Created reservations ['a0c89c84-4ca3-4172-a65a-163c1fc84f04', '9145570d-0df4-4907-8c86-1710ac2d2c97', '4ed73eec-24af-4be7-94e7-9f3a35e86fd8', '2d30d778-7652-4632-85b0-df6687fa66c2'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:33:28 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-26f35b59-3563-40e3-adae-7404f29c4200 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:33:28 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-26f35b59-3563-40e3-adae-7404f29c4200 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:33:28 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-26f35b59-3563-40e3-adae-7404f29c4200 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:33:28 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-26f35b59-3563-40e3-adae-7404f29c4200 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:33:28 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-26f35b59-3563-40e3-adae-7404f29c4200 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:33:28 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-26f35b59-3563-40e3-adae-7404f29c4200 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:33:28 devstack sudo[105080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:33:28 devstack sudo[105080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:33:28 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-83441bab-bda9-4317-adb7-b2b4018a08c9 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Acquiring lock "cinder-cb10d71b-117b-455f-bb34-869f65c2d7dc-delete_volume" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:33:28 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-83441bab-bda9-4317-adb7-b2b4018a08c9 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Lock "cinder-cb10d71b-117b-455f-bb34-869f65c2d7dc-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:33:28 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-83441bab-bda9-4317-adb7-b2b4018a08c9 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Acquiring lock "cinder-quobyte-cb10d71b-117b-455f-bb34-869f65c2d7dc" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:33:28 devstack sudo[105080]: pam_unix(sudo:session): session closed for user root Sep 29 18:33:28 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-26f35b59-3563-40e3-adae-7404f29c4200 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.371s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:33:28 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-26f35b59-3563-40e3-adae-7404f29c4200 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:33:28 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-83441bab-bda9-4317-adb7-b2b4018a08c9 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Lock "cinder-quobyte-cb10d71b-117b-455f-bb34-869f65c2d7dc" acquired by "delete_volume" :: waited 0.040s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:33:28 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-26f35b59-3563-40e3-adae-7404f29c4200 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Deleted volume successfully. Sep 29 18:33:28 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3e2e91b-ff3d-4731-ab13-1aac2d52c3a0]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:33:28 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-83441bab-bda9-4317-adb7-b2b4018a08c9 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-cb10d71b-117b-455f-bb34-869f65c2d7dc {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:33:28 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-26f35b59-3563-40e3-adae-7404f29c4200 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Lock "cinder-279dc378-976b-4704-bb67-153dc11bf69d-delete_volume" released by "delete_volume" :: held 1.452s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:33:28 devstack sudo[105083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-cb10d71b-117b-455f-bb34-869f65c2d7dc Sep 29 18:33:28 devstack sudo[105083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:33:29 devstack sudo[105083]: pam_unix(sudo:session): session closed for user root Sep 29 18:33:29 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-83441bab-bda9-4317-adb7-b2b4018a08c9 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-cb10d71b-117b-455f-bb34-869f65c2d7dc" returned: 0 in 0.385s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:33:29 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-83441bab-bda9-4317-adb7-b2b4018a08c9 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-cb10d71b-117b-455f-bb34-869f65c2d7dc {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:33:29 devstack sudo[105088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-cb10d71b-117b-455f-bb34-869f65c2d7dc Sep 29 18:33:29 devstack sudo[105088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:33:29 devstack sudo[105088]: pam_unix(sudo:session): session closed for user root Sep 29 18:33:29 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-83441bab-bda9-4317-adb7-b2b4018a08c9 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-cb10d71b-117b-455f-bb34-869f65c2d7dc" returned: 0 in 0.256s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:33:29 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-83441bab-bda9-4317-adb7-b2b4018a08c9 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Lock "cinder-quobyte-cb10d71b-117b-455f-bb34-869f65c2d7dc" released by "delete_volume" :: held 0.700s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:33:29 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-83441bab-bda9-4317-adb7-b2b4018a08c9 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Created reservations ['a5802e39-b286-4ffc-8af4-fb9a58965239', '12412749-3c9e-4bba-bce2-5a7667660359', '41dc1621-8692-4189-afed-fbcf4cc935e5', 'e6376085-2f76-4a57-a1f4-fc13dcab64b6'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:33:29 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-83441bab-bda9-4317-adb7-b2b4018a08c9 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:33:29 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-83441bab-bda9-4317-adb7-b2b4018a08c9 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:33:29 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-83441bab-bda9-4317-adb7-b2b4018a08c9 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:33:29 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-83441bab-bda9-4317-adb7-b2b4018a08c9 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:33:29 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-83441bab-bda9-4317-adb7-b2b4018a08c9 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:33:29 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-83441bab-bda9-4317-adb7-b2b4018a08c9 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:33:29 devstack sudo[105091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:33:29 devstack sudo[105091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:33:29 devstack sudo[105091]: pam_unix(sudo:session): session closed for user root Sep 29 18:33:29 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-83441bab-bda9-4317-adb7-b2b4018a08c9 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.406s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:33:29 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-83441bab-bda9-4317-adb7-b2b4018a08c9 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:33:29 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-83441bab-bda9-4317-adb7-b2b4018a08c9 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Deleted volume successfully. Sep 29 18:33:29 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-83441bab-bda9-4317-adb7-b2b4018a08c9 tempest-CreateVolumesFromSourceVolumeTest-847005671 None] Lock "cinder-cb10d71b-117b-455f-bb34-869f65c2d7dc-delete_volume" released by "delete_volume" :: held 1.423s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:33:33 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae91fa4d-54e1-402a-9ff9-693543dfb32e tempest-VolumeDependencyTests-9485720 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86512) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:33:33 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-ae91fa4d-54e1-402a-9ff9-693543dfb32e tempest-VolumeDependencyTests-9485720 None] Flow 'volume_create_manager' (ff8b25d3-e703-4604-a487-9b27566cf969) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:33:33 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-ae91fa4d-54e1-402a-9ff9-693543dfb32e tempest-VolumeDependencyTests-9485720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d367760-10f1-44af-b3cb-3a7447039383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:33:33 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-ae91fa4d-54e1-402a-9ff9-693543dfb32e tempest-VolumeDependencyTests-9485720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d367760-10f1-44af-b3cb-3a7447039383) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:33:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1326359663',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7c77a01-4260-4bd7-8300-3c4d107fa9af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6374f0dd9c1432ea3889d57b2acbf56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:33:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:33:33Z,use_quota=True,user_id='d6a40490c9c7446d8027c11a4e89fdbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:33:33 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-ae91fa4d-54e1-402a-9ff9-693543dfb32e tempest-VolumeDependencyTests-9485720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c100246-5609-4001-9147-5a4593e75a85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:33:33 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-ae91fa4d-54e1-402a-9ff9-693543dfb32e tempest-VolumeDependencyTests-9485720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c100246-5609-4001-9147-5a4593e75a85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:33:33 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-ae91fa4d-54e1-402a-9ff9-693543dfb32e tempest-VolumeDependencyTests-9485720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b3be479-72da-43dc-9825-87319e9d2485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:33:33 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-ae91fa4d-54e1-402a-9ff9-693543dfb32e tempest-VolumeDependencyTests-9485720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b3be479-72da-43dc-9825-87319e9d2485) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7c77a01-4260-4bd7-8300-3c4d107fa9af', 'volume_name': 'volume-e7c77a01-4260-4bd7-8300-3c4d107fa9af', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:33:33 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-ae91fa4d-54e1-402a-9ff9-693543dfb32e tempest-VolumeDependencyTests-9485720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d88c8b5f-05cf-4c58-80e1-b4e57ca7e531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:33:33 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-ae91fa4d-54e1-402a-9ff9-693543dfb32e tempest-VolumeDependencyTests-9485720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d88c8b5f-05cf-4c58-80e1-b4e57ca7e531) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:33:33 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-ae91fa4d-54e1-402a-9ff9-693543dfb32e tempest-VolumeDependencyTests-9485720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98208772-bfa1-4873-94ca-e6112518b06f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:33:33 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-ae91fa4d-54e1-402a-9ff9-693543dfb32e tempest-VolumeDependencyTests-9485720 None] Volume e7c77a01-4260-4bd7-8300-3c4d107fa9af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7c77a01-4260-4bd7-8300-3c4d107fa9af', 'volume_size': 1} Sep 29 18:33:33 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-ae91fa4d-54e1-402a-9ff9-693543dfb32e tempest-VolumeDependencyTests-9485720 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:33:33 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-ae91fa4d-54e1-402a-9ff9-693543dfb32e tempest-VolumeDependencyTests-9485720 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:33:33 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-ae91fa4d-54e1-402a-9ff9-693543dfb32e tempest-VolumeDependencyTests-9485720 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:33:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1326359663',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7c77a01-4260-4bd7-8300-3c4d107fa9af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6374f0dd9c1432ea3889d57b2acbf56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:33:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:33:33Z,use_quota=True,user_id='d6a40490c9c7446d8027c11a4e89fdbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)}" {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:33:33 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-ae91fa4d-54e1-402a-9ff9-693543dfb32e tempest-VolumeDependencyTests-9485720 None] Creating volume e7c77a01-4260-4bd7-8300-3c4d107fa9af {{(pid=86512) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:33:33 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-ae91fa4d-54e1-402a-9ff9-693543dfb32e tempest-VolumeDependencyTests-9485720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:33:33 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-ae91fa4d-54e1-402a-9ff9-693543dfb32e tempest-VolumeDependencyTests-9485720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:33:33 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-ae91fa4d-54e1-402a-9ff9-693543dfb32e tempest-VolumeDependencyTests-9485720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:33:33 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-ae91fa4d-54e1-402a-9ff9-693543dfb32e tempest-VolumeDependencyTests-9485720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:33:33 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-ae91fa4d-54e1-402a-9ff9-693543dfb32e tempest-VolumeDependencyTests-9485720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:33:33 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-ae91fa4d-54e1-402a-9ff9-693543dfb32e tempest-VolumeDependencyTests-9485720 None] Selected osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 as target Quobyte volume. {{(pid=86512) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:33:33 devstack cinder-volume[86512]: INFO cinder.volume.drivers.remotefs [None req-ae91fa4d-54e1-402a-9ff9-693543dfb32e tempest-VolumeDependencyTests-9485720 None] casted to osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 Sep 29 18:33:33 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-ae91fa4d-54e1-402a-9ff9-693543dfb32e tempest-VolumeDependencyTests-9485720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e7c77a01-4260-4bd7-8300-3c4d107fa9af 1073741824 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:33:33 devstack sudo[105094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e7c77a01-4260-4bd7-8300-3c4d107fa9af 1073741824 Sep 29 18:33:33 devstack sudo[105094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:33:33 devstack sudo[105094]: pam_unix(sudo:session): session closed for user root Sep 29 18:33:33 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-ae91fa4d-54e1-402a-9ff9-693543dfb32e tempest-VolumeDependencyTests-9485720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e7c77a01-4260-4bd7-8300-3c4d107fa9af 1073741824" returned: 0 in 0.489s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:33:34 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-ae91fa4d-54e1-402a-9ff9-693543dfb32e tempest-VolumeDependencyTests-9485720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e7c77a01-4260-4bd7-8300-3c4d107fa9af {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:33:34 devstack sudo[105101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e7c77a01-4260-4bd7-8300-3c4d107fa9af Sep 29 18:33:34 devstack sudo[105101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:33:34 devstack sudo[105101]: pam_unix(sudo:session): session closed for user root Sep 29 18:33:34 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-ae91fa4d-54e1-402a-9ff9-693543dfb32e tempest-VolumeDependencyTests-9485720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e7c77a01-4260-4bd7-8300-3c4d107fa9af" returned: 0 in 0.344s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:33:34 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-ae91fa4d-54e1-402a-9ff9-693543dfb32e tempest-VolumeDependencyTests-9485720 None] <== create_volume: return (884ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'} {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:33:34 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-ae91fa4d-54e1-402a-9ff9-693543dfb32e tempest-VolumeDependencyTests-9485720 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.886s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:33:34 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-ae91fa4d-54e1-402a-9ff9-693543dfb32e tempest-VolumeDependencyTests-9485720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98208772-bfa1-4873-94ca-e6112518b06f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7c77a01-4260-4bd7-8300-3c4d107fa9af', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:33:34 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-ae91fa4d-54e1-402a-9ff9-693543dfb32e tempest-VolumeDependencyTests-9485720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6ecb15f-bd8c-4087-b2de-e151f3ae96ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:33:34 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-ae91fa4d-54e1-402a-9ff9-693543dfb32e tempest-VolumeDependencyTests-9485720 None] Volume volume-e7c77a01-4260-4bd7-8300-3c4d107fa9af (e7c77a01-4260-4bd7-8300-3c4d107fa9af): created successfully Sep 29 18:33:34 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-ae91fa4d-54e1-402a-9ff9-693543dfb32e tempest-VolumeDependencyTests-9485720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6ecb15f-bd8c-4087-b2de-e151f3ae96ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:33:34 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-ae91fa4d-54e1-402a-9ff9-693543dfb32e tempest-VolumeDependencyTests-9485720 None] Flow 'volume_create_manager' (ff8b25d3-e703-4604-a487-9b27566cf969) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:33:34 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-ae91fa4d-54e1-402a-9ff9-693543dfb32e tempest-VolumeDependencyTests-9485720 None] Created volume successfully. Sep 29 18:33:35 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-7b34e425-7592-4d04-94c0-0186d51be053 tempest-VolumeDependencyTests-9485720 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:33:35 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-7b34e425-7592-4d04-94c0-0186d51be053 tempest-VolumeDependencyTests-9485720 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:33:35 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-7b34e425-7592-4d04-94c0-0186d51be053 tempest-VolumeDependencyTests-9485720 None] Creating offline snapshot e659cb2e-f7b5-44b6-b390-3dfcdc126b2e of volume e7c77a01-4260-4bd7-8300-3c4d107fa9af {{(pid=86512) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 18:33:35 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f10f632-9e4d-4a7f-b387-2eec04371ce1]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:33:35 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-7b34e425-7592-4d04-94c0-0186d51be053 tempest-VolumeDependencyTests-9485720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e7c77a01-4260-4bd7-8300-3c4d107fa9af {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:33:35 devstack sudo[105104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e7c77a01-4260-4bd7-8300-3c4d107fa9af Sep 29 18:33:35 devstack sudo[105104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:33:36 devstack sudo[105104]: pam_unix(sudo:session): session closed for user root Sep 29 18:33:36 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-7b34e425-7592-4d04-94c0-0186d51be053 tempest-VolumeDependencyTests-9485720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e7c77a01-4260-4bd7-8300-3c4d107fa9af" returned: 0 in 0.493s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:33:36 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-7b34e425-7592-4d04-94c0-0186d51be053 tempest-VolumeDependencyTests-9485720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e7c77a01-4260-4bd7-8300-3c4d107fa9af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e7c77a01-4260-4bd7-8300-3c4d107fa9af.e659cb2e-f7b5-44b6-b390-3dfcdc126b2e 1G {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:33:36 devstack sudo[105121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e7c77a01-4260-4bd7-8300-3c4d107fa9af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e7c77a01-4260-4bd7-8300-3c4d107fa9af.e659cb2e-f7b5-44b6-b390-3dfcdc126b2e 1G Sep 29 18:33:36 devstack sudo[105121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:33:36 devstack sudo[105121]: pam_unix(sudo:session): session closed for user root Sep 29 18:33:36 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-7b34e425-7592-4d04-94c0-0186d51be053 tempest-VolumeDependencyTests-9485720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e7c77a01-4260-4bd7-8300-3c4d107fa9af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e7c77a01-4260-4bd7-8300-3c4d107fa9af.e659cb2e-f7b5-44b6-b390-3dfcdc126b2e 1G" returned: 0 in 0.556s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:33:36 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-7b34e425-7592-4d04-94c0-0186d51be053 tempest-VolumeDependencyTests-9485720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7c77a01-4260-4bd7-8300-3c4d107fa9af -F qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e7c77a01-4260-4bd7-8300-3c4d107fa9af.e659cb2e-f7b5-44b6-b390-3dfcdc126b2e {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:33:36 devstack sudo[105129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7c77a01-4260-4bd7-8300-3c4d107fa9af -F qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e7c77a01-4260-4bd7-8300-3c4d107fa9af.e659cb2e-f7b5-44b6-b390-3dfcdc126b2e Sep 29 18:33:36 devstack sudo[105129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:33:37 devstack sudo[105129]: pam_unix(sudo:session): session closed for user root Sep 29 18:33:37 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-7b34e425-7592-4d04-94c0-0186d51be053 tempest-VolumeDependencyTests-9485720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7c77a01-4260-4bd7-8300-3c4d107fa9af -F qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e7c77a01-4260-4bd7-8300-3c4d107fa9af.e659cb2e-f7b5-44b6-b390-3dfcdc126b2e" returned: 0 in 0.548s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:33:37 devstack cinder-volume[86512]: WARNING cinder.volume.drivers.remotefs [None req-7b34e425-7592-4d04-94c0-0186d51be053 tempest-VolumeDependencyTests-9485720 None] /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e7c77a01-4260-4bd7-8300-3c4d107fa9af.e659cb2e-f7b5-44b6-b390-3dfcdc126b2e is being set with open permissions: ugo+rw Sep 29 18:33:37 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-7b34e425-7592-4d04-94c0-0186d51be053 tempest-VolumeDependencyTests-9485720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e7c77a01-4260-4bd7-8300-3c4d107fa9af.e659cb2e-f7b5-44b6-b390-3dfcdc126b2e {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:33:37 devstack sudo[105136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e7c77a01-4260-4bd7-8300-3c4d107fa9af.e659cb2e-f7b5-44b6-b390-3dfcdc126b2e Sep 29 18:33:37 devstack sudo[105136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:33:37 devstack sudo[105136]: pam_unix(sudo:session): session closed for user root Sep 29 18:33:37 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-7b34e425-7592-4d04-94c0-0186d51be053 tempest-VolumeDependencyTests-9485720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e7c77a01-4260-4bd7-8300-3c4d107fa9af.e659cb2e-f7b5-44b6-b390-3dfcdc126b2e" returned: 0 in 0.324s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:33:37 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-7b34e425-7592-4d04-94c0-0186d51be053 tempest-VolumeDependencyTests-9485720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e7c77a01-4260-4bd7-8300-3c4d107fa9af.info {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:33:37 devstack sudo[105163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e7c77a01-4260-4bd7-8300-3c4d107fa9af.info Sep 29 18:33:37 devstack sudo[105163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:33:37 devstack sudo[105163]: pam_unix(sudo:session): session closed for user root Sep 29 18:33:37 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-7b34e425-7592-4d04-94c0-0186d51be053 tempest-VolumeDependencyTests-9485720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e7c77a01-4260-4bd7-8300-3c4d107fa9af.info" returned: 0 in 0.293s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:33:37 devstack cinder-volume[86512]: WARNING cinder.volume.drivers.remotefs [None req-7b34e425-7592-4d04-94c0-0186d51be053 tempest-VolumeDependencyTests-9485720 None] /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e7c77a01-4260-4bd7-8300-3c4d107fa9af.info is being set with open permissions: ugo+rw Sep 29 18:33:37 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-7b34e425-7592-4d04-94c0-0186d51be053 tempest-VolumeDependencyTests-9485720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e7c77a01-4260-4bd7-8300-3c4d107fa9af.info {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:33:37 devstack sudo[105166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e7c77a01-4260-4bd7-8300-3c4d107fa9af.info Sep 29 18:33:37 devstack sudo[105166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:33:38 devstack sudo[105166]: pam_unix(sudo:session): session closed for user root Sep 29 18:33:38 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-7b34e425-7592-4d04-94c0-0186d51be053 tempest-VolumeDependencyTests-9485720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e7c77a01-4260-4bd7-8300-3c4d107fa9af.info" returned: 0 in 0.255s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:33:38 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-7b34e425-7592-4d04-94c0-0186d51be053 tempest-VolumeDependencyTests-9485720 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.576s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:33:38 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-7b34e425-7592-4d04-94c0-0186d51be053 tempest-VolumeDependencyTests-9485720 None] Create snapshot completed successfully Sep 29 18:33:38 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-4171542a-abd0-4359-b3ad-c2096701f7b1 tempest-VolumesSnapshotTestJSON-1354260036 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86512) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:33:38 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-4171542a-abd0-4359-b3ad-c2096701f7b1 tempest-VolumesSnapshotTestJSON-1354260036 None] Flow 'volume_create_manager' (82dda31e-8b8c-49ea-96c9-e8a572d5770d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:33:38 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-4171542a-abd0-4359-b3ad-c2096701f7b1 tempest-VolumesSnapshotTestJSON-1354260036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f61d0b93-4190-4f0c-ae7c-acb8a77c63fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:33:38 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-4171542a-abd0-4359-b3ad-c2096701f7b1 tempest-VolumesSnapshotTestJSON-1354260036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f61d0b93-4190-4f0c-ae7c-acb8a77c63fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:33:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-547113689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e667038a-486d-4b1e-99d9-b63db5fa82c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd288a0f9bec4d359ab34e9f2079e2ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:33:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:33:39Z,use_quota=True,user_id='1efcc6a2f76e46dbae7d214b0f803523',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:33:38 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-4171542a-abd0-4359-b3ad-c2096701f7b1 tempest-VolumesSnapshotTestJSON-1354260036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (515a8c4f-300c-423f-a67a-1b0e8efd831a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:33:38 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-4171542a-abd0-4359-b3ad-c2096701f7b1 tempest-VolumesSnapshotTestJSON-1354260036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (515a8c4f-300c-423f-a67a-1b0e8efd831a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:33:38 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-4171542a-abd0-4359-b3ad-c2096701f7b1 tempest-VolumesSnapshotTestJSON-1354260036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43f5cb86-14b5-4fa9-9ada-583d54a155c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:33:38 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-4171542a-abd0-4359-b3ad-c2096701f7b1 tempest-VolumesSnapshotTestJSON-1354260036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43f5cb86-14b5-4fa9-9ada-583d54a155c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e667038a-486d-4b1e-99d9-b63db5fa82c6', 'volume_name': 'volume-e667038a-486d-4b1e-99d9-b63db5fa82c6', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:33:38 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-4171542a-abd0-4359-b3ad-c2096701f7b1 tempest-VolumesSnapshotTestJSON-1354260036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3716c8f-5eb5-45f0-9990-d03a66d5308b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:33:38 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-4171542a-abd0-4359-b3ad-c2096701f7b1 tempest-VolumesSnapshotTestJSON-1354260036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3716c8f-5eb5-45f0-9990-d03a66d5308b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:33:38 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-4171542a-abd0-4359-b3ad-c2096701f7b1 tempest-VolumesSnapshotTestJSON-1354260036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01ad9323-fec4-49df-94af-b5f1891c1959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:33:38 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-4171542a-abd0-4359-b3ad-c2096701f7b1 tempest-VolumesSnapshotTestJSON-1354260036 None] Volume e667038a-486d-4b1e-99d9-b63db5fa82c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e667038a-486d-4b1e-99d9-b63db5fa82c6', 'volume_size': 1} Sep 29 18:33:38 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-4171542a-abd0-4359-b3ad-c2096701f7b1 tempest-VolumesSnapshotTestJSON-1354260036 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:33:38 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-4171542a-abd0-4359-b3ad-c2096701f7b1 tempest-VolumesSnapshotTestJSON-1354260036 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:33:38 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-4171542a-abd0-4359-b3ad-c2096701f7b1 tempest-VolumesSnapshotTestJSON-1354260036 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:33:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-547113689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e667038a-486d-4b1e-99d9-b63db5fa82c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd288a0f9bec4d359ab34e9f2079e2ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:33:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:33:39Z,use_quota=True,user_id='1efcc6a2f76e46dbae7d214b0f803523',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)}" {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:33:38 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-4171542a-abd0-4359-b3ad-c2096701f7b1 tempest-VolumesSnapshotTestJSON-1354260036 None] Creating volume e667038a-486d-4b1e-99d9-b63db5fa82c6 {{(pid=86512) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:33:38 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-4171542a-abd0-4359-b3ad-c2096701f7b1 tempest-VolumesSnapshotTestJSON-1354260036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:33:38 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-4171542a-abd0-4359-b3ad-c2096701f7b1 tempest-VolumesSnapshotTestJSON-1354260036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:33:38 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-4171542a-abd0-4359-b3ad-c2096701f7b1 tempest-VolumesSnapshotTestJSON-1354260036 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:33:38 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-4171542a-abd0-4359-b3ad-c2096701f7b1 tempest-VolumesSnapshotTestJSON-1354260036 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:33:38 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-4171542a-abd0-4359-b3ad-c2096701f7b1 tempest-VolumesSnapshotTestJSON-1354260036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:33:38 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-4171542a-abd0-4359-b3ad-c2096701f7b1 tempest-VolumesSnapshotTestJSON-1354260036 None] Selected osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 as target Quobyte volume. {{(pid=86512) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:33:38 devstack cinder-volume[86512]: INFO cinder.volume.drivers.remotefs [None req-4171542a-abd0-4359-b3ad-c2096701f7b1 tempest-VolumesSnapshotTestJSON-1354260036 None] casted to osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 Sep 29 18:33:38 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-4171542a-abd0-4359-b3ad-c2096701f7b1 tempest-VolumesSnapshotTestJSON-1354260036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e667038a-486d-4b1e-99d9-b63db5fa82c6 1073741824 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:33:38 devstack sudo[105169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e667038a-486d-4b1e-99d9-b63db5fa82c6 1073741824 Sep 29 18:33:38 devstack sudo[105169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:33:39 devstack sudo[105169]: pam_unix(sudo:session): session closed for user root Sep 29 18:33:39 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-4171542a-abd0-4359-b3ad-c2096701f7b1 tempest-VolumesSnapshotTestJSON-1354260036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e667038a-486d-4b1e-99d9-b63db5fa82c6 1073741824" returned: 0 in 0.481s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:33:39 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-4171542a-abd0-4359-b3ad-c2096701f7b1 tempest-VolumesSnapshotTestJSON-1354260036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e667038a-486d-4b1e-99d9-b63db5fa82c6 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:33:39 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-108d28cb-c757-48e2-afbb-de02a93e59a3 tempest-VolumeDependencyTests-9485720 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86512) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:33:39 devstack sudo[105175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e667038a-486d-4b1e-99d9-b63db5fa82c6 Sep 29 18:33:39 devstack sudo[105175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:33:39 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-108d28cb-c757-48e2-afbb-de02a93e59a3 tempest-VolumeDependencyTests-9485720 None] Flow 'volume_create_manager' (9a9e5132-bf78-4e66-8cc3-2db31ac2d473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:33:39 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-108d28cb-c757-48e2-afbb-de02a93e59a3 tempest-VolumeDependencyTests-9485720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79638f42-5568-4c96-b629-078ed3ea6b84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:33:39 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-108d28cb-c757-48e2-afbb-de02a93e59a3 tempest-VolumeDependencyTests-9485720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79638f42-5568-4c96-b629-078ed3ea6b84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:33:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-481293663',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=666d811a-06a5-4390-9dfd-03f94b996dcf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6374f0dd9c1432ea3889d57b2acbf56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:33:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=e659cb2e-f7b5-44b6-b390-3dfcdc126b2e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:33:39Z,use_quota=True,user_id='d6a40490c9c7446d8027c11a4e89fdbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:33:39 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-108d28cb-c757-48e2-afbb-de02a93e59a3 tempest-VolumeDependencyTests-9485720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3673066c-52c9-4834-bc6b-72fc327c3f44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:33:39 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-108d28cb-c757-48e2-afbb-de02a93e59a3 tempest-VolumeDependencyTests-9485720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3673066c-52c9-4834-bc6b-72fc327c3f44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:33:39 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-108d28cb-c757-48e2-afbb-de02a93e59a3 tempest-VolumeDependencyTests-9485720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e323e6c-5590-483c-ac03-6188834aa61f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:33:39 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-108d28cb-c757-48e2-afbb-de02a93e59a3 tempest-VolumeDependencyTests-9485720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e323e6c-5590-483c-ac03-6188834aa61f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '666d811a-06a5-4390-9dfd-03f94b996dcf', 'volume_name': 'volume-666d811a-06a5-4390-9dfd-03f94b996dcf', 'volume_size': 1, 'snapshot_id': 'e659cb2e-f7b5-44b6-b390-3dfcdc126b2e'}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:33:39 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-108d28cb-c757-48e2-afbb-de02a93e59a3 tempest-VolumeDependencyTests-9485720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7c11b49-ba09-44d4-a3a8-cff2e7725785) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:33:39 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-108d28cb-c757-48e2-afbb-de02a93e59a3 tempest-VolumeDependencyTests-9485720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7c11b49-ba09-44d4-a3a8-cff2e7725785) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:33:39 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-108d28cb-c757-48e2-afbb-de02a93e59a3 tempest-VolumeDependencyTests-9485720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bef96e5c-e80e-45e6-9df1-644dc7e1ba1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:33:39 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-108d28cb-c757-48e2-afbb-de02a93e59a3 tempest-VolumeDependencyTests-9485720 None] Volume 666d811a-06a5-4390-9dfd-03f94b996dcf: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-666d811a-06a5-4390-9dfd-03f94b996dcf', 'volume_size': 1, 'snapshot_id': 'e659cb2e-f7b5-44b6-b390-3dfcdc126b2e'} Sep 29 18:33:39 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-108d28cb-c757-48e2-afbb-de02a93e59a3 tempest-VolumeDependencyTests-9485720 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:33:39 devstack sudo[105175]: pam_unix(sudo:session): session closed for user root Sep 29 18:33:39 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-4171542a-abd0-4359-b3ad-c2096701f7b1 tempest-VolumesSnapshotTestJSON-1354260036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e667038a-486d-4b1e-99d9-b63db5fa82c6" returned: 0 in 0.241s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:33:39 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-4171542a-abd0-4359-b3ad-c2096701f7b1 tempest-VolumesSnapshotTestJSON-1354260036 None] <== create_volume: return (782ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'} {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:33:39 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-4171542a-abd0-4359-b3ad-c2096701f7b1 tempest-VolumesSnapshotTestJSON-1354260036 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.784s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:33:39 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-108d28cb-c757-48e2-afbb-de02a93e59a3 tempest-VolumeDependencyTests-9485720 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.121s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:33:39 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-108d28cb-c757-48e2-afbb-de02a93e59a3 tempest-VolumeDependencyTests-9485720 None] Acquiring lock "cinder-quobyte-e659cb2e-f7b5-44b6-b390-3dfcdc126b2e-666d811a-06a5-4390-9dfd-03f94b996dcf" by "_create_volume_from_snapshot" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:33:39 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-4171542a-abd0-4359-b3ad-c2096701f7b1 tempest-VolumesSnapshotTestJSON-1354260036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01ad9323-fec4-49df-94af-b5f1891c1959) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e667038a-486d-4b1e-99d9-b63db5fa82c6', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:33:39 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-4171542a-abd0-4359-b3ad-c2096701f7b1 tempest-VolumesSnapshotTestJSON-1354260036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1db610f8-4e31-4665-83b8-5709e7c741cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:33:39 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-108d28cb-c757-48e2-afbb-de02a93e59a3 tempest-VolumeDependencyTests-9485720 None] Lock "cinder-quobyte-e659cb2e-f7b5-44b6-b390-3dfcdc126b2e-666d811a-06a5-4390-9dfd-03f94b996dcf" acquired by "_create_volume_from_snapshot" :: waited 0.036s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:33:39 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-108d28cb-c757-48e2-afbb-de02a93e59a3 tempest-VolumeDependencyTests-9485720 None] Creating volume 666d811a-06a5-4390-9dfd-03f94b996dcf from snapshot e659cb2e-f7b5-44b6-b390-3dfcdc126b2e {{(pid=86512) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 29 18:33:39 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-108d28cb-c757-48e2-afbb-de02a93e59a3 tempest-VolumeDependencyTests-9485720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:33:39 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-108d28cb-c757-48e2-afbb-de02a93e59a3 tempest-VolumeDependencyTests-9485720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:33:39 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-108d28cb-c757-48e2-afbb-de02a93e59a3 tempest-VolumeDependencyTests-9485720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:33:39 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-108d28cb-c757-48e2-afbb-de02a93e59a3 tempest-VolumeDependencyTests-9485720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:33:39 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-108d28cb-c757-48e2-afbb-de02a93e59a3 tempest-VolumeDependencyTests-9485720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:33:39 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-108d28cb-c757-48e2-afbb-de02a93e59a3 tempest-VolumeDependencyTests-9485720 None] Selected osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 as target Quobyte volume. {{(pid=86512) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:33:39 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-108d28cb-c757-48e2-afbb-de02a93e59a3 tempest-VolumeDependencyTests-9485720 None] Acquiring lock "cinder-quobyte-666d811a-06a5-4390-9dfd-03f94b996dcf" by "_copy_volume_from_snapshot" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:33:39 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-4171542a-abd0-4359-b3ad-c2096701f7b1 tempest-VolumesSnapshotTestJSON-1354260036 None] Volume volume-e667038a-486d-4b1e-99d9-b63db5fa82c6 (e667038a-486d-4b1e-99d9-b63db5fa82c6): created successfully Sep 29 18:33:39 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-4171542a-abd0-4359-b3ad-c2096701f7b1 tempest-VolumesSnapshotTestJSON-1354260036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1db610f8-4e31-4665-83b8-5709e7c741cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:33:39 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-4171542a-abd0-4359-b3ad-c2096701f7b1 tempest-VolumesSnapshotTestJSON-1354260036 None] Flow 'volume_create_manager' (82dda31e-8b8c-49ea-96c9-e8a572d5770d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:33:39 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-108d28cb-c757-48e2-afbb-de02a93e59a3 tempest-VolumeDependencyTests-9485720 None] Lock "cinder-quobyte-666d811a-06a5-4390-9dfd-03f94b996dcf" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:33:39 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-108d28cb-c757-48e2-afbb-de02a93e59a3 tempest-VolumeDependencyTests-9485720 None] snapshot: e659cb2e-f7b5-44b6-b390-3dfcdc126b2e, volume: 666d811a-06a5-4390-9dfd-03f94b996dcf, {{(pid=86512) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 29 18:33:39 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-108d28cb-c757-48e2-afbb-de02a93e59a3 tempest-VolumeDependencyTests-9485720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:33:39 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-108d28cb-c757-48e2-afbb-de02a93e59a3 tempest-VolumeDependencyTests-9485720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:33:39 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-108d28cb-c757-48e2-afbb-de02a93e59a3 tempest-VolumeDependencyTests-9485720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:33:39 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-108d28cb-c757-48e2-afbb-de02a93e59a3 tempest-VolumeDependencyTests-9485720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:33:39 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-108d28cb-c757-48e2-afbb-de02a93e59a3 tempest-VolumeDependencyTests-9485720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:33:39 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-4171542a-abd0-4359-b3ad-c2096701f7b1 tempest-VolumesSnapshotTestJSON-1354260036 None] Created volume successfully. Sep 29 18:33:39 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b86f50b-f4da-4d68-a021-5cc49e47d920]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:33:39 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-108d28cb-c757-48e2-afbb-de02a93e59a3 tempest-VolumeDependencyTests-9485720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e7c77a01-4260-4bd7-8300-3c4d107fa9af.e659cb2e-f7b5-44b6-b390-3dfcdc126b2e {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:33:39 devstack sudo[105178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e7c77a01-4260-4bd7-8300-3c4d107fa9af.e659cb2e-f7b5-44b6-b390-3dfcdc126b2e Sep 29 18:33:39 devstack sudo[105178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:33:39 devstack sudo[105178]: pam_unix(sudo:session): session closed for user root Sep 29 18:33:40 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-108d28cb-c757-48e2-afbb-de02a93e59a3 tempest-VolumeDependencyTests-9485720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e7c77a01-4260-4bd7-8300-3c4d107fa9af.e659cb2e-f7b5-44b6-b390-3dfcdc126b2e" returned: 0 in 0.347s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:33:40 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-108d28cb-c757-48e2-afbb-de02a93e59a3 tempest-VolumeDependencyTests-9485720 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e7c77a01-4260-4bd7-8300-3c4d107fa9af(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86512) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 18:33:40 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[83fd9b56-c35c-452c-bbfe-6fbfa2ded5ad]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:33:40 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-108d28cb-c757-48e2-afbb-de02a93e59a3 tempest-VolumeDependencyTests-9485720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e7c77a01-4260-4bd7-8300-3c4d107fa9af {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:33:40 devstack sudo[105183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e7c77a01-4260-4bd7-8300-3c4d107fa9af Sep 29 18:33:40 devstack sudo[105183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:33:40 devstack sudo[105183]: pam_unix(sudo:session): session closed for user root Sep 29 18:33:40 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-108d28cb-c757-48e2-afbb-de02a93e59a3 tempest-VolumeDependencyTests-9485720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e7c77a01-4260-4bd7-8300-3c4d107fa9af" returned: 0 in 0.342s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:33:40 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-108d28cb-c757-48e2-afbb-de02a93e59a3 tempest-VolumeDependencyTests-9485720 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e7c77a01-4260-4bd7-8300-3c4d107fa9af {{(pid=86512) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 29 18:33:40 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-108d28cb-c757-48e2-afbb-de02a93e59a3 tempest-VolumeDependencyTests-9485720 None] Creating direct copy from snapshot {{(pid=86512) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 29 18:33:40 devstack cinder-volume[86512]: DEBUG cinder.utils [None req-108d28cb-c757-48e2-afbb-de02a93e59a3 tempest-VolumeDependencyTests-9485720 None] Path /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-666d811a-06a5-4390-9dfd-03f94b996dcf not found in is_blk_device check {{(pid=86512) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 29 18:33:40 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-108d28cb-c757-48e2-afbb-de02a93e59a3 tempest-VolumeDependencyTests-9485720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e7c77a01-4260-4bd7-8300-3c4d107fa9af /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-666d811a-06a5-4390-9dfd-03f94b996dcf {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:33:40 devstack sudo[105188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e7c77a01-4260-4bd7-8300-3c4d107fa9af /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-666d811a-06a5-4390-9dfd-03f94b996dcf Sep 29 18:33:40 devstack sudo[105188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:33:41 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-39e22d0a-2050-4965-acef-ffbf37593e3e tempest-VolumesSnapshotTestJSON-1354260036 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:33:46 devstack sudo[105188]: pam_unix(sudo:session): session closed for user root Sep 29 18:33:46 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-108d28cb-c757-48e2-afbb-de02a93e59a3 tempest-VolumeDependencyTests-9485720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e7c77a01-4260-4bd7-8300-3c4d107fa9af /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-666d811a-06a5-4390-9dfd-03f94b996dcf" returned: 0 in 6.336s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:33:46 devstack cinder-volume[86512]: DEBUG cinder.image.image_utils [None req-108d28cb-c757-48e2-afbb-de02a93e59a3 tempest-VolumeDependencyTests-9485720 None] Image conversion details: src /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e7c77a01-4260-4bd7-8300-3c4d107fa9af, size 1024.00 MB, duration 6.34 sec, destination /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-666d811a-06a5-4390-9dfd-03f94b996dcf {{(pid=86512) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 29 18:33:46 devstack cinder-volume[86512]: INFO cinder.image.image_utils [None req-108d28cb-c757-48e2-afbb-de02a93e59a3 tempest-VolumeDependencyTests-9485720 None] Converted 1024.00 MB image at 161.60 MB/s Sep 29 18:33:46 devstack cinder-volume[86512]: WARNING cinder.volume.drivers.remotefs [None req-108d28cb-c757-48e2-afbb-de02a93e59a3 tempest-VolumeDependencyTests-9485720 None] /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-666d811a-06a5-4390-9dfd-03f94b996dcf is being set with open permissions: ugo+rw Sep 29 18:33:46 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-108d28cb-c757-48e2-afbb-de02a93e59a3 tempest-VolumeDependencyTests-9485720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-666d811a-06a5-4390-9dfd-03f94b996dcf {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:33:46 devstack sudo[105202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-666d811a-06a5-4390-9dfd-03f94b996dcf Sep 29 18:33:46 devstack sudo[105202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:33:46 devstack sudo[105202]: pam_unix(sudo:session): session closed for user root Sep 29 18:33:46 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-108d28cb-c757-48e2-afbb-de02a93e59a3 tempest-VolumeDependencyTests-9485720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-666d811a-06a5-4390-9dfd-03f94b996dcf" returned: 0 in 0.235s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:33:46 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-108d28cb-c757-48e2-afbb-de02a93e59a3 tempest-VolumeDependencyTests-9485720 None] Lock "cinder-quobyte-666d811a-06a5-4390-9dfd-03f94b996dcf" released by "_copy_volume_from_snapshot" :: held 7.343s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:33:46 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-108d28cb-c757-48e2-afbb-de02a93e59a3 tempest-VolumeDependencyTests-9485720 None] Lock "cinder-quobyte-e659cb2e-f7b5-44b6-b390-3dfcdc126b2e-666d811a-06a5-4390-9dfd-03f94b996dcf" released by "_create_volume_from_snapshot" :: held 7.411s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:33:46 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-108d28cb-c757-48e2-afbb-de02a93e59a3 tempest-VolumeDependencyTests-9485720 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.448s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:33:46 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-39e22d0a-2050-4965-acef-ffbf37593e3e tempest-VolumesSnapshotTestJSON-1354260036 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.763s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:33:46 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-39e22d0a-2050-4965-acef-ffbf37593e3e tempest-VolumesSnapshotTestJSON-1354260036 None] Creating offline snapshot f3454cb1-d2cb-43d8-8f51-4f8364297d39 of volume e667038a-486d-4b1e-99d9-b63db5fa82c6 {{(pid=86512) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 18:33:47 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-108d28cb-c757-48e2-afbb-de02a93e59a3 tempest-VolumeDependencyTests-9485720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bef96e5c-e80e-45e6-9df1-644dc7e1ba1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-666d811a-06a5-4390-9dfd-03f94b996dcf', 'volume_size': 1, 'snapshot_id': 'e659cb2e-f7b5-44b6-b390-3dfcdc126b2e'}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:33:47 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-108d28cb-c757-48e2-afbb-de02a93e59a3 tempest-VolumeDependencyTests-9485720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cdcc0e3-eeb4-4ed9-9c61-5a66d98a2f1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:33:47 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4915a4d-e6a4-4090-acd7-4f974ce2b5ae]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:33:47 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-39e22d0a-2050-4965-acef-ffbf37593e3e tempest-VolumesSnapshotTestJSON-1354260036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e667038a-486d-4b1e-99d9-b63db5fa82c6 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:33:47 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-108d28cb-c757-48e2-afbb-de02a93e59a3 tempest-VolumeDependencyTests-9485720 None] Volume volume-666d811a-06a5-4390-9dfd-03f94b996dcf (666d811a-06a5-4390-9dfd-03f94b996dcf): created successfully Sep 29 18:33:47 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-108d28cb-c757-48e2-afbb-de02a93e59a3 tempest-VolumeDependencyTests-9485720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cdcc0e3-eeb4-4ed9-9c61-5a66d98a2f1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:33:47 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-108d28cb-c757-48e2-afbb-de02a93e59a3 tempest-VolumeDependencyTests-9485720 None] Flow 'volume_create_manager' (9a9e5132-bf78-4e66-8cc3-2db31ac2d473) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:33:47 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-108d28cb-c757-48e2-afbb-de02a93e59a3 tempest-VolumeDependencyTests-9485720 None] Created volume successfully. Sep 29 18:33:47 devstack sudo[105205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e667038a-486d-4b1e-99d9-b63db5fa82c6 Sep 29 18:33:47 devstack sudo[105205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:33:47 devstack sudo[105205]: pam_unix(sudo:session): session closed for user root Sep 29 18:33:47 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-39e22d0a-2050-4965-acef-ffbf37593e3e tempest-VolumesSnapshotTestJSON-1354260036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e667038a-486d-4b1e-99d9-b63db5fa82c6" returned: 0 in 0.353s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:33:47 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-39e22d0a-2050-4965-acef-ffbf37593e3e tempest-VolumesSnapshotTestJSON-1354260036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e667038a-486d-4b1e-99d9-b63db5fa82c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e667038a-486d-4b1e-99d9-b63db5fa82c6.f3454cb1-d2cb-43d8-8f51-4f8364297d39 1G {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:33:47 devstack sudo[105246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e667038a-486d-4b1e-99d9-b63db5fa82c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e667038a-486d-4b1e-99d9-b63db5fa82c6.f3454cb1-d2cb-43d8-8f51-4f8364297d39 1G Sep 29 18:33:47 devstack sudo[105246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:33:47 devstack sudo[105246]: pam_unix(sudo:session): session closed for user root Sep 29 18:33:47 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-39e22d0a-2050-4965-acef-ffbf37593e3e tempest-VolumesSnapshotTestJSON-1354260036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e667038a-486d-4b1e-99d9-b63db5fa82c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e667038a-486d-4b1e-99d9-b63db5fa82c6.f3454cb1-d2cb-43d8-8f51-4f8364297d39 1G" returned: 0 in 0.373s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:33:47 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-39e22d0a-2050-4965-acef-ffbf37593e3e tempest-VolumesSnapshotTestJSON-1354260036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e667038a-486d-4b1e-99d9-b63db5fa82c6 -F qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e667038a-486d-4b1e-99d9-b63db5fa82c6.f3454cb1-d2cb-43d8-8f51-4f8364297d39 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:33:47 devstack sudo[105251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e667038a-486d-4b1e-99d9-b63db5fa82c6 -F qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e667038a-486d-4b1e-99d9-b63db5fa82c6.f3454cb1-d2cb-43d8-8f51-4f8364297d39 Sep 29 18:33:47 devstack sudo[105251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:33:47 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-87b2b6ff-295c-4128-af95-47277173c959 tempest-VolumeDependencyTests-9485720 None] Acquiring lock "cinder-e659cb2e-f7b5-44b6-b390-3dfcdc126b2e-delete_snapshot" by "delete_snapshot" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:33:47 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-87b2b6ff-295c-4128-af95-47277173c959 tempest-VolumeDependencyTests-9485720 None] Lock "cinder-e659cb2e-f7b5-44b6-b390-3dfcdc126b2e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:33:47 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-87b2b6ff-295c-4128-af95-47277173c959 tempest-VolumeDependencyTests-9485720 None] Acquiring lock "cinder-quobyte-e7c77a01-4260-4bd7-8300-3c4d107fa9af" by "delete_snapshot" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:33:47 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-87b2b6ff-295c-4128-af95-47277173c959 tempest-VolumeDependencyTests-9485720 None] Lock "cinder-quobyte-e7c77a01-4260-4bd7-8300-3c4d107fa9af" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:33:47 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-87b2b6ff-295c-4128-af95-47277173c959 tempest-VolumeDependencyTests-9485720 None] Acquiring lock "cinder-quobyte-e659cb2e-f7b5-44b6-b390-3dfcdc126b2e" by "_delete_snapshot" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:33:47 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-87b2b6ff-295c-4128-af95-47277173c959 tempest-VolumeDependencyTests-9485720 None] Lock "cinder-quobyte-e659cb2e-f7b5-44b6-b390-3dfcdc126b2e" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:33:47 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-87b2b6ff-295c-4128-af95-47277173c959 tempest-VolumeDependencyTests-9485720 None] Deleting offline snapshot e659cb2e-f7b5-44b6-b390-3dfcdc126b2e of volume e7c77a01-4260-4bd7-8300-3c4d107fa9af {{(pid=86512) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 18:33:47 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-87b2b6ff-295c-4128-af95-47277173c959 tempest-VolumeDependencyTests-9485720 None] snapshot_file for this snap is: volume-e7c77a01-4260-4bd7-8300-3c4d107fa9af.e659cb2e-f7b5-44b6-b390-3dfcdc126b2e {{(pid=86512) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 18:33:47 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[e07c53d4-ba60-438a-8f5d-8a73b62bea5e]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:33:47 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-87b2b6ff-295c-4128-af95-47277173c959 tempest-VolumeDependencyTests-9485720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e7c77a01-4260-4bd7-8300-3c4d107fa9af.e659cb2e-f7b5-44b6-b390-3dfcdc126b2e {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:33:48 devstack sudo[105251]: pam_unix(sudo:session): session closed for user root Sep 29 18:33:48 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-39e22d0a-2050-4965-acef-ffbf37593e3e tempest-VolumesSnapshotTestJSON-1354260036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e667038a-486d-4b1e-99d9-b63db5fa82c6 -F qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e667038a-486d-4b1e-99d9-b63db5fa82c6.f3454cb1-d2cb-43d8-8f51-4f8364297d39" returned: 0 in 0.293s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:33:48 devstack cinder-volume[86512]: WARNING cinder.volume.drivers.remotefs [None req-39e22d0a-2050-4965-acef-ffbf37593e3e tempest-VolumesSnapshotTestJSON-1354260036 None] /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e667038a-486d-4b1e-99d9-b63db5fa82c6.f3454cb1-d2cb-43d8-8f51-4f8364297d39 is being set with open permissions: ugo+rw Sep 29 18:33:48 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-39e22d0a-2050-4965-acef-ffbf37593e3e tempest-VolumesSnapshotTestJSON-1354260036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e667038a-486d-4b1e-99d9-b63db5fa82c6.f3454cb1-d2cb-43d8-8f51-4f8364297d39 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:33:48 devstack sudo[105257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e667038a-486d-4b1e-99d9-b63db5fa82c6.f3454cb1-d2cb-43d8-8f51-4f8364297d39 Sep 29 18:33:48 devstack sudo[105257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:33:48 devstack sudo[105256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e7c77a01-4260-4bd7-8300-3c4d107fa9af.e659cb2e-f7b5-44b6-b390-3dfcdc126b2e Sep 29 18:33:48 devstack sudo[105256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:33:48 devstack sudo[105257]: pam_unix(sudo:session): session closed for user root Sep 29 18:33:48 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-39e22d0a-2050-4965-acef-ffbf37593e3e tempest-VolumesSnapshotTestJSON-1354260036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e667038a-486d-4b1e-99d9-b63db5fa82c6.f3454cb1-d2cb-43d8-8f51-4f8364297d39" returned: 0 in 0.254s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:33:48 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-39e22d0a-2050-4965-acef-ffbf37593e3e tempest-VolumesSnapshotTestJSON-1354260036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e667038a-486d-4b1e-99d9-b63db5fa82c6.info {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:33:48 devstack sudo[105256]: pam_unix(sudo:session): session closed for user root Sep 29 18:33:48 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-87b2b6ff-295c-4128-af95-47277173c959 tempest-VolumeDependencyTests-9485720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e7c77a01-4260-4bd7-8300-3c4d107fa9af.e659cb2e-f7b5-44b6-b390-3dfcdc126b2e" returned: 0 in 0.356s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:33:48 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-87b2b6ff-295c-4128-af95-47277173c959 tempest-VolumeDependencyTests-9485720 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e7c77a01-4260-4bd7-8300-3c4d107fa9af(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86512) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 18:33:48 devstack sudo[105265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e667038a-486d-4b1e-99d9-b63db5fa82c6.info Sep 29 18:33:48 devstack sudo[105265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:33:48 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fb82b9a-acea-427c-8583-1ef71b61d627]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:33:48 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-87b2b6ff-295c-4128-af95-47277173c959 tempest-VolumeDependencyTests-9485720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e7c77a01-4260-4bd7-8300-3c4d107fa9af {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:33:48 devstack sudo[105267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e7c77a01-4260-4bd7-8300-3c4d107fa9af Sep 29 18:33:48 devstack sudo[105267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:33:48 devstack sudo[105265]: pam_unix(sudo:session): session closed for user root Sep 29 18:33:48 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-39e22d0a-2050-4965-acef-ffbf37593e3e tempest-VolumesSnapshotTestJSON-1354260036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e667038a-486d-4b1e-99d9-b63db5fa82c6.info" returned: 0 in 0.246s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:33:48 devstack cinder-volume[86512]: WARNING cinder.volume.drivers.remotefs [None req-39e22d0a-2050-4965-acef-ffbf37593e3e tempest-VolumesSnapshotTestJSON-1354260036 None] /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e667038a-486d-4b1e-99d9-b63db5fa82c6.info is being set with open permissions: ugo+rw Sep 29 18:33:48 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-39e22d0a-2050-4965-acef-ffbf37593e3e tempest-VolumesSnapshotTestJSON-1354260036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e667038a-486d-4b1e-99d9-b63db5fa82c6.info {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:33:48 devstack sudo[105270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e667038a-486d-4b1e-99d9-b63db5fa82c6.info Sep 29 18:33:48 devstack sudo[105270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:33:48 devstack sudo[105270]: pam_unix(sudo:session): session closed for user root Sep 29 18:33:48 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-39e22d0a-2050-4965-acef-ffbf37593e3e tempest-VolumesSnapshotTestJSON-1354260036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e667038a-486d-4b1e-99d9-b63db5fa82c6.info" returned: 0 in 0.241s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:33:48 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-39e22d0a-2050-4965-acef-ffbf37593e3e tempest-VolumesSnapshotTestJSON-1354260036 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.859s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:33:48 devstack sudo[105267]: pam_unix(sudo:session): session closed for user root Sep 29 18:33:48 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-87b2b6ff-295c-4128-af95-47277173c959 tempest-VolumeDependencyTests-9485720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e7c77a01-4260-4bd7-8300-3c4d107fa9af" returned: 0 in 0.539s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:33:48 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-87b2b6ff-295c-4128-af95-47277173c959 tempest-VolumeDependencyTests-9485720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e7c77a01-4260-4bd7-8300-3c4d107fa9af.e659cb2e-f7b5-44b6-b390-3dfcdc126b2e {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:33:48 devstack sudo[105276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e7c77a01-4260-4bd7-8300-3c4d107fa9af.e659cb2e-f7b5-44b6-b390-3dfcdc126b2e Sep 29 18:33:48 devstack sudo[105276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:33:49 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-39e22d0a-2050-4965-acef-ffbf37593e3e tempest-VolumesSnapshotTestJSON-1354260036 None] Create snapshot completed successfully Sep 29 18:33:49 devstack sudo[105276]: pam_unix(sudo:session): session closed for user root Sep 29 18:33:49 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-87b2b6ff-295c-4128-af95-47277173c959 tempest-VolumeDependencyTests-9485720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e7c77a01-4260-4bd7-8300-3c4d107fa9af.e659cb2e-f7b5-44b6-b390-3dfcdc126b2e" returned: 0 in 0.311s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:33:49 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-87b2b6ff-295c-4128-af95-47277173c959 tempest-VolumeDependencyTests-9485720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e7c77a01-4260-4bd7-8300-3c4d107fa9af.e659cb2e-f7b5-44b6-b390-3dfcdc126b2e {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:33:49 devstack sudo[105281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e7c77a01-4260-4bd7-8300-3c4d107fa9af.e659cb2e-f7b5-44b6-b390-3dfcdc126b2e Sep 29 18:33:49 devstack sudo[105281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:33:49 devstack sudo[105281]: pam_unix(sudo:session): session closed for user root Sep 29 18:33:49 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-87b2b6ff-295c-4128-af95-47277173c959 tempest-VolumeDependencyTests-9485720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e7c77a01-4260-4bd7-8300-3c4d107fa9af.e659cb2e-f7b5-44b6-b390-3dfcdc126b2e" returned: 0 in 0.232s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:33:49 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-87b2b6ff-295c-4128-af95-47277173c959 tempest-VolumeDependencyTests-9485720 None] Lock "cinder-quobyte-e659cb2e-f7b5-44b6-b390-3dfcdc126b2e" released by "_delete_snapshot" :: held 1.547s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:33:49 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-87b2b6ff-295c-4128-af95-47277173c959 tempest-VolumeDependencyTests-9485720 None] Lock "cinder-quobyte-e7c77a01-4260-4bd7-8300-3c4d107fa9af" released by "delete_snapshot" :: held 1.568s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:33:49 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-87b2b6ff-295c-4128-af95-47277173c959 tempest-VolumeDependencyTests-9485720 None] Created reservations ['92d29896-7cbf-4a5b-b549-a5a76cbfdd9e', '916b561c-c6a6-4c75-94be-7e8ecbc35e6d', '5c6ee9f5-1772-47e6-8386-d0b238dc2171', 'eacc86bb-f3c0-46c6-9a86-6e402fafb560'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:33:49 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-87b2b6ff-295c-4128-af95-47277173c959 tempest-VolumeDependencyTests-9485720 None] Delete snapshot completed successfully. Sep 29 18:33:49 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-87b2b6ff-295c-4128-af95-47277173c959 tempest-VolumeDependencyTests-9485720 None] Lock "cinder-e659cb2e-f7b5-44b6-b390-3dfcdc126b2e-delete_snapshot" released by "delete_snapshot" :: held 1.702s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:33:49 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-e046f7dc-6375-4150-9043-b2d79ad8b349 tempest-VolumesSnapshotTestJSON-1354260036 None] Acquiring lock "cinder-f3454cb1-d2cb-43d8-8f51-4f8364297d39-delete_snapshot" by "delete_snapshot" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:33:49 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-e046f7dc-6375-4150-9043-b2d79ad8b349 tempest-VolumesSnapshotTestJSON-1354260036 None] Lock "cinder-f3454cb1-d2cb-43d8-8f51-4f8364297d39-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:33:49 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-e046f7dc-6375-4150-9043-b2d79ad8b349 tempest-VolumesSnapshotTestJSON-1354260036 None] Acquiring lock "cinder-quobyte-e667038a-486d-4b1e-99d9-b63db5fa82c6" by "delete_snapshot" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:33:49 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-e046f7dc-6375-4150-9043-b2d79ad8b349 tempest-VolumesSnapshotTestJSON-1354260036 None] Lock "cinder-quobyte-e667038a-486d-4b1e-99d9-b63db5fa82c6" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:33:49 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-e046f7dc-6375-4150-9043-b2d79ad8b349 tempest-VolumesSnapshotTestJSON-1354260036 None] Acquiring lock "cinder-quobyte-f3454cb1-d2cb-43d8-8f51-4f8364297d39" by "_delete_snapshot" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:33:49 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-e046f7dc-6375-4150-9043-b2d79ad8b349 tempest-VolumesSnapshotTestJSON-1354260036 None] Lock "cinder-quobyte-f3454cb1-d2cb-43d8-8f51-4f8364297d39" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:33:49 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-e046f7dc-6375-4150-9043-b2d79ad8b349 tempest-VolumesSnapshotTestJSON-1354260036 None] Deleting offline snapshot f3454cb1-d2cb-43d8-8f51-4f8364297d39 of volume e667038a-486d-4b1e-99d9-b63db5fa82c6 {{(pid=86512) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 18:33:49 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-e046f7dc-6375-4150-9043-b2d79ad8b349 tempest-VolumesSnapshotTestJSON-1354260036 None] snapshot_file for this snap is: volume-e667038a-486d-4b1e-99d9-b63db5fa82c6.f3454cb1-d2cb-43d8-8f51-4f8364297d39 {{(pid=86512) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 18:33:49 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[b64051a4-d7e5-4def-bd21-1d3727b1481c]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:33:49 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-e046f7dc-6375-4150-9043-b2d79ad8b349 tempest-VolumesSnapshotTestJSON-1354260036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e667038a-486d-4b1e-99d9-b63db5fa82c6.f3454cb1-d2cb-43d8-8f51-4f8364297d39 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:33:49 devstack sudo[105284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e667038a-486d-4b1e-99d9-b63db5fa82c6.f3454cb1-d2cb-43d8-8f51-4f8364297d39 Sep 29 18:33:49 devstack sudo[105284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:33:50 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-0098869f-6b16-41f7-9cab-9e6591712e63 tempest-VolumeDependencyTests-9485720 None] Acquiring lock "cinder-e7c77a01-4260-4bd7-8300-3c4d107fa9af-delete_volume" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:33:50 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-0098869f-6b16-41f7-9cab-9e6591712e63 tempest-VolumeDependencyTests-9485720 None] Lock "cinder-e7c77a01-4260-4bd7-8300-3c4d107fa9af-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:33:50 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-0098869f-6b16-41f7-9cab-9e6591712e63 tempest-VolumeDependencyTests-9485720 None] Acquiring lock "cinder-quobyte-e7c77a01-4260-4bd7-8300-3c4d107fa9af" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:33:50 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-0098869f-6b16-41f7-9cab-9e6591712e63 tempest-VolumeDependencyTests-9485720 None] Lock "cinder-quobyte-e7c77a01-4260-4bd7-8300-3c4d107fa9af" acquired by "delete_volume" :: waited 0.020s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:33:50 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a8a4aae-94c3-4bb4-9cef-4f56bf621b77]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:33:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-0098869f-6b16-41f7-9cab-9e6591712e63 tempest-VolumeDependencyTests-9485720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e7c77a01-4260-4bd7-8300-3c4d107fa9af {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:33:50 devstack sudo[105284]: pam_unix(sudo:session): session closed for user root Sep 29 18:33:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-e046f7dc-6375-4150-9043-b2d79ad8b349 tempest-VolumesSnapshotTestJSON-1354260036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e667038a-486d-4b1e-99d9-b63db5fa82c6.f3454cb1-d2cb-43d8-8f51-4f8364297d39" returned: 0 in 0.380s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:33:50 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-e046f7dc-6375-4150-9043-b2d79ad8b349 tempest-VolumesSnapshotTestJSON-1354260036 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e667038a-486d-4b1e-99d9-b63db5fa82c6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86512) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 18:33:50 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[7657352a-1709-485a-8835-5692815ebfd5]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:33:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-e046f7dc-6375-4150-9043-b2d79ad8b349 tempest-VolumesSnapshotTestJSON-1354260036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e667038a-486d-4b1e-99d9-b63db5fa82c6 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:33:50 devstack sudo[105289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e7c77a01-4260-4bd7-8300-3c4d107fa9af Sep 29 18:33:50 devstack sudo[105289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:33:50 devstack sudo[105290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e667038a-486d-4b1e-99d9-b63db5fa82c6 Sep 29 18:33:50 devstack sudo[105290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:33:50 devstack sudo[105289]: pam_unix(sudo:session): session closed for user root Sep 29 18:33:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-0098869f-6b16-41f7-9cab-9e6591712e63 tempest-VolumeDependencyTests-9485720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e7c77a01-4260-4bd7-8300-3c4d107fa9af" returned: 0 in 0.366s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:33:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-0098869f-6b16-41f7-9cab-9e6591712e63 tempest-VolumeDependencyTests-9485720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e7c77a01-4260-4bd7-8300-3c4d107fa9af {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:33:50 devstack sudo[105290]: pam_unix(sudo:session): session closed for user root Sep 29 18:33:50 devstack sudo[105300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e7c77a01-4260-4bd7-8300-3c4d107fa9af Sep 29 18:33:50 devstack sudo[105300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:33:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-e046f7dc-6375-4150-9043-b2d79ad8b349 tempest-VolumesSnapshotTestJSON-1354260036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e667038a-486d-4b1e-99d9-b63db5fa82c6" returned: 0 in 0.362s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:33:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-e046f7dc-6375-4150-9043-b2d79ad8b349 tempest-VolumesSnapshotTestJSON-1354260036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e667038a-486d-4b1e-99d9-b63db5fa82c6.f3454cb1-d2cb-43d8-8f51-4f8364297d39 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:33:50 devstack sudo[105302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e667038a-486d-4b1e-99d9-b63db5fa82c6.f3454cb1-d2cb-43d8-8f51-4f8364297d39 Sep 29 18:33:50 devstack sudo[105302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:33:50 devstack cinder-volume[86512]: DEBUG oslo_service.periodic_task [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86512) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 18:33:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:33:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:33:50 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:33:50 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:33:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:33:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:33:50 devstack sudo[105304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:33:50 devstack sudo[105304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:33:50 devstack sudo[105300]: pam_unix(sudo:session): session closed for user root Sep 29 18:33:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-0098869f-6b16-41f7-9cab-9e6591712e63 tempest-VolumeDependencyTests-9485720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e7c77a01-4260-4bd7-8300-3c4d107fa9af" returned: 0 in 0.267s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:33:50 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-0098869f-6b16-41f7-9cab-9e6591712e63 tempest-VolumeDependencyTests-9485720 None] Lock "cinder-quobyte-e7c77a01-4260-4bd7-8300-3c4d107fa9af" released by "delete_volume" :: held 0.700s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:33:50 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-0098869f-6b16-41f7-9cab-9e6591712e63 tempest-VolumeDependencyTests-9485720 None] Created reservations ['5b953129-2b0f-482e-9a2b-a6399f46d157', '393a4bc4-4d63-4391-b6b5-70ef2e4ee638', 'e68bf96e-f555-4d43-8bf5-eaf2409c9eb7', '38e87668-bd64-43c6-9a4d-3f99b50227c8'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:33:50 devstack sudo[105304]: pam_unix(sudo:session): session closed for user root Sep 29 18:33:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.276s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:33:50 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:33:50 devstack cinder-volume[86512]: DEBUG oslo_service.periodic_task [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Running periodic task VolumeManager._thread_info {{(pid=86512) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 18:33:50 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] thread count: 29 {{(pid=86512) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 29 18:33:50 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] thread info: [<_MainThread(MainThread, started 135593654804608)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86512) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 29 18:33:50 devstack sudo[105302]: pam_unix(sudo:session): session closed for user root Sep 29 18:33:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-e046f7dc-6375-4150-9043-b2d79ad8b349 tempest-VolumesSnapshotTestJSON-1354260036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e667038a-486d-4b1e-99d9-b63db5fa82c6.f3454cb1-d2cb-43d8-8f51-4f8364297d39" returned: 0 in 0.386s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:33:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-e046f7dc-6375-4150-9043-b2d79ad8b349 tempest-VolumesSnapshotTestJSON-1354260036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e667038a-486d-4b1e-99d9-b63db5fa82c6.f3454cb1-d2cb-43d8-8f51-4f8364297d39 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:33:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-0098869f-6b16-41f7-9cab-9e6591712e63 tempest-VolumeDependencyTests-9485720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:33:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-0098869f-6b16-41f7-9cab-9e6591712e63 tempest-VolumeDependencyTests-9485720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:33:50 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-0098869f-6b16-41f7-9cab-9e6591712e63 tempest-VolumeDependencyTests-9485720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:33:50 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-0098869f-6b16-41f7-9cab-9e6591712e63 tempest-VolumeDependencyTests-9485720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:33:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-0098869f-6b16-41f7-9cab-9e6591712e63 tempest-VolumeDependencyTests-9485720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:33:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-0098869f-6b16-41f7-9cab-9e6591712e63 tempest-VolumeDependencyTests-9485720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:33:50 devstack sudo[105312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e667038a-486d-4b1e-99d9-b63db5fa82c6.f3454cb1-d2cb-43d8-8f51-4f8364297d39 Sep 29 18:33:50 devstack sudo[105312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:33:51 devstack sudo[105313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:33:51 devstack sudo[105313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:33:51 devstack sudo[105312]: pam_unix(sudo:session): session closed for user root Sep 29 18:33:51 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-e046f7dc-6375-4150-9043-b2d79ad8b349 tempest-VolumesSnapshotTestJSON-1354260036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e667038a-486d-4b1e-99d9-b63db5fa82c6.f3454cb1-d2cb-43d8-8f51-4f8364297d39" returned: 0 in 0.248s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:33:51 devstack sudo[105313]: pam_unix(sudo:session): session closed for user root Sep 29 18:33:51 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-a3f08ad0-e66f-452c-8804-00e0702fc3e3 tempest-VolumeDependencyTests-9485720 None] Acquiring lock "cinder-666d811a-06a5-4390-9dfd-03f94b996dcf-delete_volume" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:33:51 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-0098869f-6b16-41f7-9cab-9e6591712e63 tempest-VolumeDependencyTests-9485720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.287s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:33:51 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-0098869f-6b16-41f7-9cab-9e6591712e63 tempest-VolumeDependencyTests-9485720 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:33:51 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-e046f7dc-6375-4150-9043-b2d79ad8b349 tempest-VolumesSnapshotTestJSON-1354260036 None] Lock "cinder-quobyte-f3454cb1-d2cb-43d8-8f51-4f8364297d39" released by "_delete_snapshot" :: held 1.502s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:33:51 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-0098869f-6b16-41f7-9cab-9e6591712e63 tempest-VolumeDependencyTests-9485720 None] Deleted volume successfully. Sep 29 18:33:51 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-e046f7dc-6375-4150-9043-b2d79ad8b349 tempest-VolumesSnapshotTestJSON-1354260036 None] Lock "cinder-quobyte-e667038a-486d-4b1e-99d9-b63db5fa82c6" released by "delete_snapshot" :: held 1.526s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:33:51 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-a3f08ad0-e66f-452c-8804-00e0702fc3e3 tempest-VolumeDependencyTests-9485720 None] Lock "cinder-666d811a-06a5-4390-9dfd-03f94b996dcf-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:33:51 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-0098869f-6b16-41f7-9cab-9e6591712e63 tempest-VolumeDependencyTests-9485720 None] Lock "cinder-e7c77a01-4260-4bd7-8300-3c4d107fa9af-delete_volume" released by "delete_volume" :: held 1.239s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:33:51 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-a3f08ad0-e66f-452c-8804-00e0702fc3e3 tempest-VolumeDependencyTests-9485720 None] Acquiring lock "cinder-quobyte-666d811a-06a5-4390-9dfd-03f94b996dcf" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:33:51 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-a3f08ad0-e66f-452c-8804-00e0702fc3e3 tempest-VolumeDependencyTests-9485720 None] Lock "cinder-quobyte-666d811a-06a5-4390-9dfd-03f94b996dcf" acquired by "delete_volume" :: waited 0.018s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:33:51 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-e046f7dc-6375-4150-9043-b2d79ad8b349 tempest-VolumesSnapshotTestJSON-1354260036 None] Created reservations ['a0faf1cd-81b2-4a33-9b07-9f78ebd112e8', '0e687242-b58c-4ce9-ab47-70dc71299b0b', 'd71d14fd-cb04-4c2a-959d-1f1659bc4feb', '0fec42e5-ef55-4211-9acc-a60f1723f8c2'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:33:51 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[5809ad6d-a2d5-45c2-a285-d4460ada7570]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:33:51 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a3f08ad0-e66f-452c-8804-00e0702fc3e3 tempest-VolumeDependencyTests-9485720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-666d811a-06a5-4390-9dfd-03f94b996dcf {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:33:51 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-e046f7dc-6375-4150-9043-b2d79ad8b349 tempest-VolumesSnapshotTestJSON-1354260036 None] Delete snapshot completed successfully. Sep 29 18:33:51 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-e046f7dc-6375-4150-9043-b2d79ad8b349 tempest-VolumesSnapshotTestJSON-1354260036 None] Lock "cinder-f3454cb1-d2cb-43d8-8f51-4f8364297d39-delete_snapshot" released by "delete_snapshot" :: held 1.740s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:33:51 devstack sudo[105318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-666d811a-06a5-4390-9dfd-03f94b996dcf Sep 29 18:33:51 devstack sudo[105318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:33:51 devstack sudo[105318]: pam_unix(sudo:session): session closed for user root Sep 29 18:33:51 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a3f08ad0-e66f-452c-8804-00e0702fc3e3 tempest-VolumeDependencyTests-9485720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-666d811a-06a5-4390-9dfd-03f94b996dcf" returned: 0 in 0.348s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:33:51 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a3f08ad0-e66f-452c-8804-00e0702fc3e3 tempest-VolumeDependencyTests-9485720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-666d811a-06a5-4390-9dfd-03f94b996dcf {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:33:51 devstack sudo[105323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-666d811a-06a5-4390-9dfd-03f94b996dcf Sep 29 18:33:51 devstack sudo[105323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:33:52 devstack sudo[105323]: pam_unix(sudo:session): session closed for user root Sep 29 18:33:52 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a3f08ad0-e66f-452c-8804-00e0702fc3e3 tempest-VolumeDependencyTests-9485720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-666d811a-06a5-4390-9dfd-03f94b996dcf" returned: 0 in 0.277s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:33:52 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-a3f08ad0-e66f-452c-8804-00e0702fc3e3 tempest-VolumeDependencyTests-9485720 None] Lock "cinder-quobyte-666d811a-06a5-4390-9dfd-03f94b996dcf" released by "delete_volume" :: held 0.672s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:33:52 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-a3f08ad0-e66f-452c-8804-00e0702fc3e3 tempest-VolumeDependencyTests-9485720 None] Created reservations ['a17e9f7a-c651-48da-aa49-b0b8f434276c', '04440993-a43d-460a-8f69-a39f71e0b7af', 'e0f07c1f-668e-4610-9a74-2a22a2c9b033', 'd032a318-b5fd-4023-b509-c866072d1728'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:33:52 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-a3f08ad0-e66f-452c-8804-00e0702fc3e3 tempest-VolumeDependencyTests-9485720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:33:52 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-a3f08ad0-e66f-452c-8804-00e0702fc3e3 tempest-VolumeDependencyTests-9485720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:33:52 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-a3f08ad0-e66f-452c-8804-00e0702fc3e3 tempest-VolumeDependencyTests-9485720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:33:52 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-a3f08ad0-e66f-452c-8804-00e0702fc3e3 tempest-VolumeDependencyTests-9485720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:33:52 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-a3f08ad0-e66f-452c-8804-00e0702fc3e3 tempest-VolumeDependencyTests-9485720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:33:52 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a3f08ad0-e66f-452c-8804-00e0702fc3e3 tempest-VolumeDependencyTests-9485720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:33:52 devstack sudo[105326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:33:52 devstack sudo[105326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:33:52 devstack sudo[105326]: pam_unix(sudo:session): session closed for user root Sep 29 18:33:52 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a3f08ad0-e66f-452c-8804-00e0702fc3e3 tempest-VolumeDependencyTests-9485720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.299s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:33:52 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-a3f08ad0-e66f-452c-8804-00e0702fc3e3 tempest-VolumeDependencyTests-9485720 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:33:52 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-61108558-06cd-49af-9b03-2c8917709b58 tempest-VolumesSnapshotTestJSON-1354260036 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86512) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:33:52 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-61108558-06cd-49af-9b03-2c8917709b58 tempest-VolumesSnapshotTestJSON-1354260036 None] Flow 'volume_create_manager' (684d2a8f-1dd0-497d-a53a-e1c9fb7fd823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:33:52 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-61108558-06cd-49af-9b03-2c8917709b58 tempest-VolumesSnapshotTestJSON-1354260036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (350c8f7c-5f49-49be-8f52-7765a8658e96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:33:52 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-a3f08ad0-e66f-452c-8804-00e0702fc3e3 tempest-VolumeDependencyTests-9485720 None] Deleted volume successfully. Sep 29 18:33:52 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-61108558-06cd-49af-9b03-2c8917709b58 tempest-VolumesSnapshotTestJSON-1354260036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (350c8f7c-5f49-49be-8f52-7765a8658e96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:33:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-625096449',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=864a1a13-9c44-4f4d-ab33-8bff690568ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd288a0f9bec4d359ab34e9f2079e2ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:33:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:33:52Z,use_quota=True,user_id='1efcc6a2f76e46dbae7d214b0f803523',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:33:52 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-61108558-06cd-49af-9b03-2c8917709b58 tempest-VolumesSnapshotTestJSON-1354260036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (961dda6f-8392-44f0-b6f0-69e12f926cd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:33:52 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-61108558-06cd-49af-9b03-2c8917709b58 tempest-VolumesSnapshotTestJSON-1354260036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (961dda6f-8392-44f0-b6f0-69e12f926cd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:33:52 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-61108558-06cd-49af-9b03-2c8917709b58 tempest-VolumesSnapshotTestJSON-1354260036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8d938db-2332-4d65-83bd-c2d8f409a294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:33:52 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-61108558-06cd-49af-9b03-2c8917709b58 tempest-VolumesSnapshotTestJSON-1354260036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8d938db-2332-4d65-83bd-c2d8f409a294) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '864a1a13-9c44-4f4d-ab33-8bff690568ec', 'volume_name': 'volume-864a1a13-9c44-4f4d-ab33-8bff690568ec', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:33:52 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-61108558-06cd-49af-9b03-2c8917709b58 tempest-VolumesSnapshotTestJSON-1354260036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (041ec4af-3d30-4e8c-9d0e-d8fcb9c57e63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:33:52 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-61108558-06cd-49af-9b03-2c8917709b58 tempest-VolumesSnapshotTestJSON-1354260036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (041ec4af-3d30-4e8c-9d0e-d8fcb9c57e63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:33:52 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-61108558-06cd-49af-9b03-2c8917709b58 tempest-VolumesSnapshotTestJSON-1354260036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db23c814-3cea-4920-a717-43c2a5c4a435) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:33:52 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-61108558-06cd-49af-9b03-2c8917709b58 tempest-VolumesSnapshotTestJSON-1354260036 None] Volume 864a1a13-9c44-4f4d-ab33-8bff690568ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-864a1a13-9c44-4f4d-ab33-8bff690568ec', 'volume_size': 1} Sep 29 18:33:52 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-61108558-06cd-49af-9b03-2c8917709b58 tempest-VolumesSnapshotTestJSON-1354260036 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:33:52 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-61108558-06cd-49af-9b03-2c8917709b58 tempest-VolumesSnapshotTestJSON-1354260036 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:33:52 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-61108558-06cd-49af-9b03-2c8917709b58 tempest-VolumesSnapshotTestJSON-1354260036 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:33:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-625096449',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=864a1a13-9c44-4f4d-ab33-8bff690568ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd288a0f9bec4d359ab34e9f2079e2ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:33:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:33:52Z,use_quota=True,user_id='1efcc6a2f76e46dbae7d214b0f803523',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)}" {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:33:52 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-61108558-06cd-49af-9b03-2c8917709b58 tempest-VolumesSnapshotTestJSON-1354260036 None] Creating volume 864a1a13-9c44-4f4d-ab33-8bff690568ec {{(pid=86512) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:33:52 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-61108558-06cd-49af-9b03-2c8917709b58 tempest-VolumesSnapshotTestJSON-1354260036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:33:52 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-61108558-06cd-49af-9b03-2c8917709b58 tempest-VolumesSnapshotTestJSON-1354260036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:33:52 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-61108558-06cd-49af-9b03-2c8917709b58 tempest-VolumesSnapshotTestJSON-1354260036 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:33:52 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-61108558-06cd-49af-9b03-2c8917709b58 tempest-VolumesSnapshotTestJSON-1354260036 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:33:52 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-61108558-06cd-49af-9b03-2c8917709b58 tempest-VolumesSnapshotTestJSON-1354260036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:33:52 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-61108558-06cd-49af-9b03-2c8917709b58 tempest-VolumesSnapshotTestJSON-1354260036 None] Selected osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 as target Quobyte volume. {{(pid=86512) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:33:52 devstack cinder-volume[86512]: INFO cinder.volume.drivers.remotefs [None req-61108558-06cd-49af-9b03-2c8917709b58 tempest-VolumesSnapshotTestJSON-1354260036 None] casted to osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 Sep 29 18:33:52 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-61108558-06cd-49af-9b03-2c8917709b58 tempest-VolumesSnapshotTestJSON-1354260036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-864a1a13-9c44-4f4d-ab33-8bff690568ec 1073741824 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:33:52 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-a3f08ad0-e66f-452c-8804-00e0702fc3e3 tempest-VolumeDependencyTests-9485720 None] Lock "cinder-666d811a-06a5-4390-9dfd-03f94b996dcf-delete_volume" released by "delete_volume" :: held 1.300s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:33:52 devstack sudo[105329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-864a1a13-9c44-4f4d-ab33-8bff690568ec 1073741824 Sep 29 18:33:52 devstack sudo[105329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:33:53 devstack sudo[105329]: pam_unix(sudo:session): session closed for user root Sep 29 18:33:53 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-61108558-06cd-49af-9b03-2c8917709b58 tempest-VolumesSnapshotTestJSON-1354260036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-864a1a13-9c44-4f4d-ab33-8bff690568ec 1073741824" returned: 0 in 0.456s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:33:53 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-61108558-06cd-49af-9b03-2c8917709b58 tempest-VolumesSnapshotTestJSON-1354260036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-864a1a13-9c44-4f4d-ab33-8bff690568ec {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:33:53 devstack sudo[105334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-864a1a13-9c44-4f4d-ab33-8bff690568ec Sep 29 18:33:53 devstack sudo[105334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:33:53 devstack sudo[105334]: pam_unix(sudo:session): session closed for user root Sep 29 18:33:53 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-61108558-06cd-49af-9b03-2c8917709b58 tempest-VolumesSnapshotTestJSON-1354260036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-864a1a13-9c44-4f4d-ab33-8bff690568ec" returned: 0 in 0.260s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:33:53 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-61108558-06cd-49af-9b03-2c8917709b58 tempest-VolumesSnapshotTestJSON-1354260036 None] <== create_volume: return (761ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'} {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:33:53 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-61108558-06cd-49af-9b03-2c8917709b58 tempest-VolumesSnapshotTestJSON-1354260036 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.763s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:33:53 devstack cinder-volume[86512]: DEBUG dbcounter [-] [86512] Writing DB stats cinder:SELECT=103,cinder:UPDATE=112,cinder:INSERT=25,cinder:DELETE=3 {{(pid=86512) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 18:33:53 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-61108558-06cd-49af-9b03-2c8917709b58 tempest-VolumesSnapshotTestJSON-1354260036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db23c814-3cea-4920-a717-43c2a5c4a435) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-864a1a13-9c44-4f4d-ab33-8bff690568ec', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:33:53 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-61108558-06cd-49af-9b03-2c8917709b58 tempest-VolumesSnapshotTestJSON-1354260036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26af0e20-35e1-4efe-9868-c97d663ad0fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:33:53 devstack cinder-volume[86512]: DEBUG dbcounter [-] [86512] Writing DB stats cinder:SELECT=96,cinder:UPDATE=124,cinder:INSERT=31,cinder:DELETE=17 {{(pid=86512) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 18:33:53 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-61108558-06cd-49af-9b03-2c8917709b58 tempest-VolumesSnapshotTestJSON-1354260036 None] Volume volume-864a1a13-9c44-4f4d-ab33-8bff690568ec (864a1a13-9c44-4f4d-ab33-8bff690568ec): created successfully Sep 29 18:33:53 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-61108558-06cd-49af-9b03-2c8917709b58 tempest-VolumesSnapshotTestJSON-1354260036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26af0e20-35e1-4efe-9868-c97d663ad0fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:33:53 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-61108558-06cd-49af-9b03-2c8917709b58 tempest-VolumesSnapshotTestJSON-1354260036 None] Flow 'volume_create_manager' (684d2a8f-1dd0-497d-a53a-e1c9fb7fd823) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:33:53 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-61108558-06cd-49af-9b03-2c8917709b58 tempest-VolumesSnapshotTestJSON-1354260036 None] Created volume successfully. Sep 29 18:33:54 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-2670d6f2-e40b-4e38-9bc8-c5bb96a17fc9 tempest-VolumesSnapshotTestJSON-1354260036 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:33:54 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-2670d6f2-e40b-4e38-9bc8-c5bb96a17fc9 tempest-VolumesSnapshotTestJSON-1354260036 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:33:54 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-2670d6f2-e40b-4e38-9bc8-c5bb96a17fc9 tempest-VolumesSnapshotTestJSON-1354260036 None] Creating offline snapshot 2f3dc10c-7c59-4058-ad41-48af689084db of volume 864a1a13-9c44-4f4d-ab33-8bff690568ec {{(pid=86512) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 18:33:54 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[493aa712-6b25-4090-9f1a-308243814ae9]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:33:54 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-2670d6f2-e40b-4e38-9bc8-c5bb96a17fc9 tempest-VolumesSnapshotTestJSON-1354260036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-864a1a13-9c44-4f4d-ab33-8bff690568ec {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:33:54 devstack sudo[105338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-864a1a13-9c44-4f4d-ab33-8bff690568ec Sep 29 18:33:54 devstack sudo[105338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:33:55 devstack sudo[105338]: pam_unix(sudo:session): session closed for user root Sep 29 18:33:55 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-2670d6f2-e40b-4e38-9bc8-c5bb96a17fc9 tempest-VolumesSnapshotTestJSON-1354260036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-864a1a13-9c44-4f4d-ab33-8bff690568ec" returned: 0 in 0.412s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:33:55 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-2670d6f2-e40b-4e38-9bc8-c5bb96a17fc9 tempest-VolumesSnapshotTestJSON-1354260036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-864a1a13-9c44-4f4d-ab33-8bff690568ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-864a1a13-9c44-4f4d-ab33-8bff690568ec.2f3dc10c-7c59-4058-ad41-48af689084db 1G {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:33:55 devstack sudo[105343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-864a1a13-9c44-4f4d-ab33-8bff690568ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-864a1a13-9c44-4f4d-ab33-8bff690568ec.2f3dc10c-7c59-4058-ad41-48af689084db 1G Sep 29 18:33:55 devstack sudo[105343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:33:55 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-51d3805d-11d6-42f6-b6f5-16817527404f tempest-CinderUnicodeTest-1774923702 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86512) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:33:55 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-51d3805d-11d6-42f6-b6f5-16817527404f tempest-CinderUnicodeTest-1774923702 None] Flow 'volume_create_manager' (0629f25c-f33b-41f0-95e1-aedd012a478a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:33:55 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-51d3805d-11d6-42f6-b6f5-16817527404f tempest-CinderUnicodeTest-1774923702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4918e707-5ccd-41f3-a462-29ce3fbb129f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:33:55 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-51d3805d-11d6-42f6-b6f5-16817527404f tempest-CinderUnicodeTest-1774923702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4918e707-5ccd-41f3-a462-29ce3fbb129f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:33:55Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b0fe5b9-2be1-4d3f-9261-32037b5f216e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5133b6c4a84445f8ad80dcfffc6372c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:33:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:33:55Z,use_quota=True,user_id='a4f3c54e724a46faaf1680f7902f04c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:33:55 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-51d3805d-11d6-42f6-b6f5-16817527404f tempest-CinderUnicodeTest-1774923702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddb4bb05-49d6-4d60-b8bd-f9a6f06c48e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:33:55 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-51d3805d-11d6-42f6-b6f5-16817527404f tempest-CinderUnicodeTest-1774923702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddb4bb05-49d6-4d60-b8bd-f9a6f06c48e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:33:55 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-51d3805d-11d6-42f6-b6f5-16817527404f tempest-CinderUnicodeTest-1774923702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ae16ae6-7ba5-401f-9d87-0a1f086ffb2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:33:55 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-51d3805d-11d6-42f6-b6f5-16817527404f tempest-CinderUnicodeTest-1774923702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ae16ae6-7ba5-401f-9d87-0a1f086ffb2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b0fe5b9-2be1-4d3f-9261-32037b5f216e', 'volume_name': 'volume-9b0fe5b9-2be1-4d3f-9261-32037b5f216e', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:33:55 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-51d3805d-11d6-42f6-b6f5-16817527404f tempest-CinderUnicodeTest-1774923702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6b855ef-1bd6-4332-81ab-dbdfe45202c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:33:55 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-51d3805d-11d6-42f6-b6f5-16817527404f tempest-CinderUnicodeTest-1774923702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6b855ef-1bd6-4332-81ab-dbdfe45202c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:33:55 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-51d3805d-11d6-42f6-b6f5-16817527404f tempest-CinderUnicodeTest-1774923702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf1ea064-ecfa-4867-9d2a-cf2fb7cab52f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:33:55 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-51d3805d-11d6-42f6-b6f5-16817527404f tempest-CinderUnicodeTest-1774923702 None] Volume 9b0fe5b9-2be1-4d3f-9261-32037b5f216e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b0fe5b9-2be1-4d3f-9261-32037b5f216e', 'volume_size': 1} Sep 29 18:33:55 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-51d3805d-11d6-42f6-b6f5-16817527404f tempest-CinderUnicodeTest-1774923702 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:33:55 devstack sudo[105343]: pam_unix(sudo:session): session closed for user root Sep 29 18:33:55 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-2670d6f2-e40b-4e38-9bc8-c5bb96a17fc9 tempest-VolumesSnapshotTestJSON-1354260036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-864a1a13-9c44-4f4d-ab33-8bff690568ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-864a1a13-9c44-4f4d-ab33-8bff690568ec.2f3dc10c-7c59-4058-ad41-48af689084db 1G" returned: 0 in 0.396s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:33:55 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-2670d6f2-e40b-4e38-9bc8-c5bb96a17fc9 tempest-VolumesSnapshotTestJSON-1354260036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-864a1a13-9c44-4f4d-ab33-8bff690568ec -F qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-864a1a13-9c44-4f4d-ab33-8bff690568ec.2f3dc10c-7c59-4058-ad41-48af689084db {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:33:55 devstack sudo[105348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-864a1a13-9c44-4f4d-ab33-8bff690568ec -F qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-864a1a13-9c44-4f4d-ab33-8bff690568ec.2f3dc10c-7c59-4058-ad41-48af689084db Sep 29 18:33:55 devstack sudo[105348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:33:55 devstack sudo[105348]: pam_unix(sudo:session): session closed for user root Sep 29 18:33:55 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-2670d6f2-e40b-4e38-9bc8-c5bb96a17fc9 tempest-VolumesSnapshotTestJSON-1354260036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-864a1a13-9c44-4f4d-ab33-8bff690568ec -F qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-864a1a13-9c44-4f4d-ab33-8bff690568ec.2f3dc10c-7c59-4058-ad41-48af689084db" returned: 0 in 0.281s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:33:55 devstack cinder-volume[86512]: WARNING cinder.volume.drivers.remotefs [None req-2670d6f2-e40b-4e38-9bc8-c5bb96a17fc9 tempest-VolumesSnapshotTestJSON-1354260036 None] /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-864a1a13-9c44-4f4d-ab33-8bff690568ec.2f3dc10c-7c59-4058-ad41-48af689084db is being set with open permissions: ugo+rw Sep 29 18:33:55 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-2670d6f2-e40b-4e38-9bc8-c5bb96a17fc9 tempest-VolumesSnapshotTestJSON-1354260036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-864a1a13-9c44-4f4d-ab33-8bff690568ec.2f3dc10c-7c59-4058-ad41-48af689084db {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:33:55 devstack sudo[105353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-864a1a13-9c44-4f4d-ab33-8bff690568ec.2f3dc10c-7c59-4058-ad41-48af689084db Sep 29 18:33:55 devstack sudo[105353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:33:56 devstack sudo[105353]: pam_unix(sudo:session): session closed for user root Sep 29 18:33:56 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-2670d6f2-e40b-4e38-9bc8-c5bb96a17fc9 tempest-VolumesSnapshotTestJSON-1354260036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-864a1a13-9c44-4f4d-ab33-8bff690568ec.2f3dc10c-7c59-4058-ad41-48af689084db" returned: 0 in 0.236s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:33:56 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-2670d6f2-e40b-4e38-9bc8-c5bb96a17fc9 tempest-VolumesSnapshotTestJSON-1354260036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-864a1a13-9c44-4f4d-ab33-8bff690568ec.info {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:33:56 devstack sudo[105356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-864a1a13-9c44-4f4d-ab33-8bff690568ec.info Sep 29 18:33:56 devstack sudo[105356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:33:56 devstack sudo[105356]: pam_unix(sudo:session): session closed for user root Sep 29 18:33:56 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-2670d6f2-e40b-4e38-9bc8-c5bb96a17fc9 tempest-VolumesSnapshotTestJSON-1354260036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-864a1a13-9c44-4f4d-ab33-8bff690568ec.info" returned: 0 in 0.273s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:33:56 devstack cinder-volume[86512]: WARNING cinder.volume.drivers.remotefs [None req-2670d6f2-e40b-4e38-9bc8-c5bb96a17fc9 tempest-VolumesSnapshotTestJSON-1354260036 None] /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-864a1a13-9c44-4f4d-ab33-8bff690568ec.info is being set with open permissions: ugo+rw Sep 29 18:33:56 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-2670d6f2-e40b-4e38-9bc8-c5bb96a17fc9 tempest-VolumesSnapshotTestJSON-1354260036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-864a1a13-9c44-4f4d-ab33-8bff690568ec.info {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:33:56 devstack sudo[105365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-864a1a13-9c44-4f4d-ab33-8bff690568ec.info Sep 29 18:33:56 devstack sudo[105365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:33:56 devstack sudo[105365]: pam_unix(sudo:session): session closed for user root Sep 29 18:33:56 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-2670d6f2-e40b-4e38-9bc8-c5bb96a17fc9 tempest-VolumesSnapshotTestJSON-1354260036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-864a1a13-9c44-4f4d-ab33-8bff690568ec.info" returned: 0 in 0.227s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:33:56 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-2670d6f2-e40b-4e38-9bc8-c5bb96a17fc9 tempest-VolumesSnapshotTestJSON-1354260036 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.917s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:33:56 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-51d3805d-11d6-42f6-b6f5-16817527404f tempest-CinderUnicodeTest-1774923702 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.151s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:33:56 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-51d3805d-11d6-42f6-b6f5-16817527404f tempest-CinderUnicodeTest-1774923702 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:33:55Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b0fe5b9-2be1-4d3f-9261-32037b5f216e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5133b6c4a84445f8ad80dcfffc6372c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:33:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:33:55Z,use_quota=True,user_id='a4f3c54e724a46faaf1680f7902f04c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)}" {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:33:56 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-51d3805d-11d6-42f6-b6f5-16817527404f tempest-CinderUnicodeTest-1774923702 None] Creating volume 9b0fe5b9-2be1-4d3f-9261-32037b5f216e {{(pid=86512) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:33:56 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-51d3805d-11d6-42f6-b6f5-16817527404f tempest-CinderUnicodeTest-1774923702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:33:56 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-51d3805d-11d6-42f6-b6f5-16817527404f tempest-CinderUnicodeTest-1774923702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:33:56 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-51d3805d-11d6-42f6-b6f5-16817527404f tempest-CinderUnicodeTest-1774923702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:33:56 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-51d3805d-11d6-42f6-b6f5-16817527404f tempest-CinderUnicodeTest-1774923702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:33:56 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-51d3805d-11d6-42f6-b6f5-16817527404f tempest-CinderUnicodeTest-1774923702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:33:56 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-51d3805d-11d6-42f6-b6f5-16817527404f tempest-CinderUnicodeTest-1774923702 None] Selected osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 as target Quobyte volume. {{(pid=86512) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:33:56 devstack cinder-volume[86512]: INFO cinder.volume.drivers.remotefs [None req-51d3805d-11d6-42f6-b6f5-16817527404f tempest-CinderUnicodeTest-1774923702 None] casted to osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 Sep 29 18:33:56 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-51d3805d-11d6-42f6-b6f5-16817527404f tempest-CinderUnicodeTest-1774923702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-9b0fe5b9-2be1-4d3f-9261-32037b5f216e 1073741824 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:33:56 devstack sudo[105368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-9b0fe5b9-2be1-4d3f-9261-32037b5f216e 1073741824 Sep 29 18:33:56 devstack sudo[105368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:33:56 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-2670d6f2-e40b-4e38-9bc8-c5bb96a17fc9 tempest-VolumesSnapshotTestJSON-1354260036 None] Create snapshot completed successfully Sep 29 18:33:57 devstack sudo[105368]: pam_unix(sudo:session): session closed for user root Sep 29 18:33:57 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-51d3805d-11d6-42f6-b6f5-16817527404f tempest-CinderUnicodeTest-1774923702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-9b0fe5b9-2be1-4d3f-9261-32037b5f216e 1073741824" returned: 0 in 0.429s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:33:57 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-51d3805d-11d6-42f6-b6f5-16817527404f tempest-CinderUnicodeTest-1774923702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-9b0fe5b9-2be1-4d3f-9261-32037b5f216e {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:33:57 devstack sudo[105374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-9b0fe5b9-2be1-4d3f-9261-32037b5f216e Sep 29 18:33:57 devstack sudo[105374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:33:57 devstack sudo[105374]: pam_unix(sudo:session): session closed for user root Sep 29 18:33:57 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-51d3805d-11d6-42f6-b6f5-16817527404f tempest-CinderUnicodeTest-1774923702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-9b0fe5b9-2be1-4d3f-9261-32037b5f216e" returned: 0 in 0.256s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:33:57 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-51d3805d-11d6-42f6-b6f5-16817527404f tempest-CinderUnicodeTest-1774923702 None] <== create_volume: return (727ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'} {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:33:57 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-51d3805d-11d6-42f6-b6f5-16817527404f tempest-CinderUnicodeTest-1774923702 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.731s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:33:57 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-dda5d108-288e-451f-93dc-a22b51248db8 tempest-VolumesSnapshotTestJSON-1354260036 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86512) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:33:57 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-51d3805d-11d6-42f6-b6f5-16817527404f tempest-CinderUnicodeTest-1774923702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf1ea064-ecfa-4867-9d2a-cf2fb7cab52f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b0fe5b9-2be1-4d3f-9261-32037b5f216e', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:33:57 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-51d3805d-11d6-42f6-b6f5-16817527404f tempest-CinderUnicodeTest-1774923702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26aeece2-fb37-4d8b-b2ba-2dae2fbfe6ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:33:57 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-dda5d108-288e-451f-93dc-a22b51248db8 tempest-VolumesSnapshotTestJSON-1354260036 None] Flow 'volume_create_manager' (770174c4-e647-4522-88b5-16a2f1776c8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:33:57 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-dda5d108-288e-451f-93dc-a22b51248db8 tempest-VolumesSnapshotTestJSON-1354260036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (766f705b-27c9-48ed-9531-2e790edfbaf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:33:57 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-51d3805d-11d6-42f6-b6f5-16817527404f tempest-CinderUnicodeTest-1774923702 None] Volume volume-9b0fe5b9-2be1-4d3f-9261-32037b5f216e (9b0fe5b9-2be1-4d3f-9261-32037b5f216e): created successfully Sep 29 18:33:57 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-51d3805d-11d6-42f6-b6f5-16817527404f tempest-CinderUnicodeTest-1774923702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26aeece2-fb37-4d8b-b2ba-2dae2fbfe6ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:33:57 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-51d3805d-11d6-42f6-b6f5-16817527404f tempest-CinderUnicodeTest-1774923702 None] Flow 'volume_create_manager' (0629f25c-f33b-41f0-95e1-aedd012a478a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:33:57 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-dda5d108-288e-451f-93dc-a22b51248db8 tempest-VolumesSnapshotTestJSON-1354260036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (766f705b-27c9-48ed-9531-2e790edfbaf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:33:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1457253324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7eecf82c-5284-415c-b0ea-82b37c6b1562,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd288a0f9bec4d359ab34e9f2079e2ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:33:57Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=2f3dc10c-7c59-4058-ad41-48af689084db,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:33:57Z,use_quota=True,user_id='1efcc6a2f76e46dbae7d214b0f803523',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:33:57 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-dda5d108-288e-451f-93dc-a22b51248db8 tempest-VolumesSnapshotTestJSON-1354260036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bd16e06-d8d9-4b60-9c16-1aaf156da7b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:33:57 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-dda5d108-288e-451f-93dc-a22b51248db8 tempest-VolumesSnapshotTestJSON-1354260036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bd16e06-d8d9-4b60-9c16-1aaf156da7b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:33:57 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-dda5d108-288e-451f-93dc-a22b51248db8 tempest-VolumesSnapshotTestJSON-1354260036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8e8d3cb-d33b-44d8-b5d8-8192965c8dfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:33:57 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-dda5d108-288e-451f-93dc-a22b51248db8 tempest-VolumesSnapshotTestJSON-1354260036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8e8d3cb-d33b-44d8-b5d8-8192965c8dfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7eecf82c-5284-415c-b0ea-82b37c6b1562', 'volume_name': 'volume-7eecf82c-5284-415c-b0ea-82b37c6b1562', 'volume_size': 2, 'snapshot_id': '2f3dc10c-7c59-4058-ad41-48af689084db'}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:33:57 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-dda5d108-288e-451f-93dc-a22b51248db8 tempest-VolumesSnapshotTestJSON-1354260036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (683a4523-72b6-4d05-91c0-887fb1e515d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:33:57 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-dda5d108-288e-451f-93dc-a22b51248db8 tempest-VolumesSnapshotTestJSON-1354260036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (683a4523-72b6-4d05-91c0-887fb1e515d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:33:57 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-dda5d108-288e-451f-93dc-a22b51248db8 tempest-VolumesSnapshotTestJSON-1354260036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb3bc8a6-0385-4e2c-88bf-a94a6fee595d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:33:57 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-dda5d108-288e-451f-93dc-a22b51248db8 tempest-VolumesSnapshotTestJSON-1354260036 None] Volume 7eecf82c-5284-415c-b0ea-82b37c6b1562: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7eecf82c-5284-415c-b0ea-82b37c6b1562', 'volume_size': 2, 'snapshot_id': '2f3dc10c-7c59-4058-ad41-48af689084db'} Sep 29 18:33:57 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-51d3805d-11d6-42f6-b6f5-16817527404f tempest-CinderUnicodeTest-1774923702 None] Created volume successfully. Sep 29 18:33:57 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-dda5d108-288e-451f-93dc-a22b51248db8 tempest-VolumesSnapshotTestJSON-1354260036 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:33:57 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-dda5d108-288e-451f-93dc-a22b51248db8 tempest-VolumesSnapshotTestJSON-1354260036 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:33:57 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-dda5d108-288e-451f-93dc-a22b51248db8 tempest-VolumesSnapshotTestJSON-1354260036 None] Acquiring lock "cinder-quobyte-2f3dc10c-7c59-4058-ad41-48af689084db-7eecf82c-5284-415c-b0ea-82b37c6b1562" by "_create_volume_from_snapshot" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:33:57 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-dda5d108-288e-451f-93dc-a22b51248db8 tempest-VolumesSnapshotTestJSON-1354260036 None] Lock "cinder-quobyte-2f3dc10c-7c59-4058-ad41-48af689084db-7eecf82c-5284-415c-b0ea-82b37c6b1562" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:33:57 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-dda5d108-288e-451f-93dc-a22b51248db8 tempest-VolumesSnapshotTestJSON-1354260036 None] Creating volume 7eecf82c-5284-415c-b0ea-82b37c6b1562 from snapshot 2f3dc10c-7c59-4058-ad41-48af689084db {{(pid=86512) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 29 18:33:57 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-dda5d108-288e-451f-93dc-a22b51248db8 tempest-VolumesSnapshotTestJSON-1354260036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:33:57 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-dda5d108-288e-451f-93dc-a22b51248db8 tempest-VolumesSnapshotTestJSON-1354260036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:33:57 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-dda5d108-288e-451f-93dc-a22b51248db8 tempest-VolumesSnapshotTestJSON-1354260036 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:33:57 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-dda5d108-288e-451f-93dc-a22b51248db8 tempest-VolumesSnapshotTestJSON-1354260036 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:33:57 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-dda5d108-288e-451f-93dc-a22b51248db8 tempest-VolumesSnapshotTestJSON-1354260036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:33:57 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-dda5d108-288e-451f-93dc-a22b51248db8 tempest-VolumesSnapshotTestJSON-1354260036 None] Selected osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 as target Quobyte volume. {{(pid=86512) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:33:57 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-dda5d108-288e-451f-93dc-a22b51248db8 tempest-VolumesSnapshotTestJSON-1354260036 None] Acquiring lock "cinder-quobyte-7eecf82c-5284-415c-b0ea-82b37c6b1562" by "_copy_volume_from_snapshot" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:33:57 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-dda5d108-288e-451f-93dc-a22b51248db8 tempest-VolumesSnapshotTestJSON-1354260036 None] Lock "cinder-quobyte-7eecf82c-5284-415c-b0ea-82b37c6b1562" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:33:57 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-dda5d108-288e-451f-93dc-a22b51248db8 tempest-VolumesSnapshotTestJSON-1354260036 None] snapshot: 2f3dc10c-7c59-4058-ad41-48af689084db, volume: 7eecf82c-5284-415c-b0ea-82b37c6b1562, {{(pid=86512) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 29 18:33:57 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-dda5d108-288e-451f-93dc-a22b51248db8 tempest-VolumesSnapshotTestJSON-1354260036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:33:57 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-dda5d108-288e-451f-93dc-a22b51248db8 tempest-VolumesSnapshotTestJSON-1354260036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:33:57 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-dda5d108-288e-451f-93dc-a22b51248db8 tempest-VolumesSnapshotTestJSON-1354260036 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:33:57 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-dda5d108-288e-451f-93dc-a22b51248db8 tempest-VolumesSnapshotTestJSON-1354260036 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:33:57 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-dda5d108-288e-451f-93dc-a22b51248db8 tempest-VolumesSnapshotTestJSON-1354260036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:33:57 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e187c7c-de6b-4e11-88ac-5df74ddeb462]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:33:57 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-dda5d108-288e-451f-93dc-a22b51248db8 tempest-VolumesSnapshotTestJSON-1354260036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-864a1a13-9c44-4f4d-ab33-8bff690568ec.2f3dc10c-7c59-4058-ad41-48af689084db {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:33:57 devstack sudo[105377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-864a1a13-9c44-4f4d-ab33-8bff690568ec.2f3dc10c-7c59-4058-ad41-48af689084db Sep 29 18:33:57 devstack sudo[105377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:33:57 devstack sudo[105377]: pam_unix(sudo:session): session closed for user root Sep 29 18:33:57 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-dda5d108-288e-451f-93dc-a22b51248db8 tempest-VolumesSnapshotTestJSON-1354260036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-864a1a13-9c44-4f4d-ab33-8bff690568ec.2f3dc10c-7c59-4058-ad41-48af689084db" returned: 0 in 0.369s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:33:57 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-dda5d108-288e-451f-93dc-a22b51248db8 tempest-VolumesSnapshotTestJSON-1354260036 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-864a1a13-9c44-4f4d-ab33-8bff690568ec(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86512) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 18:33:57 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c6cc962-8e19-40ae-b770-d7fc58220c88]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:33:57 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-dda5d108-288e-451f-93dc-a22b51248db8 tempest-VolumesSnapshotTestJSON-1354260036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-864a1a13-9c44-4f4d-ab33-8bff690568ec {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:33:58 devstack sudo[105386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-864a1a13-9c44-4f4d-ab33-8bff690568ec Sep 29 18:33:58 devstack sudo[105386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:33:58 devstack sudo[105386]: pam_unix(sudo:session): session closed for user root Sep 29 18:33:58 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-dda5d108-288e-451f-93dc-a22b51248db8 tempest-VolumesSnapshotTestJSON-1354260036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-864a1a13-9c44-4f4d-ab33-8bff690568ec" returned: 0 in 0.375s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:33:58 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-dda5d108-288e-451f-93dc-a22b51248db8 tempest-VolumesSnapshotTestJSON-1354260036 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-864a1a13-9c44-4f4d-ab33-8bff690568ec {{(pid=86512) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 29 18:33:58 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-dda5d108-288e-451f-93dc-a22b51248db8 tempest-VolumesSnapshotTestJSON-1354260036 None] Creating direct copy from snapshot {{(pid=86512) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 29 18:33:58 devstack cinder-volume[86512]: DEBUG cinder.utils [None req-dda5d108-288e-451f-93dc-a22b51248db8 tempest-VolumesSnapshotTestJSON-1354260036 None] Path /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7eecf82c-5284-415c-b0ea-82b37c6b1562 not found in is_blk_device check {{(pid=86512) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 29 18:33:58 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-dda5d108-288e-451f-93dc-a22b51248db8 tempest-VolumesSnapshotTestJSON-1354260036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-864a1a13-9c44-4f4d-ab33-8bff690568ec /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7eecf82c-5284-415c-b0ea-82b37c6b1562 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:33:58 devstack sudo[105391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-864a1a13-9c44-4f4d-ab33-8bff690568ec /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7eecf82c-5284-415c-b0ea-82b37c6b1562 Sep 29 18:33:58 devstack sudo[105391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:33:59 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-85db96a1-47ab-4e6a-9390-0799e8e928da tempest-CinderUnicodeTest-1774923702 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86512) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:33:59 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-85db96a1-47ab-4e6a-9390-0799e8e928da tempest-CinderUnicodeTest-1774923702 None] Flow 'volume_create_manager' (4bbca60a-d8ee-4912-bd91-d3c471e12f29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:33:59 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-85db96a1-47ab-4e6a-9390-0799e8e928da tempest-CinderUnicodeTest-1774923702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92979b3f-f9b5-43ce-9918-e8980c78c655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:33:59 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-85db96a1-47ab-4e6a-9390-0799e8e928da tempest-CinderUnicodeTest-1774923702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92979b3f-f9b5-43ce-9918-e8980c78c655) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:33:59Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1171645635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82fd2f50-3bed-48fe-b5d2-530259e0d330,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5133b6c4a84445f8ad80dcfffc6372c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:33:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:33:59Z,use_quota=True,user_id='a4f3c54e724a46faaf1680f7902f04c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:33:59 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-85db96a1-47ab-4e6a-9390-0799e8e928da tempest-CinderUnicodeTest-1774923702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c974be94-74ed-4fab-a6f1-33ae00b9513f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:33:59 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-85db96a1-47ab-4e6a-9390-0799e8e928da tempest-CinderUnicodeTest-1774923702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c974be94-74ed-4fab-a6f1-33ae00b9513f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:33:59 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-85db96a1-47ab-4e6a-9390-0799e8e928da tempest-CinderUnicodeTest-1774923702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b2afe22-c40d-45b0-94ce-92ac8a2e4512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:33:59 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-85db96a1-47ab-4e6a-9390-0799e8e928da tempest-CinderUnicodeTest-1774923702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b2afe22-c40d-45b0-94ce-92ac8a2e4512) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82fd2f50-3bed-48fe-b5d2-530259e0d330', 'volume_name': 'volume-82fd2f50-3bed-48fe-b5d2-530259e0d330', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:33:59 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-85db96a1-47ab-4e6a-9390-0799e8e928da tempest-CinderUnicodeTest-1774923702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4d0cc20-b2a7-4f85-8718-34368c6312b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:33:59 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-85db96a1-47ab-4e6a-9390-0799e8e928da tempest-CinderUnicodeTest-1774923702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4d0cc20-b2a7-4f85-8718-34368c6312b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:33:59 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-85db96a1-47ab-4e6a-9390-0799e8e928da tempest-CinderUnicodeTest-1774923702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91ca4acb-7126-494d-b9ce-e0f8a507367f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:33:59 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-85db96a1-47ab-4e6a-9390-0799e8e928da tempest-CinderUnicodeTest-1774923702 None] Volume 82fd2f50-3bed-48fe-b5d2-530259e0d330: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82fd2f50-3bed-48fe-b5d2-530259e0d330', 'volume_size': 1} Sep 29 18:33:59 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-85db96a1-47ab-4e6a-9390-0799e8e928da tempest-CinderUnicodeTest-1774923702 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:34:02 devstack cinder-volume[86512]: INFO cinder.volume.manager [req-b443979f-b9a2-4b84-a42e-3ecefd598c99 req-a4bc4eb6-575e-49dc-a765-7a5af703f892 tempest-TestShelveInstance-22798712 None] Terminate volume connection completed successfully. Sep 29 18:34:02 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [req-b443979f-b9a2-4b84-a42e-3ecefd598c99 req-a4bc4eb6-575e-49dc-a765-7a5af703f892 tempest-TestShelveInstance-22798712 None] Deleting attachment ac1732fa-91b8-44f9-b3cc-f1450d098029. {{(pid=86512) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 29 18:34:02 devstack cinder-volume[86512]: DEBUG cinder.coordination [req-b443979f-b9a2-4b84-a42e-3ecefd598c99 req-9ef1d3c0-9800-4f99-9080-233783350b67 tempest-TestShelveInstance-22798712 None] Acquiring lock "cinder-83546d33-b4e2-47f0-a157-0ecd5376f3b7-delete_volume" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:34:02 devstack cinder-volume[86512]: DEBUG cinder.coordination [req-b443979f-b9a2-4b84-a42e-3ecefd598c99 req-9ef1d3c0-9800-4f99-9080-233783350b67 tempest-TestShelveInstance-22798712 None] Lock "cinder-83546d33-b4e2-47f0-a157-0ecd5376f3b7-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:34:02 devstack cinder-volume[86512]: DEBUG cinder.coordination [req-b443979f-b9a2-4b84-a42e-3ecefd598c99 req-9ef1d3c0-9800-4f99-9080-233783350b67 tempest-TestShelveInstance-22798712 None] Acquiring lock "cinder-quobyte-83546d33-b4e2-47f0-a157-0ecd5376f3b7" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:34:02 devstack cinder-volume[86512]: DEBUG cinder.coordination [req-b443979f-b9a2-4b84-a42e-3ecefd598c99 req-9ef1d3c0-9800-4f99-9080-233783350b67 tempest-TestShelveInstance-22798712 None] Lock "cinder-quobyte-83546d33-b4e2-47f0-a157-0ecd5376f3b7" acquired by "delete_volume" :: waited 0.034s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:34:02 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[16ec79d4-3531-43ca-8fa7-887080208189]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:34:02 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [req-b443979f-b9a2-4b84-a42e-3ecefd598c99 req-9ef1d3c0-9800-4f99-9080-233783350b67 tempest-TestShelveInstance-22798712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-83546d33-b4e2-47f0-a157-0ecd5376f3b7 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:34:03 devstack sudo[105432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-83546d33-b4e2-47f0-a157-0ecd5376f3b7 Sep 29 18:34:03 devstack sudo[105432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:34:03 devstack sudo[105432]: pam_unix(sudo:session): session closed for user root Sep 29 18:34:03 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [req-b443979f-b9a2-4b84-a42e-3ecefd598c99 req-9ef1d3c0-9800-4f99-9080-233783350b67 tempest-TestShelveInstance-22798712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-83546d33-b4e2-47f0-a157-0ecd5376f3b7" returned: 0 in 0.867s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:34:03 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [req-b443979f-b9a2-4b84-a42e-3ecefd598c99 req-9ef1d3c0-9800-4f99-9080-233783350b67 tempest-TestShelveInstance-22798712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-83546d33-b4e2-47f0-a157-0ecd5376f3b7 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:34:03 devstack sudo[105437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-83546d33-b4e2-47f0-a157-0ecd5376f3b7 Sep 29 18:34:03 devstack sudo[105437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:34:04 devstack sudo[105437]: pam_unix(sudo:session): session closed for user root Sep 29 18:34:04 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [req-b443979f-b9a2-4b84-a42e-3ecefd598c99 req-9ef1d3c0-9800-4f99-9080-233783350b67 tempest-TestShelveInstance-22798712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-83546d33-b4e2-47f0-a157-0ecd5376f3b7" returned: 0 in 0.440s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:34:04 devstack cinder-volume[86512]: DEBUG cinder.coordination [req-b443979f-b9a2-4b84-a42e-3ecefd598c99 req-9ef1d3c0-9800-4f99-9080-233783350b67 tempest-TestShelveInstance-22798712 None] Lock "cinder-quobyte-83546d33-b4e2-47f0-a157-0ecd5376f3b7" released by "delete_volume" :: held 1.440s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:34:04 devstack cinder-volume[86512]: DEBUG cinder.quota [req-b443979f-b9a2-4b84-a42e-3ecefd598c99 req-9ef1d3c0-9800-4f99-9080-233783350b67 tempest-TestShelveInstance-22798712 None] Created reservations ['b861f65a-9482-4d77-8438-fb24a85a1eea', '82f05fc2-41d8-4bc4-a9bb-4d47bf257377', '1e838227-402f-4663-9f9a-bebe3479daa6', 'e0d369c9-2bb6-4f3f-849b-be021e763f5b'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:34:04 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [req-b443979f-b9a2-4b84-a42e-3ecefd598c99 req-9ef1d3c0-9800-4f99-9080-233783350b67 tempest-TestShelveInstance-22798712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:34:04 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [req-b443979f-b9a2-4b84-a42e-3ecefd598c99 req-9ef1d3c0-9800-4f99-9080-233783350b67 tempest-TestShelveInstance-22798712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:34:04 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [req-b443979f-b9a2-4b84-a42e-3ecefd598c99 req-9ef1d3c0-9800-4f99-9080-233783350b67 tempest-TestShelveInstance-22798712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:34:04 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [req-b443979f-b9a2-4b84-a42e-3ecefd598c99 req-9ef1d3c0-9800-4f99-9080-233783350b67 tempest-TestShelveInstance-22798712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:34:04 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [req-b443979f-b9a2-4b84-a42e-3ecefd598c99 req-9ef1d3c0-9800-4f99-9080-233783350b67 tempest-TestShelveInstance-22798712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:34:04 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [req-b443979f-b9a2-4b84-a42e-3ecefd598c99 req-9ef1d3c0-9800-4f99-9080-233783350b67 tempest-TestShelveInstance-22798712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:34:04 devstack sudo[105441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:34:04 devstack sudo[105441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:34:05 devstack sudo[105441]: pam_unix(sudo:session): session closed for user root Sep 29 18:34:05 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [req-b443979f-b9a2-4b84-a42e-3ecefd598c99 req-9ef1d3c0-9800-4f99-9080-233783350b67 tempest-TestShelveInstance-22798712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.479s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:34:05 devstack cinder-volume[86512]: DEBUG cinder.manager [req-b443979f-b9a2-4b84-a42e-3ecefd598c99 req-9ef1d3c0-9800-4f99-9080-233783350b67 tempest-TestShelveInstance-22798712 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:34:05 devstack cinder-volume[86512]: INFO cinder.volume.manager [req-b443979f-b9a2-4b84-a42e-3ecefd598c99 req-9ef1d3c0-9800-4f99-9080-233783350b67 tempest-TestShelveInstance-22798712 None] Deleted volume successfully. Sep 29 18:34:05 devstack cinder-volume[86512]: DEBUG cinder.coordination [req-b443979f-b9a2-4b84-a42e-3ecefd598c99 req-9ef1d3c0-9800-4f99-9080-233783350b67 tempest-TestShelveInstance-22798712 None] Lock "cinder-83546d33-b4e2-47f0-a157-0ecd5376f3b7-delete_volume" released by "delete_volume" :: held 2.531s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:34:06 devstack sudo[105391]: pam_unix(sudo:session): session closed for user root Sep 29 18:34:06 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-dda5d108-288e-451f-93dc-a22b51248db8 tempest-VolumesSnapshotTestJSON-1354260036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-864a1a13-9c44-4f4d-ab33-8bff690568ec /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7eecf82c-5284-415c-b0ea-82b37c6b1562" returned: 0 in 8.157s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:34:06 devstack cinder-volume[86512]: DEBUG cinder.image.image_utils [None req-dda5d108-288e-451f-93dc-a22b51248db8 tempest-VolumesSnapshotTestJSON-1354260036 None] Image conversion details: src /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-864a1a13-9c44-4f4d-ab33-8bff690568ec, size 1024.00 MB, duration 8.16 sec, destination /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7eecf82c-5284-415c-b0ea-82b37c6b1562 {{(pid=86512) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 29 18:34:06 devstack cinder-volume[86512]: INFO cinder.image.image_utils [None req-dda5d108-288e-451f-93dc-a22b51248db8 tempest-VolumesSnapshotTestJSON-1354260036 None] Converted 1024.00 MB image at 125.52 MB/s Sep 29 18:34:06 devstack cinder-volume[86512]: WARNING cinder.volume.drivers.remotefs [None req-dda5d108-288e-451f-93dc-a22b51248db8 tempest-VolumesSnapshotTestJSON-1354260036 None] /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7eecf82c-5284-415c-b0ea-82b37c6b1562 is being set with open permissions: ugo+rw Sep 29 18:34:06 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-dda5d108-288e-451f-93dc-a22b51248db8 tempest-VolumesSnapshotTestJSON-1354260036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7eecf82c-5284-415c-b0ea-82b37c6b1562 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:34:06 devstack sudo[105444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7eecf82c-5284-415c-b0ea-82b37c6b1562 Sep 29 18:34:06 devstack sudo[105444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:34:06 devstack sudo[105444]: pam_unix(sudo:session): session closed for user root Sep 29 18:34:06 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-dda5d108-288e-451f-93dc-a22b51248db8 tempest-VolumesSnapshotTestJSON-1354260036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7eecf82c-5284-415c-b0ea-82b37c6b1562" returned: 0 in 0.278s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:34:06 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-dda5d108-288e-451f-93dc-a22b51248db8 tempest-VolumesSnapshotTestJSON-1354260036 None] Lock "cinder-quobyte-7eecf82c-5284-415c-b0ea-82b37c6b1562" released by "_copy_volume_from_snapshot" :: held 9.269s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:34:06 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-dda5d108-288e-451f-93dc-a22b51248db8 tempest-VolumesSnapshotTestJSON-1354260036 None] Lock "cinder-quobyte-2f3dc10c-7c59-4058-ad41-48af689084db-7eecf82c-5284-415c-b0ea-82b37c6b1562" released by "_create_volume_from_snapshot" :: held 9.367s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:34:06 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-dda5d108-288e-451f-93dc-a22b51248db8 tempest-VolumesSnapshotTestJSON-1354260036 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.386s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:34:06 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-85db96a1-47ab-4e6a-9390-0799e8e928da tempest-CinderUnicodeTest-1774923702 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.382s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:34:06 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-85db96a1-47ab-4e6a-9390-0799e8e928da tempest-CinderUnicodeTest-1774923702 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:33:59Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1171645635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82fd2f50-3bed-48fe-b5d2-530259e0d330,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5133b6c4a84445f8ad80dcfffc6372c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:33:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:33:59Z,use_quota=True,user_id='a4f3c54e724a46faaf1680f7902f04c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)}" {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:34:06 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-85db96a1-47ab-4e6a-9390-0799e8e928da tempest-CinderUnicodeTest-1774923702 None] Creating volume 82fd2f50-3bed-48fe-b5d2-530259e0d330 {{(pid=86512) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:34:06 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-85db96a1-47ab-4e6a-9390-0799e8e928da tempest-CinderUnicodeTest-1774923702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:34:06 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-85db96a1-47ab-4e6a-9390-0799e8e928da tempest-CinderUnicodeTest-1774923702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:34:06 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-85db96a1-47ab-4e6a-9390-0799e8e928da tempest-CinderUnicodeTest-1774923702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:34:06 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-85db96a1-47ab-4e6a-9390-0799e8e928da tempest-CinderUnicodeTest-1774923702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:34:06 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-85db96a1-47ab-4e6a-9390-0799e8e928da tempest-CinderUnicodeTest-1774923702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:34:06 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-85db96a1-47ab-4e6a-9390-0799e8e928da tempest-CinderUnicodeTest-1774923702 None] Selected osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 as target Quobyte volume. {{(pid=86512) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:34:06 devstack cinder-volume[86512]: INFO cinder.volume.drivers.remotefs [None req-85db96a1-47ab-4e6a-9390-0799e8e928da tempest-CinderUnicodeTest-1774923702 None] casted to osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 Sep 29 18:34:06 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-85db96a1-47ab-4e6a-9390-0799e8e928da tempest-CinderUnicodeTest-1774923702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-82fd2f50-3bed-48fe-b5d2-530259e0d330 1073741824 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:34:06 devstack sudo[105447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-82fd2f50-3bed-48fe-b5d2-530259e0d330 1073741824 Sep 29 18:34:06 devstack sudo[105447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:34:06 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-dda5d108-288e-451f-93dc-a22b51248db8 tempest-VolumesSnapshotTestJSON-1354260036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb3bc8a6-0385-4e2c-88bf-a94a6fee595d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7eecf82c-5284-415c-b0ea-82b37c6b1562', 'volume_size': 2, 'snapshot_id': '2f3dc10c-7c59-4058-ad41-48af689084db'}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:34:06 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-dda5d108-288e-451f-93dc-a22b51248db8 tempest-VolumesSnapshotTestJSON-1354260036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (067d3584-5414-4e8e-8f1d-848810ecb052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:34:06 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-dda5d108-288e-451f-93dc-a22b51248db8 tempest-VolumesSnapshotTestJSON-1354260036 None] Volume volume-7eecf82c-5284-415c-b0ea-82b37c6b1562 (7eecf82c-5284-415c-b0ea-82b37c6b1562): created successfully Sep 29 18:34:06 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-dda5d108-288e-451f-93dc-a22b51248db8 tempest-VolumesSnapshotTestJSON-1354260036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (067d3584-5414-4e8e-8f1d-848810ecb052) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:34:06 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-dda5d108-288e-451f-93dc-a22b51248db8 tempest-VolumesSnapshotTestJSON-1354260036 None] Flow 'volume_create_manager' (770174c4-e647-4522-88b5-16a2f1776c8f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:34:06 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-dda5d108-288e-451f-93dc-a22b51248db8 tempest-VolumesSnapshotTestJSON-1354260036 None] Created volume successfully. Sep 29 18:34:07 devstack sudo[105447]: pam_unix(sudo:session): session closed for user root Sep 29 18:34:07 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-85db96a1-47ab-4e6a-9390-0799e8e928da tempest-CinderUnicodeTest-1774923702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-82fd2f50-3bed-48fe-b5d2-530259e0d330 1073741824" returned: 0 in 0.508s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:34:07 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-85db96a1-47ab-4e6a-9390-0799e8e928da tempest-CinderUnicodeTest-1774923702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-82fd2f50-3bed-48fe-b5d2-530259e0d330 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:34:07 devstack sudo[105453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-82fd2f50-3bed-48fe-b5d2-530259e0d330 Sep 29 18:34:07 devstack sudo[105453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:34:07 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-37b3d357-ad5d-497b-afb2-cb9054c2dda7 tempest-VolumesSnapshotTestJSON-1354260036 None] Acquiring lock "cinder-7eecf82c-5284-415c-b0ea-82b37c6b1562-delete_volume" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:34:07 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-37b3d357-ad5d-497b-afb2-cb9054c2dda7 tempest-VolumesSnapshotTestJSON-1354260036 None] Lock "cinder-7eecf82c-5284-415c-b0ea-82b37c6b1562-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:34:07 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-37b3d357-ad5d-497b-afb2-cb9054c2dda7 tempest-VolumesSnapshotTestJSON-1354260036 None] Acquiring lock "cinder-quobyte-7eecf82c-5284-415c-b0ea-82b37c6b1562" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:34:07 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-37b3d357-ad5d-497b-afb2-cb9054c2dda7 tempest-VolumesSnapshotTestJSON-1354260036 None] Lock "cinder-quobyte-7eecf82c-5284-415c-b0ea-82b37c6b1562" acquired by "delete_volume" :: waited 0.029s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:34:07 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fc37750-55cc-46d5-9183-2f5773d85309]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:34:07 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-37b3d357-ad5d-497b-afb2-cb9054c2dda7 tempest-VolumesSnapshotTestJSON-1354260036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7eecf82c-5284-415c-b0ea-82b37c6b1562 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:34:07 devstack sudo[105453]: pam_unix(sudo:session): session closed for user root Sep 29 18:34:07 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-85db96a1-47ab-4e6a-9390-0799e8e928da tempest-CinderUnicodeTest-1774923702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-82fd2f50-3bed-48fe-b5d2-530259e0d330" returned: 0 in 0.342s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:34:07 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-85db96a1-47ab-4e6a-9390-0799e8e928da tempest-CinderUnicodeTest-1774923702 None] <== create_volume: return (910ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'} {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:34:07 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-85db96a1-47ab-4e6a-9390-0799e8e928da tempest-CinderUnicodeTest-1774923702 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.916s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:34:07 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-85db96a1-47ab-4e6a-9390-0799e8e928da tempest-CinderUnicodeTest-1774923702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91ca4acb-7126-494d-b9ce-e0f8a507367f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82fd2f50-3bed-48fe-b5d2-530259e0d330', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:34:07 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-85db96a1-47ab-4e6a-9390-0799e8e928da tempest-CinderUnicodeTest-1774923702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (169f5426-580b-4a8e-8627-88b3846fb279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:34:07 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-85db96a1-47ab-4e6a-9390-0799e8e928da tempest-CinderUnicodeTest-1774923702 None] Volume volume-82fd2f50-3bed-48fe-b5d2-530259e0d330 (82fd2f50-3bed-48fe-b5d2-530259e0d330): created successfully Sep 29 18:34:07 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-85db96a1-47ab-4e6a-9390-0799e8e928da tempest-CinderUnicodeTest-1774923702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (169f5426-580b-4a8e-8627-88b3846fb279) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:34:07 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-85db96a1-47ab-4e6a-9390-0799e8e928da tempest-CinderUnicodeTest-1774923702 None] Flow 'volume_create_manager' (4bbca60a-d8ee-4912-bd91-d3c471e12f29) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:34:07 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-85db96a1-47ab-4e6a-9390-0799e8e928da tempest-CinderUnicodeTest-1774923702 None] Created volume successfully. Sep 29 18:34:07 devstack sudo[105457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7eecf82c-5284-415c-b0ea-82b37c6b1562 Sep 29 18:34:07 devstack sudo[105457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:34:08 devstack sudo[105457]: pam_unix(sudo:session): session closed for user root Sep 29 18:34:08 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-37b3d357-ad5d-497b-afb2-cb9054c2dda7 tempest-VolumesSnapshotTestJSON-1354260036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7eecf82c-5284-415c-b0ea-82b37c6b1562" returned: 0 in 0.437s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:34:08 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-37b3d357-ad5d-497b-afb2-cb9054c2dda7 tempest-VolumesSnapshotTestJSON-1354260036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7eecf82c-5284-415c-b0ea-82b37c6b1562 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:34:08 devstack sudo[105462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7eecf82c-5284-415c-b0ea-82b37c6b1562 Sep 29 18:34:08 devstack sudo[105462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:34:08 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-57614104-399d-4ae6-ab86-9f8bbf54d910 tempest-CinderUnicodeTest-1774923702 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:34:08 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-57614104-399d-4ae6-ab86-9f8bbf54d910 tempest-CinderUnicodeTest-1774923702 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:34:08 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-57614104-399d-4ae6-ab86-9f8bbf54d910 tempest-CinderUnicodeTest-1774923702 None] Creating offline snapshot f9e263be-069b-4a37-bc73-76522577dcf1 of volume 82fd2f50-3bed-48fe-b5d2-530259e0d330 {{(pid=86512) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 18:34:08 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb802a0a-bcff-4cf6-bf4b-f2cd9f9292d0]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:34:08 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-57614104-399d-4ae6-ab86-9f8bbf54d910 tempest-CinderUnicodeTest-1774923702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-82fd2f50-3bed-48fe-b5d2-530259e0d330 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:34:08 devstack sudo[105462]: pam_unix(sudo:session): session closed for user root Sep 29 18:34:08 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-37b3d357-ad5d-497b-afb2-cb9054c2dda7 tempest-VolumesSnapshotTestJSON-1354260036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7eecf82c-5284-415c-b0ea-82b37c6b1562" returned: 0 in 0.324s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:34:08 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-37b3d357-ad5d-497b-afb2-cb9054c2dda7 tempest-VolumesSnapshotTestJSON-1354260036 None] Lock "cinder-quobyte-7eecf82c-5284-415c-b0ea-82b37c6b1562" released by "delete_volume" :: held 0.817s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:34:08 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-37b3d357-ad5d-497b-afb2-cb9054c2dda7 tempest-VolumesSnapshotTestJSON-1354260036 None] Created reservations ['175c8a3b-3400-4eab-b482-e6e25bd0dc0f', 'fa9cee51-c306-46e8-8908-85a9c54c33e0', '55193943-8c9b-452b-bf41-e2a39d9cd60f', 'a8f5f931-a7fe-4a9a-beab-58ed1cd34e5d'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:34:08 devstack sudo[105465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-82fd2f50-3bed-48fe-b5d2-530259e0d330 Sep 29 18:34:08 devstack sudo[105465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:34:08 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-37b3d357-ad5d-497b-afb2-cb9054c2dda7 tempest-VolumesSnapshotTestJSON-1354260036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:34:08 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-37b3d357-ad5d-497b-afb2-cb9054c2dda7 tempest-VolumesSnapshotTestJSON-1354260036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:34:08 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-37b3d357-ad5d-497b-afb2-cb9054c2dda7 tempest-VolumesSnapshotTestJSON-1354260036 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:34:08 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-37b3d357-ad5d-497b-afb2-cb9054c2dda7 tempest-VolumesSnapshotTestJSON-1354260036 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:34:08 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-37b3d357-ad5d-497b-afb2-cb9054c2dda7 tempest-VolumesSnapshotTestJSON-1354260036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:34:08 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-37b3d357-ad5d-497b-afb2-cb9054c2dda7 tempest-VolumesSnapshotTestJSON-1354260036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:34:08 devstack sudo[105467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:34:08 devstack sudo[105467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:34:08 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-c482fa40-f0fd-4ed7-bc14-10a948f63669 tempest-VolumesSnapshotTestJSON-1354260036 None] Acquiring lock "cinder-2f3dc10c-7c59-4058-ad41-48af689084db-delete_snapshot" by "delete_snapshot" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:34:08 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-c482fa40-f0fd-4ed7-bc14-10a948f63669 tempest-VolumesSnapshotTestJSON-1354260036 None] Lock "cinder-2f3dc10c-7c59-4058-ad41-48af689084db-delete_snapshot" acquired by "delete_snapshot" :: waited 0.050s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:34:08 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-c482fa40-f0fd-4ed7-bc14-10a948f63669 tempest-VolumesSnapshotTestJSON-1354260036 None] Acquiring lock "cinder-quobyte-864a1a13-9c44-4f4d-ab33-8bff690568ec" by "delete_snapshot" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:34:09 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-c482fa40-f0fd-4ed7-bc14-10a948f63669 tempest-VolumesSnapshotTestJSON-1354260036 None] Lock "cinder-quobyte-864a1a13-9c44-4f4d-ab33-8bff690568ec" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:34:09 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-c482fa40-f0fd-4ed7-bc14-10a948f63669 tempest-VolumesSnapshotTestJSON-1354260036 None] Acquiring lock "cinder-quobyte-2f3dc10c-7c59-4058-ad41-48af689084db" by "_delete_snapshot" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:34:09 devstack sudo[105465]: pam_unix(sudo:session): session closed for user root Sep 29 18:34:09 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-57614104-399d-4ae6-ab86-9f8bbf54d910 tempest-CinderUnicodeTest-1774923702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-82fd2f50-3bed-48fe-b5d2-530259e0d330" returned: 0 in 0.569s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:34:09 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-57614104-399d-4ae6-ab86-9f8bbf54d910 tempest-CinderUnicodeTest-1774923702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-82fd2f50-3bed-48fe-b5d2-530259e0d330,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-82fd2f50-3bed-48fe-b5d2-530259e0d330.f9e263be-069b-4a37-bc73-76522577dcf1 1G {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:34:09 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-c482fa40-f0fd-4ed7-bc14-10a948f63669 tempest-VolumesSnapshotTestJSON-1354260036 None] Lock "cinder-quobyte-2f3dc10c-7c59-4058-ad41-48af689084db" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:34:09 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-c482fa40-f0fd-4ed7-bc14-10a948f63669 tempest-VolumesSnapshotTestJSON-1354260036 None] Deleting offline snapshot 2f3dc10c-7c59-4058-ad41-48af689084db of volume 864a1a13-9c44-4f4d-ab33-8bff690568ec {{(pid=86512) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 18:34:09 devstack sudo[105467]: pam_unix(sudo:session): session closed for user root Sep 29 18:34:09 devstack sudo[105473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-82fd2f50-3bed-48fe-b5d2-530259e0d330,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-82fd2f50-3bed-48fe-b5d2-530259e0d330.f9e263be-069b-4a37-bc73-76522577dcf1 1G Sep 29 18:34:09 devstack sudo[105473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:34:09 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-c482fa40-f0fd-4ed7-bc14-10a948f63669 tempest-VolumesSnapshotTestJSON-1354260036 None] snapshot_file for this snap is: volume-864a1a13-9c44-4f4d-ab33-8bff690568ec.2f3dc10c-7c59-4058-ad41-48af689084db {{(pid=86512) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 18:34:09 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-37b3d357-ad5d-497b-afb2-cb9054c2dda7 tempest-VolumesSnapshotTestJSON-1354260036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.415s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:34:09 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-37b3d357-ad5d-497b-afb2-cb9054c2dda7 tempest-VolumesSnapshotTestJSON-1354260036 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:34:09 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[c920f136-d72a-49cf-810b-c09d80a94286]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:34:09 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-c482fa40-f0fd-4ed7-bc14-10a948f63669 tempest-VolumesSnapshotTestJSON-1354260036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-864a1a13-9c44-4f4d-ab33-8bff690568ec.2f3dc10c-7c59-4058-ad41-48af689084db {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:34:09 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-37b3d357-ad5d-497b-afb2-cb9054c2dda7 tempest-VolumesSnapshotTestJSON-1354260036 None] Deleted volume successfully. Sep 29 18:34:09 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-37b3d357-ad5d-497b-afb2-cb9054c2dda7 tempest-VolumesSnapshotTestJSON-1354260036 None] Lock "cinder-7eecf82c-5284-415c-b0ea-82b37c6b1562-delete_volume" released by "delete_volume" :: held 1.506s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:34:09 devstack sudo[105475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-864a1a13-9c44-4f4d-ab33-8bff690568ec.2f3dc10c-7c59-4058-ad41-48af689084db Sep 29 18:34:09 devstack sudo[105475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:34:09 devstack sudo[105475]: pam_unix(sudo:session): session closed for user root Sep 29 18:34:09 devstack sudo[105473]: pam_unix(sudo:session): session closed for user root Sep 29 18:34:09 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-c482fa40-f0fd-4ed7-bc14-10a948f63669 tempest-VolumesSnapshotTestJSON-1354260036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-864a1a13-9c44-4f4d-ab33-8bff690568ec.2f3dc10c-7c59-4058-ad41-48af689084db" returned: 0 in 0.406s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:34:09 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-c482fa40-f0fd-4ed7-bc14-10a948f63669 tempest-VolumesSnapshotTestJSON-1354260036 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-864a1a13-9c44-4f4d-ab33-8bff690568ec(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86512) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 18:34:09 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-57614104-399d-4ae6-ab86-9f8bbf54d910 tempest-CinderUnicodeTest-1774923702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-82fd2f50-3bed-48fe-b5d2-530259e0d330,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-82fd2f50-3bed-48fe-b5d2-530259e0d330.f9e263be-069b-4a37-bc73-76522577dcf1 1G" returned: 0 in 0.479s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:34:09 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-57614104-399d-4ae6-ab86-9f8bbf54d910 tempest-CinderUnicodeTest-1774923702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82fd2f50-3bed-48fe-b5d2-530259e0d330 -F qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-82fd2f50-3bed-48fe-b5d2-530259e0d330.f9e263be-069b-4a37-bc73-76522577dcf1 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:34:09 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[db35f6fc-3266-4421-9e40-5f702c70c2cf]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:34:09 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-c482fa40-f0fd-4ed7-bc14-10a948f63669 tempest-VolumesSnapshotTestJSON-1354260036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-864a1a13-9c44-4f4d-ab33-8bff690568ec {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:34:09 devstack sudo[105486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82fd2f50-3bed-48fe-b5d2-530259e0d330 -F qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-82fd2f50-3bed-48fe-b5d2-530259e0d330.f9e263be-069b-4a37-bc73-76522577dcf1 Sep 29 18:34:09 devstack sudo[105486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:34:09 devstack sudo[105487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-864a1a13-9c44-4f4d-ab33-8bff690568ec Sep 29 18:34:09 devstack sudo[105487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:34:09 devstack sudo[105486]: pam_unix(sudo:session): session closed for user root Sep 29 18:34:09 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-57614104-399d-4ae6-ab86-9f8bbf54d910 tempest-CinderUnicodeTest-1774923702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82fd2f50-3bed-48fe-b5d2-530259e0d330 -F qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-82fd2f50-3bed-48fe-b5d2-530259e0d330.f9e263be-069b-4a37-bc73-76522577dcf1" returned: 0 in 0.347s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:34:09 devstack cinder-volume[86512]: WARNING cinder.volume.drivers.remotefs [None req-57614104-399d-4ae6-ab86-9f8bbf54d910 tempest-CinderUnicodeTest-1774923702 None] /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-82fd2f50-3bed-48fe-b5d2-530259e0d330.f9e263be-069b-4a37-bc73-76522577dcf1 is being set with open permissions: ugo+rw Sep 29 18:34:09 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-57614104-399d-4ae6-ab86-9f8bbf54d910 tempest-CinderUnicodeTest-1774923702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-82fd2f50-3bed-48fe-b5d2-530259e0d330.f9e263be-069b-4a37-bc73-76522577dcf1 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:34:09 devstack sudo[105495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-82fd2f50-3bed-48fe-b5d2-530259e0d330.f9e263be-069b-4a37-bc73-76522577dcf1 Sep 29 18:34:09 devstack sudo[105495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:34:10 devstack sudo[105487]: pam_unix(sudo:session): session closed for user root Sep 29 18:34:10 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-c482fa40-f0fd-4ed7-bc14-10a948f63669 tempest-VolumesSnapshotTestJSON-1354260036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-864a1a13-9c44-4f4d-ab33-8bff690568ec" returned: 0 in 0.585s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:34:10 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-c482fa40-f0fd-4ed7-bc14-10a948f63669 tempest-VolumesSnapshotTestJSON-1354260036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-864a1a13-9c44-4f4d-ab33-8bff690568ec.2f3dc10c-7c59-4058-ad41-48af689084db {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:34:10 devstack sudo[105499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-864a1a13-9c44-4f4d-ab33-8bff690568ec.2f3dc10c-7c59-4058-ad41-48af689084db Sep 29 18:34:10 devstack sudo[105499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:34:10 devstack sudo[105495]: pam_unix(sudo:session): session closed for user root Sep 29 18:34:10 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-57614104-399d-4ae6-ab86-9f8bbf54d910 tempest-CinderUnicodeTest-1774923702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-82fd2f50-3bed-48fe-b5d2-530259e0d330.f9e263be-069b-4a37-bc73-76522577dcf1" returned: 0 in 0.306s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:34:10 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-57614104-399d-4ae6-ab86-9f8bbf54d910 tempest-CinderUnicodeTest-1774923702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-82fd2f50-3bed-48fe-b5d2-530259e0d330.info {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:34:10 devstack sudo[105501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-82fd2f50-3bed-48fe-b5d2-530259e0d330.info Sep 29 18:34:10 devstack sudo[105501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:34:10 devstack sudo[105501]: pam_unix(sudo:session): session closed for user root Sep 29 18:34:10 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-57614104-399d-4ae6-ab86-9f8bbf54d910 tempest-CinderUnicodeTest-1774923702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-82fd2f50-3bed-48fe-b5d2-530259e0d330.info" returned: 0 in 0.278s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:34:10 devstack cinder-volume[86512]: WARNING cinder.volume.drivers.remotefs [None req-57614104-399d-4ae6-ab86-9f8bbf54d910 tempest-CinderUnicodeTest-1774923702 None] /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-82fd2f50-3bed-48fe-b5d2-530259e0d330.info is being set with open permissions: ugo+rw Sep 29 18:34:10 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-57614104-399d-4ae6-ab86-9f8bbf54d910 tempest-CinderUnicodeTest-1774923702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-82fd2f50-3bed-48fe-b5d2-530259e0d330.info {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:34:10 devstack sudo[105507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-82fd2f50-3bed-48fe-b5d2-530259e0d330.info Sep 29 18:34:10 devstack sudo[105507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:34:10 devstack sudo[105499]: pam_unix(sudo:session): session closed for user root Sep 29 18:34:10 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-c482fa40-f0fd-4ed7-bc14-10a948f63669 tempest-VolumesSnapshotTestJSON-1354260036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-864a1a13-9c44-4f4d-ab33-8bff690568ec.2f3dc10c-7c59-4058-ad41-48af689084db" returned: 0 in 0.414s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:34:10 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-c482fa40-f0fd-4ed7-bc14-10a948f63669 tempest-VolumesSnapshotTestJSON-1354260036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-864a1a13-9c44-4f4d-ab33-8bff690568ec.2f3dc10c-7c59-4058-ad41-48af689084db {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:34:10 devstack sudo[105509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-864a1a13-9c44-4f4d-ab33-8bff690568ec.2f3dc10c-7c59-4058-ad41-48af689084db Sep 29 18:34:10 devstack sudo[105509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:34:10 devstack sudo[105507]: pam_unix(sudo:session): session closed for user root Sep 29 18:34:10 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-57614104-399d-4ae6-ab86-9f8bbf54d910 tempest-CinderUnicodeTest-1774923702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-82fd2f50-3bed-48fe-b5d2-530259e0d330.info" returned: 0 in 0.360s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:34:10 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-57614104-399d-4ae6-ab86-9f8bbf54d910 tempest-CinderUnicodeTest-1774923702 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.462s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:34:10 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-57614104-399d-4ae6-ab86-9f8bbf54d910 tempest-CinderUnicodeTest-1774923702 None] Create snapshot completed successfully Sep 29 18:34:10 devstack sudo[105509]: pam_unix(sudo:session): session closed for user root Sep 29 18:34:10 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-c482fa40-f0fd-4ed7-bc14-10a948f63669 tempest-VolumesSnapshotTestJSON-1354260036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-864a1a13-9c44-4f4d-ab33-8bff690568ec.2f3dc10c-7c59-4058-ad41-48af689084db" returned: 0 in 0.394s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:34:10 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-c482fa40-f0fd-4ed7-bc14-10a948f63669 tempest-VolumesSnapshotTestJSON-1354260036 None] Lock "cinder-quobyte-2f3dc10c-7c59-4058-ad41-48af689084db" released by "_delete_snapshot" :: held 1.925s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:34:10 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-c482fa40-f0fd-4ed7-bc14-10a948f63669 tempest-VolumesSnapshotTestJSON-1354260036 None] Lock "cinder-quobyte-864a1a13-9c44-4f4d-ab33-8bff690568ec" released by "delete_snapshot" :: held 1.962s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:34:11 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-c482fa40-f0fd-4ed7-bc14-10a948f63669 tempest-VolumesSnapshotTestJSON-1354260036 None] Created reservations ['2e0096fd-1033-4409-8447-116af4ebfdaf', '8d54bf84-089e-4ede-a038-58527479b372', '960cd266-38ec-45e3-b2d7-2bebc17386a8', '41116429-aa7a-401c-9b56-33edf4f76b48'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:34:11 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-c482fa40-f0fd-4ed7-bc14-10a948f63669 tempest-VolumesSnapshotTestJSON-1354260036 None] Delete snapshot completed successfully. Sep 29 18:34:11 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-c482fa40-f0fd-4ed7-bc14-10a948f63669 tempest-VolumesSnapshotTestJSON-1354260036 None] Lock "cinder-2f3dc10c-7c59-4058-ad41-48af689084db-delete_snapshot" released by "delete_snapshot" :: held 2.120s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:34:11 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-b5ebf709-7695-46da-8447-c22afa51c7e3 tempest-CinderUnicodeTest-1774923702 None] Acquiring lock "cinder-f9e263be-069b-4a37-bc73-76522577dcf1-delete_snapshot" by "delete_snapshot" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:34:11 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-b5ebf709-7695-46da-8447-c22afa51c7e3 tempest-CinderUnicodeTest-1774923702 None] Lock "cinder-f9e263be-069b-4a37-bc73-76522577dcf1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:34:11 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-b5ebf709-7695-46da-8447-c22afa51c7e3 tempest-CinderUnicodeTest-1774923702 None] Acquiring lock "cinder-quobyte-82fd2f50-3bed-48fe-b5d2-530259e0d330" by "delete_snapshot" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:34:11 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-b5ebf709-7695-46da-8447-c22afa51c7e3 tempest-CinderUnicodeTest-1774923702 None] Lock "cinder-quobyte-82fd2f50-3bed-48fe-b5d2-530259e0d330" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:34:11 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-b5ebf709-7695-46da-8447-c22afa51c7e3 tempest-CinderUnicodeTest-1774923702 None] Acquiring lock "cinder-quobyte-f9e263be-069b-4a37-bc73-76522577dcf1" by "_delete_snapshot" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:34:11 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-b5ebf709-7695-46da-8447-c22afa51c7e3 tempest-CinderUnicodeTest-1774923702 None] Lock "cinder-quobyte-f9e263be-069b-4a37-bc73-76522577dcf1" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:34:11 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-b5ebf709-7695-46da-8447-c22afa51c7e3 tempest-CinderUnicodeTest-1774923702 None] Deleting offline snapshot f9e263be-069b-4a37-bc73-76522577dcf1 of volume 82fd2f50-3bed-48fe-b5d2-530259e0d330 {{(pid=86512) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 18:34:11 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-b5ebf709-7695-46da-8447-c22afa51c7e3 tempest-CinderUnicodeTest-1774923702 None] snapshot_file for this snap is: volume-82fd2f50-3bed-48fe-b5d2-530259e0d330.f9e263be-069b-4a37-bc73-76522577dcf1 {{(pid=86512) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 18:34:11 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[947938ff-2985-46fc-9a9c-3708ee5e1e12]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:34:11 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-b5ebf709-7695-46da-8447-c22afa51c7e3 tempest-CinderUnicodeTest-1774923702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-82fd2f50-3bed-48fe-b5d2-530259e0d330.f9e263be-069b-4a37-bc73-76522577dcf1 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:34:11 devstack sudo[105514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-82fd2f50-3bed-48fe-b5d2-530259e0d330.f9e263be-069b-4a37-bc73-76522577dcf1 Sep 29 18:34:11 devstack sudo[105514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:34:12 devstack sudo[105514]: pam_unix(sudo:session): session closed for user root Sep 29 18:34:12 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-b5ebf709-7695-46da-8447-c22afa51c7e3 tempest-CinderUnicodeTest-1774923702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-82fd2f50-3bed-48fe-b5d2-530259e0d330.f9e263be-069b-4a37-bc73-76522577dcf1" returned: 0 in 0.422s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:34:12 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-b5ebf709-7695-46da-8447-c22afa51c7e3 tempest-CinderUnicodeTest-1774923702 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-82fd2f50-3bed-48fe-b5d2-530259e0d330(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86512) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 18:34:12 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4233c82-a907-4a3b-b01d-9df6ac37c1cd]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:34:12 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-b5ebf709-7695-46da-8447-c22afa51c7e3 tempest-CinderUnicodeTest-1774923702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-82fd2f50-3bed-48fe-b5d2-530259e0d330 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:34:12 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-c1f2233b-3295-4b17-8c86-c3db5dd09b2e tempest-VolumesSnapshotTestJSON-1354260036 None] Acquiring lock "cinder-864a1a13-9c44-4f4d-ab33-8bff690568ec-delete_volume" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:34:12 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-c1f2233b-3295-4b17-8c86-c3db5dd09b2e tempest-VolumesSnapshotTestJSON-1354260036 None] Lock "cinder-864a1a13-9c44-4f4d-ab33-8bff690568ec-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:34:12 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-c1f2233b-3295-4b17-8c86-c3db5dd09b2e tempest-VolumesSnapshotTestJSON-1354260036 None] Acquiring lock "cinder-quobyte-864a1a13-9c44-4f4d-ab33-8bff690568ec" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:34:12 devstack sudo[105519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-82fd2f50-3bed-48fe-b5d2-530259e0d330 Sep 29 18:34:12 devstack sudo[105519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:34:12 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-c1f2233b-3295-4b17-8c86-c3db5dd09b2e tempest-VolumesSnapshotTestJSON-1354260036 None] Lock "cinder-quobyte-864a1a13-9c44-4f4d-ab33-8bff690568ec" acquired by "delete_volume" :: waited 0.021s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:34:12 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bf1981b-c37e-44bc-bb14-b992426df283]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:34:12 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-c1f2233b-3295-4b17-8c86-c3db5dd09b2e tempest-VolumesSnapshotTestJSON-1354260036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-864a1a13-9c44-4f4d-ab33-8bff690568ec {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:34:12 devstack sudo[105521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-864a1a13-9c44-4f4d-ab33-8bff690568ec Sep 29 18:34:12 devstack sudo[105521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:34:12 devstack sudo[105519]: pam_unix(sudo:session): session closed for user root Sep 29 18:34:12 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-b5ebf709-7695-46da-8447-c22afa51c7e3 tempest-CinderUnicodeTest-1774923702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-82fd2f50-3bed-48fe-b5d2-530259e0d330" returned: 0 in 0.454s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:34:12 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-b5ebf709-7695-46da-8447-c22afa51c7e3 tempest-CinderUnicodeTest-1774923702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-82fd2f50-3bed-48fe-b5d2-530259e0d330.f9e263be-069b-4a37-bc73-76522577dcf1 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:34:12 devstack sudo[105526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-82fd2f50-3bed-48fe-b5d2-530259e0d330.f9e263be-069b-4a37-bc73-76522577dcf1 Sep 29 18:34:12 devstack sudo[105526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:34:12 devstack sudo[105521]: pam_unix(sudo:session): session closed for user root Sep 29 18:34:12 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-c1f2233b-3295-4b17-8c86-c3db5dd09b2e tempest-VolumesSnapshotTestJSON-1354260036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-864a1a13-9c44-4f4d-ab33-8bff690568ec" returned: 0 in 0.417s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:34:12 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-c1f2233b-3295-4b17-8c86-c3db5dd09b2e tempest-VolumesSnapshotTestJSON-1354260036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-864a1a13-9c44-4f4d-ab33-8bff690568ec {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:34:12 devstack sudo[105531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-864a1a13-9c44-4f4d-ab33-8bff690568ec Sep 29 18:34:12 devstack sudo[105531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:34:13 devstack sudo[105526]: pam_unix(sudo:session): session closed for user root Sep 29 18:34:13 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-b5ebf709-7695-46da-8447-c22afa51c7e3 tempest-CinderUnicodeTest-1774923702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-82fd2f50-3bed-48fe-b5d2-530259e0d330.f9e263be-069b-4a37-bc73-76522577dcf1" returned: 0 in 0.381s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:34:13 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-b5ebf709-7695-46da-8447-c22afa51c7e3 tempest-CinderUnicodeTest-1774923702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-82fd2f50-3bed-48fe-b5d2-530259e0d330.f9e263be-069b-4a37-bc73-76522577dcf1 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:34:13 devstack sudo[105536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-82fd2f50-3bed-48fe-b5d2-530259e0d330.f9e263be-069b-4a37-bc73-76522577dcf1 Sep 29 18:34:13 devstack sudo[105536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:34:13 devstack sudo[105531]: pam_unix(sudo:session): session closed for user root Sep 29 18:34:13 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-c1f2233b-3295-4b17-8c86-c3db5dd09b2e tempest-VolumesSnapshotTestJSON-1354260036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-864a1a13-9c44-4f4d-ab33-8bff690568ec" returned: 0 in 0.337s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:34:13 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-c1f2233b-3295-4b17-8c86-c3db5dd09b2e tempest-VolumesSnapshotTestJSON-1354260036 None] Lock "cinder-quobyte-864a1a13-9c44-4f4d-ab33-8bff690568ec" released by "delete_volume" :: held 0.873s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:34:13 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-c1f2233b-3295-4b17-8c86-c3db5dd09b2e tempest-VolumesSnapshotTestJSON-1354260036 None] Created reservations ['5ffb37fd-15c1-426d-aa58-45121a2536f8', '335021d8-da01-413b-b3bf-55d08b2c41ab', '3c6254d4-b5b7-4cf4-903e-6a245958ec8d', '6cfba9d3-1cc0-44e5-85e8-634b22fe6494'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:34:13 devstack sudo[105536]: pam_unix(sudo:session): session closed for user root Sep 29 18:34:13 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-b5ebf709-7695-46da-8447-c22afa51c7e3 tempest-CinderUnicodeTest-1774923702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-82fd2f50-3bed-48fe-b5d2-530259e0d330.f9e263be-069b-4a37-bc73-76522577dcf1" returned: 0 in 0.310s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:34:13 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-c1f2233b-3295-4b17-8c86-c3db5dd09b2e tempest-VolumesSnapshotTestJSON-1354260036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:34:13 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-c1f2233b-3295-4b17-8c86-c3db5dd09b2e tempest-VolumesSnapshotTestJSON-1354260036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:34:13 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-c1f2233b-3295-4b17-8c86-c3db5dd09b2e tempest-VolumesSnapshotTestJSON-1354260036 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:34:13 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-c1f2233b-3295-4b17-8c86-c3db5dd09b2e tempest-VolumesSnapshotTestJSON-1354260036 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:34:13 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-c1f2233b-3295-4b17-8c86-c3db5dd09b2e tempest-VolumesSnapshotTestJSON-1354260036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:34:13 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-c1f2233b-3295-4b17-8c86-c3db5dd09b2e tempest-VolumesSnapshotTestJSON-1354260036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:34:13 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-b5ebf709-7695-46da-8447-c22afa51c7e3 tempest-CinderUnicodeTest-1774923702 None] Lock "cinder-quobyte-f9e263be-069b-4a37-bc73-76522577dcf1" released by "_delete_snapshot" :: held 1.731s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:34:13 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-b5ebf709-7695-46da-8447-c22afa51c7e3 tempest-CinderUnicodeTest-1774923702 None] Lock "cinder-quobyte-82fd2f50-3bed-48fe-b5d2-530259e0d330" released by "delete_snapshot" :: held 1.764s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:34:13 devstack sudo[105541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:34:13 devstack sudo[105541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:34:13 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-b5ebf709-7695-46da-8447-c22afa51c7e3 tempest-CinderUnicodeTest-1774923702 None] Created reservations ['9c6bf8ca-0a49-4703-a1e2-943a98483e29', '33acb63e-896d-4c14-ae1c-04bff81d376e', '18f9745e-a8ff-44f7-b284-4e2a685887da', 'e4d63728-fe2d-4750-b1bd-9471a7b529ac'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:34:13 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-b5ebf709-7695-46da-8447-c22afa51c7e3 tempest-CinderUnicodeTest-1774923702 None] Delete snapshot completed successfully. Sep 29 18:34:13 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-b5ebf709-7695-46da-8447-c22afa51c7e3 tempest-CinderUnicodeTest-1774923702 None] Lock "cinder-f9e263be-069b-4a37-bc73-76522577dcf1-delete_snapshot" released by "delete_snapshot" :: held 1.937s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:34:13 devstack sudo[105541]: pam_unix(sudo:session): session closed for user root Sep 29 18:34:13 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-c1f2233b-3295-4b17-8c86-c3db5dd09b2e tempest-VolumesSnapshotTestJSON-1354260036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.297s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:34:13 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-c1f2233b-3295-4b17-8c86-c3db5dd09b2e tempest-VolumesSnapshotTestJSON-1354260036 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:34:13 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-c1f2233b-3295-4b17-8c86-c3db5dd09b2e tempest-VolumesSnapshotTestJSON-1354260036 None] Deleted volume successfully. Sep 29 18:34:13 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-c1f2233b-3295-4b17-8c86-c3db5dd09b2e tempest-VolumesSnapshotTestJSON-1354260036 None] Lock "cinder-864a1a13-9c44-4f4d-ab33-8bff690568ec-delete_volume" released by "delete_volume" :: held 1.461s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:34:13 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-708562e5-3846-4277-bd86-a5d1021b4584 tempest-CinderUnicodeTest-1774923702 None] Acquiring lock "cinder-82fd2f50-3bed-48fe-b5d2-530259e0d330-delete_volume" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:34:13 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-708562e5-3846-4277-bd86-a5d1021b4584 tempest-CinderUnicodeTest-1774923702 None] Lock "cinder-82fd2f50-3bed-48fe-b5d2-530259e0d330-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:34:13 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-708562e5-3846-4277-bd86-a5d1021b4584 tempest-CinderUnicodeTest-1774923702 None] Acquiring lock "cinder-quobyte-82fd2f50-3bed-48fe-b5d2-530259e0d330" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:34:13 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-708562e5-3846-4277-bd86-a5d1021b4584 tempest-CinderUnicodeTest-1774923702 None] Lock "cinder-quobyte-82fd2f50-3bed-48fe-b5d2-530259e0d330" acquired by "delete_volume" :: waited 0.019s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:34:14 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab7c9bcd-633f-446a-b098-25b929d9452f]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:34:14 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-708562e5-3846-4277-bd86-a5d1021b4584 tempest-CinderUnicodeTest-1774923702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-82fd2f50-3bed-48fe-b5d2-530259e0d330 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:34:14 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-175d71fd-3f08-4a55-ad8e-74cd0906694f tempest-VolumesSnapshotTestJSON-1354260036 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86512) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:34:14 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-175d71fd-3f08-4a55-ad8e-74cd0906694f tempest-VolumesSnapshotTestJSON-1354260036 None] Flow 'volume_create_manager' (8e65ff7f-a2b5-4445-aea2-fed82854c207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:34:14 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-175d71fd-3f08-4a55-ad8e-74cd0906694f tempest-VolumesSnapshotTestJSON-1354260036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc6a5574-c84d-40c2-8f91-3e131eab1e4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:34:14 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-175d71fd-3f08-4a55-ad8e-74cd0906694f tempest-VolumesSnapshotTestJSON-1354260036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc6a5574-c84d-40c2-8f91-3e131eab1e4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:34:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-310059080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7359aedd-cb5c-4684-b84b-607b5f28b04b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd288a0f9bec4d359ab34e9f2079e2ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:34:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:34:14Z,use_quota=True,user_id='1efcc6a2f76e46dbae7d214b0f803523',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:34:14 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-175d71fd-3f08-4a55-ad8e-74cd0906694f tempest-VolumesSnapshotTestJSON-1354260036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7795028f-7ba9-4272-a817-6957c192b088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:34:14 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-175d71fd-3f08-4a55-ad8e-74cd0906694f tempest-VolumesSnapshotTestJSON-1354260036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7795028f-7ba9-4272-a817-6957c192b088) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:34:14 devstack sudo[105545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-82fd2f50-3bed-48fe-b5d2-530259e0d330 Sep 29 18:34:14 devstack sudo[105545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:34:14 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-175d71fd-3f08-4a55-ad8e-74cd0906694f tempest-VolumesSnapshotTestJSON-1354260036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (565cb8f3-6f8d-42e1-b89b-4144b80964d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:34:14 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-175d71fd-3f08-4a55-ad8e-74cd0906694f tempest-VolumesSnapshotTestJSON-1354260036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (565cb8f3-6f8d-42e1-b89b-4144b80964d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7359aedd-cb5c-4684-b84b-607b5f28b04b', 'volume_name': 'volume-7359aedd-cb5c-4684-b84b-607b5f28b04b', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:34:14 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-175d71fd-3f08-4a55-ad8e-74cd0906694f tempest-VolumesSnapshotTestJSON-1354260036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a530c303-a454-44a2-aa2d-64dd8791e468) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:34:14 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-175d71fd-3f08-4a55-ad8e-74cd0906694f tempest-VolumesSnapshotTestJSON-1354260036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a530c303-a454-44a2-aa2d-64dd8791e468) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:34:14 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-175d71fd-3f08-4a55-ad8e-74cd0906694f tempest-VolumesSnapshotTestJSON-1354260036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (236bf525-2c29-4af9-ac0e-1f75afaf0210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:34:14 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-175d71fd-3f08-4a55-ad8e-74cd0906694f tempest-VolumesSnapshotTestJSON-1354260036 None] Volume 7359aedd-cb5c-4684-b84b-607b5f28b04b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7359aedd-cb5c-4684-b84b-607b5f28b04b', 'volume_size': 1} Sep 29 18:34:14 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-175d71fd-3f08-4a55-ad8e-74cd0906694f tempest-VolumesSnapshotTestJSON-1354260036 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:34:14 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-175d71fd-3f08-4a55-ad8e-74cd0906694f tempest-VolumesSnapshotTestJSON-1354260036 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:34:14 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-175d71fd-3f08-4a55-ad8e-74cd0906694f tempest-VolumesSnapshotTestJSON-1354260036 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:34:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-310059080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7359aedd-cb5c-4684-b84b-607b5f28b04b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd288a0f9bec4d359ab34e9f2079e2ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:34:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:34:14Z,use_quota=True,user_id='1efcc6a2f76e46dbae7d214b0f803523',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)}" {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:34:14 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-175d71fd-3f08-4a55-ad8e-74cd0906694f tempest-VolumesSnapshotTestJSON-1354260036 None] Creating volume 7359aedd-cb5c-4684-b84b-607b5f28b04b {{(pid=86512) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:34:14 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-175d71fd-3f08-4a55-ad8e-74cd0906694f tempest-VolumesSnapshotTestJSON-1354260036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:34:14 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-175d71fd-3f08-4a55-ad8e-74cd0906694f tempest-VolumesSnapshotTestJSON-1354260036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:34:14 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-175d71fd-3f08-4a55-ad8e-74cd0906694f tempest-VolumesSnapshotTestJSON-1354260036 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:34:14 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-175d71fd-3f08-4a55-ad8e-74cd0906694f tempest-VolumesSnapshotTestJSON-1354260036 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:34:14 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-175d71fd-3f08-4a55-ad8e-74cd0906694f tempest-VolumesSnapshotTestJSON-1354260036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:34:14 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-175d71fd-3f08-4a55-ad8e-74cd0906694f tempest-VolumesSnapshotTestJSON-1354260036 None] Selected osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 as target Quobyte volume. {{(pid=86512) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:34:14 devstack cinder-volume[86512]: INFO cinder.volume.drivers.remotefs [None req-175d71fd-3f08-4a55-ad8e-74cd0906694f tempest-VolumesSnapshotTestJSON-1354260036 None] casted to osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 Sep 29 18:34:14 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-175d71fd-3f08-4a55-ad8e-74cd0906694f tempest-VolumesSnapshotTestJSON-1354260036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7359aedd-cb5c-4684-b84b-607b5f28b04b 1073741824 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:34:14 devstack sudo[105547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7359aedd-cb5c-4684-b84b-607b5f28b04b 1073741824 Sep 29 18:34:14 devstack sudo[105547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:34:14 devstack sudo[105545]: pam_unix(sudo:session): session closed for user root Sep 29 18:34:14 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-708562e5-3846-4277-bd86-a5d1021b4584 tempest-CinderUnicodeTest-1774923702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-82fd2f50-3bed-48fe-b5d2-530259e0d330" returned: 0 in 0.416s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:34:14 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-708562e5-3846-4277-bd86-a5d1021b4584 tempest-CinderUnicodeTest-1774923702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-82fd2f50-3bed-48fe-b5d2-530259e0d330 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:34:14 devstack sudo[105554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-82fd2f50-3bed-48fe-b5d2-530259e0d330 Sep 29 18:34:14 devstack sudo[105554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:34:14 devstack sudo[105547]: pam_unix(sudo:session): session closed for user root Sep 29 18:34:14 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-175d71fd-3f08-4a55-ad8e-74cd0906694f tempest-VolumesSnapshotTestJSON-1354260036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7359aedd-cb5c-4684-b84b-607b5f28b04b 1073741824" returned: 0 in 0.498s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:34:14 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-175d71fd-3f08-4a55-ad8e-74cd0906694f tempest-VolumesSnapshotTestJSON-1354260036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7359aedd-cb5c-4684-b84b-607b5f28b04b {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:34:14 devstack sudo[105554]: pam_unix(sudo:session): session closed for user root Sep 29 18:34:14 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-708562e5-3846-4277-bd86-a5d1021b4584 tempest-CinderUnicodeTest-1774923702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-82fd2f50-3bed-48fe-b5d2-530259e0d330" returned: 0 in 0.283s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:34:14 devstack sudo[105559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7359aedd-cb5c-4684-b84b-607b5f28b04b Sep 29 18:34:14 devstack sudo[105559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:34:14 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-708562e5-3846-4277-bd86-a5d1021b4584 tempest-CinderUnicodeTest-1774923702 None] Lock "cinder-quobyte-82fd2f50-3bed-48fe-b5d2-530259e0d330" released by "delete_volume" :: held 0.780s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:34:14 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-708562e5-3846-4277-bd86-a5d1021b4584 tempest-CinderUnicodeTest-1774923702 None] Created reservations ['5b9722d5-1fec-42fa-a6dc-827001a386f1', '7698b8b9-b963-436a-a69e-642123b6f706', '88368fff-9535-4bf6-9c4e-74a8d279a220', 'fe9cd4d0-64e8-40e9-a4b5-09a3866ce176'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:34:14 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-708562e5-3846-4277-bd86-a5d1021b4584 tempest-CinderUnicodeTest-1774923702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:34:14 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-708562e5-3846-4277-bd86-a5d1021b4584 tempest-CinderUnicodeTest-1774923702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:34:14 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-708562e5-3846-4277-bd86-a5d1021b4584 tempest-CinderUnicodeTest-1774923702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:34:14 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-708562e5-3846-4277-bd86-a5d1021b4584 tempest-CinderUnicodeTest-1774923702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:34:14 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-708562e5-3846-4277-bd86-a5d1021b4584 tempest-CinderUnicodeTest-1774923702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:34:14 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-708562e5-3846-4277-bd86-a5d1021b4584 tempest-CinderUnicodeTest-1774923702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:34:14 devstack sudo[105561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:34:14 devstack sudo[105561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:34:14 devstack sudo[105559]: pam_unix(sudo:session): session closed for user root Sep 29 18:34:14 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-175d71fd-3f08-4a55-ad8e-74cd0906694f tempest-VolumesSnapshotTestJSON-1354260036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7359aedd-cb5c-4684-b84b-607b5f28b04b" returned: 0 in 0.285s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:34:14 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-175d71fd-3f08-4a55-ad8e-74cd0906694f tempest-VolumesSnapshotTestJSON-1354260036 None] <== create_volume: return (830ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'} {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:34:14 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-175d71fd-3f08-4a55-ad8e-74cd0906694f tempest-VolumesSnapshotTestJSON-1354260036 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.834s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:34:15 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-175d71fd-3f08-4a55-ad8e-74cd0906694f tempest-VolumesSnapshotTestJSON-1354260036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (236bf525-2c29-4af9-ac0e-1f75afaf0210) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7359aedd-cb5c-4684-b84b-607b5f28b04b', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:34:15 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-175d71fd-3f08-4a55-ad8e-74cd0906694f tempest-VolumesSnapshotTestJSON-1354260036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f6639f9-9a27-48bc-a9ad-3d1ed8412081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:34:15 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-175d71fd-3f08-4a55-ad8e-74cd0906694f tempest-VolumesSnapshotTestJSON-1354260036 None] Volume volume-7359aedd-cb5c-4684-b84b-607b5f28b04b (7359aedd-cb5c-4684-b84b-607b5f28b04b): created successfully Sep 29 18:34:15 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-175d71fd-3f08-4a55-ad8e-74cd0906694f tempest-VolumesSnapshotTestJSON-1354260036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f6639f9-9a27-48bc-a9ad-3d1ed8412081) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:34:15 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-175d71fd-3f08-4a55-ad8e-74cd0906694f tempest-VolumesSnapshotTestJSON-1354260036 None] Flow 'volume_create_manager' (8e65ff7f-a2b5-4445-aea2-fed82854c207) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:34:15 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-175d71fd-3f08-4a55-ad8e-74cd0906694f tempest-VolumesSnapshotTestJSON-1354260036 None] Created volume successfully. Sep 29 18:34:15 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-bd485af4-97c6-4ad3-91c5-82c1acd2d6c5 tempest-CinderUnicodeTest-1774923702 None] Acquiring lock "cinder-9b0fe5b9-2be1-4d3f-9261-32037b5f216e-delete_volume" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:34:15 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-bd485af4-97c6-4ad3-91c5-82c1acd2d6c5 tempest-CinderUnicodeTest-1774923702 None] Lock "cinder-9b0fe5b9-2be1-4d3f-9261-32037b5f216e-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:34:15 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-bd485af4-97c6-4ad3-91c5-82c1acd2d6c5 tempest-CinderUnicodeTest-1774923702 None] Acquiring lock "cinder-quobyte-9b0fe5b9-2be1-4d3f-9261-32037b5f216e" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:34:15 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-bd485af4-97c6-4ad3-91c5-82c1acd2d6c5 tempest-CinderUnicodeTest-1774923702 None] Lock "cinder-quobyte-9b0fe5b9-2be1-4d3f-9261-32037b5f216e" acquired by "delete_volume" :: waited 0.024s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:34:15 devstack sudo[105561]: pam_unix(sudo:session): session closed for user root Sep 29 18:34:15 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-708562e5-3846-4277-bd86-a5d1021b4584 tempest-CinderUnicodeTest-1774923702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.345s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:34:15 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-708562e5-3846-4277-bd86-a5d1021b4584 tempest-CinderUnicodeTest-1774923702 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:34:15 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-708562e5-3846-4277-bd86-a5d1021b4584 tempest-CinderUnicodeTest-1774923702 None] Deleted volume successfully. Sep 29 18:34:15 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[be1b35e4-7229-4c99-8b19-47c5fea69d84]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:34:15 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-bd485af4-97c6-4ad3-91c5-82c1acd2d6c5 tempest-CinderUnicodeTest-1774923702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-9b0fe5b9-2be1-4d3f-9261-32037b5f216e {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:34:15 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-708562e5-3846-4277-bd86-a5d1021b4584 tempest-CinderUnicodeTest-1774923702 None] Lock "cinder-82fd2f50-3bed-48fe-b5d2-530259e0d330-delete_volume" released by "delete_volume" :: held 1.361s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:34:15 devstack sudo[105565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-9b0fe5b9-2be1-4d3f-9261-32037b5f216e Sep 29 18:34:15 devstack sudo[105565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:34:15 devstack sudo[105565]: pam_unix(sudo:session): session closed for user root Sep 29 18:34:15 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-bd485af4-97c6-4ad3-91c5-82c1acd2d6c5 tempest-CinderUnicodeTest-1774923702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-9b0fe5b9-2be1-4d3f-9261-32037b5f216e" returned: 0 in 0.402s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:34:15 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-bd485af4-97c6-4ad3-91c5-82c1acd2d6c5 tempest-CinderUnicodeTest-1774923702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-9b0fe5b9-2be1-4d3f-9261-32037b5f216e {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:34:15 devstack sudo[105570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-9b0fe5b9-2be1-4d3f-9261-32037b5f216e Sep 29 18:34:15 devstack sudo[105570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:34:15 devstack sudo[105570]: pam_unix(sudo:session): session closed for user root Sep 29 18:34:15 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-bd485af4-97c6-4ad3-91c5-82c1acd2d6c5 tempest-CinderUnicodeTest-1774923702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-9b0fe5b9-2be1-4d3f-9261-32037b5f216e" returned: 0 in 0.264s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:34:15 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-bd485af4-97c6-4ad3-91c5-82c1acd2d6c5 tempest-CinderUnicodeTest-1774923702 None] Lock "cinder-quobyte-9b0fe5b9-2be1-4d3f-9261-32037b5f216e" released by "delete_volume" :: held 0.722s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:34:15 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-bd485af4-97c6-4ad3-91c5-82c1acd2d6c5 tempest-CinderUnicodeTest-1774923702 None] Created reservations ['a4f4ba77-536b-4b0b-b0ca-a1433be884b3', 'a77fc033-123b-4970-894b-e15cfe2bdec1', '93337b45-c940-4240-ad34-00440b6ec4d3', '277b4f66-1f78-412b-9487-ead50d2d5c85'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:34:16 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-bd485af4-97c6-4ad3-91c5-82c1acd2d6c5 tempest-CinderUnicodeTest-1774923702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:34:16 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-bd485af4-97c6-4ad3-91c5-82c1acd2d6c5 tempest-CinderUnicodeTest-1774923702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:34:16 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-bd485af4-97c6-4ad3-91c5-82c1acd2d6c5 tempest-CinderUnicodeTest-1774923702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:34:16 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-bd485af4-97c6-4ad3-91c5-82c1acd2d6c5 tempest-CinderUnicodeTest-1774923702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:34:16 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-bd485af4-97c6-4ad3-91c5-82c1acd2d6c5 tempest-CinderUnicodeTest-1774923702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:34:16 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-bd485af4-97c6-4ad3-91c5-82c1acd2d6c5 tempest-CinderUnicodeTest-1774923702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:34:16 devstack sudo[105573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:34:16 devstack sudo[105573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:34:16 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-5631854d-afab-4f28-820f-74eec41ca281 tempest-VolumesSnapshotTestJSON-1354260036 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:34:16 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-5631854d-afab-4f28-820f-74eec41ca281 tempest-VolumesSnapshotTestJSON-1354260036 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:34:16 devstack sudo[105573]: pam_unix(sudo:session): session closed for user root Sep 29 18:34:16 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-5631854d-afab-4f28-820f-74eec41ca281 tempest-VolumesSnapshotTestJSON-1354260036 None] Creating offline snapshot 4a759da5-3f94-47a9-962f-33c1dfd506d3 of volume 7359aedd-cb5c-4684-b84b-607b5f28b04b {{(pid=86512) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 18:34:16 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-bd485af4-97c6-4ad3-91c5-82c1acd2d6c5 tempest-CinderUnicodeTest-1774923702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.402s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:34:16 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-bd485af4-97c6-4ad3-91c5-82c1acd2d6c5 tempest-CinderUnicodeTest-1774923702 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:34:16 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-bd485af4-97c6-4ad3-91c5-82c1acd2d6c5 tempest-CinderUnicodeTest-1774923702 None] Deleted volume successfully. Sep 29 18:34:16 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[92baaf8d-6759-46d6-be9d-98dcf32f5d31]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:34:16 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-5631854d-afab-4f28-820f-74eec41ca281 tempest-VolumesSnapshotTestJSON-1354260036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7359aedd-cb5c-4684-b84b-607b5f28b04b {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:34:16 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-bd485af4-97c6-4ad3-91c5-82c1acd2d6c5 tempest-CinderUnicodeTest-1774923702 None] Lock "cinder-9b0fe5b9-2be1-4d3f-9261-32037b5f216e-delete_volume" released by "delete_volume" :: held 1.377s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:34:16 devstack sudo[105577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7359aedd-cb5c-4684-b84b-607b5f28b04b Sep 29 18:34:16 devstack sudo[105577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:34:16 devstack sudo[105577]: pam_unix(sudo:session): session closed for user root Sep 29 18:34:16 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-5631854d-afab-4f28-820f-74eec41ca281 tempest-VolumesSnapshotTestJSON-1354260036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7359aedd-cb5c-4684-b84b-607b5f28b04b" returned: 0 in 0.413s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:34:16 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-5631854d-afab-4f28-820f-74eec41ca281 tempest-VolumesSnapshotTestJSON-1354260036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7359aedd-cb5c-4684-b84b-607b5f28b04b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7359aedd-cb5c-4684-b84b-607b5f28b04b.4a759da5-3f94-47a9-962f-33c1dfd506d3 1G {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:34:16 devstack sudo[105582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7359aedd-cb5c-4684-b84b-607b5f28b04b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7359aedd-cb5c-4684-b84b-607b5f28b04b.4a759da5-3f94-47a9-962f-33c1dfd506d3 1G Sep 29 18:34:16 devstack sudo[105582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:34:17 devstack sudo[105582]: pam_unix(sudo:session): session closed for user root Sep 29 18:34:17 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-5631854d-afab-4f28-820f-74eec41ca281 tempest-VolumesSnapshotTestJSON-1354260036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7359aedd-cb5c-4684-b84b-607b5f28b04b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7359aedd-cb5c-4684-b84b-607b5f28b04b.4a759da5-3f94-47a9-962f-33c1dfd506d3 1G" returned: 0 in 0.525s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:34:17 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-5631854d-afab-4f28-820f-74eec41ca281 tempest-VolumesSnapshotTestJSON-1354260036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7359aedd-cb5c-4684-b84b-607b5f28b04b -F qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7359aedd-cb5c-4684-b84b-607b5f28b04b.4a759da5-3f94-47a9-962f-33c1dfd506d3 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:34:17 devstack sudo[105588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7359aedd-cb5c-4684-b84b-607b5f28b04b -F qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7359aedd-cb5c-4684-b84b-607b5f28b04b.4a759da5-3f94-47a9-962f-33c1dfd506d3 Sep 29 18:34:17 devstack sudo[105588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:34:17 devstack sudo[105588]: pam_unix(sudo:session): session closed for user root Sep 29 18:34:17 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-5631854d-afab-4f28-820f-74eec41ca281 tempest-VolumesSnapshotTestJSON-1354260036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7359aedd-cb5c-4684-b84b-607b5f28b04b -F qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7359aedd-cb5c-4684-b84b-607b5f28b04b.4a759da5-3f94-47a9-962f-33c1dfd506d3" returned: 0 in 0.330s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:34:17 devstack cinder-volume[86512]: WARNING cinder.volume.drivers.remotefs [None req-5631854d-afab-4f28-820f-74eec41ca281 tempest-VolumesSnapshotTestJSON-1354260036 None] /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7359aedd-cb5c-4684-b84b-607b5f28b04b.4a759da5-3f94-47a9-962f-33c1dfd506d3 is being set with open permissions: ugo+rw Sep 29 18:34:17 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-5631854d-afab-4f28-820f-74eec41ca281 tempest-VolumesSnapshotTestJSON-1354260036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7359aedd-cb5c-4684-b84b-607b5f28b04b.4a759da5-3f94-47a9-962f-33c1dfd506d3 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:34:17 devstack sudo[105593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7359aedd-cb5c-4684-b84b-607b5f28b04b.4a759da5-3f94-47a9-962f-33c1dfd506d3 Sep 29 18:34:17 devstack sudo[105593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:34:18 devstack sudo[105593]: pam_unix(sudo:session): session closed for user root Sep 29 18:34:18 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-5631854d-afab-4f28-820f-74eec41ca281 tempest-VolumesSnapshotTestJSON-1354260036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7359aedd-cb5c-4684-b84b-607b5f28b04b.4a759da5-3f94-47a9-962f-33c1dfd506d3" returned: 0 in 0.310s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:34:18 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-5631854d-afab-4f28-820f-74eec41ca281 tempest-VolumesSnapshotTestJSON-1354260036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7359aedd-cb5c-4684-b84b-607b5f28b04b.info {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:34:18 devstack sudo[105596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7359aedd-cb5c-4684-b84b-607b5f28b04b.info Sep 29 18:34:18 devstack sudo[105596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:34:18 devstack sudo[105596]: pam_unix(sudo:session): session closed for user root Sep 29 18:34:18 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-5631854d-afab-4f28-820f-74eec41ca281 tempest-VolumesSnapshotTestJSON-1354260036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7359aedd-cb5c-4684-b84b-607b5f28b04b.info" returned: 0 in 0.279s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:34:18 devstack cinder-volume[86512]: WARNING cinder.volume.drivers.remotefs [None req-5631854d-afab-4f28-820f-74eec41ca281 tempest-VolumesSnapshotTestJSON-1354260036 None] /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7359aedd-cb5c-4684-b84b-607b5f28b04b.info is being set with open permissions: ugo+rw Sep 29 18:34:18 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-5631854d-afab-4f28-820f-74eec41ca281 tempest-VolumesSnapshotTestJSON-1354260036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7359aedd-cb5c-4684-b84b-607b5f28b04b.info {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:34:18 devstack sudo[105599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7359aedd-cb5c-4684-b84b-607b5f28b04b.info Sep 29 18:34:18 devstack sudo[105599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:34:18 devstack sudo[105599]: pam_unix(sudo:session): session closed for user root Sep 29 18:34:18 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-5631854d-afab-4f28-820f-74eec41ca281 tempest-VolumesSnapshotTestJSON-1354260036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7359aedd-cb5c-4684-b84b-607b5f28b04b.info" returned: 0 in 0.297s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:34:18 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-5631854d-afab-4f28-820f-74eec41ca281 tempest-VolumesSnapshotTestJSON-1354260036 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.287s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:34:18 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-5631854d-afab-4f28-820f-74eec41ca281 tempest-VolumesSnapshotTestJSON-1354260036 None] Create snapshot completed successfully Sep 29 18:34:20 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-14200602-98eb-4f4b-a501-eedf929754ac tempest-VolumesSnapshotTestJSON-1354260036 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86512) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:34:20 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-14200602-98eb-4f4b-a501-eedf929754ac tempest-VolumesSnapshotTestJSON-1354260036 None] Flow 'volume_create_manager' (8654be3e-eb52-42d3-8aaf-e547ce5c2cf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:34:20 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-14200602-98eb-4f4b-a501-eedf929754ac tempest-VolumesSnapshotTestJSON-1354260036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c5a1a3a-cbcd-40e2-b2a9-020d19989908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:34:20 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-14200602-98eb-4f4b-a501-eedf929754ac tempest-VolumesSnapshotTestJSON-1354260036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c5a1a3a-cbcd-40e2-b2a9-020d19989908) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:34:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2108980604',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=857eabb2-efb3-42a1-af53-44415ae87ea6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd288a0f9bec4d359ab34e9f2079e2ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:34:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=4a759da5-3f94-47a9-962f-33c1dfd506d3,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:34:20Z,use_quota=True,user_id='1efcc6a2f76e46dbae7d214b0f803523',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:34:20 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-14200602-98eb-4f4b-a501-eedf929754ac tempest-VolumesSnapshotTestJSON-1354260036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57ed0501-9b81-47b0-9fcb-a29866bbc8d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:34:20 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-14200602-98eb-4f4b-a501-eedf929754ac tempest-VolumesSnapshotTestJSON-1354260036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57ed0501-9b81-47b0-9fcb-a29866bbc8d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:34:20 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-14200602-98eb-4f4b-a501-eedf929754ac tempest-VolumesSnapshotTestJSON-1354260036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a360b27-8ff9-4715-a231-6a785c1327a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:34:20 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-14200602-98eb-4f4b-a501-eedf929754ac tempest-VolumesSnapshotTestJSON-1354260036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a360b27-8ff9-4715-a231-6a785c1327a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '857eabb2-efb3-42a1-af53-44415ae87ea6', 'volume_name': 'volume-857eabb2-efb3-42a1-af53-44415ae87ea6', 'volume_size': 1, 'snapshot_id': '4a759da5-3f94-47a9-962f-33c1dfd506d3'}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:34:20 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-14200602-98eb-4f4b-a501-eedf929754ac tempest-VolumesSnapshotTestJSON-1354260036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45ceff1b-6798-46dc-9585-02e6413849fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:34:20 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-14200602-98eb-4f4b-a501-eedf929754ac tempest-VolumesSnapshotTestJSON-1354260036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45ceff1b-6798-46dc-9585-02e6413849fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:34:20 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-14200602-98eb-4f4b-a501-eedf929754ac tempest-VolumesSnapshotTestJSON-1354260036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47d86e4f-c33f-47e9-a026-5324d2e46016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:34:20 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-14200602-98eb-4f4b-a501-eedf929754ac tempest-VolumesSnapshotTestJSON-1354260036 None] Volume 857eabb2-efb3-42a1-af53-44415ae87ea6: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-857eabb2-efb3-42a1-af53-44415ae87ea6', 'volume_size': 1, 'snapshot_id': '4a759da5-3f94-47a9-962f-33c1dfd506d3'} Sep 29 18:34:20 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-14200602-98eb-4f4b-a501-eedf929754ac tempest-VolumesSnapshotTestJSON-1354260036 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:34:20 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-14200602-98eb-4f4b-a501-eedf929754ac tempest-VolumesSnapshotTestJSON-1354260036 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:34:20 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-14200602-98eb-4f4b-a501-eedf929754ac tempest-VolumesSnapshotTestJSON-1354260036 None] Acquiring lock "cinder-quobyte-4a759da5-3f94-47a9-962f-33c1dfd506d3-857eabb2-efb3-42a1-af53-44415ae87ea6" by "_create_volume_from_snapshot" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:34:20 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-14200602-98eb-4f4b-a501-eedf929754ac tempest-VolumesSnapshotTestJSON-1354260036 None] Lock "cinder-quobyte-4a759da5-3f94-47a9-962f-33c1dfd506d3-857eabb2-efb3-42a1-af53-44415ae87ea6" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:34:20 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-14200602-98eb-4f4b-a501-eedf929754ac tempest-VolumesSnapshotTestJSON-1354260036 None] Creating volume 857eabb2-efb3-42a1-af53-44415ae87ea6 from snapshot 4a759da5-3f94-47a9-962f-33c1dfd506d3 {{(pid=86512) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 29 18:34:20 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-14200602-98eb-4f4b-a501-eedf929754ac tempest-VolumesSnapshotTestJSON-1354260036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:34:20 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-14200602-98eb-4f4b-a501-eedf929754ac tempest-VolumesSnapshotTestJSON-1354260036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:34:20 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-14200602-98eb-4f4b-a501-eedf929754ac tempest-VolumesSnapshotTestJSON-1354260036 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:34:20 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-14200602-98eb-4f4b-a501-eedf929754ac tempest-VolumesSnapshotTestJSON-1354260036 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:34:20 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-14200602-98eb-4f4b-a501-eedf929754ac tempest-VolumesSnapshotTestJSON-1354260036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:34:20 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-14200602-98eb-4f4b-a501-eedf929754ac tempest-VolumesSnapshotTestJSON-1354260036 None] Selected osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 as target Quobyte volume. {{(pid=86512) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:34:20 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-14200602-98eb-4f4b-a501-eedf929754ac tempest-VolumesSnapshotTestJSON-1354260036 None] Acquiring lock "cinder-quobyte-857eabb2-efb3-42a1-af53-44415ae87ea6" by "_copy_volume_from_snapshot" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:34:20 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-14200602-98eb-4f4b-a501-eedf929754ac tempest-VolumesSnapshotTestJSON-1354260036 None] Lock "cinder-quobyte-857eabb2-efb3-42a1-af53-44415ae87ea6" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:34:20 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-14200602-98eb-4f4b-a501-eedf929754ac tempest-VolumesSnapshotTestJSON-1354260036 None] snapshot: 4a759da5-3f94-47a9-962f-33c1dfd506d3, volume: 857eabb2-efb3-42a1-af53-44415ae87ea6, {{(pid=86512) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 29 18:34:20 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-14200602-98eb-4f4b-a501-eedf929754ac tempest-VolumesSnapshotTestJSON-1354260036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:34:20 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-14200602-98eb-4f4b-a501-eedf929754ac tempest-VolumesSnapshotTestJSON-1354260036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:34:20 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-14200602-98eb-4f4b-a501-eedf929754ac tempest-VolumesSnapshotTestJSON-1354260036 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:34:20 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-14200602-98eb-4f4b-a501-eedf929754ac tempest-VolumesSnapshotTestJSON-1354260036 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:34:20 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-14200602-98eb-4f4b-a501-eedf929754ac tempest-VolumesSnapshotTestJSON-1354260036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:34:20 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[0215812a-6e78-464b-b665-7d38b442ed9d]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:34:20 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-14200602-98eb-4f4b-a501-eedf929754ac tempest-VolumesSnapshotTestJSON-1354260036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7359aedd-cb5c-4684-b84b-607b5f28b04b.4a759da5-3f94-47a9-962f-33c1dfd506d3 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:34:20 devstack sudo[105602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7359aedd-cb5c-4684-b84b-607b5f28b04b.4a759da5-3f94-47a9-962f-33c1dfd506d3 Sep 29 18:34:20 devstack sudo[105602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:34:20 devstack sudo[105602]: pam_unix(sudo:session): session closed for user root Sep 29 18:34:20 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-14200602-98eb-4f4b-a501-eedf929754ac tempest-VolumesSnapshotTestJSON-1354260036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7359aedd-cb5c-4684-b84b-607b5f28b04b.4a759da5-3f94-47a9-962f-33c1dfd506d3" returned: 0 in 0.380s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:34:20 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-14200602-98eb-4f4b-a501-eedf929754ac tempest-VolumesSnapshotTestJSON-1354260036 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7359aedd-cb5c-4684-b84b-607b5f28b04b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86512) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 18:34:20 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[2355e8fc-6855-42df-92b8-511acbf0f17a]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:34:20 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-14200602-98eb-4f4b-a501-eedf929754ac tempest-VolumesSnapshotTestJSON-1354260036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7359aedd-cb5c-4684-b84b-607b5f28b04b {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:34:20 devstack sudo[105607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7359aedd-cb5c-4684-b84b-607b5f28b04b Sep 29 18:34:20 devstack sudo[105607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:34:21 devstack sudo[105607]: pam_unix(sudo:session): session closed for user root Sep 29 18:34:21 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-14200602-98eb-4f4b-a501-eedf929754ac tempest-VolumesSnapshotTestJSON-1354260036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7359aedd-cb5c-4684-b84b-607b5f28b04b" returned: 0 in 0.389s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:34:21 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-14200602-98eb-4f4b-a501-eedf929754ac tempest-VolumesSnapshotTestJSON-1354260036 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7359aedd-cb5c-4684-b84b-607b5f28b04b {{(pid=86512) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 29 18:34:21 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-14200602-98eb-4f4b-a501-eedf929754ac tempest-VolumesSnapshotTestJSON-1354260036 None] Creating direct copy from snapshot {{(pid=86512) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 29 18:34:21 devstack cinder-volume[86512]: DEBUG cinder.utils [None req-14200602-98eb-4f4b-a501-eedf929754ac tempest-VolumesSnapshotTestJSON-1354260036 None] Path /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-857eabb2-efb3-42a1-af53-44415ae87ea6 not found in is_blk_device check {{(pid=86512) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 29 18:34:21 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-14200602-98eb-4f4b-a501-eedf929754ac tempest-VolumesSnapshotTestJSON-1354260036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7359aedd-cb5c-4684-b84b-607b5f28b04b /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-857eabb2-efb3-42a1-af53-44415ae87ea6 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:34:21 devstack sudo[105612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7359aedd-cb5c-4684-b84b-607b5f28b04b /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-857eabb2-efb3-42a1-af53-44415ae87ea6 Sep 29 18:34:21 devstack sudo[105612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:34:27 devstack sudo[105612]: pam_unix(sudo:session): session closed for user root Sep 29 18:34:27 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-14200602-98eb-4f4b-a501-eedf929754ac tempest-VolumesSnapshotTestJSON-1354260036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7359aedd-cb5c-4684-b84b-607b5f28b04b /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-857eabb2-efb3-42a1-af53-44415ae87ea6" returned: 0 in 6.666s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:34:27 devstack cinder-volume[86512]: DEBUG cinder.image.image_utils [None req-14200602-98eb-4f4b-a501-eedf929754ac tempest-VolumesSnapshotTestJSON-1354260036 None] Image conversion details: src /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7359aedd-cb5c-4684-b84b-607b5f28b04b, size 1024.00 MB, duration 6.67 sec, destination /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-857eabb2-efb3-42a1-af53-44415ae87ea6 {{(pid=86512) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 29 18:34:27 devstack cinder-volume[86512]: INFO cinder.image.image_utils [None req-14200602-98eb-4f4b-a501-eedf929754ac tempest-VolumesSnapshotTestJSON-1354260036 None] Converted 1024.00 MB image at 153.57 MB/s Sep 29 18:34:27 devstack cinder-volume[86512]: WARNING cinder.volume.drivers.remotefs [None req-14200602-98eb-4f4b-a501-eedf929754ac tempest-VolumesSnapshotTestJSON-1354260036 None] /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-857eabb2-efb3-42a1-af53-44415ae87ea6 is being set with open permissions: ugo+rw Sep 29 18:34:27 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-14200602-98eb-4f4b-a501-eedf929754ac tempest-VolumesSnapshotTestJSON-1354260036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-857eabb2-efb3-42a1-af53-44415ae87ea6 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:34:27 devstack sudo[105630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-857eabb2-efb3-42a1-af53-44415ae87ea6 Sep 29 18:34:27 devstack sudo[105630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:34:28 devstack sudo[105630]: pam_unix(sudo:session): session closed for user root Sep 29 18:34:28 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-14200602-98eb-4f4b-a501-eedf929754ac tempest-VolumesSnapshotTestJSON-1354260036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-857eabb2-efb3-42a1-af53-44415ae87ea6" returned: 0 in 0.257s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:34:28 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-14200602-98eb-4f4b-a501-eedf929754ac tempest-VolumesSnapshotTestJSON-1354260036 None] Lock "cinder-quobyte-857eabb2-efb3-42a1-af53-44415ae87ea6" released by "_copy_volume_from_snapshot" :: held 7.787s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:34:28 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-14200602-98eb-4f4b-a501-eedf929754ac tempest-VolumesSnapshotTestJSON-1354260036 None] Lock "cinder-quobyte-4a759da5-3f94-47a9-962f-33c1dfd506d3-857eabb2-efb3-42a1-af53-44415ae87ea6" released by "_create_volume_from_snapshot" :: held 7.851s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:34:28 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-14200602-98eb-4f4b-a501-eedf929754ac tempest-VolumesSnapshotTestJSON-1354260036 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.867s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:34:28 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-14200602-98eb-4f4b-a501-eedf929754ac tempest-VolumesSnapshotTestJSON-1354260036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47d86e4f-c33f-47e9-a026-5324d2e46016) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-857eabb2-efb3-42a1-af53-44415ae87ea6', 'volume_size': 1, 'snapshot_id': '4a759da5-3f94-47a9-962f-33c1dfd506d3'}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:34:28 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-14200602-98eb-4f4b-a501-eedf929754ac tempest-VolumesSnapshotTestJSON-1354260036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c6fedcb-d6c1-4cef-acc7-0477f4bbaa0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:34:28 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-14200602-98eb-4f4b-a501-eedf929754ac tempest-VolumesSnapshotTestJSON-1354260036 None] Volume volume-857eabb2-efb3-42a1-af53-44415ae87ea6 (857eabb2-efb3-42a1-af53-44415ae87ea6): created successfully Sep 29 18:34:28 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-14200602-98eb-4f4b-a501-eedf929754ac tempest-VolumesSnapshotTestJSON-1354260036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c6fedcb-d6c1-4cef-acc7-0477f4bbaa0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:34:28 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-14200602-98eb-4f4b-a501-eedf929754ac tempest-VolumesSnapshotTestJSON-1354260036 None] Flow 'volume_create_manager' (8654be3e-eb52-42d3-8aaf-e547ce5c2cf6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:34:28 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-14200602-98eb-4f4b-a501-eedf929754ac tempest-VolumesSnapshotTestJSON-1354260036 None] Created volume successfully. Sep 29 18:34:28 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-35d944bf-8cd8-4748-9495-c9fd3ed62cb4 tempest-VolumesSnapshotTestJSON-1354260036 None] Acquiring lock "cinder-857eabb2-efb3-42a1-af53-44415ae87ea6-delete_volume" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:34:28 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-35d944bf-8cd8-4748-9495-c9fd3ed62cb4 tempest-VolumesSnapshotTestJSON-1354260036 None] Lock "cinder-857eabb2-efb3-42a1-af53-44415ae87ea6-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:34:29 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-35d944bf-8cd8-4748-9495-c9fd3ed62cb4 tempest-VolumesSnapshotTestJSON-1354260036 None] Acquiring lock "cinder-quobyte-857eabb2-efb3-42a1-af53-44415ae87ea6" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:34:29 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-35d944bf-8cd8-4748-9495-c9fd3ed62cb4 tempest-VolumesSnapshotTestJSON-1354260036 None] Lock "cinder-quobyte-857eabb2-efb3-42a1-af53-44415ae87ea6" acquired by "delete_volume" :: waited 0.014s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:34:29 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[1554cf27-89c9-4076-a19b-c7b9887b3cd0]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:34:29 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-35d944bf-8cd8-4748-9495-c9fd3ed62cb4 tempest-VolumesSnapshotTestJSON-1354260036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-857eabb2-efb3-42a1-af53-44415ae87ea6 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:34:29 devstack sudo[105633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-857eabb2-efb3-42a1-af53-44415ae87ea6 Sep 29 18:34:29 devstack sudo[105633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:34:29 devstack sudo[105633]: pam_unix(sudo:session): session closed for user root Sep 29 18:34:29 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-35d944bf-8cd8-4748-9495-c9fd3ed62cb4 tempest-VolumesSnapshotTestJSON-1354260036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-857eabb2-efb3-42a1-af53-44415ae87ea6" returned: 0 in 0.350s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:34:29 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-35d944bf-8cd8-4748-9495-c9fd3ed62cb4 tempest-VolumesSnapshotTestJSON-1354260036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-857eabb2-efb3-42a1-af53-44415ae87ea6 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:34:29 devstack sudo[105638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-857eabb2-efb3-42a1-af53-44415ae87ea6 Sep 29 18:34:29 devstack sudo[105638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:34:29 devstack sudo[105638]: pam_unix(sudo:session): session closed for user root Sep 29 18:34:29 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-35d944bf-8cd8-4748-9495-c9fd3ed62cb4 tempest-VolumesSnapshotTestJSON-1354260036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-857eabb2-efb3-42a1-af53-44415ae87ea6" returned: 0 in 0.232s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:34:29 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-35d944bf-8cd8-4748-9495-c9fd3ed62cb4 tempest-VolumesSnapshotTestJSON-1354260036 None] Lock "cinder-quobyte-857eabb2-efb3-42a1-af53-44415ae87ea6" released by "delete_volume" :: held 0.623s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:34:29 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-35d944bf-8cd8-4748-9495-c9fd3ed62cb4 tempest-VolumesSnapshotTestJSON-1354260036 None] Created reservations ['746ddf07-0c25-4b56-98d6-3e4bc0bb199b', 'd822d108-1757-4698-8d00-8b0ef56fc614', '84b5de9f-a56f-45a9-95b0-df4cca9205eb', '7ab8d076-945c-46cb-af26-2ea56332dde3'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:34:29 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-35d944bf-8cd8-4748-9495-c9fd3ed62cb4 tempest-VolumesSnapshotTestJSON-1354260036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:34:29 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-35d944bf-8cd8-4748-9495-c9fd3ed62cb4 tempest-VolumesSnapshotTestJSON-1354260036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:34:29 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-35d944bf-8cd8-4748-9495-c9fd3ed62cb4 tempest-VolumesSnapshotTestJSON-1354260036 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:34:29 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-35d944bf-8cd8-4748-9495-c9fd3ed62cb4 tempest-VolumesSnapshotTestJSON-1354260036 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:34:29 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-35d944bf-8cd8-4748-9495-c9fd3ed62cb4 tempest-VolumesSnapshotTestJSON-1354260036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:34:29 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-35d944bf-8cd8-4748-9495-c9fd3ed62cb4 tempest-VolumesSnapshotTestJSON-1354260036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:34:29 devstack sudo[105641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:34:29 devstack sudo[105641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:34:30 devstack sudo[105641]: pam_unix(sudo:session): session closed for user root Sep 29 18:34:30 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-35d944bf-8cd8-4748-9495-c9fd3ed62cb4 tempest-VolumesSnapshotTestJSON-1354260036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.238s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:34:30 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-35d944bf-8cd8-4748-9495-c9fd3ed62cb4 tempest-VolumesSnapshotTestJSON-1354260036 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:34:30 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-35d944bf-8cd8-4748-9495-c9fd3ed62cb4 tempest-VolumesSnapshotTestJSON-1354260036 None] Deleted volume successfully. Sep 29 18:34:30 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-35d944bf-8cd8-4748-9495-c9fd3ed62cb4 tempest-VolumesSnapshotTestJSON-1354260036 None] Lock "cinder-857eabb2-efb3-42a1-af53-44415ae87ea6-delete_volume" released by "delete_volume" :: held 1.046s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:34:30 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-0699ae80-1a8b-4146-ae92-00ac8c847878 tempest-VolumesSnapshotTestJSON-1354260036 None] Acquiring lock "cinder-4a759da5-3f94-47a9-962f-33c1dfd506d3-delete_snapshot" by "delete_snapshot" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:34:30 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-0699ae80-1a8b-4146-ae92-00ac8c847878 tempest-VolumesSnapshotTestJSON-1354260036 None] Lock "cinder-4a759da5-3f94-47a9-962f-33c1dfd506d3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:34:30 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-0699ae80-1a8b-4146-ae92-00ac8c847878 tempest-VolumesSnapshotTestJSON-1354260036 None] Acquiring lock "cinder-quobyte-7359aedd-cb5c-4684-b84b-607b5f28b04b" by "delete_snapshot" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:34:30 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-0699ae80-1a8b-4146-ae92-00ac8c847878 tempest-VolumesSnapshotTestJSON-1354260036 None] Lock "cinder-quobyte-7359aedd-cb5c-4684-b84b-607b5f28b04b" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:34:30 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-0699ae80-1a8b-4146-ae92-00ac8c847878 tempest-VolumesSnapshotTestJSON-1354260036 None] Acquiring lock "cinder-quobyte-4a759da5-3f94-47a9-962f-33c1dfd506d3" by "_delete_snapshot" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:34:30 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-0699ae80-1a8b-4146-ae92-00ac8c847878 tempest-VolumesSnapshotTestJSON-1354260036 None] Lock "cinder-quobyte-4a759da5-3f94-47a9-962f-33c1dfd506d3" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:34:30 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-0699ae80-1a8b-4146-ae92-00ac8c847878 tempest-VolumesSnapshotTestJSON-1354260036 None] Deleting offline snapshot 4a759da5-3f94-47a9-962f-33c1dfd506d3 of volume 7359aedd-cb5c-4684-b84b-607b5f28b04b {{(pid=86512) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 18:34:30 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-0699ae80-1a8b-4146-ae92-00ac8c847878 tempest-VolumesSnapshotTestJSON-1354260036 None] snapshot_file for this snap is: volume-7359aedd-cb5c-4684-b84b-607b5f28b04b.4a759da5-3f94-47a9-962f-33c1dfd506d3 {{(pid=86512) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 18:34:30 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3ebeb58-bf11-44e3-8522-d3f50e939463]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:34:30 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-0699ae80-1a8b-4146-ae92-00ac8c847878 tempest-VolumesSnapshotTestJSON-1354260036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7359aedd-cb5c-4684-b84b-607b5f28b04b.4a759da5-3f94-47a9-962f-33c1dfd506d3 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:34:30 devstack sudo[105644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7359aedd-cb5c-4684-b84b-607b5f28b04b.4a759da5-3f94-47a9-962f-33c1dfd506d3 Sep 29 18:34:30 devstack sudo[105644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:34:30 devstack sudo[105644]: pam_unix(sudo:session): session closed for user root Sep 29 18:34:30 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-0699ae80-1a8b-4146-ae92-00ac8c847878 tempest-VolumesSnapshotTestJSON-1354260036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7359aedd-cb5c-4684-b84b-607b5f28b04b.4a759da5-3f94-47a9-962f-33c1dfd506d3" returned: 0 in 0.362s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:34:30 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-0699ae80-1a8b-4146-ae92-00ac8c847878 tempest-VolumesSnapshotTestJSON-1354260036 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7359aedd-cb5c-4684-b84b-607b5f28b04b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86512) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 18:34:30 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d50839e-bde2-4490-b8c8-23d8165826f0]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:34:30 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-0699ae80-1a8b-4146-ae92-00ac8c847878 tempest-VolumesSnapshotTestJSON-1354260036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7359aedd-cb5c-4684-b84b-607b5f28b04b {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:34:30 devstack sudo[105649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7359aedd-cb5c-4684-b84b-607b5f28b04b Sep 29 18:34:30 devstack sudo[105649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:34:31 devstack sudo[105649]: pam_unix(sudo:session): session closed for user root Sep 29 18:34:31 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-0699ae80-1a8b-4146-ae92-00ac8c847878 tempest-VolumesSnapshotTestJSON-1354260036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7359aedd-cb5c-4684-b84b-607b5f28b04b" returned: 0 in 0.518s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:34:31 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-0699ae80-1a8b-4146-ae92-00ac8c847878 tempest-VolumesSnapshotTestJSON-1354260036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7359aedd-cb5c-4684-b84b-607b5f28b04b.4a759da5-3f94-47a9-962f-33c1dfd506d3 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:34:31 devstack sudo[105654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7359aedd-cb5c-4684-b84b-607b5f28b04b.4a759da5-3f94-47a9-962f-33c1dfd506d3 Sep 29 18:34:31 devstack sudo[105654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:34:31 devstack sudo[105654]: pam_unix(sudo:session): session closed for user root Sep 29 18:34:31 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-0699ae80-1a8b-4146-ae92-00ac8c847878 tempest-VolumesSnapshotTestJSON-1354260036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7359aedd-cb5c-4684-b84b-607b5f28b04b.4a759da5-3f94-47a9-962f-33c1dfd506d3" returned: 0 in 0.331s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:34:31 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-0699ae80-1a8b-4146-ae92-00ac8c847878 tempest-VolumesSnapshotTestJSON-1354260036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7359aedd-cb5c-4684-b84b-607b5f28b04b.4a759da5-3f94-47a9-962f-33c1dfd506d3 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:34:31 devstack sudo[105659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7359aedd-cb5c-4684-b84b-607b5f28b04b.4a759da5-3f94-47a9-962f-33c1dfd506d3 Sep 29 18:34:31 devstack sudo[105659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:34:31 devstack sudo[105659]: pam_unix(sudo:session): session closed for user root Sep 29 18:34:31 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-0699ae80-1a8b-4146-ae92-00ac8c847878 tempest-VolumesSnapshotTestJSON-1354260036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7359aedd-cb5c-4684-b84b-607b5f28b04b.4a759da5-3f94-47a9-962f-33c1dfd506d3" returned: 0 in 0.231s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:34:31 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-0699ae80-1a8b-4146-ae92-00ac8c847878 tempest-VolumesSnapshotTestJSON-1354260036 None] Lock "cinder-quobyte-4a759da5-3f94-47a9-962f-33c1dfd506d3" released by "_delete_snapshot" :: held 1.549s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:34:31 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-0699ae80-1a8b-4146-ae92-00ac8c847878 tempest-VolumesSnapshotTestJSON-1354260036 None] Lock "cinder-quobyte-7359aedd-cb5c-4684-b84b-607b5f28b04b" released by "delete_snapshot" :: held 1.572s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:34:31 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-0699ae80-1a8b-4146-ae92-00ac8c847878 tempest-VolumesSnapshotTestJSON-1354260036 None] Created reservations ['dc595fdc-0cf9-4a79-8425-05acbfdb17b0', '76b8c398-fc9c-4bf4-adb2-b1ac0c0fa02d', '26e4800a-d85f-4c32-94be-869b786dbdbf', '7682bfc2-9f4a-4606-8eb5-24d08e45c061'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:34:31 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-0699ae80-1a8b-4146-ae92-00ac8c847878 tempest-VolumesSnapshotTestJSON-1354260036 None] Delete snapshot completed successfully. Sep 29 18:34:31 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-0699ae80-1a8b-4146-ae92-00ac8c847878 tempest-VolumesSnapshotTestJSON-1354260036 None] Lock "cinder-4a759da5-3f94-47a9-962f-33c1dfd506d3-delete_snapshot" released by "delete_snapshot" :: held 1.709s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:34:32 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-9e1047a0-9931-4d35-a6ca-c33e56b11df6 tempest-VolumesSnapshotTestJSON-1354260036 None] Acquiring lock "cinder-7359aedd-cb5c-4684-b84b-607b5f28b04b-delete_volume" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:34:32 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-9e1047a0-9931-4d35-a6ca-c33e56b11df6 tempest-VolumesSnapshotTestJSON-1354260036 None] Lock "cinder-7359aedd-cb5c-4684-b84b-607b5f28b04b-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:34:32 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-9e1047a0-9931-4d35-a6ca-c33e56b11df6 tempest-VolumesSnapshotTestJSON-1354260036 None] Acquiring lock "cinder-quobyte-7359aedd-cb5c-4684-b84b-607b5f28b04b" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:34:32 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-9e1047a0-9931-4d35-a6ca-c33e56b11df6 tempest-VolumesSnapshotTestJSON-1354260036 None] Lock "cinder-quobyte-7359aedd-cb5c-4684-b84b-607b5f28b04b" acquired by "delete_volume" :: waited 0.014s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:34:32 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[499264c7-c990-4f45-8f26-10ced9fdc1e4]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:34:32 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-9e1047a0-9931-4d35-a6ca-c33e56b11df6 tempest-VolumesSnapshotTestJSON-1354260036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7359aedd-cb5c-4684-b84b-607b5f28b04b {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:34:32 devstack sudo[105662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7359aedd-cb5c-4684-b84b-607b5f28b04b Sep 29 18:34:32 devstack sudo[105662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:34:32 devstack sudo[105662]: pam_unix(sudo:session): session closed for user root Sep 29 18:34:32 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-9e1047a0-9931-4d35-a6ca-c33e56b11df6 tempest-VolumesSnapshotTestJSON-1354260036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7359aedd-cb5c-4684-b84b-607b5f28b04b" returned: 0 in 0.355s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:34:32 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-9e1047a0-9931-4d35-a6ca-c33e56b11df6 tempest-VolumesSnapshotTestJSON-1354260036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7359aedd-cb5c-4684-b84b-607b5f28b04b {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:34:32 devstack sudo[105667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7359aedd-cb5c-4684-b84b-607b5f28b04b Sep 29 18:34:32 devstack sudo[105667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:34:33 devstack sudo[105667]: pam_unix(sudo:session): session closed for user root Sep 29 18:34:33 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-9e1047a0-9931-4d35-a6ca-c33e56b11df6 tempest-VolumesSnapshotTestJSON-1354260036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7359aedd-cb5c-4684-b84b-607b5f28b04b" returned: 0 in 0.237s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:34:33 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-9e1047a0-9931-4d35-a6ca-c33e56b11df6 tempest-VolumesSnapshotTestJSON-1354260036 None] Lock "cinder-quobyte-7359aedd-cb5c-4684-b84b-607b5f28b04b" released by "delete_volume" :: held 0.653s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:34:33 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-9e1047a0-9931-4d35-a6ca-c33e56b11df6 tempest-VolumesSnapshotTestJSON-1354260036 None] Created reservations ['935ebf48-f491-4c68-b189-5eae06d1da84', '53811efc-de1d-4cd5-8ce6-d6c723292fed', '9d670dda-a6c1-43f8-9eb6-eb4918d4d8e3', '6174aedb-b7c5-4b14-bc20-ed9a0586407c'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:34:33 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-9e1047a0-9931-4d35-a6ca-c33e56b11df6 tempest-VolumesSnapshotTestJSON-1354260036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:34:33 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-9e1047a0-9931-4d35-a6ca-c33e56b11df6 tempest-VolumesSnapshotTestJSON-1354260036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:34:33 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-9e1047a0-9931-4d35-a6ca-c33e56b11df6 tempest-VolumesSnapshotTestJSON-1354260036 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:34:33 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-9e1047a0-9931-4d35-a6ca-c33e56b11df6 tempest-VolumesSnapshotTestJSON-1354260036 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:34:33 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-9e1047a0-9931-4d35-a6ca-c33e56b11df6 tempest-VolumesSnapshotTestJSON-1354260036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:34:33 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-9e1047a0-9931-4d35-a6ca-c33e56b11df6 tempest-VolumesSnapshotTestJSON-1354260036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:34:33 devstack sudo[105670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:34:33 devstack sudo[105670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:34:33 devstack sudo[105670]: pam_unix(sudo:session): session closed for user root Sep 29 18:34:33 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-9e1047a0-9931-4d35-a6ca-c33e56b11df6 tempest-VolumesSnapshotTestJSON-1354260036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.232s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:34:33 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-9e1047a0-9931-4d35-a6ca-c33e56b11df6 tempest-VolumesSnapshotTestJSON-1354260036 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:34:33 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-9e1047a0-9931-4d35-a6ca-c33e56b11df6 tempest-VolumesSnapshotTestJSON-1354260036 None] Deleted volume successfully. Sep 29 18:34:33 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-9e1047a0-9931-4d35-a6ca-c33e56b11df6 tempest-VolumesSnapshotTestJSON-1354260036 None] Lock "cinder-7359aedd-cb5c-4684-b84b-607b5f28b04b-delete_volume" released by "delete_volume" :: held 1.060s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:34:33 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-dae377c9-3178-4a54-9892-ea2a2aef9a08 tempest-VolumesSnapshotTestJSON-1354260036 None] Acquiring lock "cinder-e667038a-486d-4b1e-99d9-b63db5fa82c6-delete_volume" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:34:33 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-dae377c9-3178-4a54-9892-ea2a2aef9a08 tempest-VolumesSnapshotTestJSON-1354260036 None] Lock "cinder-e667038a-486d-4b1e-99d9-b63db5fa82c6-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:34:33 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-dae377c9-3178-4a54-9892-ea2a2aef9a08 tempest-VolumesSnapshotTestJSON-1354260036 None] Acquiring lock "cinder-quobyte-e667038a-486d-4b1e-99d9-b63db5fa82c6" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:34:33 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-dae377c9-3178-4a54-9892-ea2a2aef9a08 tempest-VolumesSnapshotTestJSON-1354260036 None] Lock "cinder-quobyte-e667038a-486d-4b1e-99d9-b63db5fa82c6" acquired by "delete_volume" :: waited 0.013s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:34:33 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c8c5bec-020f-4398-8180-b707ac02cd65]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:34:33 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-dae377c9-3178-4a54-9892-ea2a2aef9a08 tempest-VolumesSnapshotTestJSON-1354260036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e667038a-486d-4b1e-99d9-b63db5fa82c6 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:34:33 devstack sudo[105673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e667038a-486d-4b1e-99d9-b63db5fa82c6 Sep 29 18:34:33 devstack sudo[105673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:34:34 devstack sudo[105673]: pam_unix(sudo:session): session closed for user root Sep 29 18:34:34 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-dae377c9-3178-4a54-9892-ea2a2aef9a08 tempest-VolumesSnapshotTestJSON-1354260036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e667038a-486d-4b1e-99d9-b63db5fa82c6" returned: 0 in 0.351s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:34:34 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-dae377c9-3178-4a54-9892-ea2a2aef9a08 tempest-VolumesSnapshotTestJSON-1354260036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e667038a-486d-4b1e-99d9-b63db5fa82c6 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:34:34 devstack sudo[105679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e667038a-486d-4b1e-99d9-b63db5fa82c6 Sep 29 18:34:34 devstack sudo[105679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:34:34 devstack sudo[105679]: pam_unix(sudo:session): session closed for user root Sep 29 18:34:34 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-dae377c9-3178-4a54-9892-ea2a2aef9a08 tempest-VolumesSnapshotTestJSON-1354260036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e667038a-486d-4b1e-99d9-b63db5fa82c6" returned: 0 in 0.239s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:34:34 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-dae377c9-3178-4a54-9892-ea2a2aef9a08 tempest-VolumesSnapshotTestJSON-1354260036 None] Lock "cinder-quobyte-e667038a-486d-4b1e-99d9-b63db5fa82c6" released by "delete_volume" :: held 0.654s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:34:34 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-dae377c9-3178-4a54-9892-ea2a2aef9a08 tempest-VolumesSnapshotTestJSON-1354260036 None] Created reservations ['fd7b9597-9efb-4598-9521-12933541bf3a', '817ff7aa-75bc-416b-a9e2-ff285cf7d11f', 'c721b0dc-49ce-483d-b003-64b21abde1c4', '2b46ae56-8c92-42eb-96af-92065f22ec11'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:34:34 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-dae377c9-3178-4a54-9892-ea2a2aef9a08 tempest-VolumesSnapshotTestJSON-1354260036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:34:34 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-dae377c9-3178-4a54-9892-ea2a2aef9a08 tempest-VolumesSnapshotTestJSON-1354260036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:34:34 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-dae377c9-3178-4a54-9892-ea2a2aef9a08 tempest-VolumesSnapshotTestJSON-1354260036 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:34:34 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-dae377c9-3178-4a54-9892-ea2a2aef9a08 tempest-VolumesSnapshotTestJSON-1354260036 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:34:34 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-dae377c9-3178-4a54-9892-ea2a2aef9a08 tempest-VolumesSnapshotTestJSON-1354260036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:34:34 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-dae377c9-3178-4a54-9892-ea2a2aef9a08 tempest-VolumesSnapshotTestJSON-1354260036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:34:34 devstack sudo[105682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:34:34 devstack sudo[105682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:34:34 devstack sudo[105682]: pam_unix(sudo:session): session closed for user root Sep 29 18:34:34 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-dae377c9-3178-4a54-9892-ea2a2aef9a08 tempest-VolumesSnapshotTestJSON-1354260036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.229s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:34:34 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-dae377c9-3178-4a54-9892-ea2a2aef9a08 tempest-VolumesSnapshotTestJSON-1354260036 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:34:34 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-dae377c9-3178-4a54-9892-ea2a2aef9a08 tempest-VolumesSnapshotTestJSON-1354260036 None] Deleted volume successfully. Sep 29 18:34:34 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-dae377c9-3178-4a54-9892-ea2a2aef9a08 tempest-VolumesSnapshotTestJSON-1354260036 None] Lock "cinder-e667038a-486d-4b1e-99d9-b63db5fa82c6-delete_volume" released by "delete_volume" :: held 1.069s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:34:44 devstack cinder-volume[86512]: DEBUG dbcounter [-] [86512] Writing DB stats cinder:UPDATE=95,cinder:SELECT=81,cinder:INSERT=31,cinder:DELETE=8 {{(pid=86512) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 18:34:44 devstack cinder-volume[86512]: DEBUG dbcounter [-] [86512] Writing DB stats cinder:UPDATE=107,cinder:DELETE=9,cinder:SELECT=82,cinder:INSERT=21 {{(pid=86512) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 18:34:50 devstack cinder-volume[86512]: DEBUG oslo_service.periodic_task [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86512) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 18:34:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:34:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:34:50 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:34:50 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:34:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:34:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:34:50 devstack sudo[105727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:34:50 devstack sudo[105727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:34:50 devstack sudo[105727]: pam_unix(sudo:session): session closed for user root Sep 29 18:34:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.272s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:34:50 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:34:50 devstack cinder-volume[86512]: DEBUG oslo_service.periodic_task [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Running periodic task VolumeManager._thread_info {{(pid=86512) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 18:34:50 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] thread count: 29 {{(pid=86512) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 29 18:34:50 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] thread info: [<_MainThread(MainThread, started 135593654804608)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86512) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 29 18:35:13 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-a09a8a86-f58b-4733-87bc-bcb2595b2848 tempest-TestMinimumBasicScenario-1012277087 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86512) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:35:13 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-a09a8a86-f58b-4733-87bc-bcb2595b2848 tempest-TestMinimumBasicScenario-1012277087 None] Flow 'volume_create_manager' (e63f9763-5f64-4a4d-9f8d-9f50af48e482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:35:13 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-a09a8a86-f58b-4733-87bc-bcb2595b2848 tempest-TestMinimumBasicScenario-1012277087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7aaf2e35-abf4-4401-b406-ff19d97c3266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:35:13 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-a09a8a86-f58b-4733-87bc-bcb2595b2848 tempest-TestMinimumBasicScenario-1012277087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7aaf2e35-abf4-4401-b406-ff19d97c3266) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:35:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1694319323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fc8f4fe-37fb-4947-bb71-fcfa055ab5af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c19bc1db9d94534af9f1e484d6c5d3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:35:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:35:14Z,use_quota=True,user_id='b01b5752d83d42b4895fcd69ab34d015',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:35:13 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-a09a8a86-f58b-4733-87bc-bcb2595b2848 tempest-TestMinimumBasicScenario-1012277087 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d31279c2-6323-4da1-88c4-8243f29c8567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:35:13 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-a09a8a86-f58b-4733-87bc-bcb2595b2848 tempest-TestMinimumBasicScenario-1012277087 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d31279c2-6323-4da1-88c4-8243f29c8567) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:35:13 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-a09a8a86-f58b-4733-87bc-bcb2595b2848 tempest-TestMinimumBasicScenario-1012277087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41efed14-55ec-42d4-816f-be9a10379940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:35:13 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-a09a8a86-f58b-4733-87bc-bcb2595b2848 tempest-TestMinimumBasicScenario-1012277087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41efed14-55ec-42d4-816f-be9a10379940) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3fc8f4fe-37fb-4947-bb71-fcfa055ab5af', 'volume_name': 'volume-3fc8f4fe-37fb-4947-bb71-fcfa055ab5af', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:35:13 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-a09a8a86-f58b-4733-87bc-bcb2595b2848 tempest-TestMinimumBasicScenario-1012277087 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d8b71a0-32de-4ff6-b2b9-1d2a70f7730d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:35:13 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-a09a8a86-f58b-4733-87bc-bcb2595b2848 tempest-TestMinimumBasicScenario-1012277087 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d8b71a0-32de-4ff6-b2b9-1d2a70f7730d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:35:13 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-a09a8a86-f58b-4733-87bc-bcb2595b2848 tempest-TestMinimumBasicScenario-1012277087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f49e9c29-d71d-4167-b797-70a97e9d6051) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:35:13 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-a09a8a86-f58b-4733-87bc-bcb2595b2848 tempest-TestMinimumBasicScenario-1012277087 None] Volume 3fc8f4fe-37fb-4947-bb71-fcfa055ab5af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3fc8f4fe-37fb-4947-bb71-fcfa055ab5af', 'volume_size': 1} Sep 29 18:35:13 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-a09a8a86-f58b-4733-87bc-bcb2595b2848 tempest-TestMinimumBasicScenario-1012277087 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:35:13 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-a09a8a86-f58b-4733-87bc-bcb2595b2848 tempest-TestMinimumBasicScenario-1012277087 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:35:13 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-a09a8a86-f58b-4733-87bc-bcb2595b2848 tempest-TestMinimumBasicScenario-1012277087 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:35:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1694319323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fc8f4fe-37fb-4947-bb71-fcfa055ab5af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c19bc1db9d94534af9f1e484d6c5d3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:35:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:35:14Z,use_quota=True,user_id='b01b5752d83d42b4895fcd69ab34d015',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)}" {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:35:13 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-a09a8a86-f58b-4733-87bc-bcb2595b2848 tempest-TestMinimumBasicScenario-1012277087 None] Creating volume 3fc8f4fe-37fb-4947-bb71-fcfa055ab5af {{(pid=86512) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:35:13 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-a09a8a86-f58b-4733-87bc-bcb2595b2848 tempest-TestMinimumBasicScenario-1012277087 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:35:13 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-a09a8a86-f58b-4733-87bc-bcb2595b2848 tempest-TestMinimumBasicScenario-1012277087 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:35:13 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-a09a8a86-f58b-4733-87bc-bcb2595b2848 tempest-TestMinimumBasicScenario-1012277087 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:35:13 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-a09a8a86-f58b-4733-87bc-bcb2595b2848 tempest-TestMinimumBasicScenario-1012277087 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:35:13 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-a09a8a86-f58b-4733-87bc-bcb2595b2848 tempest-TestMinimumBasicScenario-1012277087 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:35:13 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-a09a8a86-f58b-4733-87bc-bcb2595b2848 tempest-TestMinimumBasicScenario-1012277087 None] Selected osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 as target Quobyte volume. {{(pid=86512) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:35:13 devstack cinder-volume[86512]: INFO cinder.volume.drivers.remotefs [None req-a09a8a86-f58b-4733-87bc-bcb2595b2848 tempest-TestMinimumBasicScenario-1012277087 None] casted to osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 Sep 29 18:35:13 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a09a8a86-f58b-4733-87bc-bcb2595b2848 tempest-TestMinimumBasicScenario-1012277087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-3fc8f4fe-37fb-4947-bb71-fcfa055ab5af 1073741824 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:35:13 devstack sudo[105860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-3fc8f4fe-37fb-4947-bb71-fcfa055ab5af 1073741824 Sep 29 18:35:13 devstack sudo[105860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:35:14 devstack sudo[105860]: pam_unix(sudo:session): session closed for user root Sep 29 18:35:14 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a09a8a86-f58b-4733-87bc-bcb2595b2848 tempest-TestMinimumBasicScenario-1012277087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-3fc8f4fe-37fb-4947-bb71-fcfa055ab5af 1073741824" returned: 0 in 0.465s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:35:14 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a09a8a86-f58b-4733-87bc-bcb2595b2848 tempest-TestMinimumBasicScenario-1012277087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-3fc8f4fe-37fb-4947-bb71-fcfa055ab5af {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:35:14 devstack sudo[105866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-3fc8f4fe-37fb-4947-bb71-fcfa055ab5af Sep 29 18:35:14 devstack sudo[105866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:35:14 devstack sudo[105866]: pam_unix(sudo:session): session closed for user root Sep 29 18:35:14 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a09a8a86-f58b-4733-87bc-bcb2595b2848 tempest-TestMinimumBasicScenario-1012277087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-3fc8f4fe-37fb-4947-bb71-fcfa055ab5af" returned: 0 in 0.263s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:35:14 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-a09a8a86-f58b-4733-87bc-bcb2595b2848 tempest-TestMinimumBasicScenario-1012277087 None] <== create_volume: return (804ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'} {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:35:14 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-a09a8a86-f58b-4733-87bc-bcb2595b2848 tempest-TestMinimumBasicScenario-1012277087 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.808s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:35:14 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-a09a8a86-f58b-4733-87bc-bcb2595b2848 tempest-TestMinimumBasicScenario-1012277087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f49e9c29-d71d-4167-b797-70a97e9d6051) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3fc8f4fe-37fb-4947-bb71-fcfa055ab5af', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:35:14 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-a09a8a86-f58b-4733-87bc-bcb2595b2848 tempest-TestMinimumBasicScenario-1012277087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80114c75-8484-4e78-b15d-eb2f3142f6f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:35:14 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-a09a8a86-f58b-4733-87bc-bcb2595b2848 tempest-TestMinimumBasicScenario-1012277087 None] Volume volume-3fc8f4fe-37fb-4947-bb71-fcfa055ab5af (3fc8f4fe-37fb-4947-bb71-fcfa055ab5af): created successfully Sep 29 18:35:14 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-a09a8a86-f58b-4733-87bc-bcb2595b2848 tempest-TestMinimumBasicScenario-1012277087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80114c75-8484-4e78-b15d-eb2f3142f6f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:35:14 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-a09a8a86-f58b-4733-87bc-bcb2595b2848 tempest-TestMinimumBasicScenario-1012277087 None] Flow 'volume_create_manager' (e63f9763-5f64-4a4d-9f8d-9f50af48e482) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:35:14 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-a09a8a86-f58b-4733-87bc-bcb2595b2848 tempest-TestMinimumBasicScenario-1012277087 None] Created volume successfully. Sep 29 18:35:16 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [req-32b7345c-df79-443c-8b8d-41c338ec9bea req-60799107-c0b3-4eef-bb32-9a99b67fb7ea tempest-TestMinimumBasicScenario-1012277087 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:35:16 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [req-32b7345c-df79-443c-8b8d-41c338ec9bea req-60799107-c0b3-4eef-bb32-9a99b67fb7ea tempest-TestMinimumBasicScenario-1012277087 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:35:16 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [req-32b7345c-df79-443c-8b8d-41c338ec9bea req-60799107-c0b3-4eef-bb32-9a99b67fb7ea tempest-TestMinimumBasicScenario-1012277087 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:35:16 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [req-32b7345c-df79-443c-8b8d-41c338ec9bea req-60799107-c0b3-4eef-bb32-9a99b67fb7ea tempest-TestMinimumBasicScenario-1012277087 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883', 'name': 'volume-3fc8f4fe-37fb-4947-bb71-fcfa055ab5af', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'afe49de1-c6b0-4e29-9f95-2e803bd2585b', 'enforce_multipath': True} {{(pid=86512) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 29 18:35:16 devstack cinder-volume[86512]: INFO cinder.volume.manager [req-32b7345c-df79-443c-8b8d-41c338ec9bea req-60799107-c0b3-4eef-bb32-9a99b67fb7ea tempest-TestMinimumBasicScenario-1012277087 None] attachment_update completed successfully. Sep 29 18:35:26 devstack cinder-volume[86512]: DEBUG dbcounter [-] [86512] Writing DB stats cinder:UPDATE=5,cinder:SELECT=7,cinder:INSERT=1 {{(pid=86512) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 18:35:26 devstack cinder-volume[86512]: DEBUG dbcounter [-] [86512] Writing DB stats cinder:SELECT=10,cinder:UPDATE=4,cinder:DELETE=1 {{(pid=86512) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 18:35:50 devstack cinder-volume[86512]: DEBUG oslo_service.periodic_task [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86512) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 18:35:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:35:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:35:50 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:35:50 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:35:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:35:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:35:50 devstack sudo[106449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:35:50 devstack sudo[106449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:35:50 devstack sudo[106449]: pam_unix(sudo:session): session closed for user root Sep 29 18:35:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.232s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:35:50 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:35:50 devstack cinder-volume[86512]: DEBUG oslo_service.periodic_task [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Running periodic task VolumeManager._thread_info {{(pid=86512) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 18:35:50 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] thread count: 29 {{(pid=86512) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 29 18:35:50 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] thread info: [<_MainThread(MainThread, started 135593654804608)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86512) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 29 18:36:01 devstack cinder-volume[86512]: INFO cinder.volume.manager [req-58a3a61b-17d1-470e-83d8-de8042a56df3 req-0411d0ed-238c-4c3b-88da-6b074486f197 tempest-TestMinimumBasicScenario-1012277087 None] Terminate volume connection completed successfully. Sep 29 18:36:01 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [req-58a3a61b-17d1-470e-83d8-de8042a56df3 req-0411d0ed-238c-4c3b-88da-6b074486f197 tempest-TestMinimumBasicScenario-1012277087 None] Deleting attachment afe49de1-c6b0-4e29-9f95-2e803bd2585b. {{(pid=86512) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 29 18:36:01 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-45cb417d-3e63-46a3-b604-7a45a5c183a9 tempest-TestMinimumBasicScenario-1012277087 None] Acquiring lock "cinder-3fc8f4fe-37fb-4947-bb71-fcfa055ab5af-delete_volume" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:36:01 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-45cb417d-3e63-46a3-b604-7a45a5c183a9 tempest-TestMinimumBasicScenario-1012277087 None] Lock "cinder-3fc8f4fe-37fb-4947-bb71-fcfa055ab5af-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:36:01 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-45cb417d-3e63-46a3-b604-7a45a5c183a9 tempest-TestMinimumBasicScenario-1012277087 None] Acquiring lock "cinder-quobyte-3fc8f4fe-37fb-4947-bb71-fcfa055ab5af" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:36:01 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-45cb417d-3e63-46a3-b604-7a45a5c183a9 tempest-TestMinimumBasicScenario-1012277087 None] Lock "cinder-quobyte-3fc8f4fe-37fb-4947-bb71-fcfa055ab5af" acquired by "delete_volume" :: waited 0.017s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:36:01 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[8943660f-730c-43d4-8908-ded7612a5635]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:36:01 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-45cb417d-3e63-46a3-b604-7a45a5c183a9 tempest-TestMinimumBasicScenario-1012277087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-3fc8f4fe-37fb-4947-bb71-fcfa055ab5af {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:36:02 devstack sudo[106474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-3fc8f4fe-37fb-4947-bb71-fcfa055ab5af Sep 29 18:36:02 devstack sudo[106474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:36:02 devstack sudo[106474]: pam_unix(sudo:session): session closed for user root Sep 29 18:36:02 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-45cb417d-3e63-46a3-b604-7a45a5c183a9 tempest-TestMinimumBasicScenario-1012277087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-3fc8f4fe-37fb-4947-bb71-fcfa055ab5af" returned: 0 in 0.344s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:36:02 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-45cb417d-3e63-46a3-b604-7a45a5c183a9 tempest-TestMinimumBasicScenario-1012277087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-3fc8f4fe-37fb-4947-bb71-fcfa055ab5af {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:36:02 devstack sudo[106480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-3fc8f4fe-37fb-4947-bb71-fcfa055ab5af Sep 29 18:36:02 devstack sudo[106480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:36:02 devstack sudo[106480]: pam_unix(sudo:session): session closed for user root Sep 29 18:36:02 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-45cb417d-3e63-46a3-b604-7a45a5c183a9 tempest-TestMinimumBasicScenario-1012277087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-3fc8f4fe-37fb-4947-bb71-fcfa055ab5af" returned: 0 in 0.236s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:36:02 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-45cb417d-3e63-46a3-b604-7a45a5c183a9 tempest-TestMinimumBasicScenario-1012277087 None] Lock "cinder-quobyte-3fc8f4fe-37fb-4947-bb71-fcfa055ab5af" released by "delete_volume" :: held 0.622s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:36:02 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-45cb417d-3e63-46a3-b604-7a45a5c183a9 tempest-TestMinimumBasicScenario-1012277087 None] Created reservations ['aa99de8b-1d27-492b-88d5-54a6a42fa61a', 'db63644c-d1ac-443d-b95f-05f58f646047', '6e955db7-ebed-43f3-ae8d-cf18b731b936', 'd9346bee-fd04-4224-b0ea-e10fb11072b4'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:36:02 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-45cb417d-3e63-46a3-b604-7a45a5c183a9 tempest-TestMinimumBasicScenario-1012277087 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:36:02 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-45cb417d-3e63-46a3-b604-7a45a5c183a9 tempest-TestMinimumBasicScenario-1012277087 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:36:02 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-45cb417d-3e63-46a3-b604-7a45a5c183a9 tempest-TestMinimumBasicScenario-1012277087 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:36:02 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-45cb417d-3e63-46a3-b604-7a45a5c183a9 tempest-TestMinimumBasicScenario-1012277087 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:36:02 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-45cb417d-3e63-46a3-b604-7a45a5c183a9 tempest-TestMinimumBasicScenario-1012277087 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:36:02 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-45cb417d-3e63-46a3-b604-7a45a5c183a9 tempest-TestMinimumBasicScenario-1012277087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:36:02 devstack sudo[106483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:36:02 devstack sudo[106483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:36:02 devstack sudo[106483]: pam_unix(sudo:session): session closed for user root Sep 29 18:36:02 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-45cb417d-3e63-46a3-b604-7a45a5c183a9 tempest-TestMinimumBasicScenario-1012277087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.256s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:36:02 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-45cb417d-3e63-46a3-b604-7a45a5c183a9 tempest-TestMinimumBasicScenario-1012277087 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:36:02 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-45cb417d-3e63-46a3-b604-7a45a5c183a9 tempest-TestMinimumBasicScenario-1012277087 None] Deleted volume successfully. Sep 29 18:36:03 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-45cb417d-3e63-46a3-b604-7a45a5c183a9 tempest-TestMinimumBasicScenario-1012277087 None] Lock "cinder-3fc8f4fe-37fb-4947-bb71-fcfa055ab5af-delete_volume" released by "delete_volume" :: held 1.101s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:36:12 devstack cinder-volume[86512]: DEBUG dbcounter [-] [86512] Writing DB stats cinder:SELECT=7,cinder:INSERT=1,cinder:UPDATE=10 {{(pid=86512) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 18:36:12 devstack cinder-volume[86512]: DEBUG dbcounter [-] [86512] Writing DB stats cinder:SELECT=5,cinder:UPDATE=6,cinder:INSERT=3,cinder:DELETE=1 {{(pid=86512) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 18:36:41 devstack cinder-volume[86512]: DEBUG dbcounter [-] [86512] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=86512) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 18:36:41 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-f02c5e1b-9642-4ca8-af46-ce890d231e2d tempest-SnapshotDependencyTests-1166183438 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86512) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:36:41 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-f02c5e1b-9642-4ca8-af46-ce890d231e2d tempest-SnapshotDependencyTests-1166183438 None] Flow 'volume_create_manager' (715a7c48-a378-4dd2-8f16-cfe889bf9789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:36:41 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-f02c5e1b-9642-4ca8-af46-ce890d231e2d tempest-SnapshotDependencyTests-1166183438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e95ad7a0-8b53-4d05-8886-a61efcf6bb6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:36:41 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-f02c5e1b-9642-4ca8-af46-ce890d231e2d tempest-SnapshotDependencyTests-1166183438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e95ad7a0-8b53-4d05-8886-a61efcf6bb6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:36:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1352965738',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdb52e3c-f807-4616-a12f-94ec97995cf4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40d552ec92444a7497dcab8fc605ce36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:36:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:36:42Z,use_quota=True,user_id='b73caa308ba8492a9f6e0a20ac563641',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:36:41 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-f02c5e1b-9642-4ca8-af46-ce890d231e2d tempest-SnapshotDependencyTests-1166183438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4179ee30-1de8-42c5-9041-a3c00d677104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:36:41 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-f02c5e1b-9642-4ca8-af46-ce890d231e2d tempest-SnapshotDependencyTests-1166183438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4179ee30-1de8-42c5-9041-a3c00d677104) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:36:41 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-f02c5e1b-9642-4ca8-af46-ce890d231e2d tempest-SnapshotDependencyTests-1166183438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2964b5b-254d-406c-9447-cc0814204b7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:36:41 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-f02c5e1b-9642-4ca8-af46-ce890d231e2d tempest-SnapshotDependencyTests-1166183438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2964b5b-254d-406c-9447-cc0814204b7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fdb52e3c-f807-4616-a12f-94ec97995cf4', 'volume_name': 'volume-fdb52e3c-f807-4616-a12f-94ec97995cf4', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:36:41 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-f02c5e1b-9642-4ca8-af46-ce890d231e2d tempest-SnapshotDependencyTests-1166183438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5628a9f-8e43-4e8b-8f86-d8f9915cfe16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:36:41 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-f02c5e1b-9642-4ca8-af46-ce890d231e2d tempest-SnapshotDependencyTests-1166183438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5628a9f-8e43-4e8b-8f86-d8f9915cfe16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:36:41 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-f02c5e1b-9642-4ca8-af46-ce890d231e2d tempest-SnapshotDependencyTests-1166183438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41c0a921-d41f-4949-937b-3b6025352302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:36:41 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-f02c5e1b-9642-4ca8-af46-ce890d231e2d tempest-SnapshotDependencyTests-1166183438 None] Volume fdb52e3c-f807-4616-a12f-94ec97995cf4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fdb52e3c-f807-4616-a12f-94ec97995cf4', 'volume_size': 1} Sep 29 18:36:41 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-f02c5e1b-9642-4ca8-af46-ce890d231e2d tempest-SnapshotDependencyTests-1166183438 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:36:41 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-f02c5e1b-9642-4ca8-af46-ce890d231e2d tempest-SnapshotDependencyTests-1166183438 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:36:41 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-f02c5e1b-9642-4ca8-af46-ce890d231e2d tempest-SnapshotDependencyTests-1166183438 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:36:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1352965738',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdb52e3c-f807-4616-a12f-94ec97995cf4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40d552ec92444a7497dcab8fc605ce36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:36:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:36:42Z,use_quota=True,user_id='b73caa308ba8492a9f6e0a20ac563641',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)}" {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:36:41 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-f02c5e1b-9642-4ca8-af46-ce890d231e2d tempest-SnapshotDependencyTests-1166183438 None] Creating volume fdb52e3c-f807-4616-a12f-94ec97995cf4 {{(pid=86512) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:36:42 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-f02c5e1b-9642-4ca8-af46-ce890d231e2d tempest-SnapshotDependencyTests-1166183438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:36:42 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-f02c5e1b-9642-4ca8-af46-ce890d231e2d tempest-SnapshotDependencyTests-1166183438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:36:42 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-f02c5e1b-9642-4ca8-af46-ce890d231e2d tempest-SnapshotDependencyTests-1166183438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:36:42 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-f02c5e1b-9642-4ca8-af46-ce890d231e2d tempest-SnapshotDependencyTests-1166183438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:36:42 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-f02c5e1b-9642-4ca8-af46-ce890d231e2d tempest-SnapshotDependencyTests-1166183438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:36:42 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-f02c5e1b-9642-4ca8-af46-ce890d231e2d tempest-SnapshotDependencyTests-1166183438 None] Selected osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 as target Quobyte volume. {{(pid=86512) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:36:42 devstack cinder-volume[86512]: INFO cinder.volume.drivers.remotefs [None req-f02c5e1b-9642-4ca8-af46-ce890d231e2d tempest-SnapshotDependencyTests-1166183438 None] casted to osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 Sep 29 18:36:42 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-f02c5e1b-9642-4ca8-af46-ce890d231e2d tempest-SnapshotDependencyTests-1166183438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fdb52e3c-f807-4616-a12f-94ec97995cf4 1073741824 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:36:42 devstack sudo[106528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fdb52e3c-f807-4616-a12f-94ec97995cf4 1073741824 Sep 29 18:36:42 devstack sudo[106528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:36:42 devstack sudo[106528]: pam_unix(sudo:session): session closed for user root Sep 29 18:36:42 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-f02c5e1b-9642-4ca8-af46-ce890d231e2d tempest-SnapshotDependencyTests-1166183438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fdb52e3c-f807-4616-a12f-94ec97995cf4 1073741824" returned: 0 in 0.411s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:36:42 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-f02c5e1b-9642-4ca8-af46-ce890d231e2d tempest-SnapshotDependencyTests-1166183438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fdb52e3c-f807-4616-a12f-94ec97995cf4 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:36:42 devstack sudo[106534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fdb52e3c-f807-4616-a12f-94ec97995cf4 Sep 29 18:36:42 devstack sudo[106534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:36:42 devstack sudo[106534]: pam_unix(sudo:session): session closed for user root Sep 29 18:36:42 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-f02c5e1b-9642-4ca8-af46-ce890d231e2d tempest-SnapshotDependencyTests-1166183438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fdb52e3c-f807-4616-a12f-94ec97995cf4" returned: 0 in 0.235s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:36:42 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-f02c5e1b-9642-4ca8-af46-ce890d231e2d tempest-SnapshotDependencyTests-1166183438 None] <== create_volume: return (693ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'} {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:36:42 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-f02c5e1b-9642-4ca8-af46-ce890d231e2d tempest-SnapshotDependencyTests-1166183438 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.697s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:36:42 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-f02c5e1b-9642-4ca8-af46-ce890d231e2d tempest-SnapshotDependencyTests-1166183438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41c0a921-d41f-4949-937b-3b6025352302) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fdb52e3c-f807-4616-a12f-94ec97995cf4', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:36:42 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-f02c5e1b-9642-4ca8-af46-ce890d231e2d tempest-SnapshotDependencyTests-1166183438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc9b03ac-7605-4719-ba68-15c43f8c0563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:36:42 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-f02c5e1b-9642-4ca8-af46-ce890d231e2d tempest-SnapshotDependencyTests-1166183438 None] Volume volume-fdb52e3c-f807-4616-a12f-94ec97995cf4 (fdb52e3c-f807-4616-a12f-94ec97995cf4): created successfully Sep 29 18:36:42 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-f02c5e1b-9642-4ca8-af46-ce890d231e2d tempest-SnapshotDependencyTests-1166183438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc9b03ac-7605-4719-ba68-15c43f8c0563) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:36:42 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-f02c5e1b-9642-4ca8-af46-ce890d231e2d tempest-SnapshotDependencyTests-1166183438 None] Flow 'volume_create_manager' (715a7c48-a378-4dd2-8f16-cfe889bf9789) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:36:42 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-f02c5e1b-9642-4ca8-af46-ce890d231e2d tempest-SnapshotDependencyTests-1166183438 None] Created volume successfully. Sep 29 18:36:43 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-7df7c9f8-cc81-4eec-a40e-6c11d3fd85b4 tempest-SnapshotDependencyTests-1166183438 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:36:43 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-7df7c9f8-cc81-4eec-a40e-6c11d3fd85b4 tempest-SnapshotDependencyTests-1166183438 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:36:43 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-7df7c9f8-cc81-4eec-a40e-6c11d3fd85b4 tempest-SnapshotDependencyTests-1166183438 None] Creating offline snapshot ae73d573-b27b-4a43-a3ce-ea7a8c98a46b of volume fdb52e3c-f807-4616-a12f-94ec97995cf4 {{(pid=86512) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 18:36:43 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[708d10b8-e5c7-443c-beda-a8ec346cfe37]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:36:43 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-7df7c9f8-cc81-4eec-a40e-6c11d3fd85b4 tempest-SnapshotDependencyTests-1166183438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fdb52e3c-f807-4616-a12f-94ec97995cf4 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:36:43 devstack sudo[106537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fdb52e3c-f807-4616-a12f-94ec97995cf4 Sep 29 18:36:43 devstack sudo[106537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:36:43 devstack sudo[106537]: pam_unix(sudo:session): session closed for user root Sep 29 18:36:43 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-7df7c9f8-cc81-4eec-a40e-6c11d3fd85b4 tempest-SnapshotDependencyTests-1166183438 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fdb52e3c-f807-4616-a12f-94ec97995cf4" returned: 0 in 0.343s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:36:43 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-7df7c9f8-cc81-4eec-a40e-6c11d3fd85b4 tempest-SnapshotDependencyTests-1166183438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fdb52e3c-f807-4616-a12f-94ec97995cf4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fdb52e3c-f807-4616-a12f-94ec97995cf4.ae73d573-b27b-4a43-a3ce-ea7a8c98a46b 1G {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:36:43 devstack sudo[106542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fdb52e3c-f807-4616-a12f-94ec97995cf4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fdb52e3c-f807-4616-a12f-94ec97995cf4.ae73d573-b27b-4a43-a3ce-ea7a8c98a46b 1G Sep 29 18:36:43 devstack sudo[106542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:36:43 devstack sudo[106542]: pam_unix(sudo:session): session closed for user root Sep 29 18:36:43 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-7df7c9f8-cc81-4eec-a40e-6c11d3fd85b4 tempest-SnapshotDependencyTests-1166183438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fdb52e3c-f807-4616-a12f-94ec97995cf4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fdb52e3c-f807-4616-a12f-94ec97995cf4.ae73d573-b27b-4a43-a3ce-ea7a8c98a46b 1G" returned: 0 in 0.375s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:36:43 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-7df7c9f8-cc81-4eec-a40e-6c11d3fd85b4 tempest-SnapshotDependencyTests-1166183438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fdb52e3c-f807-4616-a12f-94ec97995cf4 -F qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fdb52e3c-f807-4616-a12f-94ec97995cf4.ae73d573-b27b-4a43-a3ce-ea7a8c98a46b {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:36:43 devstack sudo[106547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fdb52e3c-f807-4616-a12f-94ec97995cf4 -F qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fdb52e3c-f807-4616-a12f-94ec97995cf4.ae73d573-b27b-4a43-a3ce-ea7a8c98a46b Sep 29 18:36:43 devstack sudo[106547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:36:44 devstack sudo[106547]: pam_unix(sudo:session): session closed for user root Sep 29 18:36:44 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-7df7c9f8-cc81-4eec-a40e-6c11d3fd85b4 tempest-SnapshotDependencyTests-1166183438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fdb52e3c-f807-4616-a12f-94ec97995cf4 -F qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fdb52e3c-f807-4616-a12f-94ec97995cf4.ae73d573-b27b-4a43-a3ce-ea7a8c98a46b" returned: 0 in 0.291s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:36:44 devstack cinder-volume[86512]: WARNING cinder.volume.drivers.remotefs [None req-7df7c9f8-cc81-4eec-a40e-6c11d3fd85b4 tempest-SnapshotDependencyTests-1166183438 None] /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fdb52e3c-f807-4616-a12f-94ec97995cf4.ae73d573-b27b-4a43-a3ce-ea7a8c98a46b is being set with open permissions: ugo+rw Sep 29 18:36:44 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-7df7c9f8-cc81-4eec-a40e-6c11d3fd85b4 tempest-SnapshotDependencyTests-1166183438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fdb52e3c-f807-4616-a12f-94ec97995cf4.ae73d573-b27b-4a43-a3ce-ea7a8c98a46b {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:36:44 devstack sudo[106554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fdb52e3c-f807-4616-a12f-94ec97995cf4.ae73d573-b27b-4a43-a3ce-ea7a8c98a46b Sep 29 18:36:44 devstack sudo[106554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:36:44 devstack sudo[106554]: pam_unix(sudo:session): session closed for user root Sep 29 18:36:44 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-7df7c9f8-cc81-4eec-a40e-6c11d3fd85b4 tempest-SnapshotDependencyTests-1166183438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fdb52e3c-f807-4616-a12f-94ec97995cf4.ae73d573-b27b-4a43-a3ce-ea7a8c98a46b" returned: 0 in 0.231s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:36:44 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-7df7c9f8-cc81-4eec-a40e-6c11d3fd85b4 tempest-SnapshotDependencyTests-1166183438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fdb52e3c-f807-4616-a12f-94ec97995cf4.info {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:36:44 devstack sudo[106557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fdb52e3c-f807-4616-a12f-94ec97995cf4.info Sep 29 18:36:44 devstack sudo[106557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:36:44 devstack sudo[106557]: pam_unix(sudo:session): session closed for user root Sep 29 18:36:44 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-7df7c9f8-cc81-4eec-a40e-6c11d3fd85b4 tempest-SnapshotDependencyTests-1166183438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fdb52e3c-f807-4616-a12f-94ec97995cf4.info" returned: 0 in 0.237s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:36:44 devstack cinder-volume[86512]: WARNING cinder.volume.drivers.remotefs [None req-7df7c9f8-cc81-4eec-a40e-6c11d3fd85b4 tempest-SnapshotDependencyTests-1166183438 None] /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fdb52e3c-f807-4616-a12f-94ec97995cf4.info is being set with open permissions: ugo+rw Sep 29 18:36:44 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-7df7c9f8-cc81-4eec-a40e-6c11d3fd85b4 tempest-SnapshotDependencyTests-1166183438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fdb52e3c-f807-4616-a12f-94ec97995cf4.info {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:36:44 devstack sudo[106560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fdb52e3c-f807-4616-a12f-94ec97995cf4.info Sep 29 18:36:44 devstack sudo[106560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:36:44 devstack sudo[106560]: pam_unix(sudo:session): session closed for user root Sep 29 18:36:44 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-7df7c9f8-cc81-4eec-a40e-6c11d3fd85b4 tempest-SnapshotDependencyTests-1166183438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fdb52e3c-f807-4616-a12f-94ec97995cf4.info" returned: 0 in 0.234s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:36:44 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-7df7c9f8-cc81-4eec-a40e-6c11d3fd85b4 tempest-SnapshotDependencyTests-1166183438 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.791s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:36:44 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-7df7c9f8-cc81-4eec-a40e-6c11d3fd85b4 tempest-SnapshotDependencyTests-1166183438 None] Create snapshot completed successfully Sep 29 18:36:45 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2456cbf-3be3-45ff-b422-9ab8caa38db5 tempest-SnapshotDependencyTests-1166183438 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86512) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:36:45 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-a2456cbf-3be3-45ff-b422-9ab8caa38db5 tempest-SnapshotDependencyTests-1166183438 None] Flow 'volume_create_manager' (50476e84-208f-43cd-acc1-8d16f407742c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:36:45 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-a2456cbf-3be3-45ff-b422-9ab8caa38db5 tempest-SnapshotDependencyTests-1166183438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03926bee-9444-4a45-ad20-e4a114cfcf6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:36:45 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-a2456cbf-3be3-45ff-b422-9ab8caa38db5 tempest-SnapshotDependencyTests-1166183438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03926bee-9444-4a45-ad20-e4a114cfcf6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:36:45Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35930ba9-0ebf-431b-90f1-a5600c08b034,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40d552ec92444a7497dcab8fc605ce36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:36:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ae73d573-b27b-4a43-a3ce-ea7a8c98a46b,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:36:46Z,use_quota=True,user_id='b73caa308ba8492a9f6e0a20ac563641',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:36:45 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-a2456cbf-3be3-45ff-b422-9ab8caa38db5 tempest-SnapshotDependencyTests-1166183438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3b1b928-469b-4362-87a8-07f674cb454e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:36:45 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-a2456cbf-3be3-45ff-b422-9ab8caa38db5 tempest-SnapshotDependencyTests-1166183438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3b1b928-469b-4362-87a8-07f674cb454e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:36:45 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-a2456cbf-3be3-45ff-b422-9ab8caa38db5 tempest-SnapshotDependencyTests-1166183438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f517fc6e-cb52-480a-985c-505c80c4a7ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:36:45 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-a2456cbf-3be3-45ff-b422-9ab8caa38db5 tempest-SnapshotDependencyTests-1166183438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f517fc6e-cb52-480a-985c-505c80c4a7ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '35930ba9-0ebf-431b-90f1-a5600c08b034', 'volume_name': 'volume-35930ba9-0ebf-431b-90f1-a5600c08b034', 'volume_size': 1, 'snapshot_id': 'ae73d573-b27b-4a43-a3ce-ea7a8c98a46b'}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:36:45 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-a2456cbf-3be3-45ff-b422-9ab8caa38db5 tempest-SnapshotDependencyTests-1166183438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c04bad8a-e9e6-40b6-9e61-6f14d8327e91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:36:45 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-a2456cbf-3be3-45ff-b422-9ab8caa38db5 tempest-SnapshotDependencyTests-1166183438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c04bad8a-e9e6-40b6-9e61-6f14d8327e91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:36:45 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-a2456cbf-3be3-45ff-b422-9ab8caa38db5 tempest-SnapshotDependencyTests-1166183438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22b1cf7d-104a-47b6-a779-2c064df40901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:36:45 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-a2456cbf-3be3-45ff-b422-9ab8caa38db5 tempest-SnapshotDependencyTests-1166183438 None] Volume 35930ba9-0ebf-431b-90f1-a5600c08b034: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-35930ba9-0ebf-431b-90f1-a5600c08b034', 'volume_size': 1, 'snapshot_id': 'ae73d573-b27b-4a43-a3ce-ea7a8c98a46b'} Sep 29 18:36:45 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-a2456cbf-3be3-45ff-b422-9ab8caa38db5 tempest-SnapshotDependencyTests-1166183438 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:36:45 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-a2456cbf-3be3-45ff-b422-9ab8caa38db5 tempest-SnapshotDependencyTests-1166183438 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:36:45 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-a2456cbf-3be3-45ff-b422-9ab8caa38db5 tempest-SnapshotDependencyTests-1166183438 None] Acquiring lock "cinder-quobyte-ae73d573-b27b-4a43-a3ce-ea7a8c98a46b-35930ba9-0ebf-431b-90f1-a5600c08b034" by "_create_volume_from_snapshot" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:36:45 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-a2456cbf-3be3-45ff-b422-9ab8caa38db5 tempest-SnapshotDependencyTests-1166183438 None] Lock "cinder-quobyte-ae73d573-b27b-4a43-a3ce-ea7a8c98a46b-35930ba9-0ebf-431b-90f1-a5600c08b034" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:36:45 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-a2456cbf-3be3-45ff-b422-9ab8caa38db5 tempest-SnapshotDependencyTests-1166183438 None] Creating volume 35930ba9-0ebf-431b-90f1-a5600c08b034 from snapshot ae73d573-b27b-4a43-a3ce-ea7a8c98a46b {{(pid=86512) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 29 18:36:45 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-a2456cbf-3be3-45ff-b422-9ab8caa38db5 tempest-SnapshotDependencyTests-1166183438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:36:45 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-a2456cbf-3be3-45ff-b422-9ab8caa38db5 tempest-SnapshotDependencyTests-1166183438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:36:45 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-a2456cbf-3be3-45ff-b422-9ab8caa38db5 tempest-SnapshotDependencyTests-1166183438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:36:45 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-a2456cbf-3be3-45ff-b422-9ab8caa38db5 tempest-SnapshotDependencyTests-1166183438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:36:45 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-a2456cbf-3be3-45ff-b422-9ab8caa38db5 tempest-SnapshotDependencyTests-1166183438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:36:45 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-a2456cbf-3be3-45ff-b422-9ab8caa38db5 tempest-SnapshotDependencyTests-1166183438 None] Selected osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 as target Quobyte volume. {{(pid=86512) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:36:45 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-a2456cbf-3be3-45ff-b422-9ab8caa38db5 tempest-SnapshotDependencyTests-1166183438 None] Acquiring lock "cinder-quobyte-35930ba9-0ebf-431b-90f1-a5600c08b034" by "_copy_volume_from_snapshot" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:36:45 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-a2456cbf-3be3-45ff-b422-9ab8caa38db5 tempest-SnapshotDependencyTests-1166183438 None] Lock "cinder-quobyte-35930ba9-0ebf-431b-90f1-a5600c08b034" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:36:45 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-a2456cbf-3be3-45ff-b422-9ab8caa38db5 tempest-SnapshotDependencyTests-1166183438 None] snapshot: ae73d573-b27b-4a43-a3ce-ea7a8c98a46b, volume: 35930ba9-0ebf-431b-90f1-a5600c08b034, {{(pid=86512) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 29 18:36:45 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-a2456cbf-3be3-45ff-b422-9ab8caa38db5 tempest-SnapshotDependencyTests-1166183438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:36:45 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-a2456cbf-3be3-45ff-b422-9ab8caa38db5 tempest-SnapshotDependencyTests-1166183438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:36:45 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-a2456cbf-3be3-45ff-b422-9ab8caa38db5 tempest-SnapshotDependencyTests-1166183438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:36:45 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-a2456cbf-3be3-45ff-b422-9ab8caa38db5 tempest-SnapshotDependencyTests-1166183438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:36:45 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-a2456cbf-3be3-45ff-b422-9ab8caa38db5 tempest-SnapshotDependencyTests-1166183438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:36:45 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ecb0b48-dd29-467c-ba03-a0ee41c3d6ea]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:36:45 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a2456cbf-3be3-45ff-b422-9ab8caa38db5 tempest-SnapshotDependencyTests-1166183438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fdb52e3c-f807-4616-a12f-94ec97995cf4.ae73d573-b27b-4a43-a3ce-ea7a8c98a46b {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:36:46 devstack sudo[106563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fdb52e3c-f807-4616-a12f-94ec97995cf4.ae73d573-b27b-4a43-a3ce-ea7a8c98a46b Sep 29 18:36:46 devstack sudo[106563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:36:46 devstack sudo[106563]: pam_unix(sudo:session): session closed for user root Sep 29 18:36:46 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a2456cbf-3be3-45ff-b422-9ab8caa38db5 tempest-SnapshotDependencyTests-1166183438 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fdb52e3c-f807-4616-a12f-94ec97995cf4.ae73d573-b27b-4a43-a3ce-ea7a8c98a46b" returned: 0 in 0.352s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:36:46 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-a2456cbf-3be3-45ff-b422-9ab8caa38db5 tempest-SnapshotDependencyTests-1166183438 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fdb52e3c-f807-4616-a12f-94ec97995cf4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86512) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 18:36:46 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1608c16-b5f5-4e14-bae7-51c54f90a137]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:36:46 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a2456cbf-3be3-45ff-b422-9ab8caa38db5 tempest-SnapshotDependencyTests-1166183438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fdb52e3c-f807-4616-a12f-94ec97995cf4 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:36:46 devstack sudo[106568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fdb52e3c-f807-4616-a12f-94ec97995cf4 Sep 29 18:36:46 devstack sudo[106568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:36:46 devstack sudo[106568]: pam_unix(sudo:session): session closed for user root Sep 29 18:36:46 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a2456cbf-3be3-45ff-b422-9ab8caa38db5 tempest-SnapshotDependencyTests-1166183438 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fdb52e3c-f807-4616-a12f-94ec97995cf4" returned: 0 in 0.345s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:36:46 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-a2456cbf-3be3-45ff-b422-9ab8caa38db5 tempest-SnapshotDependencyTests-1166183438 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fdb52e3c-f807-4616-a12f-94ec97995cf4 {{(pid=86512) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 29 18:36:46 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-a2456cbf-3be3-45ff-b422-9ab8caa38db5 tempest-SnapshotDependencyTests-1166183438 None] Creating direct copy from snapshot {{(pid=86512) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 29 18:36:46 devstack cinder-volume[86512]: DEBUG cinder.utils [None req-a2456cbf-3be3-45ff-b422-9ab8caa38db5 tempest-SnapshotDependencyTests-1166183438 None] Path /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-35930ba9-0ebf-431b-90f1-a5600c08b034 not found in is_blk_device check {{(pid=86512) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 29 18:36:46 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a2456cbf-3be3-45ff-b422-9ab8caa38db5 tempest-SnapshotDependencyTests-1166183438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fdb52e3c-f807-4616-a12f-94ec97995cf4 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-35930ba9-0ebf-431b-90f1-a5600c08b034 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:36:46 devstack sudo[106573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fdb52e3c-f807-4616-a12f-94ec97995cf4 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-35930ba9-0ebf-431b-90f1-a5600c08b034 Sep 29 18:36:46 devstack sudo[106573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:36:50 devstack cinder-volume[86512]: DEBUG oslo_service.periodic_task [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Running periodic task VolumeManager._thread_info {{(pid=86512) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 18:36:50 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] thread count: 29 {{(pid=86512) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 29 18:36:50 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] thread info: [<_MainThread(MainThread, started 135593654804608)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86512) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 29 18:36:52 devstack sudo[106573]: pam_unix(sudo:session): session closed for user root Sep 29 18:36:52 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a2456cbf-3be3-45ff-b422-9ab8caa38db5 tempest-SnapshotDependencyTests-1166183438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fdb52e3c-f807-4616-a12f-94ec97995cf4 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-35930ba9-0ebf-431b-90f1-a5600c08b034" returned: 0 in 5.612s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:36:52 devstack cinder-volume[86512]: DEBUG cinder.image.image_utils [None req-a2456cbf-3be3-45ff-b422-9ab8caa38db5 tempest-SnapshotDependencyTests-1166183438 None] Image conversion details: src /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fdb52e3c-f807-4616-a12f-94ec97995cf4, size 1024.00 MB, duration 5.61 sec, destination /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-35930ba9-0ebf-431b-90f1-a5600c08b034 {{(pid=86512) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 29 18:36:52 devstack cinder-volume[86512]: INFO cinder.image.image_utils [None req-a2456cbf-3be3-45ff-b422-9ab8caa38db5 tempest-SnapshotDependencyTests-1166183438 None] Converted 1024.00 MB image at 182.42 MB/s Sep 29 18:36:52 devstack cinder-volume[86512]: WARNING cinder.volume.drivers.remotefs [None req-a2456cbf-3be3-45ff-b422-9ab8caa38db5 tempest-SnapshotDependencyTests-1166183438 None] /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-35930ba9-0ebf-431b-90f1-a5600c08b034 is being set with open permissions: ugo+rw Sep 29 18:36:52 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a2456cbf-3be3-45ff-b422-9ab8caa38db5 tempest-SnapshotDependencyTests-1166183438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-35930ba9-0ebf-431b-90f1-a5600c08b034 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:36:52 devstack sudo[106625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-35930ba9-0ebf-431b-90f1-a5600c08b034 Sep 29 18:36:52 devstack sudo[106625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:36:52 devstack sudo[106625]: pam_unix(sudo:session): session closed for user root Sep 29 18:36:52 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a2456cbf-3be3-45ff-b422-9ab8caa38db5 tempest-SnapshotDependencyTests-1166183438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-35930ba9-0ebf-431b-90f1-a5600c08b034" returned: 0 in 0.235s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:36:52 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-a2456cbf-3be3-45ff-b422-9ab8caa38db5 tempest-SnapshotDependencyTests-1166183438 None] Lock "cinder-quobyte-35930ba9-0ebf-431b-90f1-a5600c08b034" released by "_copy_volume_from_snapshot" :: held 6.624s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:36:52 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-a2456cbf-3be3-45ff-b422-9ab8caa38db5 tempest-SnapshotDependencyTests-1166183438 None] Lock "cinder-quobyte-ae73d573-b27b-4a43-a3ce-ea7a8c98a46b-35930ba9-0ebf-431b-90f1-a5600c08b034" released by "_create_volume_from_snapshot" :: held 6.682s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:36:52 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-a2456cbf-3be3-45ff-b422-9ab8caa38db5 tempest-SnapshotDependencyTests-1166183438 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.697s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:36:52 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-a2456cbf-3be3-45ff-b422-9ab8caa38db5 tempest-SnapshotDependencyTests-1166183438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22b1cf7d-104a-47b6-a779-2c064df40901) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35930ba9-0ebf-431b-90f1-a5600c08b034', 'volume_size': 1, 'snapshot_id': 'ae73d573-b27b-4a43-a3ce-ea7a8c98a46b'}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:36:52 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-a2456cbf-3be3-45ff-b422-9ab8caa38db5 tempest-SnapshotDependencyTests-1166183438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2bb8eea-88fb-41e2-bd0d-081a048218a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:36:52 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-a2456cbf-3be3-45ff-b422-9ab8caa38db5 tempest-SnapshotDependencyTests-1166183438 None] Volume volume-35930ba9-0ebf-431b-90f1-a5600c08b034 (35930ba9-0ebf-431b-90f1-a5600c08b034): created successfully Sep 29 18:36:52 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-a2456cbf-3be3-45ff-b422-9ab8caa38db5 tempest-SnapshotDependencyTests-1166183438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2bb8eea-88fb-41e2-bd0d-081a048218a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:36:52 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-a2456cbf-3be3-45ff-b422-9ab8caa38db5 tempest-SnapshotDependencyTests-1166183438 None] Flow 'volume_create_manager' (50476e84-208f-43cd-acc1-8d16f407742c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:36:52 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-a2456cbf-3be3-45ff-b422-9ab8caa38db5 tempest-SnapshotDependencyTests-1166183438 None] Created volume successfully. Sep 29 18:36:53 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-d2aee55f-fbd7-4771-86a0-949c9cd95230 tempest-SnapshotDependencyTests-1166183438 None] Acquiring lock "cinder-ae73d573-b27b-4a43-a3ce-ea7a8c98a46b-delete_snapshot" by "delete_snapshot" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:36:53 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-d2aee55f-fbd7-4771-86a0-949c9cd95230 tempest-SnapshotDependencyTests-1166183438 None] Lock "cinder-ae73d573-b27b-4a43-a3ce-ea7a8c98a46b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:36:53 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-d2aee55f-fbd7-4771-86a0-949c9cd95230 tempest-SnapshotDependencyTests-1166183438 None] Acquiring lock "cinder-quobyte-fdb52e3c-f807-4616-a12f-94ec97995cf4" by "delete_snapshot" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:36:53 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-d2aee55f-fbd7-4771-86a0-949c9cd95230 tempest-SnapshotDependencyTests-1166183438 None] Lock "cinder-quobyte-fdb52e3c-f807-4616-a12f-94ec97995cf4" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:36:53 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-d2aee55f-fbd7-4771-86a0-949c9cd95230 tempest-SnapshotDependencyTests-1166183438 None] Acquiring lock "cinder-quobyte-ae73d573-b27b-4a43-a3ce-ea7a8c98a46b" by "_delete_snapshot" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:36:53 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-d2aee55f-fbd7-4771-86a0-949c9cd95230 tempest-SnapshotDependencyTests-1166183438 None] Lock "cinder-quobyte-ae73d573-b27b-4a43-a3ce-ea7a8c98a46b" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:36:53 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-d2aee55f-fbd7-4771-86a0-949c9cd95230 tempest-SnapshotDependencyTests-1166183438 None] Deleting offline snapshot ae73d573-b27b-4a43-a3ce-ea7a8c98a46b of volume fdb52e3c-f807-4616-a12f-94ec97995cf4 {{(pid=86512) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 18:36:53 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-d2aee55f-fbd7-4771-86a0-949c9cd95230 tempest-SnapshotDependencyTests-1166183438 None] snapshot_file for this snap is: volume-fdb52e3c-f807-4616-a12f-94ec97995cf4.ae73d573-b27b-4a43-a3ce-ea7a8c98a46b {{(pid=86512) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 18:36:53 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[413c89f8-fd1f-420c-998d-7fa15b2f799c]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:36:53 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-d2aee55f-fbd7-4771-86a0-949c9cd95230 tempest-SnapshotDependencyTests-1166183438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fdb52e3c-f807-4616-a12f-94ec97995cf4.ae73d573-b27b-4a43-a3ce-ea7a8c98a46b {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:36:53 devstack sudo[106628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fdb52e3c-f807-4616-a12f-94ec97995cf4.ae73d573-b27b-4a43-a3ce-ea7a8c98a46b Sep 29 18:36:53 devstack sudo[106628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:36:53 devstack sudo[106628]: pam_unix(sudo:session): session closed for user root Sep 29 18:36:53 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-d2aee55f-fbd7-4771-86a0-949c9cd95230 tempest-SnapshotDependencyTests-1166183438 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fdb52e3c-f807-4616-a12f-94ec97995cf4.ae73d573-b27b-4a43-a3ce-ea7a8c98a46b" returned: 0 in 0.354s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:36:53 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-d2aee55f-fbd7-4771-86a0-949c9cd95230 tempest-SnapshotDependencyTests-1166183438 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fdb52e3c-f807-4616-a12f-94ec97995cf4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86512) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 18:36:53 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccbca50d-f50a-4c20-986d-d2baf58d742a]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:36:53 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-d2aee55f-fbd7-4771-86a0-949c9cd95230 tempest-SnapshotDependencyTests-1166183438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fdb52e3c-f807-4616-a12f-94ec97995cf4 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:36:53 devstack sudo[106633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fdb52e3c-f807-4616-a12f-94ec97995cf4 Sep 29 18:36:53 devstack sudo[106633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:36:54 devstack sudo[106633]: pam_unix(sudo:session): session closed for user root Sep 29 18:36:54 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-d2aee55f-fbd7-4771-86a0-949c9cd95230 tempest-SnapshotDependencyTests-1166183438 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fdb52e3c-f807-4616-a12f-94ec97995cf4" returned: 0 in 0.514s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:36:54 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-d2aee55f-fbd7-4771-86a0-949c9cd95230 tempest-SnapshotDependencyTests-1166183438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fdb52e3c-f807-4616-a12f-94ec97995cf4.ae73d573-b27b-4a43-a3ce-ea7a8c98a46b {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:36:54 devstack sudo[106639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fdb52e3c-f807-4616-a12f-94ec97995cf4.ae73d573-b27b-4a43-a3ce-ea7a8c98a46b Sep 29 18:36:54 devstack sudo[106639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:36:54 devstack sudo[106639]: pam_unix(sudo:session): session closed for user root Sep 29 18:36:54 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-d2aee55f-fbd7-4771-86a0-949c9cd95230 tempest-SnapshotDependencyTests-1166183438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fdb52e3c-f807-4616-a12f-94ec97995cf4.ae73d573-b27b-4a43-a3ce-ea7a8c98a46b" returned: 0 in 0.319s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:36:54 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-d2aee55f-fbd7-4771-86a0-949c9cd95230 tempest-SnapshotDependencyTests-1166183438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fdb52e3c-f807-4616-a12f-94ec97995cf4.ae73d573-b27b-4a43-a3ce-ea7a8c98a46b {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:36:54 devstack sudo[106644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fdb52e3c-f807-4616-a12f-94ec97995cf4.ae73d573-b27b-4a43-a3ce-ea7a8c98a46b Sep 29 18:36:54 devstack sudo[106644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:36:54 devstack sudo[106644]: pam_unix(sudo:session): session closed for user root Sep 29 18:36:54 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-d2aee55f-fbd7-4771-86a0-949c9cd95230 tempest-SnapshotDependencyTests-1166183438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fdb52e3c-f807-4616-a12f-94ec97995cf4.ae73d573-b27b-4a43-a3ce-ea7a8c98a46b" returned: 0 in 0.241s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:36:54 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-d2aee55f-fbd7-4771-86a0-949c9cd95230 tempest-SnapshotDependencyTests-1166183438 None] Lock "cinder-quobyte-ae73d573-b27b-4a43-a3ce-ea7a8c98a46b" released by "_delete_snapshot" :: held 1.534s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:36:54 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-d2aee55f-fbd7-4771-86a0-949c9cd95230 tempest-SnapshotDependencyTests-1166183438 None] Lock "cinder-quobyte-fdb52e3c-f807-4616-a12f-94ec97995cf4" released by "delete_snapshot" :: held 1.559s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:36:54 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-d2aee55f-fbd7-4771-86a0-949c9cd95230 tempest-SnapshotDependencyTests-1166183438 None] Created reservations ['8e8871fd-65e5-4b2c-b4e1-fe374f17ef01', '7a749221-bf18-4fac-b7a4-0c6a1534212d', '3bc94716-a32e-4f52-a0bf-d3612d747792', 'f5f6c782-1317-4be3-920f-5fbeeb77bc9c'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:36:54 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-d2aee55f-fbd7-4771-86a0-949c9cd95230 tempest-SnapshotDependencyTests-1166183438 None] Delete snapshot completed successfully. Sep 29 18:36:54 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-d2aee55f-fbd7-4771-86a0-949c9cd95230 tempest-SnapshotDependencyTests-1166183438 None] Lock "cinder-ae73d573-b27b-4a43-a3ce-ea7a8c98a46b-delete_snapshot" released by "delete_snapshot" :: held 1.682s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:36:55 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-22593ef1-9ea5-415d-8441-538bf178c367 tempest-SnapshotDependencyTests-1166183438 None] Acquiring lock "cinder-fdb52e3c-f807-4616-a12f-94ec97995cf4-delete_volume" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:36:55 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-22593ef1-9ea5-415d-8441-538bf178c367 tempest-SnapshotDependencyTests-1166183438 None] Lock "cinder-fdb52e3c-f807-4616-a12f-94ec97995cf4-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:36:55 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-22593ef1-9ea5-415d-8441-538bf178c367 tempest-SnapshotDependencyTests-1166183438 None] Acquiring lock "cinder-quobyte-fdb52e3c-f807-4616-a12f-94ec97995cf4" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:36:55 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-22593ef1-9ea5-415d-8441-538bf178c367 tempest-SnapshotDependencyTests-1166183438 None] Lock "cinder-quobyte-fdb52e3c-f807-4616-a12f-94ec97995cf4" acquired by "delete_volume" :: waited 0.014s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:36:55 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e091bec-2562-46bc-9a23-2b0e62cbd2f4]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:36:55 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-22593ef1-9ea5-415d-8441-538bf178c367 tempest-SnapshotDependencyTests-1166183438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fdb52e3c-f807-4616-a12f-94ec97995cf4 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:36:55 devstack sudo[106647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fdb52e3c-f807-4616-a12f-94ec97995cf4 Sep 29 18:36:55 devstack sudo[106647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:36:55 devstack sudo[106647]: pam_unix(sudo:session): session closed for user root Sep 29 18:36:55 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-22593ef1-9ea5-415d-8441-538bf178c367 tempest-SnapshotDependencyTests-1166183438 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fdb52e3c-f807-4616-a12f-94ec97995cf4" returned: 0 in 0.356s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:36:55 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-22593ef1-9ea5-415d-8441-538bf178c367 tempest-SnapshotDependencyTests-1166183438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fdb52e3c-f807-4616-a12f-94ec97995cf4 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:36:55 devstack sudo[106652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fdb52e3c-f807-4616-a12f-94ec97995cf4 Sep 29 18:36:55 devstack sudo[106652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:36:56 devstack sudo[106652]: pam_unix(sudo:session): session closed for user root Sep 29 18:36:56 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-22593ef1-9ea5-415d-8441-538bf178c367 tempest-SnapshotDependencyTests-1166183438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fdb52e3c-f807-4616-a12f-94ec97995cf4" returned: 0 in 0.236s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:36:56 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-22593ef1-9ea5-415d-8441-538bf178c367 tempest-SnapshotDependencyTests-1166183438 None] Lock "cinder-quobyte-fdb52e3c-f807-4616-a12f-94ec97995cf4" released by "delete_volume" :: held 0.649s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:36:56 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-22593ef1-9ea5-415d-8441-538bf178c367 tempest-SnapshotDependencyTests-1166183438 None] Created reservations ['38af9f27-55c4-41bb-a294-289ed592b30e', 'd8833227-c25a-4777-b60e-9686d8cd544d', 'a23d8770-28ff-4584-b687-ae1b6fce6268', 'f0a6032b-bb7e-4673-92bc-80707d87179c'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:36:56 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-22593ef1-9ea5-415d-8441-538bf178c367 tempest-SnapshotDependencyTests-1166183438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:36:56 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-22593ef1-9ea5-415d-8441-538bf178c367 tempest-SnapshotDependencyTests-1166183438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:36:56 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-22593ef1-9ea5-415d-8441-538bf178c367 tempest-SnapshotDependencyTests-1166183438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:36:56 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-22593ef1-9ea5-415d-8441-538bf178c367 tempest-SnapshotDependencyTests-1166183438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:36:56 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-22593ef1-9ea5-415d-8441-538bf178c367 tempest-SnapshotDependencyTests-1166183438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:36:56 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-22593ef1-9ea5-415d-8441-538bf178c367 tempest-SnapshotDependencyTests-1166183438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:36:56 devstack sudo[106655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:36:56 devstack sudo[106655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:36:56 devstack sudo[106655]: pam_unix(sudo:session): session closed for user root Sep 29 18:36:56 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-22593ef1-9ea5-415d-8441-538bf178c367 tempest-SnapshotDependencyTests-1166183438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.242s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:36:56 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-22593ef1-9ea5-415d-8441-538bf178c367 tempest-SnapshotDependencyTests-1166183438 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:36:56 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-22593ef1-9ea5-415d-8441-538bf178c367 tempest-SnapshotDependencyTests-1166183438 None] Deleted volume successfully. Sep 29 18:36:56 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-22593ef1-9ea5-415d-8441-538bf178c367 tempest-SnapshotDependencyTests-1166183438 None] Lock "cinder-fdb52e3c-f807-4616-a12f-94ec97995cf4-delete_volume" released by "delete_volume" :: held 1.073s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:36:56 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-b1d9e3ea-818f-4685-87a8-518dd553e121 tempest-SnapshotDependencyTests-1166183438 None] Acquiring lock "cinder-35930ba9-0ebf-431b-90f1-a5600c08b034-delete_volume" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:36:56 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-b1d9e3ea-818f-4685-87a8-518dd553e121 tempest-SnapshotDependencyTests-1166183438 None] Lock "cinder-35930ba9-0ebf-431b-90f1-a5600c08b034-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:36:56 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-b1d9e3ea-818f-4685-87a8-518dd553e121 tempest-SnapshotDependencyTests-1166183438 None] Acquiring lock "cinder-quobyte-35930ba9-0ebf-431b-90f1-a5600c08b034" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:36:56 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-b1d9e3ea-818f-4685-87a8-518dd553e121 tempest-SnapshotDependencyTests-1166183438 None] Lock "cinder-quobyte-35930ba9-0ebf-431b-90f1-a5600c08b034" acquired by "delete_volume" :: waited 0.015s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:36:56 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[57981afc-1684-4666-b7f4-5361ca31dde6]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:36:56 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-b1d9e3ea-818f-4685-87a8-518dd553e121 tempest-SnapshotDependencyTests-1166183438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-35930ba9-0ebf-431b-90f1-a5600c08b034 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:36:56 devstack sudo[106664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-35930ba9-0ebf-431b-90f1-a5600c08b034 Sep 29 18:36:56 devstack sudo[106664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:36:56 devstack sudo[106664]: pam_unix(sudo:session): session closed for user root Sep 29 18:36:56 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-b1d9e3ea-818f-4685-87a8-518dd553e121 tempest-SnapshotDependencyTests-1166183438 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-35930ba9-0ebf-431b-90f1-a5600c08b034" returned: 0 in 0.341s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:36:56 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-b1d9e3ea-818f-4685-87a8-518dd553e121 tempest-SnapshotDependencyTests-1166183438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-35930ba9-0ebf-431b-90f1-a5600c08b034 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:36:57 devstack sudo[106669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-35930ba9-0ebf-431b-90f1-a5600c08b034 Sep 29 18:36:57 devstack sudo[106669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:36:57 devstack sudo[106669]: pam_unix(sudo:session): session closed for user root Sep 29 18:36:57 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-b1d9e3ea-818f-4685-87a8-518dd553e121 tempest-SnapshotDependencyTests-1166183438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-35930ba9-0ebf-431b-90f1-a5600c08b034" returned: 0 in 0.231s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:36:57 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-b1d9e3ea-818f-4685-87a8-518dd553e121 tempest-SnapshotDependencyTests-1166183438 None] Lock "cinder-quobyte-35930ba9-0ebf-431b-90f1-a5600c08b034" released by "delete_volume" :: held 0.619s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:36:57 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-b1d9e3ea-818f-4685-87a8-518dd553e121 tempest-SnapshotDependencyTests-1166183438 None] Created reservations ['9573a3d2-61bc-45f0-a607-878ada5241e0', '10572a5d-5165-42bc-969d-27960bb493fa', 'c1f551f2-2f25-496a-b529-aa6f24662d95', 'a905b13d-836a-4663-a259-d67691bcefc0'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:36:57 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-b1d9e3ea-818f-4685-87a8-518dd553e121 tempest-SnapshotDependencyTests-1166183438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:36:57 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-b1d9e3ea-818f-4685-87a8-518dd553e121 tempest-SnapshotDependencyTests-1166183438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:36:57 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-b1d9e3ea-818f-4685-87a8-518dd553e121 tempest-SnapshotDependencyTests-1166183438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:36:57 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-b1d9e3ea-818f-4685-87a8-518dd553e121 tempest-SnapshotDependencyTests-1166183438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:36:57 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-b1d9e3ea-818f-4685-87a8-518dd553e121 tempest-SnapshotDependencyTests-1166183438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:36:57 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-b1d9e3ea-818f-4685-87a8-518dd553e121 tempest-SnapshotDependencyTests-1166183438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:36:57 devstack sudo[106672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:36:57 devstack sudo[106672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:36:57 devstack sudo[106672]: pam_unix(sudo:session): session closed for user root Sep 29 18:36:57 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-b1d9e3ea-818f-4685-87a8-518dd553e121 tempest-SnapshotDependencyTests-1166183438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.253s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:36:57 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-b1d9e3ea-818f-4685-87a8-518dd553e121 tempest-SnapshotDependencyTests-1166183438 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:36:57 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-b1d9e3ea-818f-4685-87a8-518dd553e121 tempest-SnapshotDependencyTests-1166183438 None] Deleted volume successfully. Sep 29 18:36:57 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-b1d9e3ea-818f-4685-87a8-518dd553e121 tempest-SnapshotDependencyTests-1166183438 None] Lock "cinder-35930ba9-0ebf-431b-90f1-a5600c08b034-delete_volume" released by "delete_volume" :: held 1.066s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:37:07 devstack cinder-volume[86512]: DEBUG dbcounter [-] [86512] Writing DB stats cinder:SELECT=20,cinder:UPDATE=32,cinder:DELETE=3,cinder:INSERT=8 {{(pid=86512) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 18:37:07 devstack cinder-volume[86512]: DEBUG dbcounter [-] [86512] Writing DB stats cinder:UPDATE=26,cinder:SELECT=29,cinder:INSERT=7,cinder:DELETE=2 {{(pid=86512) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 18:37:17 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-29d19516-705a-4999-a488-2e09aeb8ca6d tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86512) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:37:17 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-29d19516-705a-4999-a488-2e09aeb8ca6d tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Flow 'volume_create_manager' (6264b018-c52b-4647-ac97-c5bab807dc33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:37:17 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-29d19516-705a-4999-a488-2e09aeb8ca6d tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d915fda-1ee0-480e-804a-3670d70fd815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:17 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-29d19516-705a-4999-a488-2e09aeb8ca6d tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d915fda-1ee0-480e-804a-3670d70fd815) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:37:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2130004261',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5365de71-4e85-4c9d-9085-556cf1750bf5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e34c2ecc959493fb6230e8b48478708',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:37:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:37:18Z,use_quota=True,user_id='fa38720781b245e09fe5ed4e422ea52a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:17 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-29d19516-705a-4999-a488-2e09aeb8ca6d tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ca790e6-3001-403b-8ec3-079427e98f4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:17 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-29d19516-705a-4999-a488-2e09aeb8ca6d tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ca790e6-3001-403b-8ec3-079427e98f4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:17 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-29d19516-705a-4999-a488-2e09aeb8ca6d tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89025d0f-48d9-4ee9-a996-65b610124004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:17 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-29d19516-705a-4999-a488-2e09aeb8ca6d tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89025d0f-48d9-4ee9-a996-65b610124004) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5365de71-4e85-4c9d-9085-556cf1750bf5', 'volume_name': 'volume-5365de71-4e85-4c9d-9085-556cf1750bf5', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:17 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-29d19516-705a-4999-a488-2e09aeb8ca6d tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f127e29-34f5-47e9-874e-ab6a4992725f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:17 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-29d19516-705a-4999-a488-2e09aeb8ca6d tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f127e29-34f5-47e9-874e-ab6a4992725f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:17 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-29d19516-705a-4999-a488-2e09aeb8ca6d tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80d041a4-aeeb-46a6-9a88-47130910e683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:17 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-29d19516-705a-4999-a488-2e09aeb8ca6d tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Volume 5365de71-4e85-4c9d-9085-556cf1750bf5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5365de71-4e85-4c9d-9085-556cf1750bf5', 'volume_size': 1} Sep 29 18:37:17 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-29d19516-705a-4999-a488-2e09aeb8ca6d tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:37:17 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-29d19516-705a-4999-a488-2e09aeb8ca6d tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:37:17 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-29d19516-705a-4999-a488-2e09aeb8ca6d tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:37:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2130004261',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5365de71-4e85-4c9d-9085-556cf1750bf5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e34c2ecc959493fb6230e8b48478708',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:37:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:37:18Z,use_quota=True,user_id='fa38720781b245e09fe5ed4e422ea52a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)}" {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:37:17 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-29d19516-705a-4999-a488-2e09aeb8ca6d tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Creating volume 5365de71-4e85-4c9d-9085-556cf1750bf5 {{(pid=86512) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:37:17 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-29d19516-705a-4999-a488-2e09aeb8ca6d tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:37:17 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-29d19516-705a-4999-a488-2e09aeb8ca6d tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:37:17 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-29d19516-705a-4999-a488-2e09aeb8ca6d tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:37:17 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-29d19516-705a-4999-a488-2e09aeb8ca6d tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:37:17 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-29d19516-705a-4999-a488-2e09aeb8ca6d tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:37:17 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-29d19516-705a-4999-a488-2e09aeb8ca6d tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Selected osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 as target Quobyte volume. {{(pid=86512) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:37:17 devstack cinder-volume[86512]: INFO cinder.volume.drivers.remotefs [None req-29d19516-705a-4999-a488-2e09aeb8ca6d tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] casted to osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 Sep 29 18:37:17 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-29d19516-705a-4999-a488-2e09aeb8ca6d tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-5365de71-4e85-4c9d-9085-556cf1750bf5 1073741824 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:18 devstack sudo[106718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-5365de71-4e85-4c9d-9085-556cf1750bf5 1073741824 Sep 29 18:37:18 devstack sudo[106718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:18 devstack sudo[106718]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:18 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-29d19516-705a-4999-a488-2e09aeb8ca6d tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-5365de71-4e85-4c9d-9085-556cf1750bf5 1073741824" returned: 0 in 0.590s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:18 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-29d19516-705a-4999-a488-2e09aeb8ca6d tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-5365de71-4e85-4c9d-9085-556cf1750bf5 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:18 devstack sudo[106724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-5365de71-4e85-4c9d-9085-556cf1750bf5 Sep 29 18:37:18 devstack sudo[106724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:18 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a2c9767-3180-459d-81b6-14280267e4d1 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86512) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:37:18 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-1a2c9767-3180-459d-81b6-14280267e4d1 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Flow 'volume_create_manager' (f269b49e-fd9d-4ea2-92a6-651063cf4350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:37:18 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-1a2c9767-3180-459d-81b6-14280267e4d1 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (848af668-73d5-4394-acd2-441821e51d7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:18 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-1a2c9767-3180-459d-81b6-14280267e4d1 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (848af668-73d5-4394-acd2-441821e51d7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:37:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1893297044',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fbf0c3c-8379-44e0-9816-f48d5c7cf687,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46b8fc61c3654cbfa4d958fec5e084cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:37:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:37:19Z,use_quota=True,user_id='9f90a47c64fc4e0abf96242604fa9a82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:18 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-1a2c9767-3180-459d-81b6-14280267e4d1 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fd42213-1e69-4327-9906-65e12efe300e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:18 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-1a2c9767-3180-459d-81b6-14280267e4d1 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fd42213-1e69-4327-9906-65e12efe300e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:18 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-1a2c9767-3180-459d-81b6-14280267e4d1 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (318a581b-e1b8-4749-b936-11c520c0e42c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:18 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-1a2c9767-3180-459d-81b6-14280267e4d1 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (318a581b-e1b8-4749-b936-11c520c0e42c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0fbf0c3c-8379-44e0-9816-f48d5c7cf687', 'volume_name': 'volume-0fbf0c3c-8379-44e0-9816-f48d5c7cf687', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:18 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-1a2c9767-3180-459d-81b6-14280267e4d1 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4efb8eed-ba31-4451-8d15-cf9bae490186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:18 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-1a2c9767-3180-459d-81b6-14280267e4d1 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4efb8eed-ba31-4451-8d15-cf9bae490186) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:18 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-1a2c9767-3180-459d-81b6-14280267e4d1 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f4cd499-d407-431b-b949-44fcd8133a11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:18 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-1a2c9767-3180-459d-81b6-14280267e4d1 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Volume 0fbf0c3c-8379-44e0-9816-f48d5c7cf687: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0fbf0c3c-8379-44e0-9816-f48d5c7cf687', 'volume_size': 1} Sep 29 18:37:18 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-1a2c9767-3180-459d-81b6-14280267e4d1 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:37:18 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-3b9aa3c2-50dc-48d3-a21e-5c050e2ed7d2 tempest-ProjectAdminTests-2134423468 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.014518737793, 'free_capacity_gb': 1775.014518737793, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86512) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 29 18:37:18 devstack sudo[106724]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:18 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-29d19516-705a-4999-a488-2e09aeb8ca6d tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-5365de71-4e85-4c9d-9085-556cf1750bf5" returned: 0 in 0.306s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:18 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-29d19516-705a-4999-a488-2e09aeb8ca6d tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] <== create_volume: return (973ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'} {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:37:18 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-29d19516-705a-4999-a488-2e09aeb8ca6d tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.975s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:37:18 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-1a2c9767-3180-459d-81b6-14280267e4d1 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.172s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:37:18 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-1a2c9767-3180-459d-81b6-14280267e4d1 tempest-CreateVolumesFromSnapshotTest-1588006594 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:37:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1893297044',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fbf0c3c-8379-44e0-9816-f48d5c7cf687,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46b8fc61c3654cbfa4d958fec5e084cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:37:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:37:19Z,use_quota=True,user_id='9f90a47c64fc4e0abf96242604fa9a82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)}" {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:37:18 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-1a2c9767-3180-459d-81b6-14280267e4d1 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Creating volume 0fbf0c3c-8379-44e0-9816-f48d5c7cf687 {{(pid=86512) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:37:18 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-1a2c9767-3180-459d-81b6-14280267e4d1 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:37:18 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-1a2c9767-3180-459d-81b6-14280267e4d1 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:37:18 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-1a2c9767-3180-459d-81b6-14280267e4d1 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:37:18 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-1a2c9767-3180-459d-81b6-14280267e4d1 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:37:18 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-1a2c9767-3180-459d-81b6-14280267e4d1 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:37:18 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-1a2c9767-3180-459d-81b6-14280267e4d1 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Selected osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 as target Quobyte volume. {{(pid=86512) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:37:18 devstack cinder-volume[86512]: INFO cinder.volume.drivers.remotefs [None req-1a2c9767-3180-459d-81b6-14280267e4d1 tempest-CreateVolumesFromSnapshotTest-1588006594 None] casted to osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 Sep 29 18:37:18 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-1a2c9767-3180-459d-81b6-14280267e4d1 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0fbf0c3c-8379-44e0-9816-f48d5c7cf687 1073741824 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:18 devstack sudo[106727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0fbf0c3c-8379-44e0-9816-f48d5c7cf687 1073741824 Sep 29 18:37:18 devstack sudo[106727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:18 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-29d19516-705a-4999-a488-2e09aeb8ca6d tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80d041a4-aeeb-46a6-9a88-47130910e683) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5365de71-4e85-4c9d-9085-556cf1750bf5', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:18 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-29d19516-705a-4999-a488-2e09aeb8ca6d tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fbe40df-a5cd-4fa3-b677-593a1df27bb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:19 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-29d19516-705a-4999-a488-2e09aeb8ca6d tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Volume volume-5365de71-4e85-4c9d-9085-556cf1750bf5 (5365de71-4e85-4c9d-9085-556cf1750bf5): created successfully Sep 29 18:37:19 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-29d19516-705a-4999-a488-2e09aeb8ca6d tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fbe40df-a5cd-4fa3-b677-593a1df27bb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:19 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-29d19516-705a-4999-a488-2e09aeb8ca6d tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Flow 'volume_create_manager' (6264b018-c52b-4647-ac97-c5bab807dc33) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:37:19 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-29d19516-705a-4999-a488-2e09aeb8ca6d tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Created volume successfully. Sep 29 18:37:19 devstack sudo[106727]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:19 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-1a2c9767-3180-459d-81b6-14280267e4d1 tempest-CreateVolumesFromSnapshotTest-1588006594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0fbf0c3c-8379-44e0-9816-f48d5c7cf687 1073741824" returned: 0 in 0.527s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:19 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-1a2c9767-3180-459d-81b6-14280267e4d1 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0fbf0c3c-8379-44e0-9816-f48d5c7cf687 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:19 devstack sudo[106733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0fbf0c3c-8379-44e0-9816-f48d5c7cf687 Sep 29 18:37:19 devstack sudo[106733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:19 devstack sudo[106733]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:19 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-1a2c9767-3180-459d-81b6-14280267e4d1 tempest-CreateVolumesFromSnapshotTest-1588006594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0fbf0c3c-8379-44e0-9816-f48d5c7cf687" returned: 0 in 0.261s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:19 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-1a2c9767-3180-459d-81b6-14280267e4d1 tempest-CreateVolumesFromSnapshotTest-1588006594 None] <== create_volume: return (837ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'} {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:37:19 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-1a2c9767-3180-459d-81b6-14280267e4d1 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.840s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:37:19 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-1a2c9767-3180-459d-81b6-14280267e4d1 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f4cd499-d407-431b-b949-44fcd8133a11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0fbf0c3c-8379-44e0-9816-f48d5c7cf687', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:19 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-1a2c9767-3180-459d-81b6-14280267e4d1 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f417746-b869-4f5b-a960-972f8600d183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:19 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-1a2c9767-3180-459d-81b6-14280267e4d1 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Volume volume-0fbf0c3c-8379-44e0-9816-f48d5c7cf687 (0fbf0c3c-8379-44e0-9816-f48d5c7cf687): created successfully Sep 29 18:37:19 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-1a2c9767-3180-459d-81b6-14280267e4d1 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f417746-b869-4f5b-a960-972f8600d183) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:19 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-1a2c9767-3180-459d-81b6-14280267e4d1 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Flow 'volume_create_manager' (f269b49e-fd9d-4ea2-92a6-651063cf4350) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:37:19 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-1a2c9767-3180-459d-81b6-14280267e4d1 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Created volume successfully. Sep 29 18:37:20 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-d33be68a-76ca-43e6-8912-7536bcb53e3c tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86512) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:37:20 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d33be68a-76ca-43e6-8912-7536bcb53e3c tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Flow 'volume_create_manager' (4420240e-53ff-4336-b259-5710185d0366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:37:20 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d33be68a-76ca-43e6-8912-7536bcb53e3c tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5724c639-90cf-475c-a60d-9a96846ce2fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:20 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d33be68a-76ca-43e6-8912-7536bcb53e3c tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5724c639-90cf-475c-a60d-9a96846ce2fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:37:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-370385469',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07c1933f-b2eb-49fe-8853-d9973fe9c8c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e34c2ecc959493fb6230e8b48478708',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:37:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:37:20Z,use_quota=True,user_id='fa38720781b245e09fe5ed4e422ea52a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:20 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d33be68a-76ca-43e6-8912-7536bcb53e3c tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95135710-51fe-4276-b1fc-8542df60101d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:20 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d33be68a-76ca-43e6-8912-7536bcb53e3c tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95135710-51fe-4276-b1fc-8542df60101d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:20 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d33be68a-76ca-43e6-8912-7536bcb53e3c tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (929ecb3a-e096-4c5b-a8d7-2ba3446cf3b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:20 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d33be68a-76ca-43e6-8912-7536bcb53e3c tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (929ecb3a-e096-4c5b-a8d7-2ba3446cf3b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07c1933f-b2eb-49fe-8853-d9973fe9c8c8', 'volume_name': 'volume-07c1933f-b2eb-49fe-8853-d9973fe9c8c8', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:20 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d33be68a-76ca-43e6-8912-7536bcb53e3c tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a55c60a-e12c-4659-8226-3e14fead0b76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:20 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d33be68a-76ca-43e6-8912-7536bcb53e3c tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a55c60a-e12c-4659-8226-3e14fead0b76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:20 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d33be68a-76ca-43e6-8912-7536bcb53e3c tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ac39dbe-30a4-47fe-a968-5bd801835fca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:20 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-d33be68a-76ca-43e6-8912-7536bcb53e3c tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Volume 07c1933f-b2eb-49fe-8853-d9973fe9c8c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07c1933f-b2eb-49fe-8853-d9973fe9c8c8', 'volume_size': 1} Sep 29 18:37:20 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-d33be68a-76ca-43e6-8912-7536bcb53e3c tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:37:20 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-d33be68a-76ca-43e6-8912-7536bcb53e3c tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:37:20 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-d33be68a-76ca-43e6-8912-7536bcb53e3c tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:37:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-370385469',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07c1933f-b2eb-49fe-8853-d9973fe9c8c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e34c2ecc959493fb6230e8b48478708',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:37:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:37:20Z,use_quota=True,user_id='fa38720781b245e09fe5ed4e422ea52a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)}" {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:37:20 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-d33be68a-76ca-43e6-8912-7536bcb53e3c tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Creating volume 07c1933f-b2eb-49fe-8853-d9973fe9c8c8 {{(pid=86512) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:37:20 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-d33be68a-76ca-43e6-8912-7536bcb53e3c tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:37:20 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-d33be68a-76ca-43e6-8912-7536bcb53e3c tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:37:20 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-d33be68a-76ca-43e6-8912-7536bcb53e3c tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:37:20 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-d33be68a-76ca-43e6-8912-7536bcb53e3c tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:37:20 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-d33be68a-76ca-43e6-8912-7536bcb53e3c tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:37:20 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-d33be68a-76ca-43e6-8912-7536bcb53e3c tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Selected osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 as target Quobyte volume. {{(pid=86512) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:37:20 devstack cinder-volume[86512]: INFO cinder.volume.drivers.remotefs [None req-d33be68a-76ca-43e6-8912-7536bcb53e3c tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] casted to osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 Sep 29 18:37:20 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-d33be68a-76ca-43e6-8912-7536bcb53e3c tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-07c1933f-b2eb-49fe-8853-d9973fe9c8c8 1073741824 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:20 devstack sudo[106736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-07c1933f-b2eb-49fe-8853-d9973fe9c8c8 1073741824 Sep 29 18:37:20 devstack sudo[106736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:21 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-5e6996a5-d3e7-44f4-9e94-4e35b8d96ddb tempest-CreateVolumesFromSnapshotTest-1588006594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:37:21 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-370f2953-7ed2-4cad-bcba-90f8a2597c1a tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86512) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:37:21 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-370f2953-7ed2-4cad-bcba-90f8a2597c1a tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Flow 'volume_create_manager' (ea91a417-f4da-4a93-a0fe-6e040e68cf90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:37:21 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-370f2953-7ed2-4cad-bcba-90f8a2597c1a tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3815c1d8-34bc-4308-8425-ad12e89d9ec7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:21 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-370f2953-7ed2-4cad-bcba-90f8a2597c1a tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3815c1d8-34bc-4308-8425-ad12e89d9ec7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:37:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-506766549',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b07b67ac-5b99-4ac3-950a-f61c2340a4ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e34c2ecc959493fb6230e8b48478708',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:37:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:37:21Z,use_quota=True,user_id='fa38720781b245e09fe5ed4e422ea52a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:21 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-370f2953-7ed2-4cad-bcba-90f8a2597c1a tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78daf75f-f36a-43b1-91f6-f71f156bb1dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:21 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-370f2953-7ed2-4cad-bcba-90f8a2597c1a tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78daf75f-f36a-43b1-91f6-f71f156bb1dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:21 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-370f2953-7ed2-4cad-bcba-90f8a2597c1a tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c20b808-301c-46f9-89b1-4246960f7e55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:21 devstack sudo[106736]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:21 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-370f2953-7ed2-4cad-bcba-90f8a2597c1a tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c20b808-301c-46f9-89b1-4246960f7e55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b07b67ac-5b99-4ac3-950a-f61c2340a4ee', 'volume_name': 'volume-b07b67ac-5b99-4ac3-950a-f61c2340a4ee', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:21 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-370f2953-7ed2-4cad-bcba-90f8a2597c1a tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e256d43-9840-4637-8529-e76476588624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:21 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-370f2953-7ed2-4cad-bcba-90f8a2597c1a tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e256d43-9840-4637-8529-e76476588624) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:21 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-370f2953-7ed2-4cad-bcba-90f8a2597c1a tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93500f39-83b5-4ff5-b5d1-b0d6cfa7cbd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:21 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-370f2953-7ed2-4cad-bcba-90f8a2597c1a tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Volume b07b67ac-5b99-4ac3-950a-f61c2340a4ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b07b67ac-5b99-4ac3-950a-f61c2340a4ee', 'volume_size': 1} Sep 29 18:37:21 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-370f2953-7ed2-4cad-bcba-90f8a2597c1a tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:37:21 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-d33be68a-76ca-43e6-8912-7536bcb53e3c tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-07c1933f-b2eb-49fe-8853-d9973fe9c8c8 1073741824" returned: 0 in 0.740s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:21 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-d33be68a-76ca-43e6-8912-7536bcb53e3c tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-07c1933f-b2eb-49fe-8853-d9973fe9c8c8 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:21 devstack sudo[106743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-07c1933f-b2eb-49fe-8853-d9973fe9c8c8 Sep 29 18:37:21 devstack sudo[106743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:21 devstack sudo[106743]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:21 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-d33be68a-76ca-43e6-8912-7536bcb53e3c tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-07c1933f-b2eb-49fe-8853-d9973fe9c8c8" returned: 0 in 0.288s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:21 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-d33be68a-76ca-43e6-8912-7536bcb53e3c tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] <== create_volume: return (1089ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'} {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:37:21 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-d33be68a-76ca-43e6-8912-7536bcb53e3c tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.094s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:37:21 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-5e6996a5-d3e7-44f4-9e94-4e35b8d96ddb tempest-CreateVolumesFromSnapshotTest-1588006594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.502s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:37:21 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d33be68a-76ca-43e6-8912-7536bcb53e3c tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ac39dbe-30a4-47fe-a968-5bd801835fca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07c1933f-b2eb-49fe-8853-d9973fe9c8c8', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:21 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d33be68a-76ca-43e6-8912-7536bcb53e3c tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4884f80-ce8f-4fff-961c-7c9ded02b5e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:21 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-5e6996a5-d3e7-44f4-9e94-4e35b8d96ddb tempest-CreateVolumesFromSnapshotTest-1588006594 None] Creating offline snapshot b21cb005-34c2-4869-b19a-f0bb3b403789 of volume 0fbf0c3c-8379-44e0-9816-f48d5c7cf687 {{(pid=86512) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 18:37:21 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a18b8de-7564-462c-9aff-67f8f14c47f5 tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86512) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:37:21 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-0a18b8de-7564-462c-9aff-67f8f14c47f5 tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Flow 'volume_create_manager' (2a19ce3e-b919-4ea1-97ee-505aee95c95a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:37:21 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-0a18b8de-7564-462c-9aff-67f8f14c47f5 tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e3276ff-d3d1-4d12-b32e-cde4e80e3474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:21 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab175d40-14f6-45a9-822d-24069fe9b305]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:37:21 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-5e6996a5-d3e7-44f4-9e94-4e35b8d96ddb tempest-CreateVolumesFromSnapshotTest-1588006594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0fbf0c3c-8379-44e0-9816-f48d5c7cf687 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:21 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-d33be68a-76ca-43e6-8912-7536bcb53e3c tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Volume volume-07c1933f-b2eb-49fe-8853-d9973fe9c8c8 (07c1933f-b2eb-49fe-8853-d9973fe9c8c8): created successfully Sep 29 18:37:22 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d33be68a-76ca-43e6-8912-7536bcb53e3c tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4884f80-ce8f-4fff-961c-7c9ded02b5e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:22 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d33be68a-76ca-43e6-8912-7536bcb53e3c tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Flow 'volume_create_manager' (4420240e-53ff-4336-b259-5710185d0366) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:37:22 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-0a18b8de-7564-462c-9aff-67f8f14c47f5 tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e3276ff-d3d1-4d12-b32e-cde4e80e3474) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:37:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-245488859',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2aeb54f4-d077-456d-a7e5-99149ba171d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e34c2ecc959493fb6230e8b48478708',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:37:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:37:22Z,use_quota=True,user_id='fa38720781b245e09fe5ed4e422ea52a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:22 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-0a18b8de-7564-462c-9aff-67f8f14c47f5 tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9392154-30ee-4d73-b7e0-4473da69d072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:22 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-0a18b8de-7564-462c-9aff-67f8f14c47f5 tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9392154-30ee-4d73-b7e0-4473da69d072) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:22 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-0a18b8de-7564-462c-9aff-67f8f14c47f5 tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ed070e4-7ed5-476c-842b-bcc3b5895379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:22 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-0a18b8de-7564-462c-9aff-67f8f14c47f5 tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ed070e4-7ed5-476c-842b-bcc3b5895379) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2aeb54f4-d077-456d-a7e5-99149ba171d0', 'volume_name': 'volume-2aeb54f4-d077-456d-a7e5-99149ba171d0', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:22 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-0a18b8de-7564-462c-9aff-67f8f14c47f5 tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47670541-785e-4513-afc6-d212cff21851) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:22 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-0a18b8de-7564-462c-9aff-67f8f14c47f5 tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47670541-785e-4513-afc6-d212cff21851) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:22 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-0a18b8de-7564-462c-9aff-67f8f14c47f5 tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc2f9ad6-a490-4531-9c66-6c4438db028f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:22 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-0a18b8de-7564-462c-9aff-67f8f14c47f5 tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Volume 2aeb54f4-d077-456d-a7e5-99149ba171d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2aeb54f4-d077-456d-a7e5-99149ba171d0', 'volume_size': 1} Sep 29 18:37:22 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-0a18b8de-7564-462c-9aff-67f8f14c47f5 tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:37:22 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-d33be68a-76ca-43e6-8912-7536bcb53e3c tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Created volume successfully. Sep 29 18:37:22 devstack sudo[106746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0fbf0c3c-8379-44e0-9816-f48d5c7cf687 Sep 29 18:37:22 devstack sudo[106746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:22 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c504746-c9f2-4994-a739-25b6c1eeb911 tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86512) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:37:22 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-0c504746-c9f2-4994-a739-25b6c1eeb911 tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Flow 'volume_create_manager' (28612769-df27-428c-8d95-a5ef74264268) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:37:22 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-0c504746-c9f2-4994-a739-25b6c1eeb911 tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (128c4fbe-c55c-457c-990a-e219e9a4f5b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:22 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-0c504746-c9f2-4994-a739-25b6c1eeb911 tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (128c4fbe-c55c-457c-990a-e219e9a4f5b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:37:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-612993860',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=173e089e-1640-4f6b-80c8-21932a9cdb68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e34c2ecc959493fb6230e8b48478708',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:37:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:37:22Z,use_quota=True,user_id='fa38720781b245e09fe5ed4e422ea52a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:22 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-0c504746-c9f2-4994-a739-25b6c1eeb911 tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67206a7e-78b9-469f-905e-17b6b46870f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:22 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-0c504746-c9f2-4994-a739-25b6c1eeb911 tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67206a7e-78b9-469f-905e-17b6b46870f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:22 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-0c504746-c9f2-4994-a739-25b6c1eeb911 tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0c3eb43-2905-43c5-9bb2-edbd93ef138d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:22 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-0c504746-c9f2-4994-a739-25b6c1eeb911 tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0c3eb43-2905-43c5-9bb2-edbd93ef138d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '173e089e-1640-4f6b-80c8-21932a9cdb68', 'volume_name': 'volume-173e089e-1640-4f6b-80c8-21932a9cdb68', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:22 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-0c504746-c9f2-4994-a739-25b6c1eeb911 tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a01d9a66-a982-4528-af8b-64ef506a842d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:22 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-0c504746-c9f2-4994-a739-25b6c1eeb911 tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a01d9a66-a982-4528-af8b-64ef506a842d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:22 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-0c504746-c9f2-4994-a739-25b6c1eeb911 tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d82834e2-c7e6-4768-946c-8496742ace10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:22 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-0c504746-c9f2-4994-a739-25b6c1eeb911 tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Volume 173e089e-1640-4f6b-80c8-21932a9cdb68: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-173e089e-1640-4f6b-80c8-21932a9cdb68', 'volume_size': 1} Sep 29 18:37:22 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-0c504746-c9f2-4994-a739-25b6c1eeb911 tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:37:22 devstack sudo[106746]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:22 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-5e6996a5-d3e7-44f4-9e94-4e35b8d96ddb tempest-CreateVolumesFromSnapshotTest-1588006594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0fbf0c3c-8379-44e0-9816-f48d5c7cf687" returned: 0 in 0.568s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:22 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-5e6996a5-d3e7-44f4-9e94-4e35b8d96ddb tempest-CreateVolumesFromSnapshotTest-1588006594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0fbf0c3c-8379-44e0-9816-f48d5c7cf687,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0fbf0c3c-8379-44e0-9816-f48d5c7cf687.b21cb005-34c2-4869-b19a-f0bb3b403789 1G {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:22 devstack sudo[106751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0fbf0c3c-8379-44e0-9816-f48d5c7cf687,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0fbf0c3c-8379-44e0-9816-f48d5c7cf687.b21cb005-34c2-4869-b19a-f0bb3b403789 1G Sep 29 18:37:22 devstack sudo[106751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:22 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-bdd4deba-a993-495e-a2f5-a45aeeacfded tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86512) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:37:22 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-bdd4deba-a993-495e-a2f5-a45aeeacfded tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Flow 'volume_create_manager' (fad267d7-39b6-4957-97dd-cd13e2debe2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:37:22 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-bdd4deba-a993-495e-a2f5-a45aeeacfded tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a845b9f5-4a66-4453-9425-f9e29d93952a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:22 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-bdd4deba-a993-495e-a2f5-a45aeeacfded tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a845b9f5-4a66-4453-9425-f9e29d93952a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:37:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-285129074',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=038fc5c6-d3d1-4d4b-af84-e95b3cc0df78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e34c2ecc959493fb6230e8b48478708',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:37:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:37:23Z,use_quota=True,user_id='fa38720781b245e09fe5ed4e422ea52a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:22 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-bdd4deba-a993-495e-a2f5-a45aeeacfded tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5256aa61-1167-430e-80f8-74c30e21d62b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:22 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-bdd4deba-a993-495e-a2f5-a45aeeacfded tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5256aa61-1167-430e-80f8-74c30e21d62b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:22 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-bdd4deba-a993-495e-a2f5-a45aeeacfded tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59576b1e-8be2-4055-a6f2-08e39bc44b38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:22 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-bdd4deba-a993-495e-a2f5-a45aeeacfded tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59576b1e-8be2-4055-a6f2-08e39bc44b38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '038fc5c6-d3d1-4d4b-af84-e95b3cc0df78', 'volume_name': 'volume-038fc5c6-d3d1-4d4b-af84-e95b3cc0df78', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:22 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-bdd4deba-a993-495e-a2f5-a45aeeacfded tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6513cf03-e835-4029-bbdc-f5e5e76eb0fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:22 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-bdd4deba-a993-495e-a2f5-a45aeeacfded tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6513cf03-e835-4029-bbdc-f5e5e76eb0fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:22 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-bdd4deba-a993-495e-a2f5-a45aeeacfded tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (412208f6-13d7-4b98-ab4a-386addfe3c97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:22 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-bdd4deba-a993-495e-a2f5-a45aeeacfded tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Volume 038fc5c6-d3d1-4d4b-af84-e95b3cc0df78: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-038fc5c6-d3d1-4d4b-af84-e95b3cc0df78', 'volume_size': 1} Sep 29 18:37:22 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-bdd4deba-a993-495e-a2f5-a45aeeacfded tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:37:23 devstack sudo[106751]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:23 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-5e6996a5-d3e7-44f4-9e94-4e35b8d96ddb tempest-CreateVolumesFromSnapshotTest-1588006594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0fbf0c3c-8379-44e0-9816-f48d5c7cf687,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0fbf0c3c-8379-44e0-9816-f48d5c7cf687.b21cb005-34c2-4869-b19a-f0bb3b403789 1G" returned: 0 in 0.511s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:23 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-5e6996a5-d3e7-44f4-9e94-4e35b8d96ddb tempest-CreateVolumesFromSnapshotTest-1588006594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0fbf0c3c-8379-44e0-9816-f48d5c7cf687 -F qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0fbf0c3c-8379-44e0-9816-f48d5c7cf687.b21cb005-34c2-4869-b19a-f0bb3b403789 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:23 devstack sudo[106758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0fbf0c3c-8379-44e0-9816-f48d5c7cf687 -F qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0fbf0c3c-8379-44e0-9816-f48d5c7cf687.b21cb005-34c2-4869-b19a-f0bb3b403789 Sep 29 18:37:23 devstack sudo[106758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:23 devstack sudo[106758]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:23 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-5e6996a5-d3e7-44f4-9e94-4e35b8d96ddb tempest-CreateVolumesFromSnapshotTest-1588006594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0fbf0c3c-8379-44e0-9816-f48d5c7cf687 -F qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0fbf0c3c-8379-44e0-9816-f48d5c7cf687.b21cb005-34c2-4869-b19a-f0bb3b403789" returned: 0 in 0.338s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:23 devstack cinder-volume[86512]: WARNING cinder.volume.drivers.remotefs [None req-5e6996a5-d3e7-44f4-9e94-4e35b8d96ddb tempest-CreateVolumesFromSnapshotTest-1588006594 None] /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0fbf0c3c-8379-44e0-9816-f48d5c7cf687.b21cb005-34c2-4869-b19a-f0bb3b403789 is being set with open permissions: ugo+rw Sep 29 18:37:23 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-5e6996a5-d3e7-44f4-9e94-4e35b8d96ddb tempest-CreateVolumesFromSnapshotTest-1588006594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0fbf0c3c-8379-44e0-9816-f48d5c7cf687.b21cb005-34c2-4869-b19a-f0bb3b403789 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:23 devstack sudo[106763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0fbf0c3c-8379-44e0-9816-f48d5c7cf687.b21cb005-34c2-4869-b19a-f0bb3b403789 Sep 29 18:37:23 devstack sudo[106763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:23 devstack sudo[106763]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:23 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-5e6996a5-d3e7-44f4-9e94-4e35b8d96ddb tempest-CreateVolumesFromSnapshotTest-1588006594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0fbf0c3c-8379-44e0-9816-f48d5c7cf687.b21cb005-34c2-4869-b19a-f0bb3b403789" returned: 0 in 0.258s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:23 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-5e6996a5-d3e7-44f4-9e94-4e35b8d96ddb tempest-CreateVolumesFromSnapshotTest-1588006594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0fbf0c3c-8379-44e0-9816-f48d5c7cf687.info {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:23 devstack sudo[106766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0fbf0c3c-8379-44e0-9816-f48d5c7cf687.info Sep 29 18:37:23 devstack sudo[106766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:24 devstack sudo[106766]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:24 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-5e6996a5-d3e7-44f4-9e94-4e35b8d96ddb tempest-CreateVolumesFromSnapshotTest-1588006594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0fbf0c3c-8379-44e0-9816-f48d5c7cf687.info" returned: 0 in 0.334s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:24 devstack cinder-volume[86512]: WARNING cinder.volume.drivers.remotefs [None req-5e6996a5-d3e7-44f4-9e94-4e35b8d96ddb tempest-CreateVolumesFromSnapshotTest-1588006594 None] /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0fbf0c3c-8379-44e0-9816-f48d5c7cf687.info is being set with open permissions: ugo+rw Sep 29 18:37:24 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-5e6996a5-d3e7-44f4-9e94-4e35b8d96ddb tempest-CreateVolumesFromSnapshotTest-1588006594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0fbf0c3c-8379-44e0-9816-f48d5c7cf687.info {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:24 devstack sudo[106771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0fbf0c3c-8379-44e0-9816-f48d5c7cf687.info Sep 29 18:37:24 devstack sudo[106771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:24 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-898e2e9a-0e89-4960-90e7-4daf11c2555e tempest-VolumeAndVolumeTypeFromImageTest-1927733850 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86512) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:37:24 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-898e2e9a-0e89-4960-90e7-4daf11c2555e tempest-VolumeAndVolumeTypeFromImageTest-1927733850 None] Flow 'volume_create_manager' (24993e4f-bb12-4f4c-ae12-22a8d96e6188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:37:24 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-898e2e9a-0e89-4960-90e7-4daf11c2555e tempest-VolumeAndVolumeTypeFromImageTest-1927733850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa1c9504-ad15-46eb-aecc-822e401fd98d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:24 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-898e2e9a-0e89-4960-90e7-4daf11c2555e tempest-VolumeAndVolumeTypeFromImageTest-1927733850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa1c9504-ad15-46eb-aecc-822e401fd98d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:37:24Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5acd6fb6-f59c-4dd9-aa49-a170de7b3970,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='508004355c9c45f5bffa69d8b9fe2d8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:37:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:37:24Z,use_quota=True,user_id='a4a1794b823a44a2bd1e424454ed69ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(96391a6b-3b39-43e2-841b-840358049291),volume_type_id=96391a6b-3b39-43e2-841b-840358049291)' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:24 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-898e2e9a-0e89-4960-90e7-4daf11c2555e tempest-VolumeAndVolumeTypeFromImageTest-1927733850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25d17f28-2f58-442f-a968-b9d582e291b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:24 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-898e2e9a-0e89-4960-90e7-4daf11c2555e tempest-VolumeAndVolumeTypeFromImageTest-1927733850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25d17f28-2f58-442f-a968-b9d582e291b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:24 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-898e2e9a-0e89-4960-90e7-4daf11c2555e tempest-VolumeAndVolumeTypeFromImageTest-1927733850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f45c45d2-6603-49cd-a166-9c50f6546403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:24 devstack cinder-volume[86512]: DEBUG cinder.image.glance [None req-898e2e9a-0e89-4960-90e7-4daf11c2555e tempest-VolumeAndVolumeTypeFromImageTest-1927733850 None] Creating Keystone auth plugin from conf {{(pid=86512) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 29 18:37:24 devstack sudo[106771]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:24 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-5e6996a5-d3e7-44f4-9e94-4e35b8d96ddb tempest-CreateVolumesFromSnapshotTest-1588006594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0fbf0c3c-8379-44e0-9816-f48d5c7cf687.info" returned: 0 in 0.266s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:24 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-5e6996a5-d3e7-44f4-9e94-4e35b8d96ddb tempest-CreateVolumesFromSnapshotTest-1588006594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.506s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:37:24 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-370f2953-7ed2-4cad-bcba-90f8a2597c1a tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.847s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:37:24 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-370f2953-7ed2-4cad-bcba-90f8a2597c1a tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:37:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-506766549',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b07b67ac-5b99-4ac3-950a-f61c2340a4ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e34c2ecc959493fb6230e8b48478708',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:37:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:37:21Z,use_quota=True,user_id='fa38720781b245e09fe5ed4e422ea52a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)}" {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:37:24 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-370f2953-7ed2-4cad-bcba-90f8a2597c1a tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Creating volume b07b67ac-5b99-4ac3-950a-f61c2340a4ee {{(pid=86512) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:37:24 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-370f2953-7ed2-4cad-bcba-90f8a2597c1a tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:37:24 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-370f2953-7ed2-4cad-bcba-90f8a2597c1a tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:37:24 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-370f2953-7ed2-4cad-bcba-90f8a2597c1a tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:37:24 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-370f2953-7ed2-4cad-bcba-90f8a2597c1a tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:37:24 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-370f2953-7ed2-4cad-bcba-90f8a2597c1a tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:37:24 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-370f2953-7ed2-4cad-bcba-90f8a2597c1a tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Selected osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 as target Quobyte volume. {{(pid=86512) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:37:24 devstack cinder-volume[86512]: INFO cinder.volume.drivers.remotefs [None req-370f2953-7ed2-4cad-bcba-90f8a2597c1a tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] casted to osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 Sep 29 18:37:24 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-370f2953-7ed2-4cad-bcba-90f8a2597c1a tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-b07b67ac-5b99-4ac3-950a-f61c2340a4ee 1073741824 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:24 devstack sudo[106775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-b07b67ac-5b99-4ac3-950a-f61c2340a4ee 1073741824 Sep 29 18:37:24 devstack sudo[106775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:24 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-5e6996a5-d3e7-44f4-9e94-4e35b8d96ddb tempest-CreateVolumesFromSnapshotTest-1588006594 None] Create snapshot completed successfully Sep 29 18:37:24 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-898e2e9a-0e89-4960-90e7-4daf11c2555e tempest-VolumeAndVolumeTypeFromImageTest-1927733850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f45c45d2-6603-49cd-a166-9c50f6546403) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5acd6fb6-f59c-4dd9-aa49-a170de7b3970', 'volume_name': 'volume-5acd6fb6-f59c-4dd9-aa49-a170de7b3970', 'volume_size': 1, 'image_id': 'ab56a330-db9e-42db-a4b5-fccdd9e03fe5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ab56a330-db9e-42db-a4b5-fccdd9e03fe5', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '71d4ca50e37ee455bc27e805a9f079ba', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '508004355c9c45f5bffa69d8b9fe2d8f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2d4b0f59931c805e475415f3d50ec09b97f3695a8d37ddc7ceafcee7fdbee0e484f35b8a5f10203bbab9bde9a2f97f3ee41331b2dcf86b07448f1dd5b79fcbe4', 'id': 'ab56a330-db9e-42db-a4b5-fccdd9e03fe5', 'created_at': datetime.datetime(2026, 9, 29, 16, 37, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 16, 37, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ab56a330-db9e-42db-a4b5-fccdd9e03fe5/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:24 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-898e2e9a-0e89-4960-90e7-4daf11c2555e tempest-VolumeAndVolumeTypeFromImageTest-1927733850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5a42057-aaea-48ba-ad6b-81895cd81a71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:24 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-898e2e9a-0e89-4960-90e7-4daf11c2555e tempest-VolumeAndVolumeTypeFromImageTest-1927733850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5a42057-aaea-48ba-ad6b-81895cd81a71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:24 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-898e2e9a-0e89-4960-90e7-4daf11c2555e tempest-VolumeAndVolumeTypeFromImageTest-1927733850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f752957-518b-424a-8baa-ff9ac3781a8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:24 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-898e2e9a-0e89-4960-90e7-4daf11c2555e tempest-VolumeAndVolumeTypeFromImageTest-1927733850 None] Volume 5acd6fb6-f59c-4dd9-aa49-a170de7b3970: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5acd6fb6-f59c-4dd9-aa49-a170de7b3970', 'volume_size': 1, 'image_id': 'ab56a330-db9e-42db-a4b5-fccdd9e03fe5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ab56a330-db9e-42db-a4b5-fccdd9e03fe5', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '71d4ca50e37ee455bc27e805a9f079ba', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '508004355c9c45f5bffa69d8b9fe2d8f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2d4b0f59931c805e475415f3d50ec09b97f3695a8d37ddc7ceafcee7fdbee0e484f35b8a5f10203bbab9bde9a2f97f3ee41331b2dcf86b07448f1dd5b79fcbe4', 'id': 'ab56a330-db9e-42db-a4b5-fccdd9e03fe5', 'created_at': datetime.datetime(2026, 9, 29, 16, 37, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 16, 37, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ab56a330-db9e-42db-a4b5-fccdd9e03fe5/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 29 18:37:24 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-898e2e9a-0e89-4960-90e7-4daf11c2555e tempest-VolumeAndVolumeTypeFromImageTest-1927733850 None] Trying to clone 5acd6fb6-f59c-4dd9-aa49-a170de7b3970 from image ab56a330-db9e-42db-a4b5-fccdd9e03fe5 at location (None, [{'url': 'file:///opt/stack/data/glance/images/ab56a330-db9e-42db-a4b5-fccdd9e03fe5', 'metadata': {}}]). {{(pid=86512) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 29 18:37:24 devstack cinder-volume[86512]: DEBUG cinder.image.image_utils [None req-898e2e9a-0e89-4960-90e7-4daf11c2555e tempest-VolumeAndVolumeTypeFromImageTest-1927733850 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ab56a330-db9e-42db-a4b5-fccdd9e03fe5_yah3c40ydevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86512) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 29 18:37:24 devstack cinder-volume[86512]: INFO cinder.image.image_utils [None req-898e2e9a-0e89-4960-90e7-4daf11c2555e tempest-VolumeAndVolumeTypeFromImageTest-1927733850 None] Image download 0.00 MB at 0.00 MB/s Sep 29 18:37:24 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d3347a1-33e2-41e3-b520-3e013c8ef35e]: (4, 'raw') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:37:24 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-898e2e9a-0e89-4960-90e7-4daf11c2555e tempest-VolumeAndVolumeTypeFromImageTest-1927733850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ab56a330-db9e-42db-a4b5-fccdd9e03fe5_yah3c40ydevstack@QuobyteHD {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:24 devstack sudo[106775]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:24 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-370f2953-7ed2-4cad-bcba-90f8a2597c1a tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-b07b67ac-5b99-4ac3-950a-f61c2340a4ee 1073741824" returned: 0 in 0.480s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:24 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-370f2953-7ed2-4cad-bcba-90f8a2597c1a tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-b07b67ac-5b99-4ac3-950a-f61c2340a4ee {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:24 devstack sudo[106782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-b07b67ac-5b99-4ac3-950a-f61c2340a4ee Sep 29 18:37:24 devstack sudo[106782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:24 devstack sudo[106781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ab56a330-db9e-42db-a4b5-fccdd9e03fe5_yah3c40ydevstack@QuobyteHD Sep 29 18:37:24 devstack sudo[106781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:25 devstack sudo[106782]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:25 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-370f2953-7ed2-4cad-bcba-90f8a2597c1a tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-b07b67ac-5b99-4ac3-950a-f61c2340a4ee" returned: 0 in 0.268s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:25 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-370f2953-7ed2-4cad-bcba-90f8a2597c1a tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] <== create_volume: return (803ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'} {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:37:25 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-370f2953-7ed2-4cad-bcba-90f8a2597c1a tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.806s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:37:25 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-0a18b8de-7564-462c-9aff-67f8f14c47f5 tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.022s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:37:25 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-0a18b8de-7564-462c-9aff-67f8f14c47f5 tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:37:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-245488859',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2aeb54f4-d077-456d-a7e5-99149ba171d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e34c2ecc959493fb6230e8b48478708',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:37:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:37:22Z,use_quota=True,user_id='fa38720781b245e09fe5ed4e422ea52a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)}" {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:37:25 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-0a18b8de-7564-462c-9aff-67f8f14c47f5 tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Creating volume 2aeb54f4-d077-456d-a7e5-99149ba171d0 {{(pid=86512) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:37:25 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-0a18b8de-7564-462c-9aff-67f8f14c47f5 tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:37:25 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-0a18b8de-7564-462c-9aff-67f8f14c47f5 tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:37:25 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-0a18b8de-7564-462c-9aff-67f8f14c47f5 tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:37:25 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-0a18b8de-7564-462c-9aff-67f8f14c47f5 tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:37:25 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-0a18b8de-7564-462c-9aff-67f8f14c47f5 tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:37:25 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-0a18b8de-7564-462c-9aff-67f8f14c47f5 tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Selected osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 as target Quobyte volume. {{(pid=86512) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:37:25 devstack cinder-volume[86512]: INFO cinder.volume.drivers.remotefs [None req-0a18b8de-7564-462c-9aff-67f8f14c47f5 tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] casted to osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 Sep 29 18:37:25 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-0a18b8de-7564-462c-9aff-67f8f14c47f5 tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-2aeb54f4-d077-456d-a7e5-99149ba171d0 1073741824 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:25 devstack sudo[106781]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:25 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-898e2e9a-0e89-4960-90e7-4daf11c2555e tempest-VolumeAndVolumeTypeFromImageTest-1927733850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ab56a330-db9e-42db-a4b5-fccdd9e03fe5_yah3c40ydevstack@QuobyteHD" returned: 0 in 0.398s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:25 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-898e2e9a-0e89-4960-90e7-4daf11c2555e tempest-VolumeAndVolumeTypeFromImageTest-1927733850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ab56a330-db9e-42db-a4b5-fccdd9e03fe5_yah3c40ydevstack@QuobyteHD {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:25 devstack sudo[106788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-2aeb54f4-d077-456d-a7e5-99149ba171d0 1073741824 Sep 29 18:37:25 devstack sudo[106788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:25 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-370f2953-7ed2-4cad-bcba-90f8a2597c1a tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93500f39-83b5-4ff5-b5d1-b0d6cfa7cbd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b07b67ac-5b99-4ac3-950a-f61c2340a4ee', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:25 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-370f2953-7ed2-4cad-bcba-90f8a2597c1a tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1123769-5abd-42dc-84b7-5605afb319e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:25 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-370f2953-7ed2-4cad-bcba-90f8a2597c1a tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Volume volume-b07b67ac-5b99-4ac3-950a-f61c2340a4ee (b07b67ac-5b99-4ac3-950a-f61c2340a4ee): created successfully Sep 29 18:37:25 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-370f2953-7ed2-4cad-bcba-90f8a2597c1a tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1123769-5abd-42dc-84b7-5605afb319e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:25 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-370f2953-7ed2-4cad-bcba-90f8a2597c1a tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Flow 'volume_create_manager' (ea91a417-f4da-4a93-a0fe-6e040e68cf90) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:37:25 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-370f2953-7ed2-4cad-bcba-90f8a2597c1a tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Created volume successfully. Sep 29 18:37:25 devstack sudo[106789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ab56a330-db9e-42db-a4b5-fccdd9e03fe5_yah3c40ydevstack@QuobyteHD Sep 29 18:37:25 devstack sudo[106789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:25 devstack sudo[106789]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:25 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-898e2e9a-0e89-4960-90e7-4daf11c2555e tempest-VolumeAndVolumeTypeFromImageTest-1927733850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ab56a330-db9e-42db-a4b5-fccdd9e03fe5_yah3c40ydevstack@QuobyteHD" returned: 1 in 0.460s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:25 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-898e2e9a-0e89-4960-90e7-4daf11c2555e tempest-VolumeAndVolumeTypeFromImageTest-1927733850 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ab56a330-db9e-42db-a4b5-fccdd9e03fe5_yah3c40ydevstack@QuobyteHD' failed. Not Retrying. {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 29 18:37:25 devstack cinder-volume[86512]: DEBUG cinder.image.image_utils [None req-898e2e9a-0e89-4960-90e7-4daf11c2555e tempest-VolumeAndVolumeTypeFromImageTest-1927733850 None] Temporary image ab56a330-db9e-42db-a4b5-fccdd9e03fe5 is fetched for user a4a1794b823a44a2bd1e424454ed69ba. {{(pid=86512) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 29 18:37:25 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[df74cd0b-f5ed-42b6-9170-9d66843f6505]: (4, 'raw') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:37:25 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-898e2e9a-0e89-4960-90e7-4daf11c2555e tempest-VolumeAndVolumeTypeFromImageTest-1927733850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ab56a330-db9e-42db-a4b5-fccdd9e03fe5_yah3c40ydevstack@QuobyteHD {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:25 devstack sudo[106788]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:25 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-0a18b8de-7564-462c-9aff-67f8f14c47f5 tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-2aeb54f4-d077-456d-a7e5-99149ba171d0 1073741824" returned: 0 in 0.621s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:25 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-0a18b8de-7564-462c-9aff-67f8f14c47f5 tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-2aeb54f4-d077-456d-a7e5-99149ba171d0 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:25 devstack sudo[106799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ab56a330-db9e-42db-a4b5-fccdd9e03fe5_yah3c40ydevstack@QuobyteHD Sep 29 18:37:25 devstack sudo[106799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:25 devstack sudo[106800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-2aeb54f4-d077-456d-a7e5-99149ba171d0 Sep 29 18:37:25 devstack sudo[106800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:26 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-3646ba4f-83ed-4ccf-9c8f-b612d0f6b3f2 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86512) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:37:26 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-3646ba4f-83ed-4ccf-9c8f-b612d0f6b3f2 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Flow 'volume_create_manager' (e607b83f-f333-49ca-82f0-325409c9e96d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:37:26 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-3646ba4f-83ed-4ccf-9c8f-b612d0f6b3f2 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8b453a4-9875-4946-9e2a-02c333fa50e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:26 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-3646ba4f-83ed-4ccf-9c8f-b612d0f6b3f2 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8b453a4-9875-4946-9e2a-02c333fa50e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:37:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-333786199',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=628cbb4f-042a-4560-b95c-cabfe4bcb37c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46b8fc61c3654cbfa4d958fec5e084cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:37:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:37:26Z,use_quota=True,user_id='9f90a47c64fc4e0abf96242604fa9a82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:26 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-3646ba4f-83ed-4ccf-9c8f-b612d0f6b3f2 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0552afbc-d461-4a14-a87f-f3ae6127d1be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:26 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-3646ba4f-83ed-4ccf-9c8f-b612d0f6b3f2 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0552afbc-d461-4a14-a87f-f3ae6127d1be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:26 devstack sudo[106799]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:26 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-3646ba4f-83ed-4ccf-9c8f-b612d0f6b3f2 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90f45600-bc22-411a-bd08-5c629aa8dcdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:26 devstack sudo[106800]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:26 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-3646ba4f-83ed-4ccf-9c8f-b612d0f6b3f2 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90f45600-bc22-411a-bd08-5c629aa8dcdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '628cbb4f-042a-4560-b95c-cabfe4bcb37c', 'volume_name': 'volume-628cbb4f-042a-4560-b95c-cabfe4bcb37c', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:26 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-3646ba4f-83ed-4ccf-9c8f-b612d0f6b3f2 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8525a78e-562e-4bd1-9cfd-e67819e49165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:26 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-3646ba4f-83ed-4ccf-9c8f-b612d0f6b3f2 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8525a78e-562e-4bd1-9cfd-e67819e49165) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:26 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-3646ba4f-83ed-4ccf-9c8f-b612d0f6b3f2 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42e9f7db-67ad-4e18-a502-1433596f7a9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:26 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-3646ba4f-83ed-4ccf-9c8f-b612d0f6b3f2 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Volume 628cbb4f-042a-4560-b95c-cabfe4bcb37c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-628cbb4f-042a-4560-b95c-cabfe4bcb37c', 'volume_size': 1} Sep 29 18:37:26 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-3646ba4f-83ed-4ccf-9c8f-b612d0f6b3f2 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:37:26 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-0a18b8de-7564-462c-9aff-67f8f14c47f5 tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-2aeb54f4-d077-456d-a7e5-99149ba171d0" returned: 0 in 0.453s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:26 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-898e2e9a-0e89-4960-90e7-4daf11c2555e tempest-VolumeAndVolumeTypeFromImageTest-1927733850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ab56a330-db9e-42db-a4b5-fccdd9e03fe5_yah3c40ydevstack@QuobyteHD" returned: 0 in 0.561s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:26 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-0a18b8de-7564-462c-9aff-67f8f14c47f5 tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] <== create_volume: return (1159ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'} {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:37:26 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-0a18b8de-7564-462c-9aff-67f8f14c47f5 tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.161s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:37:26 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-898e2e9a-0e89-4960-90e7-4daf11c2555e tempest-VolumeAndVolumeTypeFromImageTest-1927733850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ab56a330-db9e-42db-a4b5-fccdd9e03fe5_yah3c40ydevstack@QuobyteHD {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:26 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-0c504746-c9f2-4994-a739-25b6c1eeb911 tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.817s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:37:26 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-0c504746-c9f2-4994-a739-25b6c1eeb911 tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:37:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-612993860',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=173e089e-1640-4f6b-80c8-21932a9cdb68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e34c2ecc959493fb6230e8b48478708',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:37:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:37:22Z,use_quota=True,user_id='fa38720781b245e09fe5ed4e422ea52a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)}" {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:37:26 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-0c504746-c9f2-4994-a739-25b6c1eeb911 tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Creating volume 173e089e-1640-4f6b-80c8-21932a9cdb68 {{(pid=86512) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:37:26 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-0c504746-c9f2-4994-a739-25b6c1eeb911 tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:37:26 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-0c504746-c9f2-4994-a739-25b6c1eeb911 tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:37:26 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-0c504746-c9f2-4994-a739-25b6c1eeb911 tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:37:26 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-0c504746-c9f2-4994-a739-25b6c1eeb911 tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:37:26 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-0c504746-c9f2-4994-a739-25b6c1eeb911 tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:37:26 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-0c504746-c9f2-4994-a739-25b6c1eeb911 tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Selected osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 as target Quobyte volume. {{(pid=86512) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:37:26 devstack cinder-volume[86512]: INFO cinder.volume.drivers.remotefs [None req-0c504746-c9f2-4994-a739-25b6c1eeb911 tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] casted to osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 Sep 29 18:37:26 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-0c504746-c9f2-4994-a739-25b6c1eeb911 tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-173e089e-1640-4f6b-80c8-21932a9cdb68 1073741824 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:26 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-0a18b8de-7564-462c-9aff-67f8f14c47f5 tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc2f9ad6-a490-4531-9c66-6c4438db028f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2aeb54f4-d077-456d-a7e5-99149ba171d0', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:26 devstack sudo[106807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-173e089e-1640-4f6b-80c8-21932a9cdb68 1073741824 Sep 29 18:37:26 devstack sudo[106807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:26 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-0a18b8de-7564-462c-9aff-67f8f14c47f5 tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94728980-fe72-45a6-b3ab-9addae9481c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:26 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-0a18b8de-7564-462c-9aff-67f8f14c47f5 tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Volume volume-2aeb54f4-d077-456d-a7e5-99149ba171d0 (2aeb54f4-d077-456d-a7e5-99149ba171d0): created successfully Sep 29 18:37:26 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-0a18b8de-7564-462c-9aff-67f8f14c47f5 tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94728980-fe72-45a6-b3ab-9addae9481c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:26 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-0a18b8de-7564-462c-9aff-67f8f14c47f5 tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Flow 'volume_create_manager' (2a19ce3e-b919-4ea1-97ee-505aee95c95a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:37:26 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-0a18b8de-7564-462c-9aff-67f8f14c47f5 tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Created volume successfully. Sep 29 18:37:26 devstack sudo[106806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ab56a330-db9e-42db-a4b5-fccdd9e03fe5_yah3c40ydevstack@QuobyteHD Sep 29 18:37:26 devstack sudo[106806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:26 devstack sudo[106806]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:26 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-898e2e9a-0e89-4960-90e7-4daf11c2555e tempest-VolumeAndVolumeTypeFromImageTest-1927733850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ab56a330-db9e-42db-a4b5-fccdd9e03fe5_yah3c40ydevstack@QuobyteHD" returned: 1 in 0.518s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:26 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-898e2e9a-0e89-4960-90e7-4daf11c2555e tempest-VolumeAndVolumeTypeFromImageTest-1927733850 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ab56a330-db9e-42db-a4b5-fccdd9e03fe5_yah3c40ydevstack@QuobyteHD' failed. Not Retrying. {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 29 18:37:26 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-898e2e9a-0e89-4960-90e7-4daf11c2555e tempest-VolumeAndVolumeTypeFromImageTest-1927733850 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:37:26 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-06655e8b-d0f1-47df-93c2-015f4fe8e663 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86512) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:37:26 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-06655e8b-d0f1-47df-93c2-015f4fe8e663 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Flow 'volume_create_manager' (32057879-fff9-42e2-a2b0-30a97272be9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:37:26 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-06655e8b-d0f1-47df-93c2-015f4fe8e663 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c4c5971-c0b8-46b3-add9-f010dc13f428) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:26 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-06655e8b-d0f1-47df-93c2-015f4fe8e663 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c4c5971-c0b8-46b3-add9-f010dc13f428) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:37:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-462341766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=107e339e-b09b-4db3-ac1f-735aae8a80a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46b8fc61c3654cbfa4d958fec5e084cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:37:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:37:27Z,use_quota=True,user_id='9f90a47c64fc4e0abf96242604fa9a82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:26 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-06655e8b-d0f1-47df-93c2-015f4fe8e663 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a78e391f-08c4-4ad3-9f71-ffc2e2163214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:26 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-06655e8b-d0f1-47df-93c2-015f4fe8e663 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a78e391f-08c4-4ad3-9f71-ffc2e2163214) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:26 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-06655e8b-d0f1-47df-93c2-015f4fe8e663 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bd1a968-b645-4936-8158-60597e07f59b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:26 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-06655e8b-d0f1-47df-93c2-015f4fe8e663 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bd1a968-b645-4936-8158-60597e07f59b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '107e339e-b09b-4db3-ac1f-735aae8a80a4', 'volume_name': 'volume-107e339e-b09b-4db3-ac1f-735aae8a80a4', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:26 devstack sudo[106807]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:26 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-06655e8b-d0f1-47df-93c2-015f4fe8e663 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acf677a2-11c7-4f94-a981-e810fd6366ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:26 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-06655e8b-d0f1-47df-93c2-015f4fe8e663 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acf677a2-11c7-4f94-a981-e810fd6366ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:26 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-06655e8b-d0f1-47df-93c2-015f4fe8e663 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f08c37ce-626a-4c4a-baf7-0e5cd3fa64de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:26 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-06655e8b-d0f1-47df-93c2-015f4fe8e663 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Volume 107e339e-b09b-4db3-ac1f-735aae8a80a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-107e339e-b09b-4db3-ac1f-735aae8a80a4', 'volume_size': 1} Sep 29 18:37:26 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-06655e8b-d0f1-47df-93c2-015f4fe8e663 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:37:26 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-0c504746-c9f2-4994-a739-25b6c1eeb911 tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-173e089e-1640-4f6b-80c8-21932a9cdb68 1073741824" returned: 0 in 0.605s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:26 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-0c504746-c9f2-4994-a739-25b6c1eeb911 tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-173e089e-1640-4f6b-80c8-21932a9cdb68 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:26 devstack sudo[106816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-173e089e-1640-4f6b-80c8-21932a9cdb68 Sep 29 18:37:26 devstack sudo[106816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:27 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfb18590-9c69-47a1-87da-eac55c230646 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86512) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:37:27 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-cfb18590-9c69-47a1-87da-eac55c230646 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Flow 'volume_create_manager' (19fd8437-3ada-4106-9ed4-a6a9345363cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:37:27 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-cfb18590-9c69-47a1-87da-eac55c230646 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (556a888a-08db-4cbe-92dd-ac89ff9ec123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:27 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-cfb18590-9c69-47a1-87da-eac55c230646 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (556a888a-08db-4cbe-92dd-ac89ff9ec123) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:37:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1894165317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb6b937d-f605-42c6-8f1e-367b36ed8742,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46b8fc61c3654cbfa4d958fec5e084cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:37:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:37:27Z,use_quota=True,user_id='9f90a47c64fc4e0abf96242604fa9a82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:27 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-cfb18590-9c69-47a1-87da-eac55c230646 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e3aa444-5256-43ee-a372-616ddcb63be6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:27 devstack sudo[106816]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:27 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-cfb18590-9c69-47a1-87da-eac55c230646 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e3aa444-5256-43ee-a372-616ddcb63be6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:27 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-cfb18590-9c69-47a1-87da-eac55c230646 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1283fd0e-b4db-4844-8056-c3c3b9d89600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:27 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-cfb18590-9c69-47a1-87da-eac55c230646 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1283fd0e-b4db-4844-8056-c3c3b9d89600) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb6b937d-f605-42c6-8f1e-367b36ed8742', 'volume_name': 'volume-eb6b937d-f605-42c6-8f1e-367b36ed8742', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:27 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-cfb18590-9c69-47a1-87da-eac55c230646 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33fa693a-a0d0-4f5a-b12b-8e0d40f71bce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:27 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-cfb18590-9c69-47a1-87da-eac55c230646 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33fa693a-a0d0-4f5a-b12b-8e0d40f71bce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:27 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-cfb18590-9c69-47a1-87da-eac55c230646 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc2f80b6-d480-41d3-bb1b-381d3729be4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:27 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-cfb18590-9c69-47a1-87da-eac55c230646 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Volume eb6b937d-f605-42c6-8f1e-367b36ed8742: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb6b937d-f605-42c6-8f1e-367b36ed8742', 'volume_size': 1} Sep 29 18:37:27 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-cfb18590-9c69-47a1-87da-eac55c230646 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:37:27 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-0c504746-c9f2-4994-a739-25b6c1eeb911 tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-173e089e-1640-4f6b-80c8-21932a9cdb68" returned: 0 in 0.297s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:27 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-0c504746-c9f2-4994-a739-25b6c1eeb911 tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] <== create_volume: return (951ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'} {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:37:27 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-0c504746-c9f2-4994-a739-25b6c1eeb911 tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.957s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:37:27 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-bdd4deba-a993-495e-a2f5-a45aeeacfded tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.307s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:37:27 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-bdd4deba-a993-495e-a2f5-a45aeeacfded tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:37:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-285129074',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=038fc5c6-d3d1-4d4b-af84-e95b3cc0df78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e34c2ecc959493fb6230e8b48478708',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:37:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:37:23Z,use_quota=True,user_id='fa38720781b245e09fe5ed4e422ea52a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)}" {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:37:27 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-bdd4deba-a993-495e-a2f5-a45aeeacfded tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Creating volume 038fc5c6-d3d1-4d4b-af84-e95b3cc0df78 {{(pid=86512) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:37:27 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-bdd4deba-a993-495e-a2f5-a45aeeacfded tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:37:27 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-bdd4deba-a993-495e-a2f5-a45aeeacfded tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:37:27 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-bdd4deba-a993-495e-a2f5-a45aeeacfded tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:37:27 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-bdd4deba-a993-495e-a2f5-a45aeeacfded tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:37:27 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-bdd4deba-a993-495e-a2f5-a45aeeacfded tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:37:27 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-bdd4deba-a993-495e-a2f5-a45aeeacfded tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Selected osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 as target Quobyte volume. {{(pid=86512) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:37:27 devstack cinder-volume[86512]: INFO cinder.volume.drivers.remotefs [None req-bdd4deba-a993-495e-a2f5-a45aeeacfded tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] casted to osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 Sep 29 18:37:27 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-bdd4deba-a993-495e-a2f5-a45aeeacfded tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-038fc5c6-d3d1-4d4b-af84-e95b3cc0df78 1073741824 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:27 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-0c504746-c9f2-4994-a739-25b6c1eeb911 tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d82834e2-c7e6-4768-946c-8496742ace10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-173e089e-1640-4f6b-80c8-21932a9cdb68', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:27 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-0c504746-c9f2-4994-a739-25b6c1eeb911 tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c217cf8-4fe1-4313-927b-df966d2c65e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:27 devstack sudo[106819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-038fc5c6-d3d1-4d4b-af84-e95b3cc0df78 1073741824 Sep 29 18:37:27 devstack sudo[106819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:27 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-0c504746-c9f2-4994-a739-25b6c1eeb911 tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Volume volume-173e089e-1640-4f6b-80c8-21932a9cdb68 (173e089e-1640-4f6b-80c8-21932a9cdb68): created successfully Sep 29 18:37:27 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-0c504746-c9f2-4994-a739-25b6c1eeb911 tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c217cf8-4fe1-4313-927b-df966d2c65e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:27 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-0c504746-c9f2-4994-a739-25b6c1eeb911 tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Flow 'volume_create_manager' (28612769-df27-428c-8d95-a5ef74264268) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:37:27 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-0c504746-c9f2-4994-a739-25b6c1eeb911 tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Created volume successfully. Sep 29 18:37:27 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-be8ffef3-187e-4e90-91cb-754a921bb371 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86512) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:37:27 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-be8ffef3-187e-4e90-91cb-754a921bb371 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Flow 'volume_create_manager' (c4cd0d93-4495-4c11-a8e3-fc84e6917405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:37:27 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-be8ffef3-187e-4e90-91cb-754a921bb371 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92260079-35a8-4981-b54c-f08c44032f31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:27 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-be8ffef3-187e-4e90-91cb-754a921bb371 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92260079-35a8-4981-b54c-f08c44032f31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:37:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-183492892',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ddc82d91-cf82-4d51-a599-1daccca95c55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46b8fc61c3654cbfa4d958fec5e084cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:37:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:37:27Z,use_quota=True,user_id='9f90a47c64fc4e0abf96242604fa9a82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:27 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-be8ffef3-187e-4e90-91cb-754a921bb371 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3f81e9e-b379-491a-a012-d46b3aff0378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:27 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-be8ffef3-187e-4e90-91cb-754a921bb371 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3f81e9e-b379-491a-a012-d46b3aff0378) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:27 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-be8ffef3-187e-4e90-91cb-754a921bb371 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2270518c-3306-408a-b316-1de623805973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:27 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-be8ffef3-187e-4e90-91cb-754a921bb371 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2270518c-3306-408a-b316-1de623805973) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ddc82d91-cf82-4d51-a599-1daccca95c55', 'volume_name': 'volume-ddc82d91-cf82-4d51-a599-1daccca95c55', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:27 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-be8ffef3-187e-4e90-91cb-754a921bb371 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71b90e59-724a-4684-8a88-26ab1f23cd9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:27 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-be8ffef3-187e-4e90-91cb-754a921bb371 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71b90e59-724a-4684-8a88-26ab1f23cd9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:27 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-be8ffef3-187e-4e90-91cb-754a921bb371 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b80fa68e-74eb-4919-9b8e-853733a1e92a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:27 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-be8ffef3-187e-4e90-91cb-754a921bb371 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Volume ddc82d91-cf82-4d51-a599-1daccca95c55: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ddc82d91-cf82-4d51-a599-1daccca95c55', 'volume_size': 1} Sep 29 18:37:27 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-be8ffef3-187e-4e90-91cb-754a921bb371 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:37:27 devstack sudo[106819]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:27 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-bdd4deba-a993-495e-a2f5-a45aeeacfded tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-038fc5c6-d3d1-4d4b-af84-e95b3cc0df78 1073741824" returned: 0 in 0.542s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:27 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-bdd4deba-a993-495e-a2f5-a45aeeacfded tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-038fc5c6-d3d1-4d4b-af84-e95b3cc0df78 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:27 devstack sudo[106825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-038fc5c6-d3d1-4d4b-af84-e95b3cc0df78 Sep 29 18:37:27 devstack sudo[106825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:27 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f4076e8-da40-41fb-b195-e216cae4047c tempest-CreateVolumesFromSnapshotTest-1588006594 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86512) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:37:27 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-4f4076e8-da40-41fb-b195-e216cae4047c tempest-CreateVolumesFromSnapshotTest-1588006594 None] Flow 'volume_create_manager' (ef66ea39-9a62-421a-a817-c2ccde4268be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:37:27 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-4f4076e8-da40-41fb-b195-e216cae4047c tempest-CreateVolumesFromSnapshotTest-1588006594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b057c529-a3a6-4cc8-912c-854dc48b7e55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:28 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-4f4076e8-da40-41fb-b195-e216cae4047c tempest-CreateVolumesFromSnapshotTest-1588006594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b057c529-a3a6-4cc8-912c-854dc48b7e55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:37:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1284643198',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcd300ad-4f6e-477c-ab46-cf4c1e691e4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46b8fc61c3654cbfa4d958fec5e084cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:37:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:37:28Z,use_quota=True,user_id='9f90a47c64fc4e0abf96242604fa9a82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:28 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-4f4076e8-da40-41fb-b195-e216cae4047c tempest-CreateVolumesFromSnapshotTest-1588006594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c2d9a2c-9dce-4cf3-98e5-37929dc357ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:28 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-4f4076e8-da40-41fb-b195-e216cae4047c tempest-CreateVolumesFromSnapshotTest-1588006594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c2d9a2c-9dce-4cf3-98e5-37929dc357ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:28 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-4f4076e8-da40-41fb-b195-e216cae4047c tempest-CreateVolumesFromSnapshotTest-1588006594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8177def1-e43e-44a3-aa46-6c8e2d3374e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:28 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-4f4076e8-da40-41fb-b195-e216cae4047c tempest-CreateVolumesFromSnapshotTest-1588006594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8177def1-e43e-44a3-aa46-6c8e2d3374e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bcd300ad-4f6e-477c-ab46-cf4c1e691e4d', 'volume_name': 'volume-bcd300ad-4f6e-477c-ab46-cf4c1e691e4d', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:28 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-4f4076e8-da40-41fb-b195-e216cae4047c tempest-CreateVolumesFromSnapshotTest-1588006594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38b70f7c-07da-466d-aedf-08a4e4ff6344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:28 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-4f4076e8-da40-41fb-b195-e216cae4047c tempest-CreateVolumesFromSnapshotTest-1588006594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38b70f7c-07da-466d-aedf-08a4e4ff6344) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:28 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-4f4076e8-da40-41fb-b195-e216cae4047c tempest-CreateVolumesFromSnapshotTest-1588006594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44249044-a867-4567-9fae-29f92d3a5e96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:28 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-4f4076e8-da40-41fb-b195-e216cae4047c tempest-CreateVolumesFromSnapshotTest-1588006594 None] Volume bcd300ad-4f6e-477c-ab46-cf4c1e691e4d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bcd300ad-4f6e-477c-ab46-cf4c1e691e4d', 'volume_size': 1} Sep 29 18:37:28 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-4f4076e8-da40-41fb-b195-e216cae4047c tempest-CreateVolumesFromSnapshotTest-1588006594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:37:28 devstack sudo[106825]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:28 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-bdd4deba-a993-495e-a2f5-a45aeeacfded tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-038fc5c6-d3d1-4d4b-af84-e95b3cc0df78" returned: 0 in 0.282s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:28 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-bdd4deba-a993-495e-a2f5-a45aeeacfded tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] <== create_volume: return (888ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'} {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:37:28 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-bdd4deba-a993-495e-a2f5-a45aeeacfded tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.890s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:37:28 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-3646ba4f-83ed-4ccf-9c8f-b612d0f6b3f2 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.878s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:37:28 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-3646ba4f-83ed-4ccf-9c8f-b612d0f6b3f2 tempest-CreateVolumesFromSnapshotTest-1588006594 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:37:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-333786199',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=628cbb4f-042a-4560-b95c-cabfe4bcb37c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46b8fc61c3654cbfa4d958fec5e084cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:37:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:37:26Z,use_quota=True,user_id='9f90a47c64fc4e0abf96242604fa9a82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)}" {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:37:28 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-3646ba4f-83ed-4ccf-9c8f-b612d0f6b3f2 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Creating volume 628cbb4f-042a-4560-b95c-cabfe4bcb37c {{(pid=86512) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:37:28 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-3646ba4f-83ed-4ccf-9c8f-b612d0f6b3f2 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:37:28 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-3646ba4f-83ed-4ccf-9c8f-b612d0f6b3f2 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:37:28 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-3646ba4f-83ed-4ccf-9c8f-b612d0f6b3f2 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:37:28 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-3646ba4f-83ed-4ccf-9c8f-b612d0f6b3f2 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:37:28 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-3646ba4f-83ed-4ccf-9c8f-b612d0f6b3f2 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:37:28 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-3646ba4f-83ed-4ccf-9c8f-b612d0f6b3f2 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Selected osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 as target Quobyte volume. {{(pid=86512) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:37:28 devstack cinder-volume[86512]: INFO cinder.volume.drivers.remotefs [None req-3646ba4f-83ed-4ccf-9c8f-b612d0f6b3f2 tempest-CreateVolumesFromSnapshotTest-1588006594 None] casted to osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 Sep 29 18:37:28 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-3646ba4f-83ed-4ccf-9c8f-b612d0f6b3f2 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-628cbb4f-042a-4560-b95c-cabfe4bcb37c 1073741824 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:28 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-bdd4deba-a993-495e-a2f5-a45aeeacfded tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (412208f6-13d7-4b98-ab4a-386addfe3c97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-038fc5c6-d3d1-4d4b-af84-e95b3cc0df78', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:28 devstack sudo[106828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-628cbb4f-042a-4560-b95c-cabfe4bcb37c 1073741824 Sep 29 18:37:28 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-bdd4deba-a993-495e-a2f5-a45aeeacfded tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (024389e8-fbbb-4516-8d9e-e9da225dcc5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:28 devstack sudo[106828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:28 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-bdd4deba-a993-495e-a2f5-a45aeeacfded tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Volume volume-038fc5c6-d3d1-4d4b-af84-e95b3cc0df78 (038fc5c6-d3d1-4d4b-af84-e95b3cc0df78): created successfully Sep 29 18:37:28 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-bdd4deba-a993-495e-a2f5-a45aeeacfded tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (024389e8-fbbb-4516-8d9e-e9da225dcc5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:28 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-bdd4deba-a993-495e-a2f5-a45aeeacfded tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Flow 'volume_create_manager' (fad267d7-39b6-4957-97dd-cd13e2debe2a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:37:28 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-bdd4deba-a993-495e-a2f5-a45aeeacfded tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Created volume successfully. Sep 29 18:37:28 devstack sudo[106828]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:28 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-3646ba4f-83ed-4ccf-9c8f-b612d0f6b3f2 tempest-CreateVolumesFromSnapshotTest-1588006594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-628cbb4f-042a-4560-b95c-cabfe4bcb37c 1073741824" returned: 0 in 0.469s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:28 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-3646ba4f-83ed-4ccf-9c8f-b612d0f6b3f2 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-628cbb4f-042a-4560-b95c-cabfe4bcb37c {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:28 devstack sudo[106834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-628cbb4f-042a-4560-b95c-cabfe4bcb37c Sep 29 18:37:28 devstack sudo[106834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:28 devstack sudo[106834]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:28 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-3646ba4f-83ed-4ccf-9c8f-b612d0f6b3f2 tempest-CreateVolumesFromSnapshotTest-1588006594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-628cbb4f-042a-4560-b95c-cabfe4bcb37c" returned: 0 in 0.277s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:28 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-3646ba4f-83ed-4ccf-9c8f-b612d0f6b3f2 tempest-CreateVolumesFromSnapshotTest-1588006594 None] <== create_volume: return (794ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'} {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:37:28 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-3646ba4f-83ed-4ccf-9c8f-b612d0f6b3f2 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.796s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:37:28 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-898e2e9a-0e89-4960-90e7-4daf11c2555e tempest-VolumeAndVolumeTypeFromImageTest-1927733850 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.150s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:37:28 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-898e2e9a-0e89-4960-90e7-4daf11c2555e tempest-VolumeAndVolumeTypeFromImageTest-1927733850 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:37:24Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5acd6fb6-f59c-4dd9-aa49-a170de7b3970,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='508004355c9c45f5bffa69d8b9fe2d8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:37:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:37:24Z,use_quota=True,user_id='a4a1794b823a44a2bd1e424454ed69ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(96391a6b-3b39-43e2-841b-840358049291),volume_type_id=96391a6b-3b39-43e2-841b-840358049291)}" {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:37:28 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-898e2e9a-0e89-4960-90e7-4daf11c2555e tempest-VolumeAndVolumeTypeFromImageTest-1927733850 None] Creating volume 5acd6fb6-f59c-4dd9-aa49-a170de7b3970 {{(pid=86512) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:37:28 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-898e2e9a-0e89-4960-90e7-4daf11c2555e tempest-VolumeAndVolumeTypeFromImageTest-1927733850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:37:28 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-898e2e9a-0e89-4960-90e7-4daf11c2555e tempest-VolumeAndVolumeTypeFromImageTest-1927733850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:37:28 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-898e2e9a-0e89-4960-90e7-4daf11c2555e tempest-VolumeAndVolumeTypeFromImageTest-1927733850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:37:28 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-898e2e9a-0e89-4960-90e7-4daf11c2555e tempest-VolumeAndVolumeTypeFromImageTest-1927733850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:37:28 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-898e2e9a-0e89-4960-90e7-4daf11c2555e tempest-VolumeAndVolumeTypeFromImageTest-1927733850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:37:28 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-898e2e9a-0e89-4960-90e7-4daf11c2555e tempest-VolumeAndVolumeTypeFromImageTest-1927733850 None] Selected osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 as target Quobyte volume. {{(pid=86512) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:37:28 devstack cinder-volume[86512]: INFO cinder.volume.drivers.remotefs [None req-898e2e9a-0e89-4960-90e7-4daf11c2555e tempest-VolumeAndVolumeTypeFromImageTest-1927733850 None] casted to osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 Sep 29 18:37:28 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-898e2e9a-0e89-4960-90e7-4daf11c2555e tempest-VolumeAndVolumeTypeFromImageTest-1927733850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-5acd6fb6-f59c-4dd9-aa49-a170de7b3970 1073741824 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:29 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-3646ba4f-83ed-4ccf-9c8f-b612d0f6b3f2 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42e9f7db-67ad-4e18-a502-1433596f7a9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-628cbb4f-042a-4560-b95c-cabfe4bcb37c', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:29 devstack sudo[106837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-5acd6fb6-f59c-4dd9-aa49-a170de7b3970 1073741824 Sep 29 18:37:29 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-3646ba4f-83ed-4ccf-9c8f-b612d0f6b3f2 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c9537ba-dd6b-4063-8e91-b8a797ca4a41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:29 devstack sudo[106837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:29 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-3646ba4f-83ed-4ccf-9c8f-b612d0f6b3f2 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Volume volume-628cbb4f-042a-4560-b95c-cabfe4bcb37c (628cbb4f-042a-4560-b95c-cabfe4bcb37c): created successfully Sep 29 18:37:29 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-3646ba4f-83ed-4ccf-9c8f-b612d0f6b3f2 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c9537ba-dd6b-4063-8e91-b8a797ca4a41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:29 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-3646ba4f-83ed-4ccf-9c8f-b612d0f6b3f2 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Flow 'volume_create_manager' (e607b83f-f333-49ca-82f0-325409c9e96d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:37:29 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-3646ba4f-83ed-4ccf-9c8f-b612d0f6b3f2 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Created volume successfully. Sep 29 18:37:29 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-f45a05fd-2de7-491e-a39c-99e1790b4f26 tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Acquiring lock "cinder-038fc5c6-d3d1-4d4b-af84-e95b3cc0df78-delete_volume" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:37:29 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-f45a05fd-2de7-491e-a39c-99e1790b4f26 tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Lock "cinder-038fc5c6-d3d1-4d4b-af84-e95b3cc0df78-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:37:29 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-f45a05fd-2de7-491e-a39c-99e1790b4f26 tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Acquiring lock "cinder-quobyte-038fc5c6-d3d1-4d4b-af84-e95b3cc0df78" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:37:29 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-f45a05fd-2de7-491e-a39c-99e1790b4f26 tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Lock "cinder-quobyte-038fc5c6-d3d1-4d4b-af84-e95b3cc0df78" acquired by "delete_volume" :: waited 0.019s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:37:29 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[5806b3c5-f293-4d09-8d25-effddaf6e096]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:37:29 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-f45a05fd-2de7-491e-a39c-99e1790b4f26 tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-038fc5c6-d3d1-4d4b-af84-e95b3cc0df78 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:29 devstack sudo[106839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-038fc5c6-d3d1-4d4b-af84-e95b3cc0df78 Sep 29 18:37:29 devstack sudo[106839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:29 devstack sudo[106837]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:29 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-898e2e9a-0e89-4960-90e7-4daf11c2555e tempest-VolumeAndVolumeTypeFromImageTest-1927733850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-5acd6fb6-f59c-4dd9-aa49-a170de7b3970 1073741824" returned: 0 in 0.525s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:29 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-898e2e9a-0e89-4960-90e7-4daf11c2555e tempest-VolumeAndVolumeTypeFromImageTest-1927733850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-5acd6fb6-f59c-4dd9-aa49-a170de7b3970 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:29 devstack sudo[106846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-5acd6fb6-f59c-4dd9-aa49-a170de7b3970 Sep 29 18:37:29 devstack sudo[106846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:29 devstack sudo[106839]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:29 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-f45a05fd-2de7-491e-a39c-99e1790b4f26 tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-038fc5c6-d3d1-4d4b-af84-e95b3cc0df78" returned: 0 in 0.454s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:29 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-f45a05fd-2de7-491e-a39c-99e1790b4f26 tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-038fc5c6-d3d1-4d4b-af84-e95b3cc0df78 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:29 devstack sudo[106850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-038fc5c6-d3d1-4d4b-af84-e95b3cc0df78 Sep 29 18:37:29 devstack sudo[106850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:29 devstack sudo[106846]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:29 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-898e2e9a-0e89-4960-90e7-4daf11c2555e tempest-VolumeAndVolumeTypeFromImageTest-1927733850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-5acd6fb6-f59c-4dd9-aa49-a170de7b3970" returned: 0 in 0.334s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:29 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-898e2e9a-0e89-4960-90e7-4daf11c2555e tempest-VolumeAndVolumeTypeFromImageTest-1927733850 None] <== create_volume: return (913ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'} {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:37:29 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-898e2e9a-0e89-4960-90e7-4daf11c2555e tempest-VolumeAndVolumeTypeFromImageTest-1927733850 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.917s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:37:29 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-06655e8b-d0f1-47df-93c2-015f4fe8e663 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.957s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:37:29 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-06655e8b-d0f1-47df-93c2-015f4fe8e663 tempest-CreateVolumesFromSnapshotTest-1588006594 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:37:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-462341766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=107e339e-b09b-4db3-ac1f-735aae8a80a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46b8fc61c3654cbfa4d958fec5e084cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:37:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:37:27Z,use_quota=True,user_id='9f90a47c64fc4e0abf96242604fa9a82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)}" {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:37:29 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-06655e8b-d0f1-47df-93c2-015f4fe8e663 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Creating volume 107e339e-b09b-4db3-ac1f-735aae8a80a4 {{(pid=86512) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:37:29 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-06655e8b-d0f1-47df-93c2-015f4fe8e663 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:37:29 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-06655e8b-d0f1-47df-93c2-015f4fe8e663 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:37:29 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-06655e8b-d0f1-47df-93c2-015f4fe8e663 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:37:29 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-06655e8b-d0f1-47df-93c2-015f4fe8e663 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:37:29 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-06655e8b-d0f1-47df-93c2-015f4fe8e663 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:37:29 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-06655e8b-d0f1-47df-93c2-015f4fe8e663 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Selected osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 as target Quobyte volume. {{(pid=86512) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:37:29 devstack cinder-volume[86512]: INFO cinder.volume.drivers.remotefs [None req-06655e8b-d0f1-47df-93c2-015f4fe8e663 tempest-CreateVolumesFromSnapshotTest-1588006594 None] casted to osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 Sep 29 18:37:29 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-06655e8b-d0f1-47df-93c2-015f4fe8e663 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-107e339e-b09b-4db3-ac1f-735aae8a80a4 1073741824 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:29 devstack sudo[106854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-107e339e-b09b-4db3-ac1f-735aae8a80a4 1073741824 Sep 29 18:37:29 devstack sudo[106854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:29 devstack sudo[106850]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:29 devstack cinder-volume[86512]: DEBUG cinder.volume.volume_utils [None req-898e2e9a-0e89-4960-90e7-4daf11c2555e tempest-VolumeAndVolumeTypeFromImageTest-1927733850 None] Attempting download of ab56a330-db9e-42db-a4b5-fccdd9e03fe5 ((None, [{'url': 'file:///opt/stack/data/glance/images/ab56a330-db9e-42db-a4b5-fccdd9e03fe5', 'metadata': {}}])) to volume 5acd6fb6-f59c-4dd9-aa49-a170de7b3970. {{(pid=86512) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 29 18:37:29 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-f45a05fd-2de7-491e-a39c-99e1790b4f26 tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-038fc5c6-d3d1-4d4b-af84-e95b3cc0df78" returned: 0 in 0.356s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:30 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-f45a05fd-2de7-491e-a39c-99e1790b4f26 tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Lock "cinder-quobyte-038fc5c6-d3d1-4d4b-af84-e95b3cc0df78" released by "delete_volume" :: held 0.879s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:37:30 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[38e47928-252b-43aa-b323-f01a3160e0a3]: (4, 'raw') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:37:30 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-898e2e9a-0e89-4960-90e7-4daf11c2555e tempest-VolumeAndVolumeTypeFromImageTest-1927733850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ab56a330-db9e-42db-a4b5-fccdd9e03fe5_tqsuqvhe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:30 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-f45a05fd-2de7-491e-a39c-99e1790b4f26 tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Created reservations ['415a8335-34d8-4d99-a84a-0ab4a644b292', '67e98827-2471-44e7-91f2-bce66954cd9c', '8f1f7560-a121-4f40-a6fc-a0df36ef9e6a', '7bf99004-3c8b-4cb1-a463-5dd67c116a17'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:37:30 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-f45a05fd-2de7-491e-a39c-99e1790b4f26 tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:37:30 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-f45a05fd-2de7-491e-a39c-99e1790b4f26 tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:37:30 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-f45a05fd-2de7-491e-a39c-99e1790b4f26 tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:37:30 devstack sudo[106856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ab56a330-db9e-42db-a4b5-fccdd9e03fe5_tqsuqvhe Sep 29 18:37:30 devstack sudo[106856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:30 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-f45a05fd-2de7-491e-a39c-99e1790b4f26 tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:37:30 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-f45a05fd-2de7-491e-a39c-99e1790b4f26 tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:37:30 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-f45a05fd-2de7-491e-a39c-99e1790b4f26 tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:30 devstack sudo[106860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:37:30 devstack sudo[106860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:30 devstack sudo[106856]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:30 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-898e2e9a-0e89-4960-90e7-4daf11c2555e tempest-VolumeAndVolumeTypeFromImageTest-1927733850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ab56a330-db9e-42db-a4b5-fccdd9e03fe5_tqsuqvhe" returned: 0 in 0.441s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:30 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-898e2e9a-0e89-4960-90e7-4daf11c2555e tempest-VolumeAndVolumeTypeFromImageTest-1927733850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ab56a330-db9e-42db-a4b5-fccdd9e03fe5_tqsuqvhe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:30 devstack sudo[106854]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:30 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-06655e8b-d0f1-47df-93c2-015f4fe8e663 tempest-CreateVolumesFromSnapshotTest-1588006594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-107e339e-b09b-4db3-ac1f-735aae8a80a4 1073741824" returned: 0 in 0.649s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:30 devstack sudo[106860]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:30 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-06655e8b-d0f1-47df-93c2-015f4fe8e663 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-107e339e-b09b-4db3-ac1f-735aae8a80a4 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:30 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-f45a05fd-2de7-491e-a39c-99e1790b4f26 tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.315s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:30 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-f45a05fd-2de7-491e-a39c-99e1790b4f26 tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:37:30 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-f45a05fd-2de7-491e-a39c-99e1790b4f26 tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Deleted volume successfully. Sep 29 18:37:30 devstack sudo[106868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-107e339e-b09b-4db3-ac1f-735aae8a80a4 Sep 29 18:37:30 devstack sudo[106868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:30 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-f45a05fd-2de7-491e-a39c-99e1790b4f26 tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Lock "cinder-038fc5c6-d3d1-4d4b-af84-e95b3cc0df78-delete_volume" released by "delete_volume" :: held 1.569s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:37:30 devstack sudo[106866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ab56a330-db9e-42db-a4b5-fccdd9e03fe5_tqsuqvhe Sep 29 18:37:30 devstack sudo[106866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:30 devstack sudo[106868]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:30 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-06655e8b-d0f1-47df-93c2-015f4fe8e663 tempest-CreateVolumesFromSnapshotTest-1588006594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-107e339e-b09b-4db3-ac1f-735aae8a80a4" returned: 0 in 0.278s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:30 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-06655e8b-d0f1-47df-93c2-015f4fe8e663 tempest-CreateVolumesFromSnapshotTest-1588006594 None] <== create_volume: return (997ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'} {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:37:30 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-06655e8b-d0f1-47df-93c2-015f4fe8e663 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.003s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:37:30 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-cfb18590-9c69-47a1-87da-eac55c230646 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.636s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:37:30 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-cfb18590-9c69-47a1-87da-eac55c230646 tempest-CreateVolumesFromSnapshotTest-1588006594 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:37:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1894165317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb6b937d-f605-42c6-8f1e-367b36ed8742,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46b8fc61c3654cbfa4d958fec5e084cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:37:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:37:27Z,use_quota=True,user_id='9f90a47c64fc4e0abf96242604fa9a82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)}" {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:37:30 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-cfb18590-9c69-47a1-87da-eac55c230646 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Creating volume eb6b937d-f605-42c6-8f1e-367b36ed8742 {{(pid=86512) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:37:30 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-cfb18590-9c69-47a1-87da-eac55c230646 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:37:30 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-cfb18590-9c69-47a1-87da-eac55c230646 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:37:30 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-cfb18590-9c69-47a1-87da-eac55c230646 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:37:30 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-cfb18590-9c69-47a1-87da-eac55c230646 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:37:30 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-cfb18590-9c69-47a1-87da-eac55c230646 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:37:30 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-cfb18590-9c69-47a1-87da-eac55c230646 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Selected osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 as target Quobyte volume. {{(pid=86512) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:37:30 devstack cinder-volume[86512]: INFO cinder.volume.drivers.remotefs [None req-cfb18590-9c69-47a1-87da-eac55c230646 tempest-CreateVolumesFromSnapshotTest-1588006594 None] casted to osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 Sep 29 18:37:30 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-cfb18590-9c69-47a1-87da-eac55c230646 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-eb6b937d-f605-42c6-8f1e-367b36ed8742 1073741824 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:30 devstack sudo[106866]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:30 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-898e2e9a-0e89-4960-90e7-4daf11c2555e tempest-VolumeAndVolumeTypeFromImageTest-1927733850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ab56a330-db9e-42db-a4b5-fccdd9e03fe5_tqsuqvhe" returned: 1 in 0.382s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:30 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-898e2e9a-0e89-4960-90e7-4daf11c2555e tempest-VolumeAndVolumeTypeFromImageTest-1927733850 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ab56a330-db9e-42db-a4b5-fccdd9e03fe5_tqsuqvhe' failed. Not Retrying. {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 29 18:37:30 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-06655e8b-d0f1-47df-93c2-015f4fe8e663 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f08c37ce-626a-4c4a-baf7-0e5cd3fa64de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-107e339e-b09b-4db3-ac1f-735aae8a80a4', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:30 devstack sudo[106874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-eb6b937d-f605-42c6-8f1e-367b36ed8742 1073741824 Sep 29 18:37:30 devstack sudo[106874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:30 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-06655e8b-d0f1-47df-93c2-015f4fe8e663 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61aaeb7f-75a8-4cc5-b744-d5627e882f59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:30 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[c677af55-f4b8-480d-9c5d-c67e77e637be]: (4, 'raw') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:37:30 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-898e2e9a-0e89-4960-90e7-4daf11c2555e tempest-VolumeAndVolumeTypeFromImageTest-1927733850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ab56a330-db9e-42db-a4b5-fccdd9e03fe5_yah3c40ydevstack@QuobyteHD {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:30 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-06655e8b-d0f1-47df-93c2-015f4fe8e663 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Volume volume-107e339e-b09b-4db3-ac1f-735aae8a80a4 (107e339e-b09b-4db3-ac1f-735aae8a80a4): created successfully Sep 29 18:37:30 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-06655e8b-d0f1-47df-93c2-015f4fe8e663 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61aaeb7f-75a8-4cc5-b744-d5627e882f59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:30 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-06655e8b-d0f1-47df-93c2-015f4fe8e663 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Flow 'volume_create_manager' (32057879-fff9-42e2-a2b0-30a97272be9e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:37:31 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-06655e8b-d0f1-47df-93c2-015f4fe8e663 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Created volume successfully. Sep 29 18:37:31 devstack sudo[106876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ab56a330-db9e-42db-a4b5-fccdd9e03fe5_yah3c40ydevstack@QuobyteHD Sep 29 18:37:31 devstack sudo[106876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:31 devstack sudo[106876]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:31 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-898e2e9a-0e89-4960-90e7-4daf11c2555e tempest-VolumeAndVolumeTypeFromImageTest-1927733850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ab56a330-db9e-42db-a4b5-fccdd9e03fe5_yah3c40ydevstack@QuobyteHD" returned: 0 in 0.384s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:31 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-898e2e9a-0e89-4960-90e7-4daf11c2555e tempest-VolumeAndVolumeTypeFromImageTest-1927733850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ab56a330-db9e-42db-a4b5-fccdd9e03fe5_yah3c40ydevstack@QuobyteHD {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:31 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-918087e7-1635-4e85-8823-392b32b4424a tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Acquiring lock "cinder-173e089e-1640-4f6b-80c8-21932a9cdb68-delete_volume" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:37:31 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-918087e7-1635-4e85-8823-392b32b4424a tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Lock "cinder-173e089e-1640-4f6b-80c8-21932a9cdb68-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:37:31 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-918087e7-1635-4e85-8823-392b32b4424a tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Acquiring lock "cinder-quobyte-173e089e-1640-4f6b-80c8-21932a9cdb68" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:37:31 devstack sudo[106885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ab56a330-db9e-42db-a4b5-fccdd9e03fe5_yah3c40ydevstack@QuobyteHD Sep 29 18:37:31 devstack sudo[106885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:31 devstack sudo[106874]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:31 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-918087e7-1635-4e85-8823-392b32b4424a tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Lock "cinder-quobyte-173e089e-1640-4f6b-80c8-21932a9cdb68" acquired by "delete_volume" :: waited 0.021s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:37:31 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-cfb18590-9c69-47a1-87da-eac55c230646 tempest-CreateVolumesFromSnapshotTest-1588006594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-eb6b937d-f605-42c6-8f1e-367b36ed8742 1073741824" returned: 0 in 0.601s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:31 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[a430f364-a334-44be-b596-5104afff17e7]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:37:31 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-918087e7-1635-4e85-8823-392b32b4424a tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-173e089e-1640-4f6b-80c8-21932a9cdb68 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:31 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-cfb18590-9c69-47a1-87da-eac55c230646 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-eb6b937d-f605-42c6-8f1e-367b36ed8742 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:31 devstack sudo[106888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-eb6b937d-f605-42c6-8f1e-367b36ed8742 Sep 29 18:37:31 devstack sudo[106888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:31 devstack sudo[106887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-173e089e-1640-4f6b-80c8-21932a9cdb68 Sep 29 18:37:31 devstack sudo[106887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:31 devstack sudo[106885]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:31 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-898e2e9a-0e89-4960-90e7-4daf11c2555e tempest-VolumeAndVolumeTypeFromImageTest-1927733850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ab56a330-db9e-42db-a4b5-fccdd9e03fe5_yah3c40ydevstack@QuobyteHD" returned: 1 in 0.409s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:31 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-898e2e9a-0e89-4960-90e7-4daf11c2555e tempest-VolumeAndVolumeTypeFromImageTest-1927733850 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ab56a330-db9e-42db-a4b5-fccdd9e03fe5_yah3c40ydevstack@QuobyteHD' failed. Not Retrying. {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 29 18:37:31 devstack cinder-volume[86512]: DEBUG cinder.image.image_utils [None req-898e2e9a-0e89-4960-90e7-4daf11c2555e tempest-VolumeAndVolumeTypeFromImageTest-1927733850 None] ab56a330-db9e-42db-a4b5-fccdd9e03fe5 was raw, converting to qcow2 {{(pid=86512) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 29 18:37:31 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-898e2e9a-0e89-4960-90e7-4daf11c2555e tempest-VolumeAndVolumeTypeFromImageTest-1927733850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_ab56a330-db9e-42db-a4b5-fccdd9e03fe5_yah3c40ydevstack@QuobyteHD /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-5acd6fb6-f59c-4dd9-aa49-a170de7b3970 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:31 devstack sudo[106894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_ab56a330-db9e-42db-a4b5-fccdd9e03fe5_yah3c40ydevstack@QuobyteHD /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-5acd6fb6-f59c-4dd9-aa49-a170de7b3970 Sep 29 18:37:31 devstack sudo[106894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:31 devstack sudo[106888]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:31 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-cfb18590-9c69-47a1-87da-eac55c230646 tempest-CreateVolumesFromSnapshotTest-1588006594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-eb6b937d-f605-42c6-8f1e-367b36ed8742" returned: 0 in 0.344s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:31 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-cfb18590-9c69-47a1-87da-eac55c230646 tempest-CreateVolumesFromSnapshotTest-1588006594 None] <== create_volume: return (1017ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'} {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:37:31 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-cfb18590-9c69-47a1-87da-eac55c230646 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.022s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:37:31 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-be8ffef3-187e-4e90-91cb-754a921bb371 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.272s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:37:31 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-be8ffef3-187e-4e90-91cb-754a921bb371 tempest-CreateVolumesFromSnapshotTest-1588006594 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:37:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-183492892',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ddc82d91-cf82-4d51-a599-1daccca95c55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46b8fc61c3654cbfa4d958fec5e084cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:37:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:37:27Z,use_quota=True,user_id='9f90a47c64fc4e0abf96242604fa9a82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)}" {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:37:31 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-be8ffef3-187e-4e90-91cb-754a921bb371 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Creating volume ddc82d91-cf82-4d51-a599-1daccca95c55 {{(pid=86512) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:37:31 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-be8ffef3-187e-4e90-91cb-754a921bb371 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:37:31 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-be8ffef3-187e-4e90-91cb-754a921bb371 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:37:31 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-be8ffef3-187e-4e90-91cb-754a921bb371 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:37:31 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-be8ffef3-187e-4e90-91cb-754a921bb371 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:37:31 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-be8ffef3-187e-4e90-91cb-754a921bb371 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:37:31 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-be8ffef3-187e-4e90-91cb-754a921bb371 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Selected osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 as target Quobyte volume. {{(pid=86512) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:37:31 devstack cinder-volume[86512]: INFO cinder.volume.drivers.remotefs [None req-be8ffef3-187e-4e90-91cb-754a921bb371 tempest-CreateVolumesFromSnapshotTest-1588006594 None] casted to osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 Sep 29 18:37:31 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-be8ffef3-187e-4e90-91cb-754a921bb371 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ddc82d91-cf82-4d51-a599-1daccca95c55 1073741824 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:31 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-cfb18590-9c69-47a1-87da-eac55c230646 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc2f80b6-d480-41d3-bb1b-381d3729be4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb6b937d-f605-42c6-8f1e-367b36ed8742', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:31 devstack sudo[106899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ddc82d91-cf82-4d51-a599-1daccca95c55 1073741824 Sep 29 18:37:31 devstack sudo[106899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:31 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-cfb18590-9c69-47a1-87da-eac55c230646 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a68c312d-9a7a-4567-986a-b491bfc6e2f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:32 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-cfb18590-9c69-47a1-87da-eac55c230646 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Volume volume-eb6b937d-f605-42c6-8f1e-367b36ed8742 (eb6b937d-f605-42c6-8f1e-367b36ed8742): created successfully Sep 29 18:37:32 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-cfb18590-9c69-47a1-87da-eac55c230646 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a68c312d-9a7a-4567-986a-b491bfc6e2f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:32 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-cfb18590-9c69-47a1-87da-eac55c230646 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Flow 'volume_create_manager' (19fd8437-3ada-4106-9ed4-a6a9345363cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:37:32 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-cfb18590-9c69-47a1-87da-eac55c230646 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Created volume successfully. Sep 29 18:37:32 devstack sudo[106887]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:32 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-918087e7-1635-4e85-8823-392b32b4424a tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-173e089e-1640-4f6b-80c8-21932a9cdb68" returned: 0 in 0.542s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:32 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-918087e7-1635-4e85-8823-392b32b4424a tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-173e089e-1640-4f6b-80c8-21932a9cdb68 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:32 devstack sudo[106904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-173e089e-1640-4f6b-80c8-21932a9cdb68 Sep 29 18:37:32 devstack sudo[106904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:32 devstack sudo[106894]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:32 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-898e2e9a-0e89-4960-90e7-4daf11c2555e tempest-VolumeAndVolumeTypeFromImageTest-1927733850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_ab56a330-db9e-42db-a4b5-fccdd9e03fe5_yah3c40ydevstack@QuobyteHD /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-5acd6fb6-f59c-4dd9-aa49-a170de7b3970" returned: 0 in 0.623s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:32 devstack cinder-volume[86512]: DEBUG cinder.image.image_utils [None req-898e2e9a-0e89-4960-90e7-4daf11c2555e tempest-VolumeAndVolumeTypeFromImageTest-1927733850 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ab56a330-db9e-42db-a4b5-fccdd9e03fe5_yah3c40ydevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-5acd6fb6-f59c-4dd9-aa49-a170de7b3970 {{(pid=86512) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 29 18:37:32 devstack cinder-volume[86512]: INFO cinder.image.image_utils [None req-898e2e9a-0e89-4960-90e7-4daf11c2555e tempest-VolumeAndVolumeTypeFromImageTest-1927733850 None] Converted 0.00 MB image at 0.00 MB/s Sep 29 18:37:32 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-898e2e9a-0e89-4960-90e7-4daf11c2555e tempest-VolumeAndVolumeTypeFromImageTest-1927733850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-5acd6fb6-f59c-4dd9-aa49-a170de7b3970 1G {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:32 devstack sudo[106912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-5acd6fb6-f59c-4dd9-aa49-a170de7b3970 1G Sep 29 18:37:32 devstack sudo[106912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:32 devstack sudo[106904]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:32 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-918087e7-1635-4e85-8823-392b32b4424a tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-173e089e-1640-4f6b-80c8-21932a9cdb68" returned: 0 in 0.349s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:32 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-918087e7-1635-4e85-8823-392b32b4424a tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Lock "cinder-quobyte-173e089e-1640-4f6b-80c8-21932a9cdb68" released by "delete_volume" :: held 0.964s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:37:32 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-918087e7-1635-4e85-8823-392b32b4424a tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Created reservations ['72a7532c-bc00-4f96-ae75-8e6be35f2498', '6e65eae0-a293-4e13-b804-b6d6bd1b5622', '0b2afb24-b561-4b56-b2ef-42ce38b51903', '87efbc65-e903-4d16-9403-60192062b28d'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:37:32 devstack sudo[106899]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:32 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-be8ffef3-187e-4e90-91cb-754a921bb371 tempest-CreateVolumesFromSnapshotTest-1588006594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ddc82d91-cf82-4d51-a599-1daccca95c55 1073741824" returned: 0 in 0.645s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:32 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-be8ffef3-187e-4e90-91cb-754a921bb371 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ddc82d91-cf82-4d51-a599-1daccca95c55 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:32 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-918087e7-1635-4e85-8823-392b32b4424a tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:37:32 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-918087e7-1635-4e85-8823-392b32b4424a tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:37:32 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-918087e7-1635-4e85-8823-392b32b4424a tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:37:32 devstack sudo[106917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ddc82d91-cf82-4d51-a599-1daccca95c55 Sep 29 18:37:32 devstack sudo[106917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:32 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-918087e7-1635-4e85-8823-392b32b4424a tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:37:32 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-918087e7-1635-4e85-8823-392b32b4424a tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:37:32 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-918087e7-1635-4e85-8823-392b32b4424a tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:32 devstack sudo[106920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:37:32 devstack sudo[106920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:32 devstack sudo[106912]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:32 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-898e2e9a-0e89-4960-90e7-4daf11c2555e tempest-VolumeAndVolumeTypeFromImageTest-1927733850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-5acd6fb6-f59c-4dd9-aa49-a170de7b3970 1G" returned: 0 in 0.383s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:32 devstack cinder-volume[86512]: DEBUG cinder.volume.volume_utils [None req-898e2e9a-0e89-4960-90e7-4daf11c2555e tempest-VolumeAndVolumeTypeFromImageTest-1927733850 None] Downloaded image ab56a330-db9e-42db-a4b5-fccdd9e03fe5 ((None, [{'url': 'file:///opt/stack/data/glance/images/ab56a330-db9e-42db-a4b5-fccdd9e03fe5', 'metadata': {}}])) to volume 5acd6fb6-f59c-4dd9-aa49-a170de7b3970 successfully. {{(pid=86512) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 29 18:37:32 devstack cinder-volume[86512]: DEBUG cinder.image.image_utils [None req-898e2e9a-0e89-4960-90e7-4daf11c2555e tempest-VolumeAndVolumeTypeFromImageTest-1927733850 None] Temporary image ab56a330-db9e-42db-a4b5-fccdd9e03fe5 for user a4a1794b823a44a2bd1e424454ed69ba is deleted. {{(pid=86512) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 29 18:37:32 devstack cinder-volume[86512]: DEBUG cinder.volume.volume_utils [None req-898e2e9a-0e89-4960-90e7-4daf11c2555e tempest-VolumeAndVolumeTypeFromImageTest-1927733850 None] Marking volume 5acd6fb6-f59c-4dd9-aa49-a170de7b3970 as bootable. {{(pid=86512) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 29 18:37:32 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-898e2e9a-0e89-4960-90e7-4daf11c2555e tempest-VolumeAndVolumeTypeFromImageTest-1927733850 None] Copying metadata from image ab56a330-db9e-42db-a4b5-fccdd9e03fe5 to 5acd6fb6-f59c-4dd9-aa49-a170de7b3970. {{(pid=86512) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 29 18:37:32 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-898e2e9a-0e89-4960-90e7-4daf11c2555e tempest-VolumeAndVolumeTypeFromImageTest-1927733850 None] Creating volume glance metadata for volume 5acd6fb6-f59c-4dd9-aa49-a170de7b3970 backed by image ab56a330-db9e-42db-a4b5-fccdd9e03fe5 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'ab56a330-db9e-42db-a4b5-fccdd9e03fe5', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '71d4ca50e37ee455bc27e805a9f079ba', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86512) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 29 18:37:32 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-898e2e9a-0e89-4960-90e7-4daf11c2555e tempest-VolumeAndVolumeTypeFromImageTest-1927733850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f752957-518b-424a-8baa-ff9ac3781a8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5acd6fb6-f59c-4dd9-aa49-a170de7b3970', 'volume_size': 1, 'image_id': 'ab56a330-db9e-42db-a4b5-fccdd9e03fe5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ab56a330-db9e-42db-a4b5-fccdd9e03fe5', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '71d4ca50e37ee455bc27e805a9f079ba', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '508004355c9c45f5bffa69d8b9fe2d8f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2d4b0f59931c805e475415f3d50ec09b97f3695a8d37ddc7ceafcee7fdbee0e484f35b8a5f10203bbab9bde9a2f97f3ee41331b2dcf86b07448f1dd5b79fcbe4', 'id': 'ab56a330-db9e-42db-a4b5-fccdd9e03fe5', 'created_at': datetime.datetime(2026, 9, 29, 16, 37, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 16, 37, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ab56a330-db9e-42db-a4b5-fccdd9e03fe5/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:32 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-898e2e9a-0e89-4960-90e7-4daf11c2555e tempest-VolumeAndVolumeTypeFromImageTest-1927733850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27b0366c-595f-40d3-bbaa-0014244fe34b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:32 devstack sudo[106917]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:32 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-898e2e9a-0e89-4960-90e7-4daf11c2555e tempest-VolumeAndVolumeTypeFromImageTest-1927733850 None] Volume volume-5acd6fb6-f59c-4dd9-aa49-a170de7b3970 (5acd6fb6-f59c-4dd9-aa49-a170de7b3970): created successfully Sep 29 18:37:32 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-898e2e9a-0e89-4960-90e7-4daf11c2555e tempest-VolumeAndVolumeTypeFromImageTest-1927733850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27b0366c-595f-40d3-bbaa-0014244fe34b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:32 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-898e2e9a-0e89-4960-90e7-4daf11c2555e tempest-VolumeAndVolumeTypeFromImageTest-1927733850 None] Flow 'volume_create_manager' (24993e4f-bb12-4f4c-ae12-22a8d96e6188) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:37:32 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-be8ffef3-187e-4e90-91cb-754a921bb371 tempest-CreateVolumesFromSnapshotTest-1588006594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ddc82d91-cf82-4d51-a599-1daccca95c55" returned: 0 in 0.293s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:32 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-be8ffef3-187e-4e90-91cb-754a921bb371 tempest-CreateVolumesFromSnapshotTest-1588006594 None] <== create_volume: return (991ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'} {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:37:32 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-be8ffef3-187e-4e90-91cb-754a921bb371 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.993s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:37:32 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-4f4076e8-da40-41fb-b195-e216cae4047c tempest-CreateVolumesFromSnapshotTest-1588006594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.875s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:37:32 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-4f4076e8-da40-41fb-b195-e216cae4047c tempest-CreateVolumesFromSnapshotTest-1588006594 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:37:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1284643198',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcd300ad-4f6e-477c-ab46-cf4c1e691e4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46b8fc61c3654cbfa4d958fec5e084cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:37:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:37:28Z,use_quota=True,user_id='9f90a47c64fc4e0abf96242604fa9a82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)}" {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:37:32 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-4f4076e8-da40-41fb-b195-e216cae4047c tempest-CreateVolumesFromSnapshotTest-1588006594 None] Creating volume bcd300ad-4f6e-477c-ab46-cf4c1e691e4d {{(pid=86512) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:37:32 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-4f4076e8-da40-41fb-b195-e216cae4047c tempest-CreateVolumesFromSnapshotTest-1588006594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:37:32 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-4f4076e8-da40-41fb-b195-e216cae4047c tempest-CreateVolumesFromSnapshotTest-1588006594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:37:32 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-4f4076e8-da40-41fb-b195-e216cae4047c tempest-CreateVolumesFromSnapshotTest-1588006594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:37:32 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-4f4076e8-da40-41fb-b195-e216cae4047c tempest-CreateVolumesFromSnapshotTest-1588006594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:37:32 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-4f4076e8-da40-41fb-b195-e216cae4047c tempest-CreateVolumesFromSnapshotTest-1588006594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:37:32 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-4f4076e8-da40-41fb-b195-e216cae4047c tempest-CreateVolumesFromSnapshotTest-1588006594 None] Selected osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 as target Quobyte volume. {{(pid=86512) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:37:32 devstack cinder-volume[86512]: INFO cinder.volume.drivers.remotefs [None req-4f4076e8-da40-41fb-b195-e216cae4047c tempest-CreateVolumesFromSnapshotTest-1588006594 None] casted to osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 Sep 29 18:37:32 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-4f4076e8-da40-41fb-b195-e216cae4047c tempest-CreateVolumesFromSnapshotTest-1588006594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-bcd300ad-4f6e-477c-ab46-cf4c1e691e4d 1073741824 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:32 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-898e2e9a-0e89-4960-90e7-4daf11c2555e tempest-VolumeAndVolumeTypeFromImageTest-1927733850 None] Created volume successfully. Sep 29 18:37:32 devstack sudo[106920]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:32 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-be8ffef3-187e-4e90-91cb-754a921bb371 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b80fa68e-74eb-4919-9b8e-853733a1e92a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ddc82d91-cf82-4d51-a599-1daccca95c55', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:32 devstack sudo[106925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-bcd300ad-4f6e-477c-ab46-cf4c1e691e4d 1073741824 Sep 29 18:37:32 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-be8ffef3-187e-4e90-91cb-754a921bb371 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a98dc2f-a7fb-4628-9a61-75e90fb2d0dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:32 devstack sudo[106925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:32 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-918087e7-1635-4e85-8823-392b32b4424a tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.324s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:32 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-918087e7-1635-4e85-8823-392b32b4424a tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:37:32 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-918087e7-1635-4e85-8823-392b32b4424a tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Deleted volume successfully. Sep 29 18:37:33 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-be8ffef3-187e-4e90-91cb-754a921bb371 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Volume volume-ddc82d91-cf82-4d51-a599-1daccca95c55 (ddc82d91-cf82-4d51-a599-1daccca95c55): created successfully Sep 29 18:37:33 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-be8ffef3-187e-4e90-91cb-754a921bb371 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a98dc2f-a7fb-4628-9a61-75e90fb2d0dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:33 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-be8ffef3-187e-4e90-91cb-754a921bb371 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Flow 'volume_create_manager' (c4cd0d93-4495-4c11-a8e3-fc84e6917405) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:37:33 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-918087e7-1635-4e85-8823-392b32b4424a tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Lock "cinder-173e089e-1640-4f6b-80c8-21932a9cdb68-delete_volume" released by "delete_volume" :: held 1.629s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:37:33 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-be8ffef3-187e-4e90-91cb-754a921bb371 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Created volume successfully. Sep 29 18:37:33 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-73d449ce-684e-4f3b-aa08-6b7fc7f189e4 tempest-VolumeAndVolumeTypeFromImageTest-1927733850 None] Acquiring lock "cinder-5acd6fb6-f59c-4dd9-aa49-a170de7b3970-delete_volume" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:37:33 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-73d449ce-684e-4f3b-aa08-6b7fc7f189e4 tempest-VolumeAndVolumeTypeFromImageTest-1927733850 None] Lock "cinder-5acd6fb6-f59c-4dd9-aa49-a170de7b3970-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:37:33 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-73d449ce-684e-4f3b-aa08-6b7fc7f189e4 tempest-VolumeAndVolumeTypeFromImageTest-1927733850 None] Acquiring lock "cinder-quobyte-5acd6fb6-f59c-4dd9-aa49-a170de7b3970" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:37:33 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-73d449ce-684e-4f3b-aa08-6b7fc7f189e4 tempest-VolumeAndVolumeTypeFromImageTest-1927733850 None] Lock "cinder-quobyte-5acd6fb6-f59c-4dd9-aa49-a170de7b3970" acquired by "delete_volume" :: waited 0.017s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:37:33 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[d10ddb08-c70e-4a87-8681-9cc3f85a1463]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:37:33 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-73d449ce-684e-4f3b-aa08-6b7fc7f189e4 tempest-VolumeAndVolumeTypeFromImageTest-1927733850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-5acd6fb6-f59c-4dd9-aa49-a170de7b3970 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:33 devstack sudo[106930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-5acd6fb6-f59c-4dd9-aa49-a170de7b3970 Sep 29 18:37:33 devstack sudo[106930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:33 devstack sudo[106925]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:33 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-4f4076e8-da40-41fb-b195-e216cae4047c tempest-CreateVolumesFromSnapshotTest-1588006594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-bcd300ad-4f6e-477c-ab46-cf4c1e691e4d 1073741824" returned: 0 in 0.575s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:33 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-4f4076e8-da40-41fb-b195-e216cae4047c tempest-CreateVolumesFromSnapshotTest-1588006594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-bcd300ad-4f6e-477c-ab46-cf4c1e691e4d {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:33 devstack sudo[106933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-bcd300ad-4f6e-477c-ab46-cf4c1e691e4d Sep 29 18:37:33 devstack sudo[106933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:33 devstack sudo[106930]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:33 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-73d449ce-684e-4f3b-aa08-6b7fc7f189e4 tempest-VolumeAndVolumeTypeFromImageTest-1927733850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-5acd6fb6-f59c-4dd9-aa49-a170de7b3970" returned: 0 in 0.435s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:33 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-73d449ce-684e-4f3b-aa08-6b7fc7f189e4 tempest-VolumeAndVolumeTypeFromImageTest-1927733850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-5acd6fb6-f59c-4dd9-aa49-a170de7b3970 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:33 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-f9a975dc-9306-4d08-b9c6-f759294a79ca tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Acquiring lock "cinder-2aeb54f4-d077-456d-a7e5-99149ba171d0-delete_volume" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:37:33 devstack sudo[106938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-5acd6fb6-f59c-4dd9-aa49-a170de7b3970 Sep 29 18:37:33 devstack sudo[106938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:33 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-f9a975dc-9306-4d08-b9c6-f759294a79ca tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Lock "cinder-2aeb54f4-d077-456d-a7e5-99149ba171d0-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:37:33 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-f9a975dc-9306-4d08-b9c6-f759294a79ca tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Acquiring lock "cinder-quobyte-2aeb54f4-d077-456d-a7e5-99149ba171d0" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:37:33 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-f9a975dc-9306-4d08-b9c6-f759294a79ca tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Lock "cinder-quobyte-2aeb54f4-d077-456d-a7e5-99149ba171d0" acquired by "delete_volume" :: waited 0.016s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:37:33 devstack sudo[106933]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:33 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-4f4076e8-da40-41fb-b195-e216cae4047c tempest-CreateVolumesFromSnapshotTest-1588006594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-bcd300ad-4f6e-477c-ab46-cf4c1e691e4d" returned: 0 in 0.298s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:33 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-4f4076e8-da40-41fb-b195-e216cae4047c tempest-CreateVolumesFromSnapshotTest-1588006594 None] <== create_volume: return (918ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'} {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:37:33 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-4f4076e8-da40-41fb-b195-e216cae4047c tempest-CreateVolumesFromSnapshotTest-1588006594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.921s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:37:33 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-4f4076e8-da40-41fb-b195-e216cae4047c tempest-CreateVolumesFromSnapshotTest-1588006594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44249044-a867-4567-9fae-29f92d3a5e96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bcd300ad-4f6e-477c-ab46-cf4c1e691e4d', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:33 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-4f4076e8-da40-41fb-b195-e216cae4047c tempest-CreateVolumesFromSnapshotTest-1588006594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2914c58-c746-41d1-8a3d-a54273abba93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:33 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0d48a29-5b0e-46e6-92ca-efdbf01e4d7c]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:37:33 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-f9a975dc-9306-4d08-b9c6-f759294a79ca tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-2aeb54f4-d077-456d-a7e5-99149ba171d0 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:33 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-4f4076e8-da40-41fb-b195-e216cae4047c tempest-CreateVolumesFromSnapshotTest-1588006594 None] Volume volume-bcd300ad-4f6e-477c-ab46-cf4c1e691e4d (bcd300ad-4f6e-477c-ab46-cf4c1e691e4d): created successfully Sep 29 18:37:33 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-4f4076e8-da40-41fb-b195-e216cae4047c tempest-CreateVolumesFromSnapshotTest-1588006594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2914c58-c746-41d1-8a3d-a54273abba93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:33 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-4f4076e8-da40-41fb-b195-e216cae4047c tempest-CreateVolumesFromSnapshotTest-1588006594 None] Flow 'volume_create_manager' (ef66ea39-9a62-421a-a817-c2ccde4268be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:37:33 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-4f4076e8-da40-41fb-b195-e216cae4047c tempest-CreateVolumesFromSnapshotTest-1588006594 None] Created volume successfully. Sep 29 18:37:34 devstack sudo[106941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-2aeb54f4-d077-456d-a7e5-99149ba171d0 Sep 29 18:37:34 devstack sudo[106941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:34 devstack sudo[106938]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:34 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-73d449ce-684e-4f3b-aa08-6b7fc7f189e4 tempest-VolumeAndVolumeTypeFromImageTest-1927733850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-5acd6fb6-f59c-4dd9-aa49-a170de7b3970" returned: 0 in 0.331s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:34 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-73d449ce-684e-4f3b-aa08-6b7fc7f189e4 tempest-VolumeAndVolumeTypeFromImageTest-1927733850 None] Lock "cinder-quobyte-5acd6fb6-f59c-4dd9-aa49-a170de7b3970" released by "delete_volume" :: held 0.821s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:37:34 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-73d449ce-684e-4f3b-aa08-6b7fc7f189e4 tempest-VolumeAndVolumeTypeFromImageTest-1927733850 None] Created reservations ['099add1e-65a4-41a0-a5c3-99f70f39fe88', 'bb07d7fb-1cbf-439a-9a91-a55d6979ac53', '853896e6-955c-4dff-8efe-793d6387aae3', '837387d8-e4a1-4092-899e-40f598660145'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:37:34 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-73d449ce-684e-4f3b-aa08-6b7fc7f189e4 tempest-VolumeAndVolumeTypeFromImageTest-1927733850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:37:34 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-73d449ce-684e-4f3b-aa08-6b7fc7f189e4 tempest-VolumeAndVolumeTypeFromImageTest-1927733850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:37:34 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-73d449ce-684e-4f3b-aa08-6b7fc7f189e4 tempest-VolumeAndVolumeTypeFromImageTest-1927733850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:37:34 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-73d449ce-684e-4f3b-aa08-6b7fc7f189e4 tempest-VolumeAndVolumeTypeFromImageTest-1927733850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:37:34 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-73d449ce-684e-4f3b-aa08-6b7fc7f189e4 tempest-VolumeAndVolumeTypeFromImageTest-1927733850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:37:34 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-73d449ce-684e-4f3b-aa08-6b7fc7f189e4 tempest-VolumeAndVolumeTypeFromImageTest-1927733850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:34 devstack sudo[106945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:37:34 devstack sudo[106945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:34 devstack sudo[106941]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:34 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-f9a975dc-9306-4d08-b9c6-f759294a79ca tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-2aeb54f4-d077-456d-a7e5-99149ba171d0" returned: 0 in 0.481s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:34 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-f9a975dc-9306-4d08-b9c6-f759294a79ca tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-2aeb54f4-d077-456d-a7e5-99149ba171d0 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:34 devstack sudo[106950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-2aeb54f4-d077-456d-a7e5-99149ba171d0 Sep 29 18:37:34 devstack sudo[106950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:34 devstack sudo[106945]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:34 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-73d449ce-684e-4f3b-aa08-6b7fc7f189e4 tempest-VolumeAndVolumeTypeFromImageTest-1927733850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.312s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:34 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-73d449ce-684e-4f3b-aa08-6b7fc7f189e4 tempest-VolumeAndVolumeTypeFromImageTest-1927733850 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:37:34 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-73d449ce-684e-4f3b-aa08-6b7fc7f189e4 tempest-VolumeAndVolumeTypeFromImageTest-1927733850 None] Deleted volume successfully. Sep 29 18:37:34 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-73d449ce-684e-4f3b-aa08-6b7fc7f189e4 tempest-VolumeAndVolumeTypeFromImageTest-1927733850 None] Lock "cinder-5acd6fb6-f59c-4dd9-aa49-a170de7b3970-delete_volume" released by "delete_volume" :: held 1.380s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:37:34 devstack sudo[106950]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:34 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-f9a975dc-9306-4d08-b9c6-f759294a79ca tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-2aeb54f4-d077-456d-a7e5-99149ba171d0" returned: 0 in 0.317s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:34 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-f9a975dc-9306-4d08-b9c6-f759294a79ca tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Lock "cinder-quobyte-2aeb54f4-d077-456d-a7e5-99149ba171d0" released by "delete_volume" :: held 0.863s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:37:34 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-63fe722f-cd56-4227-af2a-aecd5b49b035 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Acquiring lock "cinder-bcd300ad-4f6e-477c-ab46-cf4c1e691e4d-delete_volume" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:37:34 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-63fe722f-cd56-4227-af2a-aecd5b49b035 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Lock "cinder-bcd300ad-4f6e-477c-ab46-cf4c1e691e4d-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:37:34 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-f9a975dc-9306-4d08-b9c6-f759294a79ca tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Created reservations ['15cd8ad0-bf61-459e-8973-fd28435ab0e9', '705e4978-d75a-4841-89bd-58519fc78bbc', '72482ab6-7edb-4b6d-a8f4-41ac98e93047', '46c43c06-f716-4bd3-86a2-e4fe4a2163f0'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:37:34 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-63fe722f-cd56-4227-af2a-aecd5b49b035 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Acquiring lock "cinder-quobyte-bcd300ad-4f6e-477c-ab46-cf4c1e691e4d" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:37:34 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-63fe722f-cd56-4227-af2a-aecd5b49b035 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Lock "cinder-quobyte-bcd300ad-4f6e-477c-ab46-cf4c1e691e4d" acquired by "delete_volume" :: waited 0.027s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:37:34 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-f9a975dc-9306-4d08-b9c6-f759294a79ca tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:37:34 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-f9a975dc-9306-4d08-b9c6-f759294a79ca tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:37:34 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-f9a975dc-9306-4d08-b9c6-f759294a79ca tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:37:34 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-f9a975dc-9306-4d08-b9c6-f759294a79ca tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:37:34 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-f9a975dc-9306-4d08-b9c6-f759294a79ca tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:37:34 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-f9a975dc-9306-4d08-b9c6-f759294a79ca tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:34 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd41a665-3197-4ff5-bdf9-1241b4b6bd35]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:37:34 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-63fe722f-cd56-4227-af2a-aecd5b49b035 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-bcd300ad-4f6e-477c-ab46-cf4c1e691e4d {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:35 devstack sudo[106954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:37:35 devstack sudo[106954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:35 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa4e02e7-94f3-4f05-999e-a08042502cd6 tempest-ProjectReaderTests-1023282426 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86512) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:37:35 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-fa4e02e7-94f3-4f05-999e-a08042502cd6 tempest-ProjectReaderTests-1023282426 None] Flow 'volume_create_manager' (9f317c4e-8fc2-4264-b585-c4de07bbe7fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:37:35 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-fa4e02e7-94f3-4f05-999e-a08042502cd6 tempest-ProjectReaderTests-1023282426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82c4f264-be99-46ca-99a3-d0c6b7303ea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:35 devstack sudo[106955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-bcd300ad-4f6e-477c-ab46-cf4c1e691e4d Sep 29 18:37:35 devstack sudo[106955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:35 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-fa4e02e7-94f3-4f05-999e-a08042502cd6 tempest-ProjectReaderTests-1023282426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82c4f264-be99-46ca-99a3-d0c6b7303ea9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:37:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2029616826',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17b1cc69-23f9-44fc-a771-03783bb63ff9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c6583dad59442f381d38f8f0383dc2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:37:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:37:35Z,use_quota=True,user_id='ef7764e50a99455faed61f3e9a1ca584',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:35 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-fa4e02e7-94f3-4f05-999e-a08042502cd6 tempest-ProjectReaderTests-1023282426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d111502-8ea0-4ed1-83f2-692374677bf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:35 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-fa4e02e7-94f3-4f05-999e-a08042502cd6 tempest-ProjectReaderTests-1023282426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d111502-8ea0-4ed1-83f2-692374677bf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:35 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-fa4e02e7-94f3-4f05-999e-a08042502cd6 tempest-ProjectReaderTests-1023282426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (347e2266-4eba-4990-8abe-3e393bbae948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:35 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-fa4e02e7-94f3-4f05-999e-a08042502cd6 tempest-ProjectReaderTests-1023282426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (347e2266-4eba-4990-8abe-3e393bbae948) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17b1cc69-23f9-44fc-a771-03783bb63ff9', 'volume_name': 'volume-17b1cc69-23f9-44fc-a771-03783bb63ff9', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:35 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-fa4e02e7-94f3-4f05-999e-a08042502cd6 tempest-ProjectReaderTests-1023282426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0415c397-79b9-4e4e-94f9-cb66e8c062d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:35 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-fa4e02e7-94f3-4f05-999e-a08042502cd6 tempest-ProjectReaderTests-1023282426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0415c397-79b9-4e4e-94f9-cb66e8c062d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:35 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-fa4e02e7-94f3-4f05-999e-a08042502cd6 tempest-ProjectReaderTests-1023282426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2f8cc5a-c2db-4608-95c3-30965f793abe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:35 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-fa4e02e7-94f3-4f05-999e-a08042502cd6 tempest-ProjectReaderTests-1023282426 None] Volume 17b1cc69-23f9-44fc-a771-03783bb63ff9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17b1cc69-23f9-44fc-a771-03783bb63ff9', 'volume_size': 1} Sep 29 18:37:35 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-fa4e02e7-94f3-4f05-999e-a08042502cd6 tempest-ProjectReaderTests-1023282426 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:37:35 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-fa4e02e7-94f3-4f05-999e-a08042502cd6 tempest-ProjectReaderTests-1023282426 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:37:35 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-fa4e02e7-94f3-4f05-999e-a08042502cd6 tempest-ProjectReaderTests-1023282426 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:37:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2029616826',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17b1cc69-23f9-44fc-a771-03783bb63ff9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c6583dad59442f381d38f8f0383dc2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:37:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:37:35Z,use_quota=True,user_id='ef7764e50a99455faed61f3e9a1ca584',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)}" {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:37:35 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-fa4e02e7-94f3-4f05-999e-a08042502cd6 tempest-ProjectReaderTests-1023282426 None] Creating volume 17b1cc69-23f9-44fc-a771-03783bb63ff9 {{(pid=86512) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:37:35 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-fa4e02e7-94f3-4f05-999e-a08042502cd6 tempest-ProjectReaderTests-1023282426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:37:35 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-fa4e02e7-94f3-4f05-999e-a08042502cd6 tempest-ProjectReaderTests-1023282426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:37:35 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-fa4e02e7-94f3-4f05-999e-a08042502cd6 tempest-ProjectReaderTests-1023282426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:37:35 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-fa4e02e7-94f3-4f05-999e-a08042502cd6 tempest-ProjectReaderTests-1023282426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:37:35 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-fa4e02e7-94f3-4f05-999e-a08042502cd6 tempest-ProjectReaderTests-1023282426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:37:35 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-fa4e02e7-94f3-4f05-999e-a08042502cd6 tempest-ProjectReaderTests-1023282426 None] Selected osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 as target Quobyte volume. {{(pid=86512) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:37:35 devstack cinder-volume[86512]: INFO cinder.volume.drivers.remotefs [None req-fa4e02e7-94f3-4f05-999e-a08042502cd6 tempest-ProjectReaderTests-1023282426 None] casted to osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 Sep 29 18:37:35 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-fa4e02e7-94f3-4f05-999e-a08042502cd6 tempest-ProjectReaderTests-1023282426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-17b1cc69-23f9-44fc-a771-03783bb63ff9 1073741824 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:35 devstack sudo[106959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-17b1cc69-23f9-44fc-a771-03783bb63ff9 1073741824 Sep 29 18:37:35 devstack sudo[106959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:35 devstack sudo[106954]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:35 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-f9a975dc-9306-4d08-b9c6-f759294a79ca tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.363s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:35 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-f9a975dc-9306-4d08-b9c6-f759294a79ca tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:37:35 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-f9a975dc-9306-4d08-b9c6-f759294a79ca tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Deleted volume successfully. Sep 29 18:37:35 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-f9a975dc-9306-4d08-b9c6-f759294a79ca tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Lock "cinder-2aeb54f4-d077-456d-a7e5-99149ba171d0-delete_volume" released by "delete_volume" :: held 1.610s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:37:35 devstack sudo[106955]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:35 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-63fe722f-cd56-4227-af2a-aecd5b49b035 tempest-CreateVolumesFromSnapshotTest-1588006594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-bcd300ad-4f6e-477c-ab46-cf4c1e691e4d" returned: 0 in 0.494s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:35 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-63fe722f-cd56-4227-af2a-aecd5b49b035 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-bcd300ad-4f6e-477c-ab46-cf4c1e691e4d {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:35 devstack sudo[106964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-bcd300ad-4f6e-477c-ab46-cf4c1e691e4d Sep 29 18:37:35 devstack sudo[106964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:35 devstack sudo[106964]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:35 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-63fe722f-cd56-4227-af2a-aecd5b49b035 tempest-CreateVolumesFromSnapshotTest-1588006594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-bcd300ad-4f6e-477c-ab46-cf4c1e691e4d" returned: 0 in 0.262s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:35 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-63fe722f-cd56-4227-af2a-aecd5b49b035 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Lock "cinder-quobyte-bcd300ad-4f6e-477c-ab46-cf4c1e691e4d" released by "delete_volume" :: held 0.845s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:37:35 devstack sudo[106959]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:35 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-fa4e02e7-94f3-4f05-999e-a08042502cd6 tempest-ProjectReaderTests-1023282426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-17b1cc69-23f9-44fc-a771-03783bb63ff9 1073741824" returned: 0 in 0.512s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:35 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-fa4e02e7-94f3-4f05-999e-a08042502cd6 tempest-ProjectReaderTests-1023282426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-17b1cc69-23f9-44fc-a771-03783bb63ff9 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:35 devstack sudo[106970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-17b1cc69-23f9-44fc-a771-03783bb63ff9 Sep 29 18:37:35 devstack sudo[106970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:35 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-63fe722f-cd56-4227-af2a-aecd5b49b035 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Created reservations ['708a5267-8359-410c-8004-74209d246a6e', 'e54369cb-87b3-446a-b696-99bda4160b27', '2f29db3a-97db-409a-88b3-8ca0e0fe50ae', 'c3ce3886-597b-408f-a672-3e7a9a11b287'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:37:35 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-63fe722f-cd56-4227-af2a-aecd5b49b035 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:37:35 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-63fe722f-cd56-4227-af2a-aecd5b49b035 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:37:35 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-63fe722f-cd56-4227-af2a-aecd5b49b035 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:37:36 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-63fe722f-cd56-4227-af2a-aecd5b49b035 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:37:36 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-63fe722f-cd56-4227-af2a-aecd5b49b035 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:37:36 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-63fe722f-cd56-4227-af2a-aecd5b49b035 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:36 devstack sudo[106972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:37:36 devstack sudo[106972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:36 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-09b274e7-da7b-4280-877c-ab18d0b4538b tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Acquiring lock "cinder-b07b67ac-5b99-4ac3-950a-f61c2340a4ee-delete_volume" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:37:36 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-09b274e7-da7b-4280-877c-ab18d0b4538b tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Lock "cinder-b07b67ac-5b99-4ac3-950a-f61c2340a4ee-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:37:36 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-09b274e7-da7b-4280-877c-ab18d0b4538b tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Acquiring lock "cinder-quobyte-b07b67ac-5b99-4ac3-950a-f61c2340a4ee" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:37:36 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-09b274e7-da7b-4280-877c-ab18d0b4538b tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Lock "cinder-quobyte-b07b67ac-5b99-4ac3-950a-f61c2340a4ee" acquired by "delete_volume" :: waited 0.022s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:37:36 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5d809d0-96f3-4e95-9a25-c2ddcf8e42f6]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:37:36 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-09b274e7-da7b-4280-877c-ab18d0b4538b tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-b07b67ac-5b99-4ac3-950a-f61c2340a4ee {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:36 devstack sudo[106970]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:36 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-fa4e02e7-94f3-4f05-999e-a08042502cd6 tempest-ProjectReaderTests-1023282426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-17b1cc69-23f9-44fc-a771-03783bb63ff9" returned: 0 in 0.429s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:36 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-fa4e02e7-94f3-4f05-999e-a08042502cd6 tempest-ProjectReaderTests-1023282426 None] <== create_volume: return (994ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'} {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:37:36 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-fa4e02e7-94f3-4f05-999e-a08042502cd6 tempest-ProjectReaderTests-1023282426 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.996s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:37:36 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-fa4e02e7-94f3-4f05-999e-a08042502cd6 tempest-ProjectReaderTests-1023282426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2f8cc5a-c2db-4608-95c3-30965f793abe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17b1cc69-23f9-44fc-a771-03783bb63ff9', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:36 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-fa4e02e7-94f3-4f05-999e-a08042502cd6 tempest-ProjectReaderTests-1023282426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e39f4f5c-b33f-4432-942c-44dcec2bda49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:36 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-fa4e02e7-94f3-4f05-999e-a08042502cd6 tempest-ProjectReaderTests-1023282426 None] Volume volume-17b1cc69-23f9-44fc-a771-03783bb63ff9 (17b1cc69-23f9-44fc-a771-03783bb63ff9): created successfully Sep 29 18:37:36 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-fa4e02e7-94f3-4f05-999e-a08042502cd6 tempest-ProjectReaderTests-1023282426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e39f4f5c-b33f-4432-942c-44dcec2bda49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:36 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-fa4e02e7-94f3-4f05-999e-a08042502cd6 tempest-ProjectReaderTests-1023282426 None] Flow 'volume_create_manager' (9f317c4e-8fc2-4264-b585-c4de07bbe7fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:37:36 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-fa4e02e7-94f3-4f05-999e-a08042502cd6 tempest-ProjectReaderTests-1023282426 None] Created volume successfully. Sep 29 18:37:36 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-63fe722f-cd56-4227-af2a-aecd5b49b035 tempest-CreateVolumesFromSnapshotTest-1588006594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.347s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:36 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-63fe722f-cd56-4227-af2a-aecd5b49b035 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:37:36 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-63fe722f-cd56-4227-af2a-aecd5b49b035 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Deleted volume successfully. Sep 29 18:37:36 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-63fe722f-cd56-4227-af2a-aecd5b49b035 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Lock "cinder-bcd300ad-4f6e-477c-ab46-cf4c1e691e4d-delete_volume" released by "delete_volume" :: held 1.637s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:37:36 devstack sudo[106972]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:36 devstack sudo[106975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-b07b67ac-5b99-4ac3-950a-f61c2340a4ee Sep 29 18:37:36 devstack sudo[106975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:36 devstack sudo[106975]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:36 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-09b274e7-da7b-4280-877c-ab18d0b4538b tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-b07b67ac-5b99-4ac3-950a-f61c2340a4ee" returned: 0 in 0.438s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:36 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-09b274e7-da7b-4280-877c-ab18d0b4538b tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-b07b67ac-5b99-4ac3-950a-f61c2340a4ee {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:36 devstack sudo[106984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-b07b67ac-5b99-4ac3-950a-f61c2340a4ee Sep 29 18:37:36 devstack sudo[106984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:36 devstack sudo[106984]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:36 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-09b274e7-da7b-4280-877c-ab18d0b4538b tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-b07b67ac-5b99-4ac3-950a-f61c2340a4ee" returned: 0 in 0.319s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:36 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-09b274e7-da7b-4280-877c-ab18d0b4538b tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Lock "cinder-quobyte-b07b67ac-5b99-4ac3-950a-f61c2340a4ee" released by "delete_volume" :: held 0.832s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:37:37 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-09b274e7-da7b-4280-877c-ab18d0b4538b tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Created reservations ['79d7fcff-2a35-4e71-8dee-18084fd45219', 'bf96ad1e-1175-43df-99d9-18afdbcbad72', 'b5628dd1-55fb-46a5-9caf-6d72c5abdecf', 'a8beb21b-330c-44eb-95e7-a89ceff522f2'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:37:37 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-2a10aad9-dfa4-4f2c-b158-b50926babc0a tempest-CreateVolumesFromSnapshotTest-1588006594 None] Acquiring lock "cinder-ddc82d91-cf82-4d51-a599-1daccca95c55-delete_volume" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:37:37 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-2a10aad9-dfa4-4f2c-b158-b50926babc0a tempest-CreateVolumesFromSnapshotTest-1588006594 None] Lock "cinder-ddc82d91-cf82-4d51-a599-1daccca95c55-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:37:37 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-2a10aad9-dfa4-4f2c-b158-b50926babc0a tempest-CreateVolumesFromSnapshotTest-1588006594 None] Acquiring lock "cinder-quobyte-ddc82d91-cf82-4d51-a599-1daccca95c55" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:37:37 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-2a10aad9-dfa4-4f2c-b158-b50926babc0a tempest-CreateVolumesFromSnapshotTest-1588006594 None] Lock "cinder-quobyte-ddc82d91-cf82-4d51-a599-1daccca95c55" acquired by "delete_volume" :: waited 0.031s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:37:37 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-09b274e7-da7b-4280-877c-ab18d0b4538b tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:37:37 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-09b274e7-da7b-4280-877c-ab18d0b4538b tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:37:37 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-09b274e7-da7b-4280-877c-ab18d0b4538b tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:37:37 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-09b274e7-da7b-4280-877c-ab18d0b4538b tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:37:37 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-09b274e7-da7b-4280-877c-ab18d0b4538b tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:37:37 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-09b274e7-da7b-4280-877c-ab18d0b4538b tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:37 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[e36260c7-040f-4471-8a65-f4c898782a47]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:37:37 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-2a10aad9-dfa4-4f2c-b158-b50926babc0a tempest-CreateVolumesFromSnapshotTest-1588006594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ddc82d91-cf82-4d51-a599-1daccca95c55 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:37 devstack sudo[106987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:37:37 devstack sudo[106987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:37 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-58323e3e-b262-4092-ac4c-6ee2c991c625 tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Acquiring lock "cinder-07c1933f-b2eb-49fe-8853-d9973fe9c8c8-delete_volume" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:37:37 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-58323e3e-b262-4092-ac4c-6ee2c991c625 tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Lock "cinder-07c1933f-b2eb-49fe-8853-d9973fe9c8c8-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:37:37 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-58323e3e-b262-4092-ac4c-6ee2c991c625 tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Acquiring lock "cinder-quobyte-07c1933f-b2eb-49fe-8853-d9973fe9c8c8" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:37:37 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-58323e3e-b262-4092-ac4c-6ee2c991c625 tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Lock "cinder-quobyte-07c1933f-b2eb-49fe-8853-d9973fe9c8c8" acquired by "delete_volume" :: waited 0.041s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:37:37 devstack sudo[106988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ddc82d91-cf82-4d51-a599-1daccca95c55 Sep 29 18:37:37 devstack sudo[106988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:37 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[dacee029-cb9a-4818-8c76-e98a6f93ca17]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:37:37 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-58323e3e-b262-4092-ac4c-6ee2c991c625 tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-07c1933f-b2eb-49fe-8853-d9973fe9c8c8 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:37 devstack sudo[106991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-07c1933f-b2eb-49fe-8853-d9973fe9c8c8 Sep 29 18:37:37 devstack sudo[106991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:37 devstack sudo[106987]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:37 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-09b274e7-da7b-4280-877c-ab18d0b4538b tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.469s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:37 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-09b274e7-da7b-4280-877c-ab18d0b4538b tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:37:37 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-09b274e7-da7b-4280-877c-ab18d0b4538b tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Deleted volume successfully. Sep 29 18:37:37 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-09b274e7-da7b-4280-877c-ab18d0b4538b tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Lock "cinder-b07b67ac-5b99-4ac3-950a-f61c2340a4ee-delete_volume" released by "delete_volume" :: held 1.707s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:37:37 devstack sudo[106988]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:37 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-2a10aad9-dfa4-4f2c-b158-b50926babc0a tempest-CreateVolumesFromSnapshotTest-1588006594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ddc82d91-cf82-4d51-a599-1daccca95c55" returned: 0 in 0.617s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:37 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-2a10aad9-dfa4-4f2c-b158-b50926babc0a tempest-CreateVolumesFromSnapshotTest-1588006594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ddc82d91-cf82-4d51-a599-1daccca95c55 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:37 devstack sudo[106998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ddc82d91-cf82-4d51-a599-1daccca95c55 Sep 29 18:37:37 devstack sudo[106998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:38 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-e7812cd1-8ea7-426c-9fb8-3da91a22fd63 tempest-ProjectReaderTests-1023282426 None] Acquiring lock "cinder-17b1cc69-23f9-44fc-a771-03783bb63ff9-delete_volume" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:37:38 devstack sudo[106991]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:38 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-58323e3e-b262-4092-ac4c-6ee2c991c625 tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-07c1933f-b2eb-49fe-8853-d9973fe9c8c8" returned: 0 in 0.527s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:38 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-58323e3e-b262-4092-ac4c-6ee2c991c625 tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-07c1933f-b2eb-49fe-8853-d9973fe9c8c8 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:38 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-e7812cd1-8ea7-426c-9fb8-3da91a22fd63 tempest-ProjectReaderTests-1023282426 None] Lock "cinder-17b1cc69-23f9-44fc-a771-03783bb63ff9-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:37:38 devstack sudo[107004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-07c1933f-b2eb-49fe-8853-d9973fe9c8c8 Sep 29 18:37:38 devstack sudo[107004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:38 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-e7812cd1-8ea7-426c-9fb8-3da91a22fd63 tempest-ProjectReaderTests-1023282426 None] Acquiring lock "cinder-quobyte-17b1cc69-23f9-44fc-a771-03783bb63ff9" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:37:38 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-e7812cd1-8ea7-426c-9fb8-3da91a22fd63 tempest-ProjectReaderTests-1023282426 None] Lock "cinder-quobyte-17b1cc69-23f9-44fc-a771-03783bb63ff9" acquired by "delete_volume" :: waited 0.022s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:37:38 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[606d617c-7b0b-4b31-8f7f-dae624d19b5e]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:37:38 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-e7812cd1-8ea7-426c-9fb8-3da91a22fd63 tempest-ProjectReaderTests-1023282426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-17b1cc69-23f9-44fc-a771-03783bb63ff9 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:38 devstack sudo[106998]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:38 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-2a10aad9-dfa4-4f2c-b158-b50926babc0a tempest-CreateVolumesFromSnapshotTest-1588006594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ddc82d91-cf82-4d51-a599-1daccca95c55" returned: 0 in 0.388s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:38 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-2a10aad9-dfa4-4f2c-b158-b50926babc0a tempest-CreateVolumesFromSnapshotTest-1588006594 None] Lock "cinder-quobyte-ddc82d91-cf82-4d51-a599-1daccca95c55" released by "delete_volume" :: held 1.115s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:37:38 devstack sudo[107007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-17b1cc69-23f9-44fc-a771-03783bb63ff9 Sep 29 18:37:38 devstack sudo[107007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:38 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-2a10aad9-dfa4-4f2c-b158-b50926babc0a tempest-CreateVolumesFromSnapshotTest-1588006594 None] Created reservations ['c051a372-1209-4c55-b064-f66271fca8c7', 'eb07ab59-518c-4b91-ac47-ac4cfe7d5dbf', 'f3758e37-f727-4754-a921-e495492f9898', '8afc3000-4a82-4247-aba0-f38542a9dd23'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:37:38 devstack sudo[107004]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:38 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-58323e3e-b262-4092-ac4c-6ee2c991c625 tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-07c1933f-b2eb-49fe-8853-d9973fe9c8c8" returned: 0 in 0.390s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:38 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-58323e3e-b262-4092-ac4c-6ee2c991c625 tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Lock "cinder-quobyte-07c1933f-b2eb-49fe-8853-d9973fe9c8c8" released by "delete_volume" :: held 1.002s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:37:38 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-2a10aad9-dfa4-4f2c-b158-b50926babc0a tempest-CreateVolumesFromSnapshotTest-1588006594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:37:38 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-2a10aad9-dfa4-4f2c-b158-b50926babc0a tempest-CreateVolumesFromSnapshotTest-1588006594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:37:38 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-2a10aad9-dfa4-4f2c-b158-b50926babc0a tempest-CreateVolumesFromSnapshotTest-1588006594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:37:38 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-2a10aad9-dfa4-4f2c-b158-b50926babc0a tempest-CreateVolumesFromSnapshotTest-1588006594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:37:38 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-2a10aad9-dfa4-4f2c-b158-b50926babc0a tempest-CreateVolumesFromSnapshotTest-1588006594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:37:38 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-2a10aad9-dfa4-4f2c-b158-b50926babc0a tempest-CreateVolumesFromSnapshotTest-1588006594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:38 devstack sudo[107010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:37:38 devstack sudo[107010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:38 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-58323e3e-b262-4092-ac4c-6ee2c991c625 tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Created reservations ['e02104f8-a2d6-49c9-85a7-fec738ad2bb3', '3075e836-0cc8-47e4-9bc5-c1dd89cbac41', '21d88177-42ae-4601-8fed-8fa77cbc706b', '786baa31-ea77-4fd1-9516-8d4e0baff1f3'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:37:38 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-58323e3e-b262-4092-ac4c-6ee2c991c625 tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:37:38 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-58323e3e-b262-4092-ac4c-6ee2c991c625 tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:37:38 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-58323e3e-b262-4092-ac4c-6ee2c991c625 tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:37:38 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-58323e3e-b262-4092-ac4c-6ee2c991c625 tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:37:38 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-58323e3e-b262-4092-ac4c-6ee2c991c625 tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:37:38 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-58323e3e-b262-4092-ac4c-6ee2c991c625 tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:38 devstack sudo[107007]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:38 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-e7812cd1-8ea7-426c-9fb8-3da91a22fd63 tempest-ProjectReaderTests-1023282426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-17b1cc69-23f9-44fc-a771-03783bb63ff9" returned: 0 in 0.500s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:38 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-e7812cd1-8ea7-426c-9fb8-3da91a22fd63 tempest-ProjectReaderTests-1023282426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-17b1cc69-23f9-44fc-a771-03783bb63ff9 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:38 devstack sudo[107015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:37:38 devstack sudo[107015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:38 devstack sudo[107017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-17b1cc69-23f9-44fc-a771-03783bb63ff9 Sep 29 18:37:38 devstack sudo[107017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:38 devstack sudo[107010]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:38 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-2a10aad9-dfa4-4f2c-b158-b50926babc0a tempest-CreateVolumesFromSnapshotTest-1588006594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.338s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:38 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-2a10aad9-dfa4-4f2c-b158-b50926babc0a tempest-CreateVolumesFromSnapshotTest-1588006594 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:37:38 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-2a10aad9-dfa4-4f2c-b158-b50926babc0a tempest-CreateVolumesFromSnapshotTest-1588006594 None] Deleted volume successfully. Sep 29 18:37:38 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-2a10aad9-dfa4-4f2c-b158-b50926babc0a tempest-CreateVolumesFromSnapshotTest-1588006594 None] Lock "cinder-ddc82d91-cf82-4d51-a599-1daccca95c55-delete_volume" released by "delete_volume" :: held 1.796s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:37:38 devstack sudo[107015]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:38 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-58323e3e-b262-4092-ac4c-6ee2c991c625 tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.300s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:38 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-58323e3e-b262-4092-ac4c-6ee2c991c625 tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:37:38 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-58323e3e-b262-4092-ac4c-6ee2c991c625 tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Deleted volume successfully. Sep 29 18:37:39 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-58323e3e-b262-4092-ac4c-6ee2c991c625 tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Lock "cinder-07c1933f-b2eb-49fe-8853-d9973fe9c8c8-delete_volume" released by "delete_volume" :: held 1.654s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:37:39 devstack sudo[107017]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:39 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-e7812cd1-8ea7-426c-9fb8-3da91a22fd63 tempest-ProjectReaderTests-1023282426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-17b1cc69-23f9-44fc-a771-03783bb63ff9" returned: 0 in 0.332s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:39 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-e7812cd1-8ea7-426c-9fb8-3da91a22fd63 tempest-ProjectReaderTests-1023282426 None] Lock "cinder-quobyte-17b1cc69-23f9-44fc-a771-03783bb63ff9" released by "delete_volume" :: held 0.895s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:37:39 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-e7812cd1-8ea7-426c-9fb8-3da91a22fd63 tempest-ProjectReaderTests-1023282426 None] Created reservations ['9198879d-659a-455a-803e-157cdc53e01d', '468386b1-0482-4777-8d86-681b4796311d', '86bc5343-bd59-43af-8106-9bbbbfa9eef4', '59c1db06-c28b-4290-b2fd-293632c38826'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:37:39 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-e7812cd1-8ea7-426c-9fb8-3da91a22fd63 tempest-ProjectReaderTests-1023282426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:37:39 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-e7812cd1-8ea7-426c-9fb8-3da91a22fd63 tempest-ProjectReaderTests-1023282426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:37:39 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-e7812cd1-8ea7-426c-9fb8-3da91a22fd63 tempest-ProjectReaderTests-1023282426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:37:39 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-e7812cd1-8ea7-426c-9fb8-3da91a22fd63 tempest-ProjectReaderTests-1023282426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:37:39 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-e7812cd1-8ea7-426c-9fb8-3da91a22fd63 tempest-ProjectReaderTests-1023282426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:37:39 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-e7812cd1-8ea7-426c-9fb8-3da91a22fd63 tempest-ProjectReaderTests-1023282426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:39 devstack sudo[107022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:37:39 devstack sudo[107022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:39 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-0a0c8dbd-d843-47c3-8623-7e2d68cd8261 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Acquiring lock "cinder-eb6b937d-f605-42c6-8f1e-367b36ed8742-delete_volume" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:37:39 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-0a0c8dbd-d843-47c3-8623-7e2d68cd8261 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Lock "cinder-eb6b937d-f605-42c6-8f1e-367b36ed8742-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:37:39 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-0a0c8dbd-d843-47c3-8623-7e2d68cd8261 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Acquiring lock "cinder-quobyte-eb6b937d-f605-42c6-8f1e-367b36ed8742" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:37:39 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-0a0c8dbd-d843-47c3-8623-7e2d68cd8261 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Lock "cinder-quobyte-eb6b937d-f605-42c6-8f1e-367b36ed8742" acquired by "delete_volume" :: waited 0.030s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:37:39 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[45e82c60-9b27-4579-b649-205e67d48407]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:37:39 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-0a0c8dbd-d843-47c3-8623-7e2d68cd8261 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-eb6b937d-f605-42c6-8f1e-367b36ed8742 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:39 devstack sudo[107022]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:39 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-e7812cd1-8ea7-426c-9fb8-3da91a22fd63 tempest-ProjectReaderTests-1023282426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.333s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:39 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-e7812cd1-8ea7-426c-9fb8-3da91a22fd63 tempest-ProjectReaderTests-1023282426 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:37:39 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-e7812cd1-8ea7-426c-9fb8-3da91a22fd63 tempest-ProjectReaderTests-1023282426 None] Deleted volume successfully. Sep 29 18:37:39 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-e7812cd1-8ea7-426c-9fb8-3da91a22fd63 tempest-ProjectReaderTests-1023282426 None] Lock "cinder-17b1cc69-23f9-44fc-a771-03783bb63ff9-delete_volume" released by "delete_volume" :: held 1.494s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:37:39 devstack sudo[107025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-eb6b937d-f605-42c6-8f1e-367b36ed8742 Sep 29 18:37:39 devstack sudo[107025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:39 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-908bd123-b469-44ff-bac9-ca758d0252fd tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Acquiring lock "cinder-5365de71-4e85-4c9d-9085-556cf1750bf5-delete_volume" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:37:39 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-908bd123-b469-44ff-bac9-ca758d0252fd tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Lock "cinder-5365de71-4e85-4c9d-9085-556cf1750bf5-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:37:39 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-908bd123-b469-44ff-bac9-ca758d0252fd tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Acquiring lock "cinder-quobyte-5365de71-4e85-4c9d-9085-556cf1750bf5" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:37:39 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-908bd123-b469-44ff-bac9-ca758d0252fd tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Lock "cinder-quobyte-5365de71-4e85-4c9d-9085-556cf1750bf5" acquired by "delete_volume" :: waited 0.023s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:37:39 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d7b29e3-a160-47ea-9dd1-41006b4f3b9f]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:37:39 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-908bd123-b469-44ff-bac9-ca758d0252fd tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-5365de71-4e85-4c9d-9085-556cf1750bf5 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:39 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-e199c65c-be5d-464e-b625-fd49cad08069 tempest-ProjectReaderTests-1023282426 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86512) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:37:39 devstack sudo[107025]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:40 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-e199c65c-be5d-464e-b625-fd49cad08069 tempest-ProjectReaderTests-1023282426 None] Flow 'volume_create_manager' (d45292ce-638a-4cb9-92f5-660f5c768708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:37:40 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-e199c65c-be5d-464e-b625-fd49cad08069 tempest-ProjectReaderTests-1023282426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfcf251c-f4a8-4c87-a270-ccb7771376e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:40 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-0a0c8dbd-d843-47c3-8623-7e2d68cd8261 tempest-CreateVolumesFromSnapshotTest-1588006594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-eb6b937d-f605-42c6-8f1e-367b36ed8742" returned: 0 in 0.516s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:40 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-0a0c8dbd-d843-47c3-8623-7e2d68cd8261 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-eb6b937d-f605-42c6-8f1e-367b36ed8742 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:40 devstack sudo[107029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-5365de71-4e85-4c9d-9085-556cf1750bf5 Sep 29 18:37:40 devstack sudo[107029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:40 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-e199c65c-be5d-464e-b625-fd49cad08069 tempest-ProjectReaderTests-1023282426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfcf251c-f4a8-4c87-a270-ccb7771376e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:37:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1864352722',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1acb0a44-15ea-4f8c-8a0e-991f41272891,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c6583dad59442f381d38f8f0383dc2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:37:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:37:40Z,use_quota=True,user_id='ef7764e50a99455faed61f3e9a1ca584',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:40 devstack sudo[107031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-eb6b937d-f605-42c6-8f1e-367b36ed8742 Sep 29 18:37:40 devstack sudo[107031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:40 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-e199c65c-be5d-464e-b625-fd49cad08069 tempest-ProjectReaderTests-1023282426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1657c181-07c1-435d-9d7c-048b47bd3888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:40 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-e199c65c-be5d-464e-b625-fd49cad08069 tempest-ProjectReaderTests-1023282426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1657c181-07c1-435d-9d7c-048b47bd3888) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:40 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-e199c65c-be5d-464e-b625-fd49cad08069 tempest-ProjectReaderTests-1023282426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5fd0327-dcff-40b9-8325-d00ff7adfcd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:40 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-e199c65c-be5d-464e-b625-fd49cad08069 tempest-ProjectReaderTests-1023282426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5fd0327-dcff-40b9-8325-d00ff7adfcd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1acb0a44-15ea-4f8c-8a0e-991f41272891', 'volume_name': 'volume-1acb0a44-15ea-4f8c-8a0e-991f41272891', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:40 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-e199c65c-be5d-464e-b625-fd49cad08069 tempest-ProjectReaderTests-1023282426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (280de58d-cc0f-4d45-a385-1dbd64c38083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:40 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-e199c65c-be5d-464e-b625-fd49cad08069 tempest-ProjectReaderTests-1023282426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (280de58d-cc0f-4d45-a385-1dbd64c38083) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:40 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-e199c65c-be5d-464e-b625-fd49cad08069 tempest-ProjectReaderTests-1023282426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dbd9e31-7470-4474-a69b-068c838a7532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:40 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-e199c65c-be5d-464e-b625-fd49cad08069 tempest-ProjectReaderTests-1023282426 None] Volume 1acb0a44-15ea-4f8c-8a0e-991f41272891: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1acb0a44-15ea-4f8c-8a0e-991f41272891', 'volume_size': 1} Sep 29 18:37:40 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-e199c65c-be5d-464e-b625-fd49cad08069 tempest-ProjectReaderTests-1023282426 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:37:40 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-e199c65c-be5d-464e-b625-fd49cad08069 tempest-ProjectReaderTests-1023282426 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:37:40 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-e199c65c-be5d-464e-b625-fd49cad08069 tempest-ProjectReaderTests-1023282426 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:37:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1864352722',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1acb0a44-15ea-4f8c-8a0e-991f41272891,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c6583dad59442f381d38f8f0383dc2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:37:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:37:40Z,use_quota=True,user_id='ef7764e50a99455faed61f3e9a1ca584',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)}" {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:37:40 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-e199c65c-be5d-464e-b625-fd49cad08069 tempest-ProjectReaderTests-1023282426 None] Creating volume 1acb0a44-15ea-4f8c-8a0e-991f41272891 {{(pid=86512) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:37:40 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-e199c65c-be5d-464e-b625-fd49cad08069 tempest-ProjectReaderTests-1023282426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:37:40 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-e199c65c-be5d-464e-b625-fd49cad08069 tempest-ProjectReaderTests-1023282426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:37:40 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-e199c65c-be5d-464e-b625-fd49cad08069 tempest-ProjectReaderTests-1023282426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:37:40 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-e199c65c-be5d-464e-b625-fd49cad08069 tempest-ProjectReaderTests-1023282426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:37:40 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-e199c65c-be5d-464e-b625-fd49cad08069 tempest-ProjectReaderTests-1023282426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:37:40 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-e199c65c-be5d-464e-b625-fd49cad08069 tempest-ProjectReaderTests-1023282426 None] Selected osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 as target Quobyte volume. {{(pid=86512) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:37:40 devstack cinder-volume[86512]: INFO cinder.volume.drivers.remotefs [None req-e199c65c-be5d-464e-b625-fd49cad08069 tempest-ProjectReaderTests-1023282426 None] casted to osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 Sep 29 18:37:40 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-e199c65c-be5d-464e-b625-fd49cad08069 tempest-ProjectReaderTests-1023282426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-1acb0a44-15ea-4f8c-8a0e-991f41272891 1073741824 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:40 devstack sudo[107034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-1acb0a44-15ea-4f8c-8a0e-991f41272891 1073741824 Sep 29 18:37:40 devstack sudo[107034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:40 devstack sudo[107029]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:40 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-908bd123-b469-44ff-bac9-ca758d0252fd tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-5365de71-4e85-4c9d-9085-556cf1750bf5" returned: 0 in 0.478s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:40 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-908bd123-b469-44ff-bac9-ca758d0252fd tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-5365de71-4e85-4c9d-9085-556cf1750bf5 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:40 devstack sudo[107040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-5365de71-4e85-4c9d-9085-556cf1750bf5 Sep 29 18:37:40 devstack sudo[107040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:40 devstack sudo[107031]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:40 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-0a0c8dbd-d843-47c3-8623-7e2d68cd8261 tempest-CreateVolumesFromSnapshotTest-1588006594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-eb6b937d-f605-42c6-8f1e-367b36ed8742" returned: 0 in 0.373s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:40 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-0a0c8dbd-d843-47c3-8623-7e2d68cd8261 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Lock "cinder-quobyte-eb6b937d-f605-42c6-8f1e-367b36ed8742" released by "delete_volume" :: held 0.957s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:37:40 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-0a0c8dbd-d843-47c3-8623-7e2d68cd8261 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Created reservations ['5c452419-fbfb-489a-b1c5-3b411c8cca10', '6557e280-360c-4c79-9994-64656ec22705', 'b212d5d0-f7a6-4f8f-ada8-7019b7b3972d', '4e4b9710-7bdb-4919-b352-e1c728b7944b'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:37:40 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-0a0c8dbd-d843-47c3-8623-7e2d68cd8261 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:37:40 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-0a0c8dbd-d843-47c3-8623-7e2d68cd8261 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:37:40 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-0a0c8dbd-d843-47c3-8623-7e2d68cd8261 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:37:40 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-0a0c8dbd-d843-47c3-8623-7e2d68cd8261 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:37:40 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-0a0c8dbd-d843-47c3-8623-7e2d68cd8261 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:37:40 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-0a0c8dbd-d843-47c3-8623-7e2d68cd8261 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:40 devstack sudo[107046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:37:40 devstack sudo[107046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:40 devstack sudo[107040]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:40 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-908bd123-b469-44ff-bac9-ca758d0252fd tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-5365de71-4e85-4c9d-9085-556cf1750bf5" returned: 0 in 0.346s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:40 devstack sudo[107034]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:40 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-e199c65c-be5d-464e-b625-fd49cad08069 tempest-ProjectReaderTests-1023282426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-1acb0a44-15ea-4f8c-8a0e-991f41272891 1073741824" returned: 0 in 0.612s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:40 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-908bd123-b469-44ff-bac9-ca758d0252fd tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Lock "cinder-quobyte-5365de71-4e85-4c9d-9085-556cf1750bf5" released by "delete_volume" :: held 0.898s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:37:40 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-ade17714-8100-47cf-8bb6-b3e1dbbe6974 tempest-CreateVolumesFromImageTest-1271613264 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86512) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:37:40 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-ade17714-8100-47cf-8bb6-b3e1dbbe6974 tempest-CreateVolumesFromImageTest-1271613264 None] Flow 'volume_create_manager' (57c687d1-4b27-4406-a1fc-58eb0e861214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:37:40 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-ade17714-8100-47cf-8bb6-b3e1dbbe6974 tempest-CreateVolumesFromImageTest-1271613264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c6c752f-34f1-423d-b891-b634d73158b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:40 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-e199c65c-be5d-464e-b625-fd49cad08069 tempest-ProjectReaderTests-1023282426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-1acb0a44-15ea-4f8c-8a0e-991f41272891 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:40 devstack sudo[107049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-1acb0a44-15ea-4f8c-8a0e-991f41272891 Sep 29 18:37:40 devstack sudo[107049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:40 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-ade17714-8100-47cf-8bb6-b3e1dbbe6974 tempest-CreateVolumesFromImageTest-1271613264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c6c752f-34f1-423d-b891-b634d73158b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:37:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1961337498',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a190b87-66d4-41b0-89b2-40f0c885e6d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50881b31ef19484ba102ee051d48ecc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:37:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:37:41Z,use_quota=True,user_id='b44cbc2a272e452882c5a3c200e3dabf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:40 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-ade17714-8100-47cf-8bb6-b3e1dbbe6974 tempest-CreateVolumesFromImageTest-1271613264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64bae366-1230-4656-8f20-47f5a5dc8b03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:40 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-ade17714-8100-47cf-8bb6-b3e1dbbe6974 tempest-CreateVolumesFromImageTest-1271613264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64bae366-1230-4656-8f20-47f5a5dc8b03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:40 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-ade17714-8100-47cf-8bb6-b3e1dbbe6974 tempest-CreateVolumesFromImageTest-1271613264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4561b630-07e1-4135-827d-4cdfe142f2f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:40 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-ade17714-8100-47cf-8bb6-b3e1dbbe6974 tempest-CreateVolumesFromImageTest-1271613264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4561b630-07e1-4135-827d-4cdfe142f2f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a190b87-66d4-41b0-89b2-40f0c885e6d9', 'volume_name': 'volume-4a190b87-66d4-41b0-89b2-40f0c885e6d9', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:40 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-ade17714-8100-47cf-8bb6-b3e1dbbe6974 tempest-CreateVolumesFromImageTest-1271613264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d32a21c4-d690-46ea-8130-6b7c589228ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:40 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-ade17714-8100-47cf-8bb6-b3e1dbbe6974 tempest-CreateVolumesFromImageTest-1271613264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d32a21c4-d690-46ea-8130-6b7c589228ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:40 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-ade17714-8100-47cf-8bb6-b3e1dbbe6974 tempest-CreateVolumesFromImageTest-1271613264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e04aed0-24b1-42e4-8f10-eec6e82a3aa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:40 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-ade17714-8100-47cf-8bb6-b3e1dbbe6974 tempest-CreateVolumesFromImageTest-1271613264 None] Volume 4a190b87-66d4-41b0-89b2-40f0c885e6d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a190b87-66d4-41b0-89b2-40f0c885e6d9', 'volume_size': 1} Sep 29 18:37:40 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-ade17714-8100-47cf-8bb6-b3e1dbbe6974 tempest-CreateVolumesFromImageTest-1271613264 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:37:41 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-908bd123-b469-44ff-bac9-ca758d0252fd tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Created reservations ['4e942cd8-3aca-42df-a8eb-8dd821e85fca', 'd52994d2-41a4-4bb7-ad97-2ee378f8d965', 'e73d9dea-d6fd-405d-9324-f225b9c9b745', '4de87315-1724-4834-9a0d-0c91ac8d1ea7'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:37:41 devstack sudo[107046]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:41 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-0a0c8dbd-d843-47c3-8623-7e2d68cd8261 tempest-CreateVolumesFromSnapshotTest-1588006594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.428s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:41 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-0a0c8dbd-d843-47c3-8623-7e2d68cd8261 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:37:41 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-0a0c8dbd-d843-47c3-8623-7e2d68cd8261 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Deleted volume successfully. Sep 29 18:37:41 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-0a0c8dbd-d843-47c3-8623-7e2d68cd8261 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Lock "cinder-eb6b937d-f605-42c6-8f1e-367b36ed8742-delete_volume" released by "delete_volume" :: held 1.699s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:37:41 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-908bd123-b469-44ff-bac9-ca758d0252fd tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:37:41 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-908bd123-b469-44ff-bac9-ca758d0252fd tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:37:41 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-908bd123-b469-44ff-bac9-ca758d0252fd tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:37:41 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-908bd123-b469-44ff-bac9-ca758d0252fd tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:37:41 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-908bd123-b469-44ff-bac9-ca758d0252fd tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:37:41 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-908bd123-b469-44ff-bac9-ca758d0252fd tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:41 devstack sudo[107053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:37:41 devstack sudo[107053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:41 devstack sudo[107049]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:41 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-e199c65c-be5d-464e-b625-fd49cad08069 tempest-ProjectReaderTests-1023282426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-1acb0a44-15ea-4f8c-8a0e-991f41272891" returned: 0 in 0.458s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:41 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-e199c65c-be5d-464e-b625-fd49cad08069 tempest-ProjectReaderTests-1023282426 None] <== create_volume: return (1220ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'} {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:37:41 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-e199c65c-be5d-464e-b625-fd49cad08069 tempest-ProjectReaderTests-1023282426 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.223s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:37:41 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-ade17714-8100-47cf-8bb6-b3e1dbbe6974 tempest-CreateVolumesFromImageTest-1271613264 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.365s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:37:41 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-ade17714-8100-47cf-8bb6-b3e1dbbe6974 tempest-CreateVolumesFromImageTest-1271613264 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:37:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1961337498',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a190b87-66d4-41b0-89b2-40f0c885e6d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50881b31ef19484ba102ee051d48ecc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:37:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:37:41Z,use_quota=True,user_id='b44cbc2a272e452882c5a3c200e3dabf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)}" {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:37:41 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-ade17714-8100-47cf-8bb6-b3e1dbbe6974 tempest-CreateVolumesFromImageTest-1271613264 None] Creating volume 4a190b87-66d4-41b0-89b2-40f0c885e6d9 {{(pid=86512) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:37:41 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-ade17714-8100-47cf-8bb6-b3e1dbbe6974 tempest-CreateVolumesFromImageTest-1271613264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:37:41 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-ade17714-8100-47cf-8bb6-b3e1dbbe6974 tempest-CreateVolumesFromImageTest-1271613264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:37:41 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-ade17714-8100-47cf-8bb6-b3e1dbbe6974 tempest-CreateVolumesFromImageTest-1271613264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:37:41 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-ade17714-8100-47cf-8bb6-b3e1dbbe6974 tempest-CreateVolumesFromImageTest-1271613264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:37:41 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-ade17714-8100-47cf-8bb6-b3e1dbbe6974 tempest-CreateVolumesFromImageTest-1271613264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:37:41 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-ade17714-8100-47cf-8bb6-b3e1dbbe6974 tempest-CreateVolumesFromImageTest-1271613264 None] Selected osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 as target Quobyte volume. {{(pid=86512) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:37:41 devstack cinder-volume[86512]: INFO cinder.volume.drivers.remotefs [None req-ade17714-8100-47cf-8bb6-b3e1dbbe6974 tempest-CreateVolumesFromImageTest-1271613264 None] casted to osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 Sep 29 18:37:41 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-ade17714-8100-47cf-8bb6-b3e1dbbe6974 tempest-CreateVolumesFromImageTest-1271613264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-4a190b87-66d4-41b0-89b2-40f0c885e6d9 1073741824 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:41 devstack sudo[107057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-4a190b87-66d4-41b0-89b2-40f0c885e6d9 1073741824 Sep 29 18:37:41 devstack sudo[107057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:41 devstack sudo[107053]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:41 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-e199c65c-be5d-464e-b625-fd49cad08069 tempest-ProjectReaderTests-1023282426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dbd9e31-7470-4474-a69b-068c838a7532) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1acb0a44-15ea-4f8c-8a0e-991f41272891', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:41 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-e199c65c-be5d-464e-b625-fd49cad08069 tempest-ProjectReaderTests-1023282426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af5492ac-a0c3-40be-8076-690e636bab1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:41 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-908bd123-b469-44ff-bac9-ca758d0252fd tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.294s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:41 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-908bd123-b469-44ff-bac9-ca758d0252fd tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:37:41 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-908bd123-b469-44ff-bac9-ca758d0252fd tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Deleted volume successfully. Sep 29 18:37:41 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-e199c65c-be5d-464e-b625-fd49cad08069 tempest-ProjectReaderTests-1023282426 None] Volume volume-1acb0a44-15ea-4f8c-8a0e-991f41272891 (1acb0a44-15ea-4f8c-8a0e-991f41272891): created successfully Sep 29 18:37:41 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-e199c65c-be5d-464e-b625-fd49cad08069 tempest-ProjectReaderTests-1023282426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af5492ac-a0c3-40be-8076-690e636bab1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:41 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-e199c65c-be5d-464e-b625-fd49cad08069 tempest-ProjectReaderTests-1023282426 None] Flow 'volume_create_manager' (d45292ce-638a-4cb9-92f5-660f5c768708) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:37:41 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a08d3ce-cf50-4821-b934-44af35443cf0 tempest-CreateVolumesFromImageTest-1271613264 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86512) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:37:41 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-4a08d3ce-cf50-4821-b934-44af35443cf0 tempest-CreateVolumesFromImageTest-1271613264 None] Flow 'volume_create_manager' (84df1c98-1883-407f-b6cb-698c199995dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:37:41 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-4a08d3ce-cf50-4821-b934-44af35443cf0 tempest-CreateVolumesFromImageTest-1271613264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92402cc2-368b-4afb-9d8f-f45139794dac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:41 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-908bd123-b469-44ff-bac9-ca758d0252fd tempest-CreateVolumesFromSourceVolumeTest-1823813559 None] Lock "cinder-5365de71-4e85-4c9d-9085-556cf1750bf5-delete_volume" released by "delete_volume" :: held 1.781s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:37:41 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-e199c65c-be5d-464e-b625-fd49cad08069 tempest-ProjectReaderTests-1023282426 None] Created volume successfully. Sep 29 18:37:41 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-4a08d3ce-cf50-4821-b934-44af35443cf0 tempest-CreateVolumesFromImageTest-1271613264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92402cc2-368b-4afb-9d8f-f45139794dac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:37:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-674065089',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a50906f-ace1-4069-a798-715d2d278732,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50881b31ef19484ba102ee051d48ecc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:37:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:37:41Z,use_quota=True,user_id='b44cbc2a272e452882c5a3c200e3dabf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:41 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-4a08d3ce-cf50-4821-b934-44af35443cf0 tempest-CreateVolumesFromImageTest-1271613264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6da2b5de-f83b-47db-bef1-5c35cc309065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:41 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-4a08d3ce-cf50-4821-b934-44af35443cf0 tempest-CreateVolumesFromImageTest-1271613264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6da2b5de-f83b-47db-bef1-5c35cc309065) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:41 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-4a08d3ce-cf50-4821-b934-44af35443cf0 tempest-CreateVolumesFromImageTest-1271613264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cc55801-99c5-48fe-b7ca-e64e6e0b4a73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:41 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-4a08d3ce-cf50-4821-b934-44af35443cf0 tempest-CreateVolumesFromImageTest-1271613264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cc55801-99c5-48fe-b7ca-e64e6e0b4a73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a50906f-ace1-4069-a798-715d2d278732', 'volume_name': 'volume-9a50906f-ace1-4069-a798-715d2d278732', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:41 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-4a08d3ce-cf50-4821-b934-44af35443cf0 tempest-CreateVolumesFromImageTest-1271613264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c58a9a7-6bf7-4fb3-bccf-91be0b226260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:41 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-4a08d3ce-cf50-4821-b934-44af35443cf0 tempest-CreateVolumesFromImageTest-1271613264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c58a9a7-6bf7-4fb3-bccf-91be0b226260) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:41 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-4a08d3ce-cf50-4821-b934-44af35443cf0 tempest-CreateVolumesFromImageTest-1271613264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff5ddd5a-7771-486e-b130-35fbe2761992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:41 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-4a08d3ce-cf50-4821-b934-44af35443cf0 tempest-CreateVolumesFromImageTest-1271613264 None] Volume 9a50906f-ace1-4069-a798-715d2d278732: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a50906f-ace1-4069-a798-715d2d278732', 'volume_size': 1} Sep 29 18:37:41 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-4a08d3ce-cf50-4821-b934-44af35443cf0 tempest-CreateVolumesFromImageTest-1271613264 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:37:41 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-63e30da8-0388-4900-acd1-fe12648f2eca tempest-CreateVolumesFromSnapshotTest-1588006594 None] Acquiring lock "cinder-107e339e-b09b-4db3-ac1f-735aae8a80a4-delete_volume" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:37:41 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-63e30da8-0388-4900-acd1-fe12648f2eca tempest-CreateVolumesFromSnapshotTest-1588006594 None] Lock "cinder-107e339e-b09b-4db3-ac1f-735aae8a80a4-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:37:41 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-63e30da8-0388-4900-acd1-fe12648f2eca tempest-CreateVolumesFromSnapshotTest-1588006594 None] Acquiring lock "cinder-quobyte-107e339e-b09b-4db3-ac1f-735aae8a80a4" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:37:41 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-63e30da8-0388-4900-acd1-fe12648f2eca tempest-CreateVolumesFromSnapshotTest-1588006594 None] Lock "cinder-quobyte-107e339e-b09b-4db3-ac1f-735aae8a80a4" acquired by "delete_volume" :: waited 0.028s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:37:41 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea4b999a-7761-47a4-906f-c74c0baa93d2]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:37:41 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-63e30da8-0388-4900-acd1-fe12648f2eca tempest-CreateVolumesFromSnapshotTest-1588006594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-107e339e-b09b-4db3-ac1f-735aae8a80a4 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:41 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-114b3a7e-1d65-4b18-8641-272810513a3d tempest-CreateVolumesFromImageTest-1271613264 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86512) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:37:42 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-114b3a7e-1d65-4b18-8641-272810513a3d tempest-CreateVolumesFromImageTest-1271613264 None] Flow 'volume_create_manager' (f1ca9866-5a48-4f5d-8323-88b3292af4e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:37:42 devstack sudo[107057]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:42 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-114b3a7e-1d65-4b18-8641-272810513a3d tempest-CreateVolumesFromImageTest-1271613264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af8d6429-5aa0-4da2-a197-1e0a0516cc15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:42 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-ade17714-8100-47cf-8bb6-b3e1dbbe6974 tempest-CreateVolumesFromImageTest-1271613264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-4a190b87-66d4-41b0-89b2-40f0c885e6d9 1073741824" returned: 0 in 0.689s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:42 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-114b3a7e-1d65-4b18-8641-272810513a3d tempest-CreateVolumesFromImageTest-1271613264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af8d6429-5aa0-4da2-a197-1e0a0516cc15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:37:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2029135519',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f91f1de-ec81-4594-b974-e6e8c81d6e28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50881b31ef19484ba102ee051d48ecc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:37:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:37:42Z,use_quota=True,user_id='b44cbc2a272e452882c5a3c200e3dabf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:42 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-114b3a7e-1d65-4b18-8641-272810513a3d tempest-CreateVolumesFromImageTest-1271613264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecd96673-7a06-4558-ae1d-c996304324cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:42 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-114b3a7e-1d65-4b18-8641-272810513a3d tempest-CreateVolumesFromImageTest-1271613264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecd96673-7a06-4558-ae1d-c996304324cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:42 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-114b3a7e-1d65-4b18-8641-272810513a3d tempest-CreateVolumesFromImageTest-1271613264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aeba326f-fe23-4449-a40a-e372995d2e1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:42 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-114b3a7e-1d65-4b18-8641-272810513a3d tempest-CreateVolumesFromImageTest-1271613264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aeba326f-fe23-4449-a40a-e372995d2e1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f91f1de-ec81-4594-b974-e6e8c81d6e28', 'volume_name': 'volume-0f91f1de-ec81-4594-b974-e6e8c81d6e28', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:42 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-114b3a7e-1d65-4b18-8641-272810513a3d tempest-CreateVolumesFromImageTest-1271613264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57f015ad-41a2-484b-9247-129626eb46ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:42 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-114b3a7e-1d65-4b18-8641-272810513a3d tempest-CreateVolumesFromImageTest-1271613264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57f015ad-41a2-484b-9247-129626eb46ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:42 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-114b3a7e-1d65-4b18-8641-272810513a3d tempest-CreateVolumesFromImageTest-1271613264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c19d28b9-94a5-40bd-a632-86d356103204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:42 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-114b3a7e-1d65-4b18-8641-272810513a3d tempest-CreateVolumesFromImageTest-1271613264 None] Volume 0f91f1de-ec81-4594-b974-e6e8c81d6e28: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f91f1de-ec81-4594-b974-e6e8c81d6e28', 'volume_size': 1} Sep 29 18:37:42 devstack sudo[107063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-107e339e-b09b-4db3-ac1f-735aae8a80a4 Sep 29 18:37:42 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-114b3a7e-1d65-4b18-8641-272810513a3d tempest-CreateVolumesFromImageTest-1271613264 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:37:42 devstack sudo[107063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:42 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-ade17714-8100-47cf-8bb6-b3e1dbbe6974 tempest-CreateVolumesFromImageTest-1271613264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-4a190b87-66d4-41b0-89b2-40f0c885e6d9 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:42 devstack sudo[107065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-4a190b87-66d4-41b0-89b2-40f0c885e6d9 Sep 29 18:37:42 devstack sudo[107065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:42 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-f33df52e-adfa-4d66-981e-5e25105414ff tempest-ProjectReaderTests-1023282426 None] Acquiring lock "cinder-1acb0a44-15ea-4f8c-8a0e-991f41272891-delete_volume" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:37:42 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-f33df52e-adfa-4d66-981e-5e25105414ff tempest-ProjectReaderTests-1023282426 None] Lock "cinder-1acb0a44-15ea-4f8c-8a0e-991f41272891-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:37:42 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-f33df52e-adfa-4d66-981e-5e25105414ff tempest-ProjectReaderTests-1023282426 None] Acquiring lock "cinder-quobyte-1acb0a44-15ea-4f8c-8a0e-991f41272891" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:37:42 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-f33df52e-adfa-4d66-981e-5e25105414ff tempest-ProjectReaderTests-1023282426 None] Lock "cinder-quobyte-1acb0a44-15ea-4f8c-8a0e-991f41272891" acquired by "delete_volume" :: waited 0.046s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:37:42 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[569860cc-cd7a-43a2-90d1-a61e10eaea55]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:37:42 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-f33df52e-adfa-4d66-981e-5e25105414ff tempest-ProjectReaderTests-1023282426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-1acb0a44-15ea-4f8c-8a0e-991f41272891 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:42 devstack sudo[107063]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:42 devstack sudo[107065]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:42 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-63e30da8-0388-4900-acd1-fe12648f2eca tempest-CreateVolumesFromSnapshotTest-1588006594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-107e339e-b09b-4db3-ac1f-735aae8a80a4" returned: 0 in 0.665s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:42 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-63e30da8-0388-4900-acd1-fe12648f2eca tempest-CreateVolumesFromSnapshotTest-1588006594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-107e339e-b09b-4db3-ac1f-735aae8a80a4 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:42 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-ade17714-8100-47cf-8bb6-b3e1dbbe6974 tempest-CreateVolumesFromImageTest-1271613264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-4a190b87-66d4-41b0-89b2-40f0c885e6d9" returned: 0 in 0.359s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:42 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-ade17714-8100-47cf-8bb6-b3e1dbbe6974 tempest-CreateVolumesFromImageTest-1271613264 None] <== create_volume: return (1184ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'} {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:37:42 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-ade17714-8100-47cf-8bb6-b3e1dbbe6974 tempest-CreateVolumesFromImageTest-1271613264 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.191s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:37:42 devstack sudo[107072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-107e339e-b09b-4db3-ac1f-735aae8a80a4 Sep 29 18:37:42 devstack sudo[107072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:42 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-4a08d3ce-cf50-4821-b934-44af35443cf0 tempest-CreateVolumesFromImageTest-1271613264 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.950s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:37:42 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-4a08d3ce-cf50-4821-b934-44af35443cf0 tempest-CreateVolumesFromImageTest-1271613264 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:37:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-674065089',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a50906f-ace1-4069-a798-715d2d278732,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50881b31ef19484ba102ee051d48ecc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:37:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:37:41Z,use_quota=True,user_id='b44cbc2a272e452882c5a3c200e3dabf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)}" {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:37:42 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-4a08d3ce-cf50-4821-b934-44af35443cf0 tempest-CreateVolumesFromImageTest-1271613264 None] Creating volume 9a50906f-ace1-4069-a798-715d2d278732 {{(pid=86512) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:37:42 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-4a08d3ce-cf50-4821-b934-44af35443cf0 tempest-CreateVolumesFromImageTest-1271613264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:37:42 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-4a08d3ce-cf50-4821-b934-44af35443cf0 tempest-CreateVolumesFromImageTest-1271613264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:37:42 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-4a08d3ce-cf50-4821-b934-44af35443cf0 tempest-CreateVolumesFromImageTest-1271613264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:37:42 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-4a08d3ce-cf50-4821-b934-44af35443cf0 tempest-CreateVolumesFromImageTest-1271613264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:37:42 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-4a08d3ce-cf50-4821-b934-44af35443cf0 tempest-CreateVolumesFromImageTest-1271613264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:37:42 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-4a08d3ce-cf50-4821-b934-44af35443cf0 tempest-CreateVolumesFromImageTest-1271613264 None] Selected osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 as target Quobyte volume. {{(pid=86512) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:37:42 devstack cinder-volume[86512]: INFO cinder.volume.drivers.remotefs [None req-4a08d3ce-cf50-4821-b934-44af35443cf0 tempest-CreateVolumesFromImageTest-1271613264 None] casted to osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 Sep 29 18:37:42 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-4a08d3ce-cf50-4821-b934-44af35443cf0 tempest-CreateVolumesFromImageTest-1271613264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-9a50906f-ace1-4069-a798-715d2d278732 1073741824 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:42 devstack sudo[107070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-1acb0a44-15ea-4f8c-8a0e-991f41272891 Sep 29 18:37:42 devstack sudo[107070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:42 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-ade17714-8100-47cf-8bb6-b3e1dbbe6974 tempest-CreateVolumesFromImageTest-1271613264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e04aed0-24b1-42e4-8f10-eec6e82a3aa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a190b87-66d4-41b0-89b2-40f0c885e6d9', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:42 devstack sudo[107074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-9a50906f-ace1-4069-a798-715d2d278732 1073741824 Sep 29 18:37:42 devstack sudo[107074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:42 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-ade17714-8100-47cf-8bb6-b3e1dbbe6974 tempest-CreateVolumesFromImageTest-1271613264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50c9f9a4-7109-42af-be3b-1da903670e73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:42 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c792aa3-b66c-4b92-a281-18d5d584df6d tempest-CreateVolumesFromImageTest-1271613264 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86512) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:37:42 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-5c792aa3-b66c-4b92-a281-18d5d584df6d tempest-CreateVolumesFromImageTest-1271613264 None] Flow 'volume_create_manager' (57256cf8-5a4b-4c6e-8855-0e85ff3a499e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:37:42 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-5c792aa3-b66c-4b92-a281-18d5d584df6d tempest-CreateVolumesFromImageTest-1271613264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d08d971-1d46-4e1b-9bc3-5d7194ce9526) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:42 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-ade17714-8100-47cf-8bb6-b3e1dbbe6974 tempest-CreateVolumesFromImageTest-1271613264 None] Volume volume-4a190b87-66d4-41b0-89b2-40f0c885e6d9 (4a190b87-66d4-41b0-89b2-40f0c885e6d9): created successfully Sep 29 18:37:42 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-ade17714-8100-47cf-8bb6-b3e1dbbe6974 tempest-CreateVolumesFromImageTest-1271613264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50c9f9a4-7109-42af-be3b-1da903670e73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:42 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-ade17714-8100-47cf-8bb6-b3e1dbbe6974 tempest-CreateVolumesFromImageTest-1271613264 None] Flow 'volume_create_manager' (57c687d1-4b27-4406-a1fc-58eb0e861214) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:37:42 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-5c792aa3-b66c-4b92-a281-18d5d584df6d tempest-CreateVolumesFromImageTest-1271613264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d08d971-1d46-4e1b-9bc3-5d7194ce9526) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:37:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-571194437',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1777b34b-57ec-41c3-b0ff-918d1a3280f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50881b31ef19484ba102ee051d48ecc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:37:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:37:42Z,use_quota=True,user_id='b44cbc2a272e452882c5a3c200e3dabf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:42 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-5c792aa3-b66c-4b92-a281-18d5d584df6d tempest-CreateVolumesFromImageTest-1271613264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3db51cca-855c-4d93-b1bd-1527c3ec7b11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:42 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-5c792aa3-b66c-4b92-a281-18d5d584df6d tempest-CreateVolumesFromImageTest-1271613264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3db51cca-855c-4d93-b1bd-1527c3ec7b11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:42 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-5c792aa3-b66c-4b92-a281-18d5d584df6d tempest-CreateVolumesFromImageTest-1271613264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b5d58a2-2bb5-42b0-86ed-df120edc7266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:42 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-5c792aa3-b66c-4b92-a281-18d5d584df6d tempest-CreateVolumesFromImageTest-1271613264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b5d58a2-2bb5-42b0-86ed-df120edc7266) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1777b34b-57ec-41c3-b0ff-918d1a3280f0', 'volume_name': 'volume-1777b34b-57ec-41c3-b0ff-918d1a3280f0', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:42 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-5c792aa3-b66c-4b92-a281-18d5d584df6d tempest-CreateVolumesFromImageTest-1271613264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a981294d-b636-438c-8640-9e0e250e61fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:42 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-5c792aa3-b66c-4b92-a281-18d5d584df6d tempest-CreateVolumesFromImageTest-1271613264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a981294d-b636-438c-8640-9e0e250e61fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:42 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-5c792aa3-b66c-4b92-a281-18d5d584df6d tempest-CreateVolumesFromImageTest-1271613264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (301d8324-cfab-4835-86a1-08818194583e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:42 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-5c792aa3-b66c-4b92-a281-18d5d584df6d tempest-CreateVolumesFromImageTest-1271613264 None] Volume 1777b34b-57ec-41c3-b0ff-918d1a3280f0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1777b34b-57ec-41c3-b0ff-918d1a3280f0', 'volume_size': 1} Sep 29 18:37:42 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-5c792aa3-b66c-4b92-a281-18d5d584df6d tempest-CreateVolumesFromImageTest-1271613264 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:37:42 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-ade17714-8100-47cf-8bb6-b3e1dbbe6974 tempest-CreateVolumesFromImageTest-1271613264 None] Created volume successfully. Sep 29 18:37:42 devstack sudo[107072]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:42 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-63e30da8-0388-4900-acd1-fe12648f2eca tempest-CreateVolumesFromSnapshotTest-1588006594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-107e339e-b09b-4db3-ac1f-735aae8a80a4" returned: 0 in 0.340s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:42 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-63e30da8-0388-4900-acd1-fe12648f2eca tempest-CreateVolumesFromSnapshotTest-1588006594 None] Lock "cinder-quobyte-107e339e-b09b-4db3-ac1f-735aae8a80a4" released by "delete_volume" :: held 1.075s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:37:43 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-63e30da8-0388-4900-acd1-fe12648f2eca tempest-CreateVolumesFromSnapshotTest-1588006594 None] Created reservations ['413cc2b1-1e78-431a-b9c8-86f832d9adb3', 'a5dafc6b-5d9c-4f40-b141-a0c794b8eea6', 'fcb4553a-089f-4d7c-a839-7fe327f8ae8a', '190d7896-b47d-4a33-83e1-17afc9b442ea'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:37:43 devstack sudo[107070]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:43 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-f33df52e-adfa-4d66-981e-5e25105414ff tempest-ProjectReaderTests-1023282426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-1acb0a44-15ea-4f8c-8a0e-991f41272891" returned: 0 in 0.710s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:43 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-f33df52e-adfa-4d66-981e-5e25105414ff tempest-ProjectReaderTests-1023282426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-1acb0a44-15ea-4f8c-8a0e-991f41272891 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:43 devstack sudo[107085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-1acb0a44-15ea-4f8c-8a0e-991f41272891 Sep 29 18:37:43 devstack sudo[107085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:43 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-63e30da8-0388-4900-acd1-fe12648f2eca tempest-CreateVolumesFromSnapshotTest-1588006594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:37:43 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-63e30da8-0388-4900-acd1-fe12648f2eca tempest-CreateVolumesFromSnapshotTest-1588006594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:37:43 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-63e30da8-0388-4900-acd1-fe12648f2eca tempest-CreateVolumesFromSnapshotTest-1588006594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:37:43 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-63e30da8-0388-4900-acd1-fe12648f2eca tempest-CreateVolumesFromSnapshotTest-1588006594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:37:43 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-63e30da8-0388-4900-acd1-fe12648f2eca tempest-CreateVolumesFromSnapshotTest-1588006594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:37:43 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-63e30da8-0388-4900-acd1-fe12648f2eca tempest-CreateVolumesFromSnapshotTest-1588006594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:43 devstack sudo[107087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:37:43 devstack sudo[107087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:43 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-46684028-5613-4c0a-a5b9-08d63ffd7560 tempest-CreateVolumesFromImageTest-1271613264 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86512) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:37:43 devstack sudo[107074]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:43 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-46684028-5613-4c0a-a5b9-08d63ffd7560 tempest-CreateVolumesFromImageTest-1271613264 None] Flow 'volume_create_manager' (4f4012f8-d616-4f19-bbcc-b1c17a749826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:37:43 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-46684028-5613-4c0a-a5b9-08d63ffd7560 tempest-CreateVolumesFromImageTest-1271613264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07071c97-adda-47fd-a87e-8a1261b8de31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:43 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-4a08d3ce-cf50-4821-b934-44af35443cf0 tempest-CreateVolumesFromImageTest-1271613264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-9a50906f-ace1-4069-a798-715d2d278732 1073741824" returned: 0 in 0.795s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:43 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-46684028-5613-4c0a-a5b9-08d63ffd7560 tempest-CreateVolumesFromImageTest-1271613264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07071c97-adda-47fd-a87e-8a1261b8de31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:37:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1967334124',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acc726d8-6b74-4f12-b9c0-24d68aa34193,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50881b31ef19484ba102ee051d48ecc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:37:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:37:43Z,use_quota=True,user_id='b44cbc2a272e452882c5a3c200e3dabf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:43 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-46684028-5613-4c0a-a5b9-08d63ffd7560 tempest-CreateVolumesFromImageTest-1271613264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37168692-89e1-4888-bb5f-88cca69b721b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:43 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-46684028-5613-4c0a-a5b9-08d63ffd7560 tempest-CreateVolumesFromImageTest-1271613264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37168692-89e1-4888-bb5f-88cca69b721b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:43 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-46684028-5613-4c0a-a5b9-08d63ffd7560 tempest-CreateVolumesFromImageTest-1271613264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26a49618-88b3-4cdf-b3ec-1194eb223a61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:43 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-46684028-5613-4c0a-a5b9-08d63ffd7560 tempest-CreateVolumesFromImageTest-1271613264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26a49618-88b3-4cdf-b3ec-1194eb223a61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'acc726d8-6b74-4f12-b9c0-24d68aa34193', 'volume_name': 'volume-acc726d8-6b74-4f12-b9c0-24d68aa34193', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:43 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-46684028-5613-4c0a-a5b9-08d63ffd7560 tempest-CreateVolumesFromImageTest-1271613264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1385d4c-4fdf-4d95-ba4f-54ee9e7d67fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:43 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-46684028-5613-4c0a-a5b9-08d63ffd7560 tempest-CreateVolumesFromImageTest-1271613264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1385d4c-4fdf-4d95-ba4f-54ee9e7d67fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:43 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-46684028-5613-4c0a-a5b9-08d63ffd7560 tempest-CreateVolumesFromImageTest-1271613264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (907909a0-6537-4348-b09d-c5641ea9ad8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:43 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-46684028-5613-4c0a-a5b9-08d63ffd7560 tempest-CreateVolumesFromImageTest-1271613264 None] Volume acc726d8-6b74-4f12-b9c0-24d68aa34193: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-acc726d8-6b74-4f12-b9c0-24d68aa34193', 'volume_size': 1} Sep 29 18:37:43 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-46684028-5613-4c0a-a5b9-08d63ffd7560 tempest-CreateVolumesFromImageTest-1271613264 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:37:43 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-4a08d3ce-cf50-4821-b934-44af35443cf0 tempest-CreateVolumesFromImageTest-1271613264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-9a50906f-ace1-4069-a798-715d2d278732 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:43 devstack sudo[107085]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:43 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-f33df52e-adfa-4d66-981e-5e25105414ff tempest-ProjectReaderTests-1023282426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-1acb0a44-15ea-4f8c-8a0e-991f41272891" returned: 0 in 0.361s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:43 devstack sudo[107090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-9a50906f-ace1-4069-a798-715d2d278732 Sep 29 18:37:43 devstack sudo[107090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:43 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-f33df52e-adfa-4d66-981e-5e25105414ff tempest-ProjectReaderTests-1023282426 None] Lock "cinder-quobyte-1acb0a44-15ea-4f8c-8a0e-991f41272891" released by "delete_volume" :: held 1.152s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:37:43 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-f33df52e-adfa-4d66-981e-5e25105414ff tempest-ProjectReaderTests-1023282426 None] Created reservations ['6ca5acd9-9a89-44ad-87f2-5c1c92b7aaf7', '6cf46d49-96a8-4824-8658-b48b5820913b', 'e46b13f7-145c-44a2-9bf2-dca00e944052', 'b877c1d9-fc4a-497a-8d20-e18f9f95299d'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:37:43 devstack sudo[107087]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:43 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-63e30da8-0388-4900-acd1-fe12648f2eca tempest-CreateVolumesFromSnapshotTest-1588006594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.362s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:43 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-63e30da8-0388-4900-acd1-fe12648f2eca tempest-CreateVolumesFromSnapshotTest-1588006594 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:37:43 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-63e30da8-0388-4900-acd1-fe12648f2eca tempest-CreateVolumesFromSnapshotTest-1588006594 None] Deleted volume successfully. Sep 29 18:37:43 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-63e30da8-0388-4900-acd1-fe12648f2eca tempest-CreateVolumesFromSnapshotTest-1588006594 None] Lock "cinder-107e339e-b09b-4db3-ac1f-735aae8a80a4-delete_volume" released by "delete_volume" :: held 1.929s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:37:43 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-f33df52e-adfa-4d66-981e-5e25105414ff tempest-ProjectReaderTests-1023282426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:37:43 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-f33df52e-adfa-4d66-981e-5e25105414ff tempest-ProjectReaderTests-1023282426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:37:43 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-f33df52e-adfa-4d66-981e-5e25105414ff tempest-ProjectReaderTests-1023282426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:37:43 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-f33df52e-adfa-4d66-981e-5e25105414ff tempest-ProjectReaderTests-1023282426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:37:43 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-f33df52e-adfa-4d66-981e-5e25105414ff tempest-ProjectReaderTests-1023282426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:37:43 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-f33df52e-adfa-4d66-981e-5e25105414ff tempest-ProjectReaderTests-1023282426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:43 devstack sudo[107093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:37:43 devstack sudo[107093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:43 devstack sudo[107090]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:43 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-4a08d3ce-cf50-4821-b934-44af35443cf0 tempest-CreateVolumesFromImageTest-1271613264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-9a50906f-ace1-4069-a798-715d2d278732" returned: 0 in 0.316s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:43 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-4a08d3ce-cf50-4821-b934-44af35443cf0 tempest-CreateVolumesFromImageTest-1271613264 None] <== create_volume: return (1245ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'} {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:37:43 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-4a08d3ce-cf50-4821-b934-44af35443cf0 tempest-CreateVolumesFromImageTest-1271613264 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.249s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:37:43 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-114b3a7e-1d65-4b18-8641-272810513a3d tempest-CreateVolumesFromImageTest-1271613264 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.668s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:37:43 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-114b3a7e-1d65-4b18-8641-272810513a3d tempest-CreateVolumesFromImageTest-1271613264 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:37:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2029135519',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f91f1de-ec81-4594-b974-e6e8c81d6e28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50881b31ef19484ba102ee051d48ecc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:37:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:37:42Z,use_quota=True,user_id='b44cbc2a272e452882c5a3c200e3dabf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)}" {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:37:43 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-114b3a7e-1d65-4b18-8641-272810513a3d tempest-CreateVolumesFromImageTest-1271613264 None] Creating volume 0f91f1de-ec81-4594-b974-e6e8c81d6e28 {{(pid=86512) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:37:43 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-114b3a7e-1d65-4b18-8641-272810513a3d tempest-CreateVolumesFromImageTest-1271613264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:37:43 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-114b3a7e-1d65-4b18-8641-272810513a3d tempest-CreateVolumesFromImageTest-1271613264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:37:43 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-114b3a7e-1d65-4b18-8641-272810513a3d tempest-CreateVolumesFromImageTest-1271613264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:37:43 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-114b3a7e-1d65-4b18-8641-272810513a3d tempest-CreateVolumesFromImageTest-1271613264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:37:43 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-114b3a7e-1d65-4b18-8641-272810513a3d tempest-CreateVolumesFromImageTest-1271613264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:37:43 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-114b3a7e-1d65-4b18-8641-272810513a3d tempest-CreateVolumesFromImageTest-1271613264 None] Selected osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 as target Quobyte volume. {{(pid=86512) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:37:43 devstack cinder-volume[86512]: INFO cinder.volume.drivers.remotefs [None req-114b3a7e-1d65-4b18-8641-272810513a3d tempest-CreateVolumesFromImageTest-1271613264 None] casted to osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 Sep 29 18:37:43 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-114b3a7e-1d65-4b18-8641-272810513a3d tempest-CreateVolumesFromImageTest-1271613264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0f91f1de-ec81-4594-b974-e6e8c81d6e28 1073741824 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:43 devstack sudo[107096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0f91f1de-ec81-4594-b974-e6e8c81d6e28 1073741824 Sep 29 18:37:43 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-4a08d3ce-cf50-4821-b934-44af35443cf0 tempest-CreateVolumesFromImageTest-1271613264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff5ddd5a-7771-486e-b130-35fbe2761992) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a50906f-ace1-4069-a798-715d2d278732', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:43 devstack sudo[107096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:43 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-4a08d3ce-cf50-4821-b934-44af35443cf0 tempest-CreateVolumesFromImageTest-1271613264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c9779e1-7e3f-4238-9dae-81762aca2de2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:43 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-4a08d3ce-cf50-4821-b934-44af35443cf0 tempest-CreateVolumesFromImageTest-1271613264 None] Volume volume-9a50906f-ace1-4069-a798-715d2d278732 (9a50906f-ace1-4069-a798-715d2d278732): created successfully Sep 29 18:37:43 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-4a08d3ce-cf50-4821-b934-44af35443cf0 tempest-CreateVolumesFromImageTest-1271613264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c9779e1-7e3f-4238-9dae-81762aca2de2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:43 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-4a08d3ce-cf50-4821-b934-44af35443cf0 tempest-CreateVolumesFromImageTest-1271613264 None] Flow 'volume_create_manager' (84df1c98-1883-407f-b6cb-698c199995dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:37:43 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-4a08d3ce-cf50-4821-b934-44af35443cf0 tempest-CreateVolumesFromImageTest-1271613264 None] Created volume successfully. Sep 29 18:37:44 devstack sudo[107093]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:44 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-f33df52e-adfa-4d66-981e-5e25105414ff tempest-ProjectReaderTests-1023282426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.325s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:44 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-f33df52e-adfa-4d66-981e-5e25105414ff tempest-ProjectReaderTests-1023282426 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:37:44 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-f33df52e-adfa-4d66-981e-5e25105414ff tempest-ProjectReaderTests-1023282426 None] Deleted volume successfully. Sep 29 18:37:44 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-f33df52e-adfa-4d66-981e-5e25105414ff tempest-ProjectReaderTests-1023282426 None] Lock "cinder-1acb0a44-15ea-4f8c-8a0e-991f41272891-delete_volume" released by "delete_volume" :: held 1.825s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:37:44 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-464357fe-55be-4709-ac5b-fdcef496ec71 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Acquiring lock "cinder-628cbb4f-042a-4560-b95c-cabfe4bcb37c-delete_volume" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:37:44 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-464357fe-55be-4709-ac5b-fdcef496ec71 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Lock "cinder-628cbb4f-042a-4560-b95c-cabfe4bcb37c-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:37:44 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-464357fe-55be-4709-ac5b-fdcef496ec71 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Acquiring lock "cinder-quobyte-628cbb4f-042a-4560-b95c-cabfe4bcb37c" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:37:44 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-464357fe-55be-4709-ac5b-fdcef496ec71 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Lock "cinder-quobyte-628cbb4f-042a-4560-b95c-cabfe4bcb37c" acquired by "delete_volume" :: waited 0.025s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:37:44 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[3171dba7-29eb-46aa-91b9-f716921e0e4c]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:37:44 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-464357fe-55be-4709-ac5b-fdcef496ec71 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-628cbb4f-042a-4560-b95c-cabfe4bcb37c {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:44 devstack sudo[107103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-628cbb4f-042a-4560-b95c-cabfe4bcb37c Sep 29 18:37:44 devstack sudo[107103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:44 devstack sudo[107096]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:44 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-114b3a7e-1d65-4b18-8641-272810513a3d tempest-CreateVolumesFromImageTest-1271613264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0f91f1de-ec81-4594-b974-e6e8c81d6e28 1073741824" returned: 0 in 0.710s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:44 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-114b3a7e-1d65-4b18-8641-272810513a3d tempest-CreateVolumesFromImageTest-1271613264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0f91f1de-ec81-4594-b974-e6e8c81d6e28 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:44 devstack sudo[107106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0f91f1de-ec81-4594-b974-e6e8c81d6e28 Sep 29 18:37:44 devstack sudo[107106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:44 devstack sudo[107103]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:44 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-464357fe-55be-4709-ac5b-fdcef496ec71 tempest-CreateVolumesFromSnapshotTest-1588006594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-628cbb4f-042a-4560-b95c-cabfe4bcb37c" returned: 0 in 0.434s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:44 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-464357fe-55be-4709-ac5b-fdcef496ec71 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-628cbb4f-042a-4560-b95c-cabfe4bcb37c {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:44 devstack sudo[107112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-628cbb4f-042a-4560-b95c-cabfe4bcb37c Sep 29 18:37:44 devstack sudo[107112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:44 devstack sudo[107106]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:44 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-114b3a7e-1d65-4b18-8641-272810513a3d tempest-CreateVolumesFromImageTest-1271613264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0f91f1de-ec81-4594-b974-e6e8c81d6e28" returned: 0 in 0.330s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:44 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-114b3a7e-1d65-4b18-8641-272810513a3d tempest-CreateVolumesFromImageTest-1271613264 None] <== create_volume: return (1092ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'} {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:37:44 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-114b3a7e-1d65-4b18-8641-272810513a3d tempest-CreateVolumesFromImageTest-1271613264 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.096s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:37:44 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-5c792aa3-b66c-4b92-a281-18d5d584df6d tempest-CreateVolumesFromImageTest-1271613264 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.074s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:37:44 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-5c792aa3-b66c-4b92-a281-18d5d584df6d tempest-CreateVolumesFromImageTest-1271613264 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:37:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-571194437',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1777b34b-57ec-41c3-b0ff-918d1a3280f0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50881b31ef19484ba102ee051d48ecc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:37:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:37:42Z,use_quota=True,user_id='b44cbc2a272e452882c5a3c200e3dabf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)}" {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:37:44 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-5c792aa3-b66c-4b92-a281-18d5d584df6d tempest-CreateVolumesFromImageTest-1271613264 None] Creating volume 1777b34b-57ec-41c3-b0ff-918d1a3280f0 {{(pid=86512) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:37:44 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-5c792aa3-b66c-4b92-a281-18d5d584df6d tempest-CreateVolumesFromImageTest-1271613264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:37:44 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-5c792aa3-b66c-4b92-a281-18d5d584df6d tempest-CreateVolumesFromImageTest-1271613264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:37:44 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-5c792aa3-b66c-4b92-a281-18d5d584df6d tempest-CreateVolumesFromImageTest-1271613264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:37:44 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-5c792aa3-b66c-4b92-a281-18d5d584df6d tempest-CreateVolumesFromImageTest-1271613264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:37:44 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-5c792aa3-b66c-4b92-a281-18d5d584df6d tempest-CreateVolumesFromImageTest-1271613264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:37:44 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-5c792aa3-b66c-4b92-a281-18d5d584df6d tempest-CreateVolumesFromImageTest-1271613264 None] Selected osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 as target Quobyte volume. {{(pid=86512) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:37:44 devstack cinder-volume[86512]: INFO cinder.volume.drivers.remotefs [None req-5c792aa3-b66c-4b92-a281-18d5d584df6d tempest-CreateVolumesFromImageTest-1271613264 None] casted to osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 Sep 29 18:37:44 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-5c792aa3-b66c-4b92-a281-18d5d584df6d tempest-CreateVolumesFromImageTest-1271613264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-1777b34b-57ec-41c3-b0ff-918d1a3280f0 1073741824 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:44 devstack sudo[107115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-1777b34b-57ec-41c3-b0ff-918d1a3280f0 1073741824 Sep 29 18:37:44 devstack sudo[107115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:44 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-114b3a7e-1d65-4b18-8641-272810513a3d tempest-CreateVolumesFromImageTest-1271613264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c19d28b9-94a5-40bd-a632-86d356103204) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f91f1de-ec81-4594-b974-e6e8c81d6e28', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:44 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-114b3a7e-1d65-4b18-8641-272810513a3d tempest-CreateVolumesFromImageTest-1271613264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (769357a1-6437-4288-bf22-6d7928a541d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:44 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-114b3a7e-1d65-4b18-8641-272810513a3d tempest-CreateVolumesFromImageTest-1271613264 None] Volume volume-0f91f1de-ec81-4594-b974-e6e8c81d6e28 (0f91f1de-ec81-4594-b974-e6e8c81d6e28): created successfully Sep 29 18:37:45 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-114b3a7e-1d65-4b18-8641-272810513a3d tempest-CreateVolumesFromImageTest-1271613264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (769357a1-6437-4288-bf22-6d7928a541d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:45 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-114b3a7e-1d65-4b18-8641-272810513a3d tempest-CreateVolumesFromImageTest-1271613264 None] Flow 'volume_create_manager' (f1ca9866-5a48-4f5d-8323-88b3292af4e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:37:45 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-114b3a7e-1d65-4b18-8641-272810513a3d tempest-CreateVolumesFromImageTest-1271613264 None] Created volume successfully. Sep 29 18:37:45 devstack sudo[107112]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:45 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-464357fe-55be-4709-ac5b-fdcef496ec71 tempest-CreateVolumesFromSnapshotTest-1588006594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-628cbb4f-042a-4560-b95c-cabfe4bcb37c" returned: 0 in 0.415s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:45 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-464357fe-55be-4709-ac5b-fdcef496ec71 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Lock "cinder-quobyte-628cbb4f-042a-4560-b95c-cabfe4bcb37c" released by "delete_volume" :: held 0.917s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:37:45 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-488685e3-a016-44c6-89d9-2a2bbf7fd1c1 tempest-ProjectReaderTests-1023282426 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86512) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:37:45 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-488685e3-a016-44c6-89d9-2a2bbf7fd1c1 tempest-ProjectReaderTests-1023282426 None] Flow 'volume_create_manager' (815b89f2-425c-4cb5-96f4-753c8e440b4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:37:45 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-488685e3-a016-44c6-89d9-2a2bbf7fd1c1 tempest-ProjectReaderTests-1023282426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df5c958c-97c1-4033-8e86-e99a08eabbbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:45 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-488685e3-a016-44c6-89d9-2a2bbf7fd1c1 tempest-ProjectReaderTests-1023282426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df5c958c-97c1-4033-8e86-e99a08eabbbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:37:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-781729712',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a96be58-754c-49cd-abb6-853afd42a445,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c6583dad59442f381d38f8f0383dc2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:37:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:37:45Z,use_quota=True,user_id='ef7764e50a99455faed61f3e9a1ca584',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:45 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-488685e3-a016-44c6-89d9-2a2bbf7fd1c1 tempest-ProjectReaderTests-1023282426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (647f75ea-0660-40b4-8c36-983eb8694836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:45 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-488685e3-a016-44c6-89d9-2a2bbf7fd1c1 tempest-ProjectReaderTests-1023282426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (647f75ea-0660-40b4-8c36-983eb8694836) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:45 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-488685e3-a016-44c6-89d9-2a2bbf7fd1c1 tempest-ProjectReaderTests-1023282426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d2b5614-52d0-4900-8500-3d91e7270d5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:45 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-488685e3-a016-44c6-89d9-2a2bbf7fd1c1 tempest-ProjectReaderTests-1023282426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d2b5614-52d0-4900-8500-3d91e7270d5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a96be58-754c-49cd-abb6-853afd42a445', 'volume_name': 'volume-7a96be58-754c-49cd-abb6-853afd42a445', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:45 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-488685e3-a016-44c6-89d9-2a2bbf7fd1c1 tempest-ProjectReaderTests-1023282426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01f007d9-2469-46f1-a73e-6623ebf88b57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:45 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-488685e3-a016-44c6-89d9-2a2bbf7fd1c1 tempest-ProjectReaderTests-1023282426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01f007d9-2469-46f1-a73e-6623ebf88b57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:45 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-488685e3-a016-44c6-89d9-2a2bbf7fd1c1 tempest-ProjectReaderTests-1023282426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cd05fa4-667e-4758-a902-2380495e139a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:45 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-488685e3-a016-44c6-89d9-2a2bbf7fd1c1 tempest-ProjectReaderTests-1023282426 None] Volume 7a96be58-754c-49cd-abb6-853afd42a445: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a96be58-754c-49cd-abb6-853afd42a445', 'volume_size': 1} Sep 29 18:37:45 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-488685e3-a016-44c6-89d9-2a2bbf7fd1c1 tempest-ProjectReaderTests-1023282426 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:37:45 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-464357fe-55be-4709-ac5b-fdcef496ec71 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Created reservations ['1b2c1ade-a027-4cf2-b5b0-e5cadf5d4f8f', 'b9e2392f-731f-4daa-abb2-acf49f31523d', '66aab5fd-67d0-464c-934b-2eac6911ca14', 'f6e8d217-e0d9-47e3-ba7e-1a66b077ebb5'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:37:45 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-464357fe-55be-4709-ac5b-fdcef496ec71 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:37:45 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-464357fe-55be-4709-ac5b-fdcef496ec71 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:37:45 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-464357fe-55be-4709-ac5b-fdcef496ec71 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:37:45 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-464357fe-55be-4709-ac5b-fdcef496ec71 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:37:45 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-464357fe-55be-4709-ac5b-fdcef496ec71 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:37:45 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-464357fe-55be-4709-ac5b-fdcef496ec71 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:45 devstack sudo[107121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:37:45 devstack sudo[107121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:45 devstack sudo[107115]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:45 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-5c792aa3-b66c-4b92-a281-18d5d584df6d tempest-CreateVolumesFromImageTest-1271613264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-1777b34b-57ec-41c3-b0ff-918d1a3280f0 1073741824" returned: 0 in 0.631s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:45 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-5c792aa3-b66c-4b92-a281-18d5d584df6d tempest-CreateVolumesFromImageTest-1271613264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-1777b34b-57ec-41c3-b0ff-918d1a3280f0 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:45 devstack sudo[107123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-1777b34b-57ec-41c3-b0ff-918d1a3280f0 Sep 29 18:37:45 devstack sudo[107123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:45 devstack sudo[107121]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:45 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-464357fe-55be-4709-ac5b-fdcef496ec71 tempest-CreateVolumesFromSnapshotTest-1588006594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.266s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:45 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-464357fe-55be-4709-ac5b-fdcef496ec71 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:37:45 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-464357fe-55be-4709-ac5b-fdcef496ec71 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Deleted volume successfully. Sep 29 18:37:45 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-464357fe-55be-4709-ac5b-fdcef496ec71 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Lock "cinder-628cbb4f-042a-4560-b95c-cabfe4bcb37c-delete_volume" released by "delete_volume" :: held 1.585s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:37:45 devstack sudo[107123]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:45 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-5c792aa3-b66c-4b92-a281-18d5d584df6d tempest-CreateVolumesFromImageTest-1271613264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-1777b34b-57ec-41c3-b0ff-918d1a3280f0" returned: 0 in 0.286s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:45 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-5c792aa3-b66c-4b92-a281-18d5d584df6d tempest-CreateVolumesFromImageTest-1271613264 None] <== create_volume: return (982ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'} {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:37:45 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-5c792aa3-b66c-4b92-a281-18d5d584df6d tempest-CreateVolumesFromImageTest-1271613264 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.985s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:37:45 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-46684028-5613-4c0a-a5b9-08d63ffd7560 tempest-CreateVolumesFromImageTest-1271613264 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.441s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:37:45 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-46684028-5613-4c0a-a5b9-08d63ffd7560 tempest-CreateVolumesFromImageTest-1271613264 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:37:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1967334124',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acc726d8-6b74-4f12-b9c0-24d68aa34193,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50881b31ef19484ba102ee051d48ecc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:37:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:37:43Z,use_quota=True,user_id='b44cbc2a272e452882c5a3c200e3dabf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)}" {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:37:45 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-46684028-5613-4c0a-a5b9-08d63ffd7560 tempest-CreateVolumesFromImageTest-1271613264 None] Creating volume acc726d8-6b74-4f12-b9c0-24d68aa34193 {{(pid=86512) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:37:45 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-46684028-5613-4c0a-a5b9-08d63ffd7560 tempest-CreateVolumesFromImageTest-1271613264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:37:45 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-46684028-5613-4c0a-a5b9-08d63ffd7560 tempest-CreateVolumesFromImageTest-1271613264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:37:45 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-46684028-5613-4c0a-a5b9-08d63ffd7560 tempest-CreateVolumesFromImageTest-1271613264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:37:45 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-46684028-5613-4c0a-a5b9-08d63ffd7560 tempest-CreateVolumesFromImageTest-1271613264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:37:45 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-46684028-5613-4c0a-a5b9-08d63ffd7560 tempest-CreateVolumesFromImageTest-1271613264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:37:45 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-46684028-5613-4c0a-a5b9-08d63ffd7560 tempest-CreateVolumesFromImageTest-1271613264 None] Selected osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 as target Quobyte volume. {{(pid=86512) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:37:45 devstack cinder-volume[86512]: INFO cinder.volume.drivers.remotefs [None req-46684028-5613-4c0a-a5b9-08d63ffd7560 tempest-CreateVolumesFromImageTest-1271613264 None] casted to osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 Sep 29 18:37:45 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-46684028-5613-4c0a-a5b9-08d63ffd7560 tempest-CreateVolumesFromImageTest-1271613264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-acc726d8-6b74-4f12-b9c0-24d68aa34193 1073741824 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:45 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-5c792aa3-b66c-4b92-a281-18d5d584df6d tempest-CreateVolumesFromImageTest-1271613264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (301d8324-cfab-4835-86a1-08818194583e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1777b34b-57ec-41c3-b0ff-918d1a3280f0', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:45 devstack sudo[107127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-acc726d8-6b74-4f12-b9c0-24d68aa34193 1073741824 Sep 29 18:37:45 devstack sudo[107127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:45 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-5c792aa3-b66c-4b92-a281-18d5d584df6d tempest-CreateVolumesFromImageTest-1271613264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca0b9586-e120-4e33-8f99-d010a3ae8161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:45 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-5c792aa3-b66c-4b92-a281-18d5d584df6d tempest-CreateVolumesFromImageTest-1271613264 None] Volume volume-1777b34b-57ec-41c3-b0ff-918d1a3280f0 (1777b34b-57ec-41c3-b0ff-918d1a3280f0): created successfully Sep 29 18:37:45 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-5c792aa3-b66c-4b92-a281-18d5d584df6d tempest-CreateVolumesFromImageTest-1271613264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca0b9586-e120-4e33-8f99-d010a3ae8161) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:45 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-5c792aa3-b66c-4b92-a281-18d5d584df6d tempest-CreateVolumesFromImageTest-1271613264 None] Flow 'volume_create_manager' (57256cf8-5a4b-4c6e-8855-0e85ff3a499e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:37:45 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-5c792aa3-b66c-4b92-a281-18d5d584df6d tempest-CreateVolumesFromImageTest-1271613264 None] Created volume successfully. Sep 29 18:37:46 devstack sudo[107127]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:46 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-46684028-5613-4c0a-a5b9-08d63ffd7560 tempest-CreateVolumesFromImageTest-1271613264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-acc726d8-6b74-4f12-b9c0-24d68aa34193 1073741824" returned: 0 in 0.508s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:46 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-1a5f01c1-542a-41a3-9b00-886209d5be76 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Acquiring lock "cinder-b21cb005-34c2-4869-b19a-f0bb3b403789-delete_snapshot" by "delete_snapshot" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:37:46 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-1a5f01c1-542a-41a3-9b00-886209d5be76 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Lock "cinder-b21cb005-34c2-4869-b19a-f0bb3b403789-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:37:46 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-1a5f01c1-542a-41a3-9b00-886209d5be76 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Acquiring lock "cinder-quobyte-0fbf0c3c-8379-44e0-9816-f48d5c7cf687" by "delete_snapshot" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:37:46 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-1a5f01c1-542a-41a3-9b00-886209d5be76 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Lock "cinder-quobyte-0fbf0c3c-8379-44e0-9816-f48d5c7cf687" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:37:46 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-1a5f01c1-542a-41a3-9b00-886209d5be76 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Acquiring lock "cinder-quobyte-b21cb005-34c2-4869-b19a-f0bb3b403789" by "_delete_snapshot" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:37:46 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-46684028-5613-4c0a-a5b9-08d63ffd7560 tempest-CreateVolumesFromImageTest-1271613264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-acc726d8-6b74-4f12-b9c0-24d68aa34193 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:46 devstack sudo[107133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-acc726d8-6b74-4f12-b9c0-24d68aa34193 Sep 29 18:37:46 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-1a5f01c1-542a-41a3-9b00-886209d5be76 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Lock "cinder-quobyte-b21cb005-34c2-4869-b19a-f0bb3b403789" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:37:46 devstack sudo[107133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:46 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-1a5f01c1-542a-41a3-9b00-886209d5be76 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Deleting offline snapshot b21cb005-34c2-4869-b19a-f0bb3b403789 of volume 0fbf0c3c-8379-44e0-9816-f48d5c7cf687 {{(pid=86512) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 18:37:46 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-1a5f01c1-542a-41a3-9b00-886209d5be76 tempest-CreateVolumesFromSnapshotTest-1588006594 None] snapshot_file for this snap is: volume-0fbf0c3c-8379-44e0-9816-f48d5c7cf687.b21cb005-34c2-4869-b19a-f0bb3b403789 {{(pid=86512) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 18:37:46 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[12664ba9-5a69-4046-a32e-59640a50a8cb]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:37:46 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-1a5f01c1-542a-41a3-9b00-886209d5be76 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0fbf0c3c-8379-44e0-9816-f48d5c7cf687.b21cb005-34c2-4869-b19a-f0bb3b403789 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:46 devstack sudo[107135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0fbf0c3c-8379-44e0-9816-f48d5c7cf687.b21cb005-34c2-4869-b19a-f0bb3b403789 Sep 29 18:37:46 devstack sudo[107135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:46 devstack sudo[107133]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:46 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-46684028-5613-4c0a-a5b9-08d63ffd7560 tempest-CreateVolumesFromImageTest-1271613264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-acc726d8-6b74-4f12-b9c0-24d68aa34193" returned: 0 in 0.274s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:46 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-46684028-5613-4c0a-a5b9-08d63ffd7560 tempest-CreateVolumesFromImageTest-1271613264 None] <== create_volume: return (867ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'} {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:37:46 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-46684028-5613-4c0a-a5b9-08d63ffd7560 tempest-CreateVolumesFromImageTest-1271613264 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.869s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:37:46 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-488685e3-a016-44c6-89d9-2a2bbf7fd1c1 tempest-ProjectReaderTests-1023282426 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.417s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:37:46 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-488685e3-a016-44c6-89d9-2a2bbf7fd1c1 tempest-ProjectReaderTests-1023282426 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:37:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-781729712',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a96be58-754c-49cd-abb6-853afd42a445,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c6583dad59442f381d38f8f0383dc2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:37:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:37:45Z,use_quota=True,user_id='ef7764e50a99455faed61f3e9a1ca584',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)}" {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:37:46 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-488685e3-a016-44c6-89d9-2a2bbf7fd1c1 tempest-ProjectReaderTests-1023282426 None] Creating volume 7a96be58-754c-49cd-abb6-853afd42a445 {{(pid=86512) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:37:46 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-488685e3-a016-44c6-89d9-2a2bbf7fd1c1 tempest-ProjectReaderTests-1023282426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:37:46 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-488685e3-a016-44c6-89d9-2a2bbf7fd1c1 tempest-ProjectReaderTests-1023282426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:37:46 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-488685e3-a016-44c6-89d9-2a2bbf7fd1c1 tempest-ProjectReaderTests-1023282426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:37:46 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-488685e3-a016-44c6-89d9-2a2bbf7fd1c1 tempest-ProjectReaderTests-1023282426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:37:46 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-488685e3-a016-44c6-89d9-2a2bbf7fd1c1 tempest-ProjectReaderTests-1023282426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:37:46 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-488685e3-a016-44c6-89d9-2a2bbf7fd1c1 tempest-ProjectReaderTests-1023282426 None] Selected osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 as target Quobyte volume. {{(pid=86512) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:37:46 devstack cinder-volume[86512]: INFO cinder.volume.drivers.remotefs [None req-488685e3-a016-44c6-89d9-2a2bbf7fd1c1 tempest-ProjectReaderTests-1023282426 None] casted to osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 Sep 29 18:37:46 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-488685e3-a016-44c6-89d9-2a2bbf7fd1c1 tempest-ProjectReaderTests-1023282426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7a96be58-754c-49cd-abb6-853afd42a445 1073741824 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:46 devstack sudo[107138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7a96be58-754c-49cd-abb6-853afd42a445 1073741824 Sep 29 18:37:46 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-46684028-5613-4c0a-a5b9-08d63ffd7560 tempest-CreateVolumesFromImageTest-1271613264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (907909a0-6537-4348-b09d-c5641ea9ad8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-acc726d8-6b74-4f12-b9c0-24d68aa34193', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:46 devstack sudo[107138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:46 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-46684028-5613-4c0a-a5b9-08d63ffd7560 tempest-CreateVolumesFromImageTest-1271613264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ca4f559-75b7-4f86-a11d-f654f9f6f9f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:46 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-46684028-5613-4c0a-a5b9-08d63ffd7560 tempest-CreateVolumesFromImageTest-1271613264 None] Volume volume-acc726d8-6b74-4f12-b9c0-24d68aa34193 (acc726d8-6b74-4f12-b9c0-24d68aa34193): created successfully Sep 29 18:37:46 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-46684028-5613-4c0a-a5b9-08d63ffd7560 tempest-CreateVolumesFromImageTest-1271613264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ca4f559-75b7-4f86-a11d-f654f9f6f9f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:46 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-46684028-5613-4c0a-a5b9-08d63ffd7560 tempest-CreateVolumesFromImageTest-1271613264 None] Flow 'volume_create_manager' (4f4012f8-d616-4f19-bbcc-b1c17a749826) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:37:46 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-46684028-5613-4c0a-a5b9-08d63ffd7560 tempest-CreateVolumesFromImageTest-1271613264 None] Created volume successfully. Sep 29 18:37:47 devstack sudo[107135]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:47 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-1a5f01c1-542a-41a3-9b00-886209d5be76 tempest-CreateVolumesFromSnapshotTest-1588006594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0fbf0c3c-8379-44e0-9816-f48d5c7cf687.b21cb005-34c2-4869-b19a-f0bb3b403789" returned: 0 in 0.435s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:47 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-1a5f01c1-542a-41a3-9b00-886209d5be76 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0fbf0c3c-8379-44e0-9816-f48d5c7cf687(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86512) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 18:37:47 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[43965830-282e-4ce9-9358-76130f2268ff]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:37:47 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-1a5f01c1-542a-41a3-9b00-886209d5be76 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0fbf0c3c-8379-44e0-9816-f48d5c7cf687 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:47 devstack sudo[107146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0fbf0c3c-8379-44e0-9816-f48d5c7cf687 Sep 29 18:37:47 devstack sudo[107146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:47 devstack sudo[107138]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:47 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-488685e3-a016-44c6-89d9-2a2bbf7fd1c1 tempest-ProjectReaderTests-1023282426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7a96be58-754c-49cd-abb6-853afd42a445 1073741824" returned: 0 in 0.517s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:47 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-488685e3-a016-44c6-89d9-2a2bbf7fd1c1 tempest-ProjectReaderTests-1023282426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7a96be58-754c-49cd-abb6-853afd42a445 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:47 devstack sudo[107149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7a96be58-754c-49cd-abb6-853afd42a445 Sep 29 18:37:47 devstack sudo[107149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:47 devstack sudo[107146]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:47 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-1a5f01c1-542a-41a3-9b00-886209d5be76 tempest-CreateVolumesFromSnapshotTest-1588006594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0fbf0c3c-8379-44e0-9816-f48d5c7cf687" returned: 0 in 0.428s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:47 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-1a5f01c1-542a-41a3-9b00-886209d5be76 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0fbf0c3c-8379-44e0-9816-f48d5c7cf687.b21cb005-34c2-4869-b19a-f0bb3b403789 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:47 devstack sudo[107155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0fbf0c3c-8379-44e0-9816-f48d5c7cf687.b21cb005-34c2-4869-b19a-f0bb3b403789 Sep 29 18:37:47 devstack sudo[107155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:47 devstack sudo[107149]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:47 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-488685e3-a016-44c6-89d9-2a2bbf7fd1c1 tempest-ProjectReaderTests-1023282426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7a96be58-754c-49cd-abb6-853afd42a445" returned: 0 in 0.280s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:47 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-488685e3-a016-44c6-89d9-2a2bbf7fd1c1 tempest-ProjectReaderTests-1023282426 None] <== create_volume: return (850ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'} {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:37:47 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-488685e3-a016-44c6-89d9-2a2bbf7fd1c1 tempest-ProjectReaderTests-1023282426 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.855s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:37:47 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-488685e3-a016-44c6-89d9-2a2bbf7fd1c1 tempest-ProjectReaderTests-1023282426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cd05fa4-667e-4758-a902-2380495e139a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a96be58-754c-49cd-abb6-853afd42a445', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:47 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-488685e3-a016-44c6-89d9-2a2bbf7fd1c1 tempest-ProjectReaderTests-1023282426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc63f13d-0e39-44c4-9311-59c9b46c03a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:47 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-488685e3-a016-44c6-89d9-2a2bbf7fd1c1 tempest-ProjectReaderTests-1023282426 None] Volume volume-7a96be58-754c-49cd-abb6-853afd42a445 (7a96be58-754c-49cd-abb6-853afd42a445): created successfully Sep 29 18:37:47 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-488685e3-a016-44c6-89d9-2a2bbf7fd1c1 tempest-ProjectReaderTests-1023282426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc63f13d-0e39-44c4-9311-59c9b46c03a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:47 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-488685e3-a016-44c6-89d9-2a2bbf7fd1c1 tempest-ProjectReaderTests-1023282426 None] Flow 'volume_create_manager' (815b89f2-425c-4cb5-96f4-753c8e440b4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:37:47 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-488685e3-a016-44c6-89d9-2a2bbf7fd1c1 tempest-ProjectReaderTests-1023282426 None] Created volume successfully. Sep 29 18:37:47 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-4060769e-1314-4c6e-a41c-77c37e1e3030 tempest-CreateVolumesFromImageTest-1271613264 None] Acquiring lock "cinder-acc726d8-6b74-4f12-b9c0-24d68aa34193-delete_volume" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:37:47 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-4060769e-1314-4c6e-a41c-77c37e1e3030 tempest-CreateVolumesFromImageTest-1271613264 None] Lock "cinder-acc726d8-6b74-4f12-b9c0-24d68aa34193-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:37:47 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-4060769e-1314-4c6e-a41c-77c37e1e3030 tempest-CreateVolumesFromImageTest-1271613264 None] Acquiring lock "cinder-quobyte-acc726d8-6b74-4f12-b9c0-24d68aa34193" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:37:47 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-4060769e-1314-4c6e-a41c-77c37e1e3030 tempest-CreateVolumesFromImageTest-1271613264 None] Lock "cinder-quobyte-acc726d8-6b74-4f12-b9c0-24d68aa34193" acquired by "delete_volume" :: waited 0.013s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:37:47 devstack sudo[107155]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:47 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-1a5f01c1-542a-41a3-9b00-886209d5be76 tempest-CreateVolumesFromSnapshotTest-1588006594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0fbf0c3c-8379-44e0-9816-f48d5c7cf687.b21cb005-34c2-4869-b19a-f0bb3b403789" returned: 0 in 0.448s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:47 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-1a5f01c1-542a-41a3-9b00-886209d5be76 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0fbf0c3c-8379-44e0-9816-f48d5c7cf687.b21cb005-34c2-4869-b19a-f0bb3b403789 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:47 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[21e5fb22-6acd-4c2f-92dc-606007eebe4b]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:37:47 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-4060769e-1314-4c6e-a41c-77c37e1e3030 tempest-CreateVolumesFromImageTest-1271613264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-acc726d8-6b74-4f12-b9c0-24d68aa34193 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:47 devstack sudo[107161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0fbf0c3c-8379-44e0-9816-f48d5c7cf687.b21cb005-34c2-4869-b19a-f0bb3b403789 Sep 29 18:37:47 devstack sudo[107161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:48 devstack sudo[107162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-acc726d8-6b74-4f12-b9c0-24d68aa34193 Sep 29 18:37:48 devstack sudo[107162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:48 devstack sudo[107161]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:48 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-1a5f01c1-542a-41a3-9b00-886209d5be76 tempest-CreateVolumesFromSnapshotTest-1588006594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0fbf0c3c-8379-44e0-9816-f48d5c7cf687.b21cb005-34c2-4869-b19a-f0bb3b403789" returned: 0 in 0.268s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:48 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-1a5f01c1-542a-41a3-9b00-886209d5be76 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Lock "cinder-quobyte-b21cb005-34c2-4869-b19a-f0bb3b403789" released by "_delete_snapshot" :: held 1.761s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:37:48 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-1a5f01c1-542a-41a3-9b00-886209d5be76 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Lock "cinder-quobyte-0fbf0c3c-8379-44e0-9816-f48d5c7cf687" released by "delete_snapshot" :: held 1.807s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:37:48 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-d2991661-5804-4471-9630-cecc9fc0dcd7 tempest-ProjectReaderTests-1023282426 None] Acquiring lock "cinder-7a96be58-754c-49cd-abb6-853afd42a445-delete_volume" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:37:48 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-1a5f01c1-542a-41a3-9b00-886209d5be76 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Created reservations ['f2b5169e-b4ca-4e96-a8a5-2a9b59908d51', '16c1f346-25ba-447e-99c3-196db6a85431', '234dbf8d-05e3-4e28-946f-0f93db8dd7bb', '067e2c29-1a70-4e28-97df-d2b137683d1a'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:37:48 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-d2991661-5804-4471-9630-cecc9fc0dcd7 tempest-ProjectReaderTests-1023282426 None] Lock "cinder-7a96be58-754c-49cd-abb6-853afd42a445-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:37:48 devstack sudo[107162]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:48 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-4060769e-1314-4c6e-a41c-77c37e1e3030 tempest-CreateVolumesFromImageTest-1271613264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-acc726d8-6b74-4f12-b9c0-24d68aa34193" returned: 0 in 0.467s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:48 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-4060769e-1314-4c6e-a41c-77c37e1e3030 tempest-CreateVolumesFromImageTest-1271613264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-acc726d8-6b74-4f12-b9c0-24d68aa34193 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:48 devstack sudo[107170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-acc726d8-6b74-4f12-b9c0-24d68aa34193 Sep 29 18:37:48 devstack sudo[107170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:48 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-d2991661-5804-4471-9630-cecc9fc0dcd7 tempest-ProjectReaderTests-1023282426 None] Acquiring lock "cinder-quobyte-7a96be58-754c-49cd-abb6-853afd42a445" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:37:48 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-d2991661-5804-4471-9630-cecc9fc0dcd7 tempest-ProjectReaderTests-1023282426 None] Lock "cinder-quobyte-7a96be58-754c-49cd-abb6-853afd42a445" acquired by "delete_volume" :: waited 0.027s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:37:48 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[707c8fff-4b84-4108-8a92-b43e8e768aa5]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:37:48 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-d2991661-5804-4471-9630-cecc9fc0dcd7 tempest-ProjectReaderTests-1023282426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7a96be58-754c-49cd-abb6-853afd42a445 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:48 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-1a5f01c1-542a-41a3-9b00-886209d5be76 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Delete snapshot completed successfully. Sep 29 18:37:48 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-1a5f01c1-542a-41a3-9b00-886209d5be76 tempest-CreateVolumesFromSnapshotTest-1588006594 None] Lock "cinder-b21cb005-34c2-4869-b19a-f0bb3b403789-delete_snapshot" released by "delete_snapshot" :: held 2.117s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:37:48 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-fb284486-6b26-4aa2-9d61-3505b8580a1d tempest-CreateVolumesFromSnapshotTest-1588006594 None] Acquiring lock "cinder-0fbf0c3c-8379-44e0-9816-f48d5c7cf687-delete_volume" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:37:48 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-fb284486-6b26-4aa2-9d61-3505b8580a1d tempest-CreateVolumesFromSnapshotTest-1588006594 None] Lock "cinder-0fbf0c3c-8379-44e0-9816-f48d5c7cf687-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:37:48 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-fb284486-6b26-4aa2-9d61-3505b8580a1d tempest-CreateVolumesFromSnapshotTest-1588006594 None] Acquiring lock "cinder-quobyte-0fbf0c3c-8379-44e0-9816-f48d5c7cf687" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:37:48 devstack sudo[107172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7a96be58-754c-49cd-abb6-853afd42a445 Sep 29 18:37:48 devstack sudo[107172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:48 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-fb284486-6b26-4aa2-9d61-3505b8580a1d tempest-CreateVolumesFromSnapshotTest-1588006594 None] Lock "cinder-quobyte-0fbf0c3c-8379-44e0-9816-f48d5c7cf687" acquired by "delete_volume" :: waited 0.023s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:37:48 devstack sudo[107170]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:48 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a3e4d73-b3d9-4c41-ab7c-15324f3a616c]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:37:48 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-fb284486-6b26-4aa2-9d61-3505b8580a1d tempest-CreateVolumesFromSnapshotTest-1588006594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0fbf0c3c-8379-44e0-9816-f48d5c7cf687 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:48 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-4060769e-1314-4c6e-a41c-77c37e1e3030 tempest-CreateVolumesFromImageTest-1271613264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-acc726d8-6b74-4f12-b9c0-24d68aa34193" returned: 0 in 0.402s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:48 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-4060769e-1314-4c6e-a41c-77c37e1e3030 tempest-CreateVolumesFromImageTest-1271613264 None] Lock "cinder-quobyte-acc726d8-6b74-4f12-b9c0-24d68aa34193" released by "delete_volume" :: held 0.920s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:37:48 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-4060769e-1314-4c6e-a41c-77c37e1e3030 tempest-CreateVolumesFromImageTest-1271613264 None] Created reservations ['19cc83cc-5f3a-4bed-8897-524259533720', 'f6cefce1-3061-47ae-a4d4-c91462e42b6c', 'c3d38420-15c8-49eb-bf6d-78a4a71bda12', 'a51b5826-aa3d-444a-9eea-6601a6345bce'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:37:48 devstack sudo[107175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0fbf0c3c-8379-44e0-9816-f48d5c7cf687 Sep 29 18:37:48 devstack sudo[107175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:49 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-4060769e-1314-4c6e-a41c-77c37e1e3030 tempest-CreateVolumesFromImageTest-1271613264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:37:49 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-4060769e-1314-4c6e-a41c-77c37e1e3030 tempest-CreateVolumesFromImageTest-1271613264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:37:49 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-4060769e-1314-4c6e-a41c-77c37e1e3030 tempest-CreateVolumesFromImageTest-1271613264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:37:49 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-4060769e-1314-4c6e-a41c-77c37e1e3030 tempest-CreateVolumesFromImageTest-1271613264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:37:49 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-4060769e-1314-4c6e-a41c-77c37e1e3030 tempest-CreateVolumesFromImageTest-1271613264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:37:49 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-4060769e-1314-4c6e-a41c-77c37e1e3030 tempest-CreateVolumesFromImageTest-1271613264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:49 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-d3d923a1-556f-4cc1-bc8a-753d30e720df tempest-CreateVolumesFromImageTest-1271613264 None] Acquiring lock "cinder-1777b34b-57ec-41c3-b0ff-918d1a3280f0-delete_volume" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:37:49 devstack sudo[107180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:37:49 devstack sudo[107180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:49 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-d3d923a1-556f-4cc1-bc8a-753d30e720df tempest-CreateVolumesFromImageTest-1271613264 None] Lock "cinder-1777b34b-57ec-41c3-b0ff-918d1a3280f0-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:37:49 devstack sudo[107172]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:49 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-d2991661-5804-4471-9630-cecc9fc0dcd7 tempest-ProjectReaderTests-1023282426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7a96be58-754c-49cd-abb6-853afd42a445" returned: 0 in 0.608s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:49 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-d2991661-5804-4471-9630-cecc9fc0dcd7 tempest-ProjectReaderTests-1023282426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7a96be58-754c-49cd-abb6-853afd42a445 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:49 devstack sudo[107182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7a96be58-754c-49cd-abb6-853afd42a445 Sep 29 18:37:49 devstack sudo[107182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:49 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-d3d923a1-556f-4cc1-bc8a-753d30e720df tempest-CreateVolumesFromImageTest-1271613264 None] Acquiring lock "cinder-quobyte-1777b34b-57ec-41c3-b0ff-918d1a3280f0" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:37:49 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-d3d923a1-556f-4cc1-bc8a-753d30e720df tempest-CreateVolumesFromImageTest-1271613264 None] Lock "cinder-quobyte-1777b34b-57ec-41c3-b0ff-918d1a3280f0" acquired by "delete_volume" :: waited 0.041s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:37:49 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6df9209-f1ab-48ce-a664-7a9421f0668d]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:37:49 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-d3d923a1-556f-4cc1-bc8a-753d30e720df tempest-CreateVolumesFromImageTest-1271613264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-1777b34b-57ec-41c3-b0ff-918d1a3280f0 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:49 devstack sudo[107180]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:49 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-4060769e-1314-4c6e-a41c-77c37e1e3030 tempest-CreateVolumesFromImageTest-1271613264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.324s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:49 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-4060769e-1314-4c6e-a41c-77c37e1e3030 tempest-CreateVolumesFromImageTest-1271613264 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:37:49 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-4060769e-1314-4c6e-a41c-77c37e1e3030 tempest-CreateVolumesFromImageTest-1271613264 None] Deleted volume successfully. Sep 29 18:37:49 devstack sudo[107175]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:49 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-fb284486-6b26-4aa2-9d61-3505b8580a1d tempest-CreateVolumesFromSnapshotTest-1588006594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0fbf0c3c-8379-44e0-9816-f48d5c7cf687" returned: 0 in 0.591s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:49 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-fb284486-6b26-4aa2-9d61-3505b8580a1d tempest-CreateVolumesFromSnapshotTest-1588006594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0fbf0c3c-8379-44e0-9816-f48d5c7cf687 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:49 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-4060769e-1314-4c6e-a41c-77c37e1e3030 tempest-CreateVolumesFromImageTest-1271613264 None] Lock "cinder-acc726d8-6b74-4f12-b9c0-24d68aa34193-delete_volume" released by "delete_volume" :: held 1.566s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:37:49 devstack sudo[107214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0fbf0c3c-8379-44e0-9816-f48d5c7cf687 Sep 29 18:37:49 devstack sudo[107214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:49 devstack sudo[107202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-1777b34b-57ec-41c3-b0ff-918d1a3280f0 Sep 29 18:37:49 devstack sudo[107202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:49 devstack sudo[107182]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:49 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-d2991661-5804-4471-9630-cecc9fc0dcd7 tempest-ProjectReaderTests-1023282426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7a96be58-754c-49cd-abb6-853afd42a445" returned: 0 in 0.513s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:49 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-d2991661-5804-4471-9630-cecc9fc0dcd7 tempest-ProjectReaderTests-1023282426 None] Lock "cinder-quobyte-7a96be58-754c-49cd-abb6-853afd42a445" released by "delete_volume" :: held 1.188s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:37:49 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-d2991661-5804-4471-9630-cecc9fc0dcd7 tempest-ProjectReaderTests-1023282426 None] Created reservations ['4a537e29-58e3-485d-b045-d749e5171af5', 'bb7bda8a-812c-4896-86c5-8cf23f1dc7e2', 'be7d1e60-598e-4368-95fe-971473d143a5', '35739023-0431-4ed5-a726-f466c665f3db'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:37:49 devstack sudo[107202]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:49 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-d3d923a1-556f-4cc1-bc8a-753d30e720df tempest-CreateVolumesFromImageTest-1271613264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-1777b34b-57ec-41c3-b0ff-918d1a3280f0" returned: 0 in 0.513s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:49 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-d3d923a1-556f-4cc1-bc8a-753d30e720df tempest-CreateVolumesFromImageTest-1271613264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-1777b34b-57ec-41c3-b0ff-918d1a3280f0 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:49 devstack sudo[107231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-1777b34b-57ec-41c3-b0ff-918d1a3280f0 Sep 29 18:37:49 devstack sudo[107231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:49 devstack sudo[107214]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:49 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-fb284486-6b26-4aa2-9d61-3505b8580a1d tempest-CreateVolumesFromSnapshotTest-1588006594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0fbf0c3c-8379-44e0-9816-f48d5c7cf687" returned: 0 in 0.483s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:49 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-fb284486-6b26-4aa2-9d61-3505b8580a1d tempest-CreateVolumesFromSnapshotTest-1588006594 None] Lock "cinder-quobyte-0fbf0c3c-8379-44e0-9816-f48d5c7cf687" released by "delete_volume" :: held 1.188s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:37:49 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-d2991661-5804-4471-9630-cecc9fc0dcd7 tempest-ProjectReaderTests-1023282426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:37:49 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-d2991661-5804-4471-9630-cecc9fc0dcd7 tempest-ProjectReaderTests-1023282426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:37:49 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-d2991661-5804-4471-9630-cecc9fc0dcd7 tempest-ProjectReaderTests-1023282426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:37:49 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-d2991661-5804-4471-9630-cecc9fc0dcd7 tempest-ProjectReaderTests-1023282426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:37:49 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-d2991661-5804-4471-9630-cecc9fc0dcd7 tempest-ProjectReaderTests-1023282426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:37:49 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-d2991661-5804-4471-9630-cecc9fc0dcd7 tempest-ProjectReaderTests-1023282426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:49 devstack sudo[107235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:37:49 devstack sudo[107235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:50 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-fb284486-6b26-4aa2-9d61-3505b8580a1d tempest-CreateVolumesFromSnapshotTest-1588006594 None] Created reservations ['06f4dfb2-9d67-4245-b2fe-47cb2639ef67', '326ff76e-6841-4b95-b8e8-b9f909dbe9d8', '3bae8bcf-f8bc-47a5-9671-c57ff40f2a4e', '5d1e8860-5ef9-46b3-baab-b66635033f95'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:37:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-fb284486-6b26-4aa2-9d61-3505b8580a1d tempest-CreateVolumesFromSnapshotTest-1588006594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:37:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-fb284486-6b26-4aa2-9d61-3505b8580a1d tempest-CreateVolumesFromSnapshotTest-1588006594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:37:50 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-fb284486-6b26-4aa2-9d61-3505b8580a1d tempest-CreateVolumesFromSnapshotTest-1588006594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:37:50 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-fb284486-6b26-4aa2-9d61-3505b8580a1d tempest-CreateVolumesFromSnapshotTest-1588006594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:37:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-fb284486-6b26-4aa2-9d61-3505b8580a1d tempest-CreateVolumesFromSnapshotTest-1588006594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:37:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-fb284486-6b26-4aa2-9d61-3505b8580a1d tempest-CreateVolumesFromSnapshotTest-1588006594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:50 devstack sudo[107231]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-d3d923a1-556f-4cc1-bc8a-753d30e720df tempest-CreateVolumesFromImageTest-1271613264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-1777b34b-57ec-41c3-b0ff-918d1a3280f0" returned: 0 in 0.410s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:50 devstack sudo[107238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:37:50 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-d3d923a1-556f-4cc1-bc8a-753d30e720df tempest-CreateVolumesFromImageTest-1271613264 None] Lock "cinder-quobyte-1777b34b-57ec-41c3-b0ff-918d1a3280f0" released by "delete_volume" :: held 0.998s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:37:50 devstack sudo[107238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:50 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-d3d923a1-556f-4cc1-bc8a-753d30e720df tempest-CreateVolumesFromImageTest-1271613264 None] Created reservations ['243de0d8-9fd6-4c14-8855-26b16a005d47', '2608814f-92d8-46cb-8d8a-422752a9cacb', '38c8f1b6-672b-4cb8-b246-c2a1839e755d', '47f8cff1-2674-42cc-99fc-b5eea2e8a17f'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:37:50 devstack sudo[107235]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-d2991661-5804-4471-9630-cecc9fc0dcd7 tempest-ProjectReaderTests-1023282426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.375s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:50 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-d2991661-5804-4471-9630-cecc9fc0dcd7 tempest-ProjectReaderTests-1023282426 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:37:50 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-d2991661-5804-4471-9630-cecc9fc0dcd7 tempest-ProjectReaderTests-1023282426 None] Deleted volume successfully. Sep 29 18:37:50 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-d2991661-5804-4471-9630-cecc9fc0dcd7 tempest-ProjectReaderTests-1023282426 None] Lock "cinder-7a96be58-754c-49cd-abb6-853afd42a445-delete_volume" released by "delete_volume" :: held 1.973s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:37:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-d3d923a1-556f-4cc1-bc8a-753d30e720df tempest-CreateVolumesFromImageTest-1271613264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:37:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-d3d923a1-556f-4cc1-bc8a-753d30e720df tempest-CreateVolumesFromImageTest-1271613264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:37:50 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-d3d923a1-556f-4cc1-bc8a-753d30e720df tempest-CreateVolumesFromImageTest-1271613264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:37:50 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-d3d923a1-556f-4cc1-bc8a-753d30e720df tempest-CreateVolumesFromImageTest-1271613264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:37:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-d3d923a1-556f-4cc1-bc8a-753d30e720df tempest-CreateVolumesFromImageTest-1271613264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:37:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-d3d923a1-556f-4cc1-bc8a-753d30e720df tempest-CreateVolumesFromImageTest-1271613264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:50 devstack sudo[107241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:37:50 devstack sudo[107241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:50 devstack sudo[107238]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-fb284486-6b26-4aa2-9d61-3505b8580a1d tempest-CreateVolumesFromSnapshotTest-1588006594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.327s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:50 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-fb284486-6b26-4aa2-9d61-3505b8580a1d tempest-CreateVolumesFromSnapshotTest-1588006594 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:37:50 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-fb284486-6b26-4aa2-9d61-3505b8580a1d tempest-CreateVolumesFromSnapshotTest-1588006594 None] Deleted volume successfully. Sep 29 18:37:50 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-fb284486-6b26-4aa2-9d61-3505b8580a1d tempest-CreateVolumesFromSnapshotTest-1588006594 None] Lock "cinder-0fbf0c3c-8379-44e0-9816-f48d5c7cf687-delete_volume" released by "delete_volume" :: held 1.922s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:37:50 devstack cinder-volume[86512]: DEBUG oslo_service.periodic_task [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86512) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 18:37:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:37:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:37:50 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:37:50 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:37:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:37:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:50 devstack sudo[107244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:37:50 devstack sudo[107244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:50 devstack sudo[107241]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-d3d923a1-556f-4cc1-bc8a-753d30e720df tempest-CreateVolumesFromImageTest-1271613264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.297s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:50 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-d3d923a1-556f-4cc1-bc8a-753d30e720df tempest-CreateVolumesFromImageTest-1271613264 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:37:50 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-d3d923a1-556f-4cc1-bc8a-753d30e720df tempest-CreateVolumesFromImageTest-1271613264 None] Deleted volume successfully. Sep 29 18:37:50 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-d3d923a1-556f-4cc1-bc8a-753d30e720df tempest-CreateVolumesFromImageTest-1271613264 None] Lock "cinder-1777b34b-57ec-41c3-b0ff-918d1a3280f0-delete_volume" released by "delete_volume" :: held 1.635s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:37:50 devstack sudo[107244]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.317s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:50 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:37:50 devstack cinder-volume[86512]: DEBUG oslo_service.periodic_task [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Running periodic task VolumeManager._thread_info {{(pid=86512) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 18:37:50 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] thread count: 29 {{(pid=86512) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 29 18:37:50 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] thread info: [<_MainThread(MainThread, started 135593654804608)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86512) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 29 18:37:51 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e975bd7-f444-43ba-92c3-42ccad088cfd tempest-ProjectReaderTests-1023282426 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86512) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:37:51 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-6e975bd7-f444-43ba-92c3-42ccad088cfd tempest-ProjectReaderTests-1023282426 None] Flow 'volume_create_manager' (69a5b49c-4711-4e18-9c2d-c3182c0dd276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:37:51 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-6e975bd7-f444-43ba-92c3-42ccad088cfd tempest-ProjectReaderTests-1023282426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3a6f877-474b-43f0-a57b-5b10ffde2054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:51 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-6e975bd7-f444-43ba-92c3-42ccad088cfd tempest-ProjectReaderTests-1023282426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3a6f877-474b-43f0-a57b-5b10ffde2054) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:37:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-430601588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae3b4b86-63ad-4d35-ab9f-ae075b9480a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c6583dad59442f381d38f8f0383dc2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:37:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:37:51Z,use_quota=True,user_id='ef7764e50a99455faed61f3e9a1ca584',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:51 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-6e975bd7-f444-43ba-92c3-42ccad088cfd tempest-ProjectReaderTests-1023282426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c11d0406-29b0-4870-ac66-3783cbcf4ea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:51 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-6e975bd7-f444-43ba-92c3-42ccad088cfd tempest-ProjectReaderTests-1023282426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c11d0406-29b0-4870-ac66-3783cbcf4ea3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:51 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-6e975bd7-f444-43ba-92c3-42ccad088cfd tempest-ProjectReaderTests-1023282426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (440ac160-eeec-46fc-9a68-a15db08e4b86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:51 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-6e975bd7-f444-43ba-92c3-42ccad088cfd tempest-ProjectReaderTests-1023282426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (440ac160-eeec-46fc-9a68-a15db08e4b86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae3b4b86-63ad-4d35-ab9f-ae075b9480a6', 'volume_name': 'volume-ae3b4b86-63ad-4d35-ab9f-ae075b9480a6', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:51 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-6e975bd7-f444-43ba-92c3-42ccad088cfd tempest-ProjectReaderTests-1023282426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (210369e2-c542-4f4f-8eb8-550df8268bf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:51 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-6e975bd7-f444-43ba-92c3-42ccad088cfd tempest-ProjectReaderTests-1023282426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (210369e2-c542-4f4f-8eb8-550df8268bf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:51 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-6e975bd7-f444-43ba-92c3-42ccad088cfd tempest-ProjectReaderTests-1023282426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f394a05a-83e0-4018-ad00-e93f4a911352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:51 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-6e975bd7-f444-43ba-92c3-42ccad088cfd tempest-ProjectReaderTests-1023282426 None] Volume ae3b4b86-63ad-4d35-ab9f-ae075b9480a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae3b4b86-63ad-4d35-ab9f-ae075b9480a6', 'volume_size': 1} Sep 29 18:37:51 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-6e975bd7-f444-43ba-92c3-42ccad088cfd tempest-ProjectReaderTests-1023282426 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:37:51 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-6e975bd7-f444-43ba-92c3-42ccad088cfd tempest-ProjectReaderTests-1023282426 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:37:51 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-6e975bd7-f444-43ba-92c3-42ccad088cfd tempest-ProjectReaderTests-1023282426 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:37:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-430601588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae3b4b86-63ad-4d35-ab9f-ae075b9480a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c6583dad59442f381d38f8f0383dc2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:37:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:37:51Z,use_quota=True,user_id='ef7764e50a99455faed61f3e9a1ca584',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)}" {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:37:51 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-6e975bd7-f444-43ba-92c3-42ccad088cfd tempest-ProjectReaderTests-1023282426 None] Creating volume ae3b4b86-63ad-4d35-ab9f-ae075b9480a6 {{(pid=86512) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:37:51 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-6e975bd7-f444-43ba-92c3-42ccad088cfd tempest-ProjectReaderTests-1023282426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:37:51 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-6e975bd7-f444-43ba-92c3-42ccad088cfd tempest-ProjectReaderTests-1023282426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:37:51 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-6e975bd7-f444-43ba-92c3-42ccad088cfd tempest-ProjectReaderTests-1023282426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:37:51 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-6e975bd7-f444-43ba-92c3-42ccad088cfd tempest-ProjectReaderTests-1023282426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:37:51 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-6e975bd7-f444-43ba-92c3-42ccad088cfd tempest-ProjectReaderTests-1023282426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:37:51 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-6e975bd7-f444-43ba-92c3-42ccad088cfd tempest-ProjectReaderTests-1023282426 None] Selected osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 as target Quobyte volume. {{(pid=86512) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:37:51 devstack cinder-volume[86512]: INFO cinder.volume.drivers.remotefs [None req-6e975bd7-f444-43ba-92c3-42ccad088cfd tempest-ProjectReaderTests-1023282426 None] casted to osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 Sep 29 18:37:51 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-6e975bd7-f444-43ba-92c3-42ccad088cfd tempest-ProjectReaderTests-1023282426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ae3b4b86-63ad-4d35-ab9f-ae075b9480a6 1073741824 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:51 devstack sudo[107248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ae3b4b86-63ad-4d35-ab9f-ae075b9480a6 1073741824 Sep 29 18:37:51 devstack sudo[107248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:51 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-c8cef50b-3e66-4806-8951-e684e4dc8d4d tempest-CreateVolumesFromImageTest-1271613264 None] Acquiring lock "cinder-0f91f1de-ec81-4594-b974-e6e8c81d6e28-delete_volume" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:37:51 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-c8cef50b-3e66-4806-8951-e684e4dc8d4d tempest-CreateVolumesFromImageTest-1271613264 None] Lock "cinder-0f91f1de-ec81-4594-b974-e6e8c81d6e28-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:37:51 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-c8cef50b-3e66-4806-8951-e684e4dc8d4d tempest-CreateVolumesFromImageTest-1271613264 None] Acquiring lock "cinder-quobyte-0f91f1de-ec81-4594-b974-e6e8c81d6e28" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:37:51 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-c8cef50b-3e66-4806-8951-e684e4dc8d4d tempest-CreateVolumesFromImageTest-1271613264 None] Lock "cinder-quobyte-0f91f1de-ec81-4594-b974-e6e8c81d6e28" acquired by "delete_volume" :: waited 0.016s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:37:51 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a0f0be6-e922-4068-a063-df1fb856386e]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:37:51 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-c8cef50b-3e66-4806-8951-e684e4dc8d4d tempest-CreateVolumesFromImageTest-1271613264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0f91f1de-ec81-4594-b974-e6e8c81d6e28 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:51 devstack sudo[107253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0f91f1de-ec81-4594-b974-e6e8c81d6e28 Sep 29 18:37:51 devstack sudo[107253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:51 devstack sudo[107248]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:51 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-6e975bd7-f444-43ba-92c3-42ccad088cfd tempest-ProjectReaderTests-1023282426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ae3b4b86-63ad-4d35-ab9f-ae075b9480a6 1073741824" returned: 0 in 0.579s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:51 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-6e975bd7-f444-43ba-92c3-42ccad088cfd tempest-ProjectReaderTests-1023282426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ae3b4b86-63ad-4d35-ab9f-ae075b9480a6 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:51 devstack sudo[107255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ae3b4b86-63ad-4d35-ab9f-ae075b9480a6 Sep 29 18:37:51 devstack sudo[107255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:52 devstack sudo[107253]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:52 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-c8cef50b-3e66-4806-8951-e684e4dc8d4d tempest-CreateVolumesFromImageTest-1271613264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0f91f1de-ec81-4594-b974-e6e8c81d6e28" returned: 0 in 0.525s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:52 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-c8cef50b-3e66-4806-8951-e684e4dc8d4d tempest-CreateVolumesFromImageTest-1271613264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0f91f1de-ec81-4594-b974-e6e8c81d6e28 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:52 devstack sudo[107261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0f91f1de-ec81-4594-b974-e6e8c81d6e28 Sep 29 18:37:52 devstack sudo[107261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:52 devstack sudo[107255]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:52 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-6e975bd7-f444-43ba-92c3-42ccad088cfd tempest-ProjectReaderTests-1023282426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ae3b4b86-63ad-4d35-ab9f-ae075b9480a6" returned: 0 in 0.354s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:52 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-6e975bd7-f444-43ba-92c3-42ccad088cfd tempest-ProjectReaderTests-1023282426 None] <== create_volume: return (993ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'} {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:37:52 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-6e975bd7-f444-43ba-92c3-42ccad088cfd tempest-ProjectReaderTests-1023282426 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.996s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:37:52 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-6e975bd7-f444-43ba-92c3-42ccad088cfd tempest-ProjectReaderTests-1023282426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f394a05a-83e0-4018-ad00-e93f4a911352) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae3b4b86-63ad-4d35-ab9f-ae075b9480a6', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:52 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-6e975bd7-f444-43ba-92c3-42ccad088cfd tempest-ProjectReaderTests-1023282426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ec1f760-2e2f-41ba-b626-8f6beb8271e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:52 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-6e975bd7-f444-43ba-92c3-42ccad088cfd tempest-ProjectReaderTests-1023282426 None] Volume volume-ae3b4b86-63ad-4d35-ab9f-ae075b9480a6 (ae3b4b86-63ad-4d35-ab9f-ae075b9480a6): created successfully Sep 29 18:37:52 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-6e975bd7-f444-43ba-92c3-42ccad088cfd tempest-ProjectReaderTests-1023282426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ec1f760-2e2f-41ba-b626-8f6beb8271e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:52 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-6e975bd7-f444-43ba-92c3-42ccad088cfd tempest-ProjectReaderTests-1023282426 None] Flow 'volume_create_manager' (69a5b49c-4711-4e18-9c2d-c3182c0dd276) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:37:52 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-6e975bd7-f444-43ba-92c3-42ccad088cfd tempest-ProjectReaderTests-1023282426 None] Created volume successfully. Sep 29 18:37:52 devstack sudo[107261]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:52 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-c8cef50b-3e66-4806-8951-e684e4dc8d4d tempest-CreateVolumesFromImageTest-1271613264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0f91f1de-ec81-4594-b974-e6e8c81d6e28" returned: 0 in 0.323s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:52 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-c8cef50b-3e66-4806-8951-e684e4dc8d4d tempest-CreateVolumesFromImageTest-1271613264 None] Lock "cinder-quobyte-0f91f1de-ec81-4594-b974-e6e8c81d6e28" released by "delete_volume" :: held 0.903s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:37:52 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-c8cef50b-3e66-4806-8951-e684e4dc8d4d tempest-CreateVolumesFromImageTest-1271613264 None] Created reservations ['ef5b2beb-3c9e-4588-b3ae-7697ea524435', '1e6160cf-dcd7-40fc-bfed-1276335c2365', '44577084-361b-4dcd-9cf1-3b05c554dd90', '3d2edbad-cc5e-48dc-a74e-5467cd4c84d8'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:37:52 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-c8cef50b-3e66-4806-8951-e684e4dc8d4d tempest-CreateVolumesFromImageTest-1271613264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:37:52 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-c8cef50b-3e66-4806-8951-e684e4dc8d4d tempest-CreateVolumesFromImageTest-1271613264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:37:52 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-c8cef50b-3e66-4806-8951-e684e4dc8d4d tempest-CreateVolumesFromImageTest-1271613264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:37:52 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-c8cef50b-3e66-4806-8951-e684e4dc8d4d tempest-CreateVolumesFromImageTest-1271613264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:37:52 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-c8cef50b-3e66-4806-8951-e684e4dc8d4d tempest-CreateVolumesFromImageTest-1271613264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:37:52 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-c8cef50b-3e66-4806-8951-e684e4dc8d4d tempest-CreateVolumesFromImageTest-1271613264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:52 devstack sudo[107265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:37:52 devstack sudo[107265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:52 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-e4a29759-260f-40f5-ae61-1986685ce47d tempest-CreateVolumesFromImageTest-1271613264 None] Acquiring lock "cinder-9a50906f-ace1-4069-a798-715d2d278732-delete_volume" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:37:52 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-e4a29759-260f-40f5-ae61-1986685ce47d tempest-CreateVolumesFromImageTest-1271613264 None] Lock "cinder-9a50906f-ace1-4069-a798-715d2d278732-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:37:52 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-e4a29759-260f-40f5-ae61-1986685ce47d tempest-CreateVolumesFromImageTest-1271613264 None] Acquiring lock "cinder-quobyte-9a50906f-ace1-4069-a798-715d2d278732" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:37:52 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-e4a29759-260f-40f5-ae61-1986685ce47d tempest-CreateVolumesFromImageTest-1271613264 None] Lock "cinder-quobyte-9a50906f-ace1-4069-a798-715d2d278732" acquired by "delete_volume" :: waited 0.025s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:37:52 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[218ae73f-a5a3-4e48-97f4-d39a271f4981]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:37:52 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-e4a29759-260f-40f5-ae61-1986685ce47d tempest-CreateVolumesFromImageTest-1271613264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-9a50906f-ace1-4069-a798-715d2d278732 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:52 devstack sudo[107265]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:53 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-c8cef50b-3e66-4806-8951-e684e4dc8d4d tempest-CreateVolumesFromImageTest-1271613264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.389s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:53 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-c8cef50b-3e66-4806-8951-e684e4dc8d4d tempest-CreateVolumesFromImageTest-1271613264 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:37:53 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-c8cef50b-3e66-4806-8951-e684e4dc8d4d tempest-CreateVolumesFromImageTest-1271613264 None] Deleted volume successfully. Sep 29 18:37:53 devstack sudo[107267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-9a50906f-ace1-4069-a798-715d2d278732 Sep 29 18:37:53 devstack sudo[107267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:53 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-c8cef50b-3e66-4806-8951-e684e4dc8d4d tempest-CreateVolumesFromImageTest-1271613264 None] Lock "cinder-0f91f1de-ec81-4594-b974-e6e8c81d6e28-delete_volume" released by "delete_volume" :: held 1.562s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:37:53 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-315f4ccd-0668-4f7d-aacd-7bd9578da4bf tempest-ProjectReaderTests-1023282426 None] Acquiring lock "cinder-ae3b4b86-63ad-4d35-ab9f-ae075b9480a6-delete_volume" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:37:53 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-315f4ccd-0668-4f7d-aacd-7bd9578da4bf tempest-ProjectReaderTests-1023282426 None] Lock "cinder-ae3b4b86-63ad-4d35-ab9f-ae075b9480a6-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:37:53 devstack sudo[107267]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:53 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-e4a29759-260f-40f5-ae61-1986685ce47d tempest-CreateVolumesFromImageTest-1271613264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-9a50906f-ace1-4069-a798-715d2d278732" returned: 0 in 0.490s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:53 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-e4a29759-260f-40f5-ae61-1986685ce47d tempest-CreateVolumesFromImageTest-1271613264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-9a50906f-ace1-4069-a798-715d2d278732 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:53 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-315f4ccd-0668-4f7d-aacd-7bd9578da4bf tempest-ProjectReaderTests-1023282426 None] Acquiring lock "cinder-quobyte-ae3b4b86-63ad-4d35-ab9f-ae075b9480a6" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:37:53 devstack sudo[107273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-9a50906f-ace1-4069-a798-715d2d278732 Sep 29 18:37:53 devstack sudo[107273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:53 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-315f4ccd-0668-4f7d-aacd-7bd9578da4bf tempest-ProjectReaderTests-1023282426 None] Lock "cinder-quobyte-ae3b4b86-63ad-4d35-ab9f-ae075b9480a6" acquired by "delete_volume" :: waited 0.019s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:37:53 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a7082eb-18ea-48eb-9f05-0c5c17a527b2]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:37:53 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-315f4ccd-0668-4f7d-aacd-7bd9578da4bf tempest-ProjectReaderTests-1023282426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ae3b4b86-63ad-4d35-ab9f-ae075b9480a6 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:53 devstack sudo[107275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ae3b4b86-63ad-4d35-ab9f-ae075b9480a6 Sep 29 18:37:53 devstack sudo[107275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:53 devstack sudo[107273]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:53 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-e4a29759-260f-40f5-ae61-1986685ce47d tempest-CreateVolumesFromImageTest-1271613264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-9a50906f-ace1-4069-a798-715d2d278732" returned: 0 in 0.261s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:53 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-e4a29759-260f-40f5-ae61-1986685ce47d tempest-CreateVolumesFromImageTest-1271613264 None] Lock "cinder-quobyte-9a50906f-ace1-4069-a798-715d2d278732" released by "delete_volume" :: held 0.827s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:37:53 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-e4a29759-260f-40f5-ae61-1986685ce47d tempest-CreateVolumesFromImageTest-1271613264 None] Created reservations ['11a13ec0-6895-454b-a5ff-33de91be8c4b', '52e4b3b9-3a89-4555-a6a8-6ec90c79eb9d', '193631aa-adac-4518-8d30-e7bfde03ee8b', '1a434cae-50b8-434e-a753-53a4012fed4d'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:37:53 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-e4a29759-260f-40f5-ae61-1986685ce47d tempest-CreateVolumesFromImageTest-1271613264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:37:53 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-e4a29759-260f-40f5-ae61-1986685ce47d tempest-CreateVolumesFromImageTest-1271613264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:37:53 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-e4a29759-260f-40f5-ae61-1986685ce47d tempest-CreateVolumesFromImageTest-1271613264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:37:53 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-e4a29759-260f-40f5-ae61-1986685ce47d tempest-CreateVolumesFromImageTest-1271613264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:37:53 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-e4a29759-260f-40f5-ae61-1986685ce47d tempest-CreateVolumesFromImageTest-1271613264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:37:53 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-e4a29759-260f-40f5-ae61-1986685ce47d tempest-CreateVolumesFromImageTest-1271613264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:53 devstack sudo[107281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:37:53 devstack sudo[107281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:53 devstack sudo[107275]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:53 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-315f4ccd-0668-4f7d-aacd-7bd9578da4bf tempest-ProjectReaderTests-1023282426 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ae3b4b86-63ad-4d35-ab9f-ae075b9480a6" returned: 0 in 0.416s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:53 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-315f4ccd-0668-4f7d-aacd-7bd9578da4bf tempest-ProjectReaderTests-1023282426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ae3b4b86-63ad-4d35-ab9f-ae075b9480a6 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:53 devstack sudo[107283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ae3b4b86-63ad-4d35-ab9f-ae075b9480a6 Sep 29 18:37:53 devstack sudo[107283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:53 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-b8d6b82f-dcd9-4bd2-8c6e-aa11e339aec9 tempest-CreateVolumesFromImageTest-1271613264 None] Acquiring lock "cinder-4a190b87-66d4-41b0-89b2-40f0c885e6d9-delete_volume" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:37:53 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-b8d6b82f-dcd9-4bd2-8c6e-aa11e339aec9 tempest-CreateVolumesFromImageTest-1271613264 None] Lock "cinder-4a190b87-66d4-41b0-89b2-40f0c885e6d9-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:37:54 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-b8d6b82f-dcd9-4bd2-8c6e-aa11e339aec9 tempest-CreateVolumesFromImageTest-1271613264 None] Acquiring lock "cinder-quobyte-4a190b87-66d4-41b0-89b2-40f0c885e6d9" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:37:54 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-b8d6b82f-dcd9-4bd2-8c6e-aa11e339aec9 tempest-CreateVolumesFromImageTest-1271613264 None] Lock "cinder-quobyte-4a190b87-66d4-41b0-89b2-40f0c885e6d9" acquired by "delete_volume" :: waited 0.030s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:37:54 devstack sudo[107281]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:54 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-e4a29759-260f-40f5-ae61-1986685ce47d tempest-CreateVolumesFromImageTest-1271613264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.332s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:54 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-e4a29759-260f-40f5-ae61-1986685ce47d tempest-CreateVolumesFromImageTest-1271613264 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:37:54 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-e4a29759-260f-40f5-ae61-1986685ce47d tempest-CreateVolumesFromImageTest-1271613264 None] Deleted volume successfully. Sep 29 18:37:54 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4354e43-feb6-472e-b874-1e9ae525c1ae]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:37:54 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-b8d6b82f-dcd9-4bd2-8c6e-aa11e339aec9 tempest-CreateVolumesFromImageTest-1271613264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-4a190b87-66d4-41b0-89b2-40f0c885e6d9 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:54 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-e4a29759-260f-40f5-ae61-1986685ce47d tempest-CreateVolumesFromImageTest-1271613264 None] Lock "cinder-9a50906f-ace1-4069-a798-715d2d278732-delete_volume" released by "delete_volume" :: held 1.437s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:37:54 devstack sudo[107286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-4a190b87-66d4-41b0-89b2-40f0c885e6d9 Sep 29 18:37:54 devstack sudo[107286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:54 devstack sudo[107283]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:54 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-315f4ccd-0668-4f7d-aacd-7bd9578da4bf tempest-ProjectReaderTests-1023282426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ae3b4b86-63ad-4d35-ab9f-ae075b9480a6" returned: 0 in 0.446s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:54 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-315f4ccd-0668-4f7d-aacd-7bd9578da4bf tempest-ProjectReaderTests-1023282426 None] Lock "cinder-quobyte-ae3b4b86-63ad-4d35-ab9f-ae075b9480a6" released by "delete_volume" :: held 0.920s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:37:54 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-315f4ccd-0668-4f7d-aacd-7bd9578da4bf tempest-ProjectReaderTests-1023282426 None] Created reservations ['f4ef32d2-70e0-465c-8299-608a9c88ec96', 'ace1f0c2-59fa-4b1d-b23b-10ef06028bbd', '26ba294b-528a-4940-9d81-de5f4e6d9e85', '1135c1f5-4ad4-4311-8aee-2f32a6201561'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:37:54 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-315f4ccd-0668-4f7d-aacd-7bd9578da4bf tempest-ProjectReaderTests-1023282426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:37:54 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-315f4ccd-0668-4f7d-aacd-7bd9578da4bf tempest-ProjectReaderTests-1023282426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:37:54 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-315f4ccd-0668-4f7d-aacd-7bd9578da4bf tempest-ProjectReaderTests-1023282426 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:37:54 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-315f4ccd-0668-4f7d-aacd-7bd9578da4bf tempest-ProjectReaderTests-1023282426 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:37:54 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-315f4ccd-0668-4f7d-aacd-7bd9578da4bf tempest-ProjectReaderTests-1023282426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:37:54 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-315f4ccd-0668-4f7d-aacd-7bd9578da4bf tempest-ProjectReaderTests-1023282426 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:54 devstack sudo[107292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:37:54 devstack sudo[107292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:54 devstack sudo[107286]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:54 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-b8d6b82f-dcd9-4bd2-8c6e-aa11e339aec9 tempest-CreateVolumesFromImageTest-1271613264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-4a190b87-66d4-41b0-89b2-40f0c885e6d9" returned: 0 in 0.501s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:54 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-b8d6b82f-dcd9-4bd2-8c6e-aa11e339aec9 tempest-CreateVolumesFromImageTest-1271613264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-4a190b87-66d4-41b0-89b2-40f0c885e6d9 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:54 devstack sudo[107296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-4a190b87-66d4-41b0-89b2-40f0c885e6d9 Sep 29 18:37:54 devstack sudo[107296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:54 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-813a1ea9-e360-4882-985f-fe6ada09d7c2 tempest-CinderUnicodeTest-435747895 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86512) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:37:54 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-813a1ea9-e360-4882-985f-fe6ada09d7c2 tempest-CinderUnicodeTest-435747895 None] Flow 'volume_create_manager' (b2fbc06f-355e-4b22-9687-ed4ffb4f2215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:37:54 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-813a1ea9-e360-4882-985f-fe6ada09d7c2 tempest-CinderUnicodeTest-435747895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63886005-e7f4-4674-b198-67441943e0fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:54 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-813a1ea9-e360-4882-985f-fe6ada09d7c2 tempest-CinderUnicodeTest-435747895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63886005-e7f4-4674-b198-67441943e0fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:37:54Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f19082d-d1ef-4b87-998b-416e6b4ee131,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e71cf491c9a497db212d74f70bc19a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:37:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:37:55Z,use_quota=True,user_id='cb6a1631765c4ac4b72f6b0dc1b5f4c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:54 devstack sudo[107292]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:54 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-813a1ea9-e360-4882-985f-fe6ada09d7c2 tempest-CinderUnicodeTest-435747895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f7d5ecf-dfa6-4258-a6a2-f4852dcdcea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:54 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-813a1ea9-e360-4882-985f-fe6ada09d7c2 tempest-CinderUnicodeTest-435747895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f7d5ecf-dfa6-4258-a6a2-f4852dcdcea3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:54 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-813a1ea9-e360-4882-985f-fe6ada09d7c2 tempest-CinderUnicodeTest-435747895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b4fdbcc-94b0-4da8-aed8-6a129646eaac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:54 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-813a1ea9-e360-4882-985f-fe6ada09d7c2 tempest-CinderUnicodeTest-435747895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b4fdbcc-94b0-4da8-aed8-6a129646eaac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f19082d-d1ef-4b87-998b-416e6b4ee131', 'volume_name': 'volume-4f19082d-d1ef-4b87-998b-416e6b4ee131', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:54 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-813a1ea9-e360-4882-985f-fe6ada09d7c2 tempest-CinderUnicodeTest-435747895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57437076-c2f7-4047-9d64-1030926687ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:54 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-813a1ea9-e360-4882-985f-fe6ada09d7c2 tempest-CinderUnicodeTest-435747895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57437076-c2f7-4047-9d64-1030926687ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:54 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-813a1ea9-e360-4882-985f-fe6ada09d7c2 tempest-CinderUnicodeTest-435747895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b094bbb0-5c72-40c2-b64f-0ca67382918f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:54 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-813a1ea9-e360-4882-985f-fe6ada09d7c2 tempest-CinderUnicodeTest-435747895 None] Volume 4f19082d-d1ef-4b87-998b-416e6b4ee131: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f19082d-d1ef-4b87-998b-416e6b4ee131', 'volume_size': 1} Sep 29 18:37:54 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-813a1ea9-e360-4882-985f-fe6ada09d7c2 tempest-CinderUnicodeTest-435747895 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:37:54 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-813a1ea9-e360-4882-985f-fe6ada09d7c2 tempest-CinderUnicodeTest-435747895 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:37:54 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-813a1ea9-e360-4882-985f-fe6ada09d7c2 tempest-CinderUnicodeTest-435747895 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:37:54Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f19082d-d1ef-4b87-998b-416e6b4ee131,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e71cf491c9a497db212d74f70bc19a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:37:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:37:55Z,use_quota=True,user_id='cb6a1631765c4ac4b72f6b0dc1b5f4c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)}" {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:37:54 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-813a1ea9-e360-4882-985f-fe6ada09d7c2 tempest-CinderUnicodeTest-435747895 None] Creating volume 4f19082d-d1ef-4b87-998b-416e6b4ee131 {{(pid=86512) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:37:54 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-813a1ea9-e360-4882-985f-fe6ada09d7c2 tempest-CinderUnicodeTest-435747895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:37:54 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-813a1ea9-e360-4882-985f-fe6ada09d7c2 tempest-CinderUnicodeTest-435747895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:37:54 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-813a1ea9-e360-4882-985f-fe6ada09d7c2 tempest-CinderUnicodeTest-435747895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:37:54 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-813a1ea9-e360-4882-985f-fe6ada09d7c2 tempest-CinderUnicodeTest-435747895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:37:54 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-813a1ea9-e360-4882-985f-fe6ada09d7c2 tempest-CinderUnicodeTest-435747895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:37:54 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-813a1ea9-e360-4882-985f-fe6ada09d7c2 tempest-CinderUnicodeTest-435747895 None] Selected osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 as target Quobyte volume. {{(pid=86512) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:37:54 devstack cinder-volume[86512]: INFO cinder.volume.drivers.remotefs [None req-813a1ea9-e360-4882-985f-fe6ada09d7c2 tempest-CinderUnicodeTest-435747895 None] casted to osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 Sep 29 18:37:54 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-813a1ea9-e360-4882-985f-fe6ada09d7c2 tempest-CinderUnicodeTest-435747895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-4f19082d-d1ef-4b87-998b-416e6b4ee131 1073741824 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:54 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-315f4ccd-0668-4f7d-aacd-7bd9578da4bf tempest-ProjectReaderTests-1023282426 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.390s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:54 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-315f4ccd-0668-4f7d-aacd-7bd9578da4bf tempest-ProjectReaderTests-1023282426 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:37:54 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-315f4ccd-0668-4f7d-aacd-7bd9578da4bf tempest-ProjectReaderTests-1023282426 None] Deleted volume successfully. Sep 29 18:37:54 devstack sudo[107299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-4f19082d-d1ef-4b87-998b-416e6b4ee131 1073741824 Sep 29 18:37:54 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-315f4ccd-0668-4f7d-aacd-7bd9578da4bf tempest-ProjectReaderTests-1023282426 None] Lock "cinder-ae3b4b86-63ad-4d35-ab9f-ae075b9480a6-delete_volume" released by "delete_volume" :: held 1.640s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:37:54 devstack sudo[107299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:55 devstack sudo[107296]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:55 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-b8d6b82f-dcd9-4bd2-8c6e-aa11e339aec9 tempest-CreateVolumesFromImageTest-1271613264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-4a190b87-66d4-41b0-89b2-40f0c885e6d9" returned: 0 in 0.427s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:55 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-b8d6b82f-dcd9-4bd2-8c6e-aa11e339aec9 tempest-CreateVolumesFromImageTest-1271613264 None] Lock "cinder-quobyte-4a190b87-66d4-41b0-89b2-40f0c885e6d9" released by "delete_volume" :: held 1.035s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:37:55 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-b8d6b82f-dcd9-4bd2-8c6e-aa11e339aec9 tempest-CreateVolumesFromImageTest-1271613264 None] Created reservations ['22b8c057-887e-4836-8892-a57dc8d75f33', 'fd864db2-9fc1-4ad0-8295-41b6e6cc78c1', '5ba85986-6119-421c-a31f-e6378989ec48', '87cfdead-923d-424b-b3c9-ac7b8a2dfbde'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:37:55 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-b8d6b82f-dcd9-4bd2-8c6e-aa11e339aec9 tempest-CreateVolumesFromImageTest-1271613264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:37:55 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-b8d6b82f-dcd9-4bd2-8c6e-aa11e339aec9 tempest-CreateVolumesFromImageTest-1271613264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:37:55 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-b8d6b82f-dcd9-4bd2-8c6e-aa11e339aec9 tempest-CreateVolumesFromImageTest-1271613264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:37:55 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-b8d6b82f-dcd9-4bd2-8c6e-aa11e339aec9 tempest-CreateVolumesFromImageTest-1271613264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:37:55 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-b8d6b82f-dcd9-4bd2-8c6e-aa11e339aec9 tempest-CreateVolumesFromImageTest-1271613264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:37:55 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-b8d6b82f-dcd9-4bd2-8c6e-aa11e339aec9 tempest-CreateVolumesFromImageTest-1271613264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:55 devstack sudo[107305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:37:55 devstack sudo[107305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:55 devstack sudo[107299]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:55 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-813a1ea9-e360-4882-985f-fe6ada09d7c2 tempest-CinderUnicodeTest-435747895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-4f19082d-d1ef-4b87-998b-416e6b4ee131 1073741824" returned: 0 in 0.658s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:55 devstack sudo[107305]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:55 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-b8d6b82f-dcd9-4bd2-8c6e-aa11e339aec9 tempest-CreateVolumesFromImageTest-1271613264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.314s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:55 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-b8d6b82f-dcd9-4bd2-8c6e-aa11e339aec9 tempest-CreateVolumesFromImageTest-1271613264 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:37:55 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-b8d6b82f-dcd9-4bd2-8c6e-aa11e339aec9 tempest-CreateVolumesFromImageTest-1271613264 None] Deleted volume successfully. Sep 29 18:37:55 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-813a1ea9-e360-4882-985f-fe6ada09d7c2 tempest-CinderUnicodeTest-435747895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-4f19082d-d1ef-4b87-998b-416e6b4ee131 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:55 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-b8d6b82f-dcd9-4bd2-8c6e-aa11e339aec9 tempest-CreateVolumesFromImageTest-1271613264 None] Lock "cinder-4a190b87-66d4-41b0-89b2-40f0c885e6d9-delete_volume" released by "delete_volume" :: held 1.698s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:37:55 devstack sudo[107308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-4f19082d-d1ef-4b87-998b-416e6b4ee131 Sep 29 18:37:55 devstack sudo[107308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:55 devstack sudo[107308]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:55 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-813a1ea9-e360-4882-985f-fe6ada09d7c2 tempest-CinderUnicodeTest-435747895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-4f19082d-d1ef-4b87-998b-416e6b4ee131" returned: 0 in 0.259s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:55 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-813a1ea9-e360-4882-985f-fe6ada09d7c2 tempest-CinderUnicodeTest-435747895 None] <== create_volume: return (981ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'} {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:37:55 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-813a1ea9-e360-4882-985f-fe6ada09d7c2 tempest-CinderUnicodeTest-435747895 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.984s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:37:55 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-813a1ea9-e360-4882-985f-fe6ada09d7c2 tempest-CinderUnicodeTest-435747895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b094bbb0-5c72-40c2-b64f-0ca67382918f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f19082d-d1ef-4b87-998b-416e6b4ee131', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:55 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-813a1ea9-e360-4882-985f-fe6ada09d7c2 tempest-CinderUnicodeTest-435747895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a246cfd5-a213-41a3-aadd-ddcfb42fefd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:55 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-813a1ea9-e360-4882-985f-fe6ada09d7c2 tempest-CinderUnicodeTest-435747895 None] Volume volume-4f19082d-d1ef-4b87-998b-416e6b4ee131 (4f19082d-d1ef-4b87-998b-416e6b4ee131): created successfully Sep 29 18:37:55 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-813a1ea9-e360-4882-985f-fe6ada09d7c2 tempest-CinderUnicodeTest-435747895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a246cfd5-a213-41a3-aadd-ddcfb42fefd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:55 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-813a1ea9-e360-4882-985f-fe6ada09d7c2 tempest-CinderUnicodeTest-435747895 None] Flow 'volume_create_manager' (b2fbc06f-355e-4b22-9687-ed4ffb4f2215) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:37:55 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-813a1ea9-e360-4882-985f-fe6ada09d7c2 tempest-CinderUnicodeTest-435747895 None] Created volume successfully. Sep 29 18:37:57 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6055a64-024f-4f4a-bbfb-8bf9dc23fe15 tempest-CinderUnicodeTest-435747895 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86512) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:37:57 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-f6055a64-024f-4f4a-bbfb-8bf9dc23fe15 tempest-CinderUnicodeTest-435747895 None] Flow 'volume_create_manager' (48ced4e1-43d9-429b-9e82-7ce55026425a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:37:57 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-f6055a64-024f-4f4a-bbfb-8bf9dc23fe15 tempest-CinderUnicodeTest-435747895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f240063-5841-45d5-bf14-8c6d15a2bf83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:57 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-f6055a64-024f-4f4a-bbfb-8bf9dc23fe15 tempest-CinderUnicodeTest-435747895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f240063-5841-45d5-bf14-8c6d15a2bf83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:37:57Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-945095222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce447f64-1e86-45dc-a9a0-14eac625e568,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e71cf491c9a497db212d74f70bc19a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:37:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:37:57Z,use_quota=True,user_id='cb6a1631765c4ac4b72f6b0dc1b5f4c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:57 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-f6055a64-024f-4f4a-bbfb-8bf9dc23fe15 tempest-CinderUnicodeTest-435747895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52a2aec5-d982-4243-aa98-9c8602ecda28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:57 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-f6055a64-024f-4f4a-bbfb-8bf9dc23fe15 tempest-CinderUnicodeTest-435747895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52a2aec5-d982-4243-aa98-9c8602ecda28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:57 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-f6055a64-024f-4f4a-bbfb-8bf9dc23fe15 tempest-CinderUnicodeTest-435747895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (279955d3-4985-45bb-928a-e478fae5a48b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:57 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-f6055a64-024f-4f4a-bbfb-8bf9dc23fe15 tempest-CinderUnicodeTest-435747895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (279955d3-4985-45bb-928a-e478fae5a48b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce447f64-1e86-45dc-a9a0-14eac625e568', 'volume_name': 'volume-ce447f64-1e86-45dc-a9a0-14eac625e568', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:57 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-f6055a64-024f-4f4a-bbfb-8bf9dc23fe15 tempest-CinderUnicodeTest-435747895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e73ebf5-2623-4424-aec3-e484c63f123e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:57 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-f6055a64-024f-4f4a-bbfb-8bf9dc23fe15 tempest-CinderUnicodeTest-435747895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e73ebf5-2623-4424-aec3-e484c63f123e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:57 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-f6055a64-024f-4f4a-bbfb-8bf9dc23fe15 tempest-CinderUnicodeTest-435747895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45243aad-5afc-4355-bff5-f426c0ac08ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:57 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-f6055a64-024f-4f4a-bbfb-8bf9dc23fe15 tempest-CinderUnicodeTest-435747895 None] Volume ce447f64-1e86-45dc-a9a0-14eac625e568: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce447f64-1e86-45dc-a9a0-14eac625e568', 'volume_size': 1} Sep 29 18:37:57 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-f6055a64-024f-4f4a-bbfb-8bf9dc23fe15 tempest-CinderUnicodeTest-435747895 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:37:57 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-f6055a64-024f-4f4a-bbfb-8bf9dc23fe15 tempest-CinderUnicodeTest-435747895 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:37:57 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-f6055a64-024f-4f4a-bbfb-8bf9dc23fe15 tempest-CinderUnicodeTest-435747895 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:37:57Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-945095222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce447f64-1e86-45dc-a9a0-14eac625e568,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e71cf491c9a497db212d74f70bc19a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:37:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:37:57Z,use_quota=True,user_id='cb6a1631765c4ac4b72f6b0dc1b5f4c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)}" {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:37:57 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-f6055a64-024f-4f4a-bbfb-8bf9dc23fe15 tempest-CinderUnicodeTest-435747895 None] Creating volume ce447f64-1e86-45dc-a9a0-14eac625e568 {{(pid=86512) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:37:57 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-f6055a64-024f-4f4a-bbfb-8bf9dc23fe15 tempest-CinderUnicodeTest-435747895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:37:57 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-f6055a64-024f-4f4a-bbfb-8bf9dc23fe15 tempest-CinderUnicodeTest-435747895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:37:57 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-f6055a64-024f-4f4a-bbfb-8bf9dc23fe15 tempest-CinderUnicodeTest-435747895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:37:57 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-f6055a64-024f-4f4a-bbfb-8bf9dc23fe15 tempest-CinderUnicodeTest-435747895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:37:57 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-f6055a64-024f-4f4a-bbfb-8bf9dc23fe15 tempest-CinderUnicodeTest-435747895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:37:57 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-f6055a64-024f-4f4a-bbfb-8bf9dc23fe15 tempest-CinderUnicodeTest-435747895 None] Selected osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 as target Quobyte volume. {{(pid=86512) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:37:57 devstack cinder-volume[86512]: INFO cinder.volume.drivers.remotefs [None req-f6055a64-024f-4f4a-bbfb-8bf9dc23fe15 tempest-CinderUnicodeTest-435747895 None] casted to osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 Sep 29 18:37:57 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-f6055a64-024f-4f4a-bbfb-8bf9dc23fe15 tempest-CinderUnicodeTest-435747895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ce447f64-1e86-45dc-a9a0-14eac625e568 1073741824 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:57 devstack sudo[107317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ce447f64-1e86-45dc-a9a0-14eac625e568 1073741824 Sep 29 18:37:57 devstack sudo[107317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:58 devstack sudo[107317]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:58 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-f6055a64-024f-4f4a-bbfb-8bf9dc23fe15 tempest-CinderUnicodeTest-435747895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ce447f64-1e86-45dc-a9a0-14eac625e568 1073741824" returned: 0 in 0.506s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:58 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-f6055a64-024f-4f4a-bbfb-8bf9dc23fe15 tempest-CinderUnicodeTest-435747895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ce447f64-1e86-45dc-a9a0-14eac625e568 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:58 devstack sudo[107323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ce447f64-1e86-45dc-a9a0-14eac625e568 Sep 29 18:37:58 devstack sudo[107323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:58 devstack sudo[107323]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:58 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-f6055a64-024f-4f4a-bbfb-8bf9dc23fe15 tempest-CinderUnicodeTest-435747895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ce447f64-1e86-45dc-a9a0-14eac625e568" returned: 0 in 0.328s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:58 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-f6055a64-024f-4f4a-bbfb-8bf9dc23fe15 tempest-CinderUnicodeTest-435747895 None] <== create_volume: return (881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'} {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:37:58 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-f6055a64-024f-4f4a-bbfb-8bf9dc23fe15 tempest-CinderUnicodeTest-435747895 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.885s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:37:58 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-f6055a64-024f-4f4a-bbfb-8bf9dc23fe15 tempest-CinderUnicodeTest-435747895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45243aad-5afc-4355-bff5-f426c0ac08ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce447f64-1e86-45dc-a9a0-14eac625e568', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:58 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-f6055a64-024f-4f4a-bbfb-8bf9dc23fe15 tempest-CinderUnicodeTest-435747895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (139db55c-e674-4a82-b1dd-4a025579c2f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:58 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-f6055a64-024f-4f4a-bbfb-8bf9dc23fe15 tempest-CinderUnicodeTest-435747895 None] Volume volume-ce447f64-1e86-45dc-a9a0-14eac625e568 (ce447f64-1e86-45dc-a9a0-14eac625e568): created successfully Sep 29 18:37:58 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-f6055a64-024f-4f4a-bbfb-8bf9dc23fe15 tempest-CinderUnicodeTest-435747895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (139db55c-e674-4a82-b1dd-4a025579c2f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:58 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-f6055a64-024f-4f4a-bbfb-8bf9dc23fe15 tempest-CinderUnicodeTest-435747895 None] Flow 'volume_create_manager' (48ced4e1-43d9-429b-9e82-7ce55026425a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:37:58 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-f6055a64-024f-4f4a-bbfb-8bf9dc23fe15 tempest-CinderUnicodeTest-435747895 None] Created volume successfully. Sep 29 18:37:59 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-16a9ea32-fc2a-49c3-be80-da9303246ed1 tempest-VolumeDependencyTests-652408482 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86512) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:37:59 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-16a9ea32-fc2a-49c3-be80-da9303246ed1 tempest-VolumeDependencyTests-652408482 None] Flow 'volume_create_manager' (6542f4da-5d6a-405b-9295-b423b78b5652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:37:59 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-16a9ea32-fc2a-49c3-be80-da9303246ed1 tempest-VolumeDependencyTests-652408482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae4d5433-e2a6-4f4d-8858-5038b5e81083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:59 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-16a9ea32-fc2a-49c3-be80-da9303246ed1 tempest-VolumeDependencyTests-652408482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae4d5433-e2a6-4f4d-8858-5038b5e81083) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:37:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-651872689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff95edf6-baaa-4fe3-b16b-ed422d627d22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9541ca19a4924e3983a77f3624b8885a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:37:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:37:59Z,use_quota=True,user_id='5207403689124a53831d4c4ca06b4698',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:59 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-16a9ea32-fc2a-49c3-be80-da9303246ed1 tempest-VolumeDependencyTests-652408482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cea3e4f9-a8a0-419d-bd26-f141208f09a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:59 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-16a9ea32-fc2a-49c3-be80-da9303246ed1 tempest-VolumeDependencyTests-652408482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cea3e4f9-a8a0-419d-bd26-f141208f09a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:59 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-16a9ea32-fc2a-49c3-be80-da9303246ed1 tempest-VolumeDependencyTests-652408482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b143b250-24a4-4d0a-b19c-5b43b34be1d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:59 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-16a9ea32-fc2a-49c3-be80-da9303246ed1 tempest-VolumeDependencyTests-652408482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b143b250-24a4-4d0a-b19c-5b43b34be1d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff95edf6-baaa-4fe3-b16b-ed422d627d22', 'volume_name': 'volume-ff95edf6-baaa-4fe3-b16b-ed422d627d22', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:59 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-16a9ea32-fc2a-49c3-be80-da9303246ed1 tempest-VolumeDependencyTests-652408482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f01307a-6e23-477a-9262-50d2f1182467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:59 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-16a9ea32-fc2a-49c3-be80-da9303246ed1 tempest-VolumeDependencyTests-652408482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f01307a-6e23-477a-9262-50d2f1182467) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:59 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-16a9ea32-fc2a-49c3-be80-da9303246ed1 tempest-VolumeDependencyTests-652408482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44b920b8-07a6-4e0d-a72c-776b86ba7544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:59 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-16a9ea32-fc2a-49c3-be80-da9303246ed1 tempest-VolumeDependencyTests-652408482 None] Volume ff95edf6-baaa-4fe3-b16b-ed422d627d22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff95edf6-baaa-4fe3-b16b-ed422d627d22', 'volume_size': 1} Sep 29 18:37:59 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-16a9ea32-fc2a-49c3-be80-da9303246ed1 tempest-VolumeDependencyTests-652408482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:37:59 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-16a9ea32-fc2a-49c3-be80-da9303246ed1 tempest-VolumeDependencyTests-652408482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:37:59 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-16a9ea32-fc2a-49c3-be80-da9303246ed1 tempest-VolumeDependencyTests-652408482 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:37:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-651872689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff95edf6-baaa-4fe3-b16b-ed422d627d22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9541ca19a4924e3983a77f3624b8885a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:37:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:37:59Z,use_quota=True,user_id='5207403689124a53831d4c4ca06b4698',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)}" {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:37:59 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-16a9ea32-fc2a-49c3-be80-da9303246ed1 tempest-VolumeDependencyTests-652408482 None] Creating volume ff95edf6-baaa-4fe3-b16b-ed422d627d22 {{(pid=86512) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:37:59 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-16a9ea32-fc2a-49c3-be80-da9303246ed1 tempest-VolumeDependencyTests-652408482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:37:59 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-16a9ea32-fc2a-49c3-be80-da9303246ed1 tempest-VolumeDependencyTests-652408482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:37:59 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-16a9ea32-fc2a-49c3-be80-da9303246ed1 tempest-VolumeDependencyTests-652408482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:37:59 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-16a9ea32-fc2a-49c3-be80-da9303246ed1 tempest-VolumeDependencyTests-652408482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:37:59 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-16a9ea32-fc2a-49c3-be80-da9303246ed1 tempest-VolumeDependencyTests-652408482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:37:59 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-16a9ea32-fc2a-49c3-be80-da9303246ed1 tempest-VolumeDependencyTests-652408482 None] Selected osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 as target Quobyte volume. {{(pid=86512) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:37:59 devstack cinder-volume[86512]: INFO cinder.volume.drivers.remotefs [None req-16a9ea32-fc2a-49c3-be80-da9303246ed1 tempest-VolumeDependencyTests-652408482 None] casted to osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 Sep 29 18:37:59 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-16a9ea32-fc2a-49c3-be80-da9303246ed1 tempest-VolumeDependencyTests-652408482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ff95edf6-baaa-4fe3-b16b-ed422d627d22 1073741824 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:59 devstack sudo[107326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ff95edf6-baaa-4fe3-b16b-ed422d627d22 1073741824 Sep 29 18:37:59 devstack sudo[107326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:59 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-97ba7fe0-c3bc-4a4a-8716-5199ee6ca878 tempest-CinderUnicodeTest-435747895 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:38:00 devstack sudo[107326]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:00 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-16a9ea32-fc2a-49c3-be80-da9303246ed1 tempest-VolumeDependencyTests-652408482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ff95edf6-baaa-4fe3-b16b-ed422d627d22 1073741824" returned: 0 in 0.483s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:00 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-16a9ea32-fc2a-49c3-be80-da9303246ed1 tempest-VolumeDependencyTests-652408482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ff95edf6-baaa-4fe3-b16b-ed422d627d22 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:00 devstack sudo[107332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ff95edf6-baaa-4fe3-b16b-ed422d627d22 Sep 29 18:38:00 devstack sudo[107332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:00 devstack sudo[107332]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:00 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-16a9ea32-fc2a-49c3-be80-da9303246ed1 tempest-VolumeDependencyTests-652408482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ff95edf6-baaa-4fe3-b16b-ed422d627d22" returned: 0 in 0.245s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:00 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-16a9ea32-fc2a-49c3-be80-da9303246ed1 tempest-VolumeDependencyTests-652408482 None] <== create_volume: return (773ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'} {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:38:00 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-16a9ea32-fc2a-49c3-be80-da9303246ed1 tempest-VolumeDependencyTests-652408482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.777s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:38:00 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-97ba7fe0-c3bc-4a4a-8716-5199ee6ca878 tempest-CinderUnicodeTest-435747895 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.472s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:38:00 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-16a9ea32-fc2a-49c3-be80-da9303246ed1 tempest-VolumeDependencyTests-652408482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44b920b8-07a6-4e0d-a72c-776b86ba7544) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff95edf6-baaa-4fe3-b16b-ed422d627d22', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:38:00 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-16a9ea32-fc2a-49c3-be80-da9303246ed1 tempest-VolumeDependencyTests-652408482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (231d5114-f168-4689-a5a8-9994ea1e54c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:38:00 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-97ba7fe0-c3bc-4a4a-8716-5199ee6ca878 tempest-CinderUnicodeTest-435747895 None] Creating offline snapshot 1ddb314e-0718-41cf-8f04-03e70fbd479d of volume ce447f64-1e86-45dc-a9a0-14eac625e568 {{(pid=86512) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 18:38:00 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-16a9ea32-fc2a-49c3-be80-da9303246ed1 tempest-VolumeDependencyTests-652408482 None] Volume volume-ff95edf6-baaa-4fe3-b16b-ed422d627d22 (ff95edf6-baaa-4fe3-b16b-ed422d627d22): created successfully Sep 29 18:38:00 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-16a9ea32-fc2a-49c3-be80-da9303246ed1 tempest-VolumeDependencyTests-652408482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (231d5114-f168-4689-a5a8-9994ea1e54c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:38:00 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-16a9ea32-fc2a-49c3-be80-da9303246ed1 tempest-VolumeDependencyTests-652408482 None] Flow 'volume_create_manager' (6542f4da-5d6a-405b-9295-b423b78b5652) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:38:00 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[84d12f29-8e02-49be-b45e-5ae6a036e82d]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:38:00 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-97ba7fe0-c3bc-4a4a-8716-5199ee6ca878 tempest-CinderUnicodeTest-435747895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ce447f64-1e86-45dc-a9a0-14eac625e568 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:00 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-16a9ea32-fc2a-49c3-be80-da9303246ed1 tempest-VolumeDependencyTests-652408482 None] Created volume successfully. Sep 29 18:38:00 devstack sudo[107335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ce447f64-1e86-45dc-a9a0-14eac625e568 Sep 29 18:38:00 devstack sudo[107335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:00 devstack sudo[107335]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:00 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-97ba7fe0-c3bc-4a4a-8716-5199ee6ca878 tempest-CinderUnicodeTest-435747895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ce447f64-1e86-45dc-a9a0-14eac625e568" returned: 0 in 0.356s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:00 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-97ba7fe0-c3bc-4a4a-8716-5199ee6ca878 tempest-CinderUnicodeTest-435747895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ce447f64-1e86-45dc-a9a0-14eac625e568,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ce447f64-1e86-45dc-a9a0-14eac625e568.1ddb314e-0718-41cf-8f04-03e70fbd479d 1G {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:00 devstack sudo[107340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ce447f64-1e86-45dc-a9a0-14eac625e568,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ce447f64-1e86-45dc-a9a0-14eac625e568.1ddb314e-0718-41cf-8f04-03e70fbd479d 1G Sep 29 18:38:00 devstack sudo[107340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:01 devstack sudo[107340]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:01 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-97ba7fe0-c3bc-4a4a-8716-5199ee6ca878 tempest-CinderUnicodeTest-435747895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ce447f64-1e86-45dc-a9a0-14eac625e568,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ce447f64-1e86-45dc-a9a0-14eac625e568.1ddb314e-0718-41cf-8f04-03e70fbd479d 1G" returned: 0 in 0.441s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:01 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-97ba7fe0-c3bc-4a4a-8716-5199ee6ca878 tempest-CinderUnicodeTest-435747895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce447f64-1e86-45dc-a9a0-14eac625e568 -F qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ce447f64-1e86-45dc-a9a0-14eac625e568.1ddb314e-0718-41cf-8f04-03e70fbd479d {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:01 devstack sudo[107346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce447f64-1e86-45dc-a9a0-14eac625e568 -F qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ce447f64-1e86-45dc-a9a0-14eac625e568.1ddb314e-0718-41cf-8f04-03e70fbd479d Sep 29 18:38:01 devstack sudo[107346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:01 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a094d25-fb70-43a4-a530-c9ff7ad37b18 tempest-ProjectReaderTests-1071181519 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86512) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:38:01 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-1a094d25-fb70-43a4-a530-c9ff7ad37b18 tempest-ProjectReaderTests-1071181519 None] Flow 'volume_create_manager' (7e2b7aad-145a-4924-b000-9cc5f74d139b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:38:01 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-1a094d25-fb70-43a4-a530-c9ff7ad37b18 tempest-ProjectReaderTests-1071181519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d1124f9-2cd6-44b3-aceb-857ceb4ef38f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:38:01 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-1a094d25-fb70-43a4-a530-c9ff7ad37b18 tempest-ProjectReaderTests-1071181519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d1124f9-2cd6-44b3-aceb-857ceb4ef38f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:38:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-840266625',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7432e625-4288-48dc-a0e9-0f4fe290e614,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9185128c87824af9a8301a3f83b0dd53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:38:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:38:01Z,use_quota=True,user_id='1202db2be99341228d8cd4b1964a630d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:38:01 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-1a094d25-fb70-43a4-a530-c9ff7ad37b18 tempest-ProjectReaderTests-1071181519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (419f940e-e1a1-42f4-90ad-6fce47ee659b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:38:01 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-1a094d25-fb70-43a4-a530-c9ff7ad37b18 tempest-ProjectReaderTests-1071181519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (419f940e-e1a1-42f4-90ad-6fce47ee659b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:38:01 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-1a094d25-fb70-43a4-a530-c9ff7ad37b18 tempest-ProjectReaderTests-1071181519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac514959-c911-40bd-bded-4dfc34151750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:38:01 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-1a094d25-fb70-43a4-a530-c9ff7ad37b18 tempest-ProjectReaderTests-1071181519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac514959-c911-40bd-bded-4dfc34151750) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7432e625-4288-48dc-a0e9-0f4fe290e614', 'volume_name': 'volume-7432e625-4288-48dc-a0e9-0f4fe290e614', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:38:01 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-1a094d25-fb70-43a4-a530-c9ff7ad37b18 tempest-ProjectReaderTests-1071181519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aad6f8f6-0524-4de1-b8a6-5f7f803f7b94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:38:01 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-1a094d25-fb70-43a4-a530-c9ff7ad37b18 tempest-ProjectReaderTests-1071181519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aad6f8f6-0524-4de1-b8a6-5f7f803f7b94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:38:01 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-1a094d25-fb70-43a4-a530-c9ff7ad37b18 tempest-ProjectReaderTests-1071181519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8235e6c-af0d-46e6-99a6-33e688c6fe19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:38:01 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-1a094d25-fb70-43a4-a530-c9ff7ad37b18 tempest-ProjectReaderTests-1071181519 None] Volume 7432e625-4288-48dc-a0e9-0f4fe290e614: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7432e625-4288-48dc-a0e9-0f4fe290e614', 'volume_size': 1} Sep 29 18:38:01 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-1a094d25-fb70-43a4-a530-c9ff7ad37b18 tempest-ProjectReaderTests-1071181519 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:38:01 devstack sudo[107346]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:01 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-97ba7fe0-c3bc-4a4a-8716-5199ee6ca878 tempest-CinderUnicodeTest-435747895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce447f64-1e86-45dc-a9a0-14eac625e568 -F qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ce447f64-1e86-45dc-a9a0-14eac625e568.1ddb314e-0718-41cf-8f04-03e70fbd479d" returned: 0 in 0.302s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:01 devstack cinder-volume[86512]: WARNING cinder.volume.drivers.remotefs [None req-97ba7fe0-c3bc-4a4a-8716-5199ee6ca878 tempest-CinderUnicodeTest-435747895 None] /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ce447f64-1e86-45dc-a9a0-14eac625e568.1ddb314e-0718-41cf-8f04-03e70fbd479d is being set with open permissions: ugo+rw Sep 29 18:38:01 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-97ba7fe0-c3bc-4a4a-8716-5199ee6ca878 tempest-CinderUnicodeTest-435747895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ce447f64-1e86-45dc-a9a0-14eac625e568.1ddb314e-0718-41cf-8f04-03e70fbd479d {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:01 devstack sudo[107351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ce447f64-1e86-45dc-a9a0-14eac625e568.1ddb314e-0718-41cf-8f04-03e70fbd479d Sep 29 18:38:01 devstack sudo[107351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:01 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-5b84348c-4da5-45b1-a4e0-58fb89170f14 tempest-VolumeDependencyTests-652408482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:38:01 devstack sudo[107351]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:01 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-97ba7fe0-c3bc-4a4a-8716-5199ee6ca878 tempest-CinderUnicodeTest-435747895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ce447f64-1e86-45dc-a9a0-14eac625e568.1ddb314e-0718-41cf-8f04-03e70fbd479d" returned: 0 in 0.260s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:01 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-97ba7fe0-c3bc-4a4a-8716-5199ee6ca878 tempest-CinderUnicodeTest-435747895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ce447f64-1e86-45dc-a9a0-14eac625e568.info {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:01 devstack sudo[107354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ce447f64-1e86-45dc-a9a0-14eac625e568.info Sep 29 18:38:01 devstack sudo[107354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:02 devstack sudo[107354]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:02 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-97ba7fe0-c3bc-4a4a-8716-5199ee6ca878 tempest-CinderUnicodeTest-435747895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ce447f64-1e86-45dc-a9a0-14eac625e568.info" returned: 0 in 0.242s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:02 devstack cinder-volume[86512]: WARNING cinder.volume.drivers.remotefs [None req-97ba7fe0-c3bc-4a4a-8716-5199ee6ca878 tempest-CinderUnicodeTest-435747895 None] /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ce447f64-1e86-45dc-a9a0-14eac625e568.info is being set with open permissions: ugo+rw Sep 29 18:38:02 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-97ba7fe0-c3bc-4a4a-8716-5199ee6ca878 tempest-CinderUnicodeTest-435747895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ce447f64-1e86-45dc-a9a0-14eac625e568.info {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:02 devstack sudo[107357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ce447f64-1e86-45dc-a9a0-14eac625e568.info Sep 29 18:38:02 devstack sudo[107357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:02 devstack sudo[107357]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:02 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-97ba7fe0-c3bc-4a4a-8716-5199ee6ca878 tempest-CinderUnicodeTest-435747895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ce447f64-1e86-45dc-a9a0-14eac625e568.info" returned: 0 in 0.231s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:02 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-97ba7fe0-c3bc-4a4a-8716-5199ee6ca878 tempest-CinderUnicodeTest-435747895 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.947s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:38:02 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-1a094d25-fb70-43a4-a530-c9ff7ad37b18 tempest-ProjectReaderTests-1071181519 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.907s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:38:02 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-1a094d25-fb70-43a4-a530-c9ff7ad37b18 tempest-ProjectReaderTests-1071181519 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:38:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-840266625',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7432e625-4288-48dc-a0e9-0f4fe290e614,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9185128c87824af9a8301a3f83b0dd53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:38:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:38:01Z,use_quota=True,user_id='1202db2be99341228d8cd4b1964a630d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)}" {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:38:02 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-1a094d25-fb70-43a4-a530-c9ff7ad37b18 tempest-ProjectReaderTests-1071181519 None] Creating volume 7432e625-4288-48dc-a0e9-0f4fe290e614 {{(pid=86512) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:38:02 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-1a094d25-fb70-43a4-a530-c9ff7ad37b18 tempest-ProjectReaderTests-1071181519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:38:02 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-1a094d25-fb70-43a4-a530-c9ff7ad37b18 tempest-ProjectReaderTests-1071181519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:38:02 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-1a094d25-fb70-43a4-a530-c9ff7ad37b18 tempest-ProjectReaderTests-1071181519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:38:02 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-1a094d25-fb70-43a4-a530-c9ff7ad37b18 tempest-ProjectReaderTests-1071181519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:38:02 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-1a094d25-fb70-43a4-a530-c9ff7ad37b18 tempest-ProjectReaderTests-1071181519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:38:02 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-1a094d25-fb70-43a4-a530-c9ff7ad37b18 tempest-ProjectReaderTests-1071181519 None] Selected osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 as target Quobyte volume. {{(pid=86512) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:38:02 devstack cinder-volume[86512]: INFO cinder.volume.drivers.remotefs [None req-1a094d25-fb70-43a4-a530-c9ff7ad37b18 tempest-ProjectReaderTests-1071181519 None] casted to osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 Sep 29 18:38:02 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-1a094d25-fb70-43a4-a530-c9ff7ad37b18 tempest-ProjectReaderTests-1071181519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7432e625-4288-48dc-a0e9-0f4fe290e614 1073741824 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:02 devstack sudo[107360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7432e625-4288-48dc-a0e9-0f4fe290e614 1073741824 Sep 29 18:38:02 devstack sudo[107360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:02 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-97ba7fe0-c3bc-4a4a-8716-5199ee6ca878 tempest-CinderUnicodeTest-435747895 None] Create snapshot completed successfully Sep 29 18:38:02 devstack sudo[107360]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:02 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-1a094d25-fb70-43a4-a530-c9ff7ad37b18 tempest-ProjectReaderTests-1071181519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7432e625-4288-48dc-a0e9-0f4fe290e614 1073741824" returned: 0 in 0.417s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:02 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-1a094d25-fb70-43a4-a530-c9ff7ad37b18 tempest-ProjectReaderTests-1071181519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7432e625-4288-48dc-a0e9-0f4fe290e614 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:02 devstack sudo[107365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7432e625-4288-48dc-a0e9-0f4fe290e614 Sep 29 18:38:02 devstack sudo[107365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:03 devstack sudo[107365]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:03 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-1a094d25-fb70-43a4-a530-c9ff7ad37b18 tempest-ProjectReaderTests-1071181519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7432e625-4288-48dc-a0e9-0f4fe290e614" returned: 0 in 0.244s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:03 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-1a094d25-fb70-43a4-a530-c9ff7ad37b18 tempest-ProjectReaderTests-1071181519 None] <== create_volume: return (710ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'} {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:38:03 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-1a094d25-fb70-43a4-a530-c9ff7ad37b18 tempest-ProjectReaderTests-1071181519 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.712s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:38:03 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-5b84348c-4da5-45b1-a4e0-58fb89170f14 tempest-VolumeDependencyTests-652408482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.311s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:38:03 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-efa82904-29ca-493a-87f1-d47757b41ddf tempest-CinderUnicodeTest-435747895 None] Acquiring lock "cinder-1ddb314e-0718-41cf-8f04-03e70fbd479d-delete_snapshot" by "delete_snapshot" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:38:03 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-1a094d25-fb70-43a4-a530-c9ff7ad37b18 tempest-ProjectReaderTests-1071181519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8235e6c-af0d-46e6-99a6-33e688c6fe19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7432e625-4288-48dc-a0e9-0f4fe290e614', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:38:03 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-1a094d25-fb70-43a4-a530-c9ff7ad37b18 tempest-ProjectReaderTests-1071181519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55facf9c-c1b1-4b7d-876e-902c2023008f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:38:03 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-efa82904-29ca-493a-87f1-d47757b41ddf tempest-CinderUnicodeTest-435747895 None] Lock "cinder-1ddb314e-0718-41cf-8f04-03e70fbd479d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:38:03 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-efa82904-29ca-493a-87f1-d47757b41ddf tempest-CinderUnicodeTest-435747895 None] Acquiring lock "cinder-quobyte-ce447f64-1e86-45dc-a9a0-14eac625e568" by "delete_snapshot" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:38:03 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-5b84348c-4da5-45b1-a4e0-58fb89170f14 tempest-VolumeDependencyTests-652408482 None] Creating offline snapshot 03085504-a717-4a09-9427-12e9c41e5a5d of volume ff95edf6-baaa-4fe3-b16b-ed422d627d22 {{(pid=86512) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 18:38:03 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-1a094d25-fb70-43a4-a530-c9ff7ad37b18 tempest-ProjectReaderTests-1071181519 None] Volume volume-7432e625-4288-48dc-a0e9-0f4fe290e614 (7432e625-4288-48dc-a0e9-0f4fe290e614): created successfully Sep 29 18:38:03 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-1a094d25-fb70-43a4-a530-c9ff7ad37b18 tempest-ProjectReaderTests-1071181519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55facf9c-c1b1-4b7d-876e-902c2023008f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:38:03 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-1a094d25-fb70-43a4-a530-c9ff7ad37b18 tempest-ProjectReaderTests-1071181519 None] Flow 'volume_create_manager' (7e2b7aad-145a-4924-b000-9cc5f74d139b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:38:03 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfbd08e6-3abe-438f-aa49-9200d59471af]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:38:03 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-efa82904-29ca-493a-87f1-d47757b41ddf tempest-CinderUnicodeTest-435747895 None] Lock "cinder-quobyte-ce447f64-1e86-45dc-a9a0-14eac625e568" acquired by "delete_snapshot" :: waited 0.042s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:38:03 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-efa82904-29ca-493a-87f1-d47757b41ddf tempest-CinderUnicodeTest-435747895 None] Acquiring lock "cinder-quobyte-1ddb314e-0718-41cf-8f04-03e70fbd479d" by "_delete_snapshot" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:38:03 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-5b84348c-4da5-45b1-a4e0-58fb89170f14 tempest-VolumeDependencyTests-652408482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ff95edf6-baaa-4fe3-b16b-ed422d627d22 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:03 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-1a094d25-fb70-43a4-a530-c9ff7ad37b18 tempest-ProjectReaderTests-1071181519 None] Created volume successfully. Sep 29 18:38:03 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-efa82904-29ca-493a-87f1-d47757b41ddf tempest-CinderUnicodeTest-435747895 None] Lock "cinder-quobyte-1ddb314e-0718-41cf-8f04-03e70fbd479d" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:38:03 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-efa82904-29ca-493a-87f1-d47757b41ddf tempest-CinderUnicodeTest-435747895 None] Deleting offline snapshot 1ddb314e-0718-41cf-8f04-03e70fbd479d of volume ce447f64-1e86-45dc-a9a0-14eac625e568 {{(pid=86512) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 18:38:03 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-efa82904-29ca-493a-87f1-d47757b41ddf tempest-CinderUnicodeTest-435747895 None] snapshot_file for this snap is: volume-ce447f64-1e86-45dc-a9a0-14eac625e568.1ddb314e-0718-41cf-8f04-03e70fbd479d {{(pid=86512) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 18:38:03 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2c680cc-fa62-4542-a2a6-66729d80360d]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:38:03 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-efa82904-29ca-493a-87f1-d47757b41ddf tempest-CinderUnicodeTest-435747895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ce447f64-1e86-45dc-a9a0-14eac625e568.1ddb314e-0718-41cf-8f04-03e70fbd479d {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:03 devstack sudo[107368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ff95edf6-baaa-4fe3-b16b-ed422d627d22 Sep 29 18:38:03 devstack sudo[107368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:03 devstack sudo[107369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ce447f64-1e86-45dc-a9a0-14eac625e568.1ddb314e-0718-41cf-8f04-03e70fbd479d Sep 29 18:38:03 devstack sudo[107369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:03 devstack sudo[107368]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:03 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-5b84348c-4da5-45b1-a4e0-58fb89170f14 tempest-VolumeDependencyTests-652408482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ff95edf6-baaa-4fe3-b16b-ed422d627d22" returned: 0 in 0.417s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:03 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-5b84348c-4da5-45b1-a4e0-58fb89170f14 tempest-VolumeDependencyTests-652408482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ff95edf6-baaa-4fe3-b16b-ed422d627d22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ff95edf6-baaa-4fe3-b16b-ed422d627d22.03085504-a717-4a09-9427-12e9c41e5a5d 1G {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:03 devstack sudo[107379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ff95edf6-baaa-4fe3-b16b-ed422d627d22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ff95edf6-baaa-4fe3-b16b-ed422d627d22.03085504-a717-4a09-9427-12e9c41e5a5d 1G Sep 29 18:38:03 devstack sudo[107379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:03 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-d292c668-df63-4e2d-a23d-07a82d4f324d tempest-ProjectReaderTests-1071181519 None] Acquiring lock "cinder-7432e625-4288-48dc-a0e9-0f4fe290e614-delete_volume" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:38:03 devstack sudo[107369]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:03 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-efa82904-29ca-493a-87f1-d47757b41ddf tempest-CinderUnicodeTest-435747895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ce447f64-1e86-45dc-a9a0-14eac625e568.1ddb314e-0718-41cf-8f04-03e70fbd479d" returned: 0 in 0.477s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:03 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-efa82904-29ca-493a-87f1-d47757b41ddf tempest-CinderUnicodeTest-435747895 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ce447f64-1e86-45dc-a9a0-14eac625e568(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86512) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 18:38:03 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-d292c668-df63-4e2d-a23d-07a82d4f324d tempest-ProjectReaderTests-1071181519 None] Lock "cinder-7432e625-4288-48dc-a0e9-0f4fe290e614-delete_volume" acquired by "delete_volume" :: waited 0.101s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:38:03 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[38387e6c-e4ec-441e-b8ea-1dbb98f81f34]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:38:03 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-efa82904-29ca-493a-87f1-d47757b41ddf tempest-CinderUnicodeTest-435747895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ce447f64-1e86-45dc-a9a0-14eac625e568 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:03 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-d292c668-df63-4e2d-a23d-07a82d4f324d tempest-ProjectReaderTests-1071181519 None] Acquiring lock "cinder-quobyte-7432e625-4288-48dc-a0e9-0f4fe290e614" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:38:03 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-d292c668-df63-4e2d-a23d-07a82d4f324d tempest-ProjectReaderTests-1071181519 None] Lock "cinder-quobyte-7432e625-4288-48dc-a0e9-0f4fe290e614" acquired by "delete_volume" :: waited 0.022s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:38:03 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[b463c6a6-b24a-41f8-befc-5972aa501fe6]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:38:03 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-d292c668-df63-4e2d-a23d-07a82d4f324d tempest-ProjectReaderTests-1071181519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7432e625-4288-48dc-a0e9-0f4fe290e614 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:03 devstack sudo[107382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ce447f64-1e86-45dc-a9a0-14eac625e568 Sep 29 18:38:03 devstack sudo[107382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:03 devstack sudo[107386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7432e625-4288-48dc-a0e9-0f4fe290e614 Sep 29 18:38:03 devstack sudo[107386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:03 devstack sudo[107379]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:03 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-5b84348c-4da5-45b1-a4e0-58fb89170f14 tempest-VolumeDependencyTests-652408482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ff95edf6-baaa-4fe3-b16b-ed422d627d22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ff95edf6-baaa-4fe3-b16b-ed422d627d22.03085504-a717-4a09-9427-12e9c41e5a5d 1G" returned: 0 in 0.448s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:03 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-5b84348c-4da5-45b1-a4e0-58fb89170f14 tempest-VolumeDependencyTests-652408482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff95edf6-baaa-4fe3-b16b-ed422d627d22 -F qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ff95edf6-baaa-4fe3-b16b-ed422d627d22.03085504-a717-4a09-9427-12e9c41e5a5d {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:03 devstack sudo[107389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff95edf6-baaa-4fe3-b16b-ed422d627d22 -F qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ff95edf6-baaa-4fe3-b16b-ed422d627d22.03085504-a717-4a09-9427-12e9c41e5a5d Sep 29 18:38:03 devstack sudo[107389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:04 devstack sudo[107382]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:04 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-efa82904-29ca-493a-87f1-d47757b41ddf tempest-CinderUnicodeTest-435747895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ce447f64-1e86-45dc-a9a0-14eac625e568" returned: 0 in 0.426s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:04 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-efa82904-29ca-493a-87f1-d47757b41ddf tempest-CinderUnicodeTest-435747895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ce447f64-1e86-45dc-a9a0-14eac625e568.1ddb314e-0718-41cf-8f04-03e70fbd479d {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:04 devstack sudo[107398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ce447f64-1e86-45dc-a9a0-14eac625e568.1ddb314e-0718-41cf-8f04-03e70fbd479d Sep 29 18:38:04 devstack sudo[107398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:04 devstack sudo[107386]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:04 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-d292c668-df63-4e2d-a23d-07a82d4f324d tempest-ProjectReaderTests-1071181519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7432e625-4288-48dc-a0e9-0f4fe290e614" returned: 0 in 0.409s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:04 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-d292c668-df63-4e2d-a23d-07a82d4f324d tempest-ProjectReaderTests-1071181519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7432e625-4288-48dc-a0e9-0f4fe290e614 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:04 devstack sudo[107403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7432e625-4288-48dc-a0e9-0f4fe290e614 Sep 29 18:38:04 devstack sudo[107403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:04 devstack sudo[107389]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:04 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-5b84348c-4da5-45b1-a4e0-58fb89170f14 tempest-VolumeDependencyTests-652408482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff95edf6-baaa-4fe3-b16b-ed422d627d22 -F qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ff95edf6-baaa-4fe3-b16b-ed422d627d22.03085504-a717-4a09-9427-12e9c41e5a5d" returned: 0 in 0.329s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:04 devstack cinder-volume[86512]: WARNING cinder.volume.drivers.remotefs [None req-5b84348c-4da5-45b1-a4e0-58fb89170f14 tempest-VolumeDependencyTests-652408482 None] /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ff95edf6-baaa-4fe3-b16b-ed422d627d22.03085504-a717-4a09-9427-12e9c41e5a5d is being set with open permissions: ugo+rw Sep 29 18:38:04 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-5b84348c-4da5-45b1-a4e0-58fb89170f14 tempest-VolumeDependencyTests-652408482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ff95edf6-baaa-4fe3-b16b-ed422d627d22.03085504-a717-4a09-9427-12e9c41e5a5d {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:04 devstack sudo[107407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ff95edf6-baaa-4fe3-b16b-ed422d627d22.03085504-a717-4a09-9427-12e9c41e5a5d Sep 29 18:38:04 devstack sudo[107407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:04 devstack sudo[107398]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:04 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-efa82904-29ca-493a-87f1-d47757b41ddf tempest-CinderUnicodeTest-435747895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ce447f64-1e86-45dc-a9a0-14eac625e568.1ddb314e-0718-41cf-8f04-03e70fbd479d" returned: 0 in 0.339s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:04 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-efa82904-29ca-493a-87f1-d47757b41ddf tempest-CinderUnicodeTest-435747895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ce447f64-1e86-45dc-a9a0-14eac625e568.1ddb314e-0718-41cf-8f04-03e70fbd479d {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:04 devstack sudo[107403]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:04 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-d292c668-df63-4e2d-a23d-07a82d4f324d tempest-ProjectReaderTests-1071181519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7432e625-4288-48dc-a0e9-0f4fe290e614" returned: 0 in 0.273s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:04 devstack sudo[107413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ce447f64-1e86-45dc-a9a0-14eac625e568.1ddb314e-0718-41cf-8f04-03e70fbd479d Sep 29 18:38:04 devstack sudo[107413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:04 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-d292c668-df63-4e2d-a23d-07a82d4f324d tempest-ProjectReaderTests-1071181519 None] Lock "cinder-quobyte-7432e625-4288-48dc-a0e9-0f4fe290e614" released by "delete_volume" :: held 0.735s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:38:04 devstack sudo[107407]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:04 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-d292c668-df63-4e2d-a23d-07a82d4f324d tempest-ProjectReaderTests-1071181519 None] Created reservations ['656538b0-8361-44df-a129-295a9d499dfd', 'c5e2f976-0e8b-40fa-87c2-7cd022f734f1', '153f72f6-b3dc-428d-aac8-82401f158738', '987e3c99-4efa-4e1a-acd0-0c07ce94db90'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:38:04 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-5b84348c-4da5-45b1-a4e0-58fb89170f14 tempest-VolumeDependencyTests-652408482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ff95edf6-baaa-4fe3-b16b-ed422d627d22.03085504-a717-4a09-9427-12e9c41e5a5d" returned: 0 in 0.259s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:04 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-5b84348c-4da5-45b1-a4e0-58fb89170f14 tempest-VolumeDependencyTests-652408482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ff95edf6-baaa-4fe3-b16b-ed422d627d22.info {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:04 devstack sudo[107416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ff95edf6-baaa-4fe3-b16b-ed422d627d22.info Sep 29 18:38:04 devstack sudo[107416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:04 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-d292c668-df63-4e2d-a23d-07a82d4f324d tempest-ProjectReaderTests-1071181519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:38:04 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-d292c668-df63-4e2d-a23d-07a82d4f324d tempest-ProjectReaderTests-1071181519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:38:04 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-d292c668-df63-4e2d-a23d-07a82d4f324d tempest-ProjectReaderTests-1071181519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:38:04 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-d292c668-df63-4e2d-a23d-07a82d4f324d tempest-ProjectReaderTests-1071181519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:38:04 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-d292c668-df63-4e2d-a23d-07a82d4f324d tempest-ProjectReaderTests-1071181519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:38:04 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-d292c668-df63-4e2d-a23d-07a82d4f324d tempest-ProjectReaderTests-1071181519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:04 devstack sudo[107418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:38:04 devstack sudo[107418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:04 devstack sudo[107413]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:04 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-efa82904-29ca-493a-87f1-d47757b41ddf tempest-CinderUnicodeTest-435747895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ce447f64-1e86-45dc-a9a0-14eac625e568.1ddb314e-0718-41cf-8f04-03e70fbd479d" returned: 0 in 0.319s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:04 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-efa82904-29ca-493a-87f1-d47757b41ddf tempest-CinderUnicodeTest-435747895 None] Lock "cinder-quobyte-1ddb314e-0718-41cf-8f04-03e70fbd479d" released by "_delete_snapshot" :: held 1.723s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:38:04 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-efa82904-29ca-493a-87f1-d47757b41ddf tempest-CinderUnicodeTest-435747895 None] Lock "cinder-quobyte-ce447f64-1e86-45dc-a9a0-14eac625e568" released by "delete_snapshot" :: held 1.773s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:38:04 devstack sudo[107416]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:04 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-5b84348c-4da5-45b1-a4e0-58fb89170f14 tempest-VolumeDependencyTests-652408482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ff95edf6-baaa-4fe3-b16b-ed422d627d22.info" returned: 0 in 0.323s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:04 devstack cinder-volume[86512]: WARNING cinder.volume.drivers.remotefs [None req-5b84348c-4da5-45b1-a4e0-58fb89170f14 tempest-VolumeDependencyTests-652408482 None] /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ff95edf6-baaa-4fe3-b16b-ed422d627d22.info is being set with open permissions: ugo+rw Sep 29 18:38:04 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-5b84348c-4da5-45b1-a4e0-58fb89170f14 tempest-VolumeDependencyTests-652408482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ff95edf6-baaa-4fe3-b16b-ed422d627d22.info {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:04 devstack sudo[107418]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:04 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-d292c668-df63-4e2d-a23d-07a82d4f324d tempest-ProjectReaderTests-1071181519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.290s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:04 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-d292c668-df63-4e2d-a23d-07a82d4f324d tempest-ProjectReaderTests-1071181519 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:38:04 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-d292c668-df63-4e2d-a23d-07a82d4f324d tempest-ProjectReaderTests-1071181519 None] Deleted volume successfully. Sep 29 18:38:04 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-efa82904-29ca-493a-87f1-d47757b41ddf tempest-CinderUnicodeTest-435747895 None] Created reservations ['1c1a23bb-bf9e-4fdb-abcd-5e1d45104f8a', '76d0a8ca-784a-4a2f-a9a5-668cd832c428', '38079a9c-5345-4680-8b4c-840809feb450', 'f382de7a-863e-4670-9ed6-2207f3c53715'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:38:04 devstack sudo[107423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ff95edf6-baaa-4fe3-b16b-ed422d627d22.info Sep 29 18:38:04 devstack sudo[107423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:05 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-d292c668-df63-4e2d-a23d-07a82d4f324d tempest-ProjectReaderTests-1071181519 None] Lock "cinder-7432e625-4288-48dc-a0e9-0f4fe290e614-delete_volume" released by "delete_volume" :: held 1.313s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:38:05 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-efa82904-29ca-493a-87f1-d47757b41ddf tempest-CinderUnicodeTest-435747895 None] Delete snapshot completed successfully. Sep 29 18:38:05 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-efa82904-29ca-493a-87f1-d47757b41ddf tempest-CinderUnicodeTest-435747895 None] Lock "cinder-1ddb314e-0718-41cf-8f04-03e70fbd479d-delete_snapshot" released by "delete_snapshot" :: held 1.996s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:38:05 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-c9ca1874-c2d9-4934-8619-8d93f9488807 tempest-CinderUnicodeTest-435747895 None] Acquiring lock "cinder-ce447f64-1e86-45dc-a9a0-14eac625e568-delete_volume" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:38:05 devstack sudo[107423]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:05 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-5b84348c-4da5-45b1-a4e0-58fb89170f14 tempest-VolumeDependencyTests-652408482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ff95edf6-baaa-4fe3-b16b-ed422d627d22.info" returned: 0 in 0.301s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:05 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-5b84348c-4da5-45b1-a4e0-58fb89170f14 tempest-VolumeDependencyTests-652408482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.254s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:38:05 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-c9ca1874-c2d9-4934-8619-8d93f9488807 tempest-CinderUnicodeTest-435747895 None] Lock "cinder-ce447f64-1e86-45dc-a9a0-14eac625e568-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:38:05 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-5b84348c-4da5-45b1-a4e0-58fb89170f14 tempest-VolumeDependencyTests-652408482 None] Create snapshot completed successfully Sep 29 18:38:05 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-c9ca1874-c2d9-4934-8619-8d93f9488807 tempest-CinderUnicodeTest-435747895 None] Acquiring lock "cinder-quobyte-ce447f64-1e86-45dc-a9a0-14eac625e568" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:38:05 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-9bf37b20-3bac-4005-83b3-2c8eddce7073 tempest-ProjectReaderTests-1071181519 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86512) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:38:05 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-9bf37b20-3bac-4005-83b3-2c8eddce7073 tempest-ProjectReaderTests-1071181519 None] Flow 'volume_create_manager' (cc7f707f-1fc8-4591-a613-3cdaaa898fbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:38:05 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-9bf37b20-3bac-4005-83b3-2c8eddce7073 tempest-ProjectReaderTests-1071181519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7e7a360-cce0-41ac-b163-170c7673b5f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:38:05 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-c9ca1874-c2d9-4934-8619-8d93f9488807 tempest-CinderUnicodeTest-435747895 None] Lock "cinder-quobyte-ce447f64-1e86-45dc-a9a0-14eac625e568" acquired by "delete_volume" :: waited 0.051s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:38:05 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-9bf37b20-3bac-4005-83b3-2c8eddce7073 tempest-ProjectReaderTests-1071181519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7e7a360-cce0-41ac-b163-170c7673b5f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:38:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1256409784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b973dbb1-7b77-440c-86e3-21f08d25fd45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9185128c87824af9a8301a3f83b0dd53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:38:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:38:05Z,use_quota=True,user_id='1202db2be99341228d8cd4b1964a630d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:38:05 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-9bf37b20-3bac-4005-83b3-2c8eddce7073 tempest-ProjectReaderTests-1071181519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dce9d268-4cc5-4e6d-9b43-fb9d8bfc3039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:38:05 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-9bf37b20-3bac-4005-83b3-2c8eddce7073 tempest-ProjectReaderTests-1071181519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dce9d268-4cc5-4e6d-9b43-fb9d8bfc3039) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:38:05 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-9bf37b20-3bac-4005-83b3-2c8eddce7073 tempest-ProjectReaderTests-1071181519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73b4f95b-5b0e-405a-b775-198c96b23e2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:38:05 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-9bf37b20-3bac-4005-83b3-2c8eddce7073 tempest-ProjectReaderTests-1071181519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73b4f95b-5b0e-405a-b775-198c96b23e2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b973dbb1-7b77-440c-86e3-21f08d25fd45', 'volume_name': 'volume-b973dbb1-7b77-440c-86e3-21f08d25fd45', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:38:05 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-9bf37b20-3bac-4005-83b3-2c8eddce7073 tempest-ProjectReaderTests-1071181519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bde7425-d352-447f-8528-1c335ac7db5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:38:05 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-9bf37b20-3bac-4005-83b3-2c8eddce7073 tempest-ProjectReaderTests-1071181519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bde7425-d352-447f-8528-1c335ac7db5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:38:05 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-9bf37b20-3bac-4005-83b3-2c8eddce7073 tempest-ProjectReaderTests-1071181519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfd8fbba-c24e-4950-a13b-0b218f39b34b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:38:05 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-9bf37b20-3bac-4005-83b3-2c8eddce7073 tempest-ProjectReaderTests-1071181519 None] Volume b973dbb1-7b77-440c-86e3-21f08d25fd45: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b973dbb1-7b77-440c-86e3-21f08d25fd45', 'volume_size': 1} Sep 29 18:38:05 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-9bf37b20-3bac-4005-83b3-2c8eddce7073 tempest-ProjectReaderTests-1071181519 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:38:05 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-9bf37b20-3bac-4005-83b3-2c8eddce7073 tempest-ProjectReaderTests-1071181519 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:38:05 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-9bf37b20-3bac-4005-83b3-2c8eddce7073 tempest-ProjectReaderTests-1071181519 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:38:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1256409784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b973dbb1-7b77-440c-86e3-21f08d25fd45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9185128c87824af9a8301a3f83b0dd53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:38:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:38:05Z,use_quota=True,user_id='1202db2be99341228d8cd4b1964a630d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)}" {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:38:05 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-9bf37b20-3bac-4005-83b3-2c8eddce7073 tempest-ProjectReaderTests-1071181519 None] Creating volume b973dbb1-7b77-440c-86e3-21f08d25fd45 {{(pid=86512) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:38:05 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-9bf37b20-3bac-4005-83b3-2c8eddce7073 tempest-ProjectReaderTests-1071181519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:38:05 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-9bf37b20-3bac-4005-83b3-2c8eddce7073 tempest-ProjectReaderTests-1071181519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:38:05 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-9bf37b20-3bac-4005-83b3-2c8eddce7073 tempest-ProjectReaderTests-1071181519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:38:05 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-9bf37b20-3bac-4005-83b3-2c8eddce7073 tempest-ProjectReaderTests-1071181519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:38:05 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-9bf37b20-3bac-4005-83b3-2c8eddce7073 tempest-ProjectReaderTests-1071181519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:38:05 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-9bf37b20-3bac-4005-83b3-2c8eddce7073 tempest-ProjectReaderTests-1071181519 None] Selected osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 as target Quobyte volume. {{(pid=86512) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:38:05 devstack cinder-volume[86512]: INFO cinder.volume.drivers.remotefs [None req-9bf37b20-3bac-4005-83b3-2c8eddce7073 tempest-ProjectReaderTests-1071181519 None] casted to osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 Sep 29 18:38:05 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-9bf37b20-3bac-4005-83b3-2c8eddce7073 tempest-ProjectReaderTests-1071181519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-b973dbb1-7b77-440c-86e3-21f08d25fd45 1073741824 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:05 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[b32e2191-cf22-469d-aba9-babe296292f0]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:38:05 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-c9ca1874-c2d9-4934-8619-8d93f9488807 tempest-CinderUnicodeTest-435747895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ce447f64-1e86-45dc-a9a0-14eac625e568 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:05 devstack sudo[107426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-b973dbb1-7b77-440c-86e3-21f08d25fd45 1073741824 Sep 29 18:38:05 devstack sudo[107426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:05 devstack sudo[107427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ce447f64-1e86-45dc-a9a0-14eac625e568 Sep 29 18:38:05 devstack sudo[107427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:05 devstack sudo[107427]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:05 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-c9ca1874-c2d9-4934-8619-8d93f9488807 tempest-CinderUnicodeTest-435747895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ce447f64-1e86-45dc-a9a0-14eac625e568" returned: 0 in 0.376s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:05 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-c9ca1874-c2d9-4934-8619-8d93f9488807 tempest-CinderUnicodeTest-435747895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ce447f64-1e86-45dc-a9a0-14eac625e568 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:05 devstack sudo[107436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ce447f64-1e86-45dc-a9a0-14eac625e568 Sep 29 18:38:05 devstack sudo[107436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:05 devstack sudo[107426]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:05 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-9bf37b20-3bac-4005-83b3-2c8eddce7073 tempest-ProjectReaderTests-1071181519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-b973dbb1-7b77-440c-86e3-21f08d25fd45 1073741824" returned: 0 in 0.439s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:05 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-9bf37b20-3bac-4005-83b3-2c8eddce7073 tempest-ProjectReaderTests-1071181519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-b973dbb1-7b77-440c-86e3-21f08d25fd45 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:05 devstack sudo[107438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-b973dbb1-7b77-440c-86e3-21f08d25fd45 Sep 29 18:38:05 devstack sudo[107438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:06 devstack sudo[107436]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:06 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-c9ca1874-c2d9-4934-8619-8d93f9488807 tempest-CinderUnicodeTest-435747895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ce447f64-1e86-45dc-a9a0-14eac625e568" returned: 0 in 0.289s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:06 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-c9ca1874-c2d9-4934-8619-8d93f9488807 tempest-CinderUnicodeTest-435747895 None] Lock "cinder-quobyte-ce447f64-1e86-45dc-a9a0-14eac625e568" released by "delete_volume" :: held 0.783s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:38:06 devstack sudo[107438]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:06 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-9bf37b20-3bac-4005-83b3-2c8eddce7073 tempest-ProjectReaderTests-1071181519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-b973dbb1-7b77-440c-86e3-21f08d25fd45" returned: 0 in 0.278s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:06 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-9bf37b20-3bac-4005-83b3-2c8eddce7073 tempest-ProjectReaderTests-1071181519 None] <== create_volume: return (765ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'} {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:38:06 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-9bf37b20-3bac-4005-83b3-2c8eddce7073 tempest-ProjectReaderTests-1071181519 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.767s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:38:06 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-9bf37b20-3bac-4005-83b3-2c8eddce7073 tempest-ProjectReaderTests-1071181519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfd8fbba-c24e-4950-a13b-0b218f39b34b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b973dbb1-7b77-440c-86e3-21f08d25fd45', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:38:06 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-9bf37b20-3bac-4005-83b3-2c8eddce7073 tempest-ProjectReaderTests-1071181519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a7ae7e0-8443-464c-b4fb-e24ea957c31f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:38:06 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-c9ca1874-c2d9-4934-8619-8d93f9488807 tempest-CinderUnicodeTest-435747895 None] Created reservations ['3bfa8f12-642c-4342-8403-28fd51d2cb33', 'bd2a0ea1-64f0-4a3a-8e4e-70961fde8122', '590f79c2-2915-4181-b9bc-cb843f96c5a1', '0c5d0f32-eaf9-4b76-9892-d5f526c80c92'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:38:06 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-9bf37b20-3bac-4005-83b3-2c8eddce7073 tempest-ProjectReaderTests-1071181519 None] Volume volume-b973dbb1-7b77-440c-86e3-21f08d25fd45 (b973dbb1-7b77-440c-86e3-21f08d25fd45): created successfully Sep 29 18:38:06 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-9bf37b20-3bac-4005-83b3-2c8eddce7073 tempest-ProjectReaderTests-1071181519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a7ae7e0-8443-464c-b4fb-e24ea957c31f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:38:06 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-9bf37b20-3bac-4005-83b3-2c8eddce7073 tempest-ProjectReaderTests-1071181519 None] Flow 'volume_create_manager' (cc7f707f-1fc8-4591-a613-3cdaaa898fbf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:38:06 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-9bf37b20-3bac-4005-83b3-2c8eddce7073 tempest-ProjectReaderTests-1071181519 None] Created volume successfully. Sep 29 18:38:06 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-c9ca1874-c2d9-4934-8619-8d93f9488807 tempest-CinderUnicodeTest-435747895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:38:06 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-c9ca1874-c2d9-4934-8619-8d93f9488807 tempest-CinderUnicodeTest-435747895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:38:06 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-c9ca1874-c2d9-4934-8619-8d93f9488807 tempest-CinderUnicodeTest-435747895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:38:06 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-c9ca1874-c2d9-4934-8619-8d93f9488807 tempest-CinderUnicodeTest-435747895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:38:06 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-c9ca1874-c2d9-4934-8619-8d93f9488807 tempest-CinderUnicodeTest-435747895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:38:06 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-c9ca1874-c2d9-4934-8619-8d93f9488807 tempest-CinderUnicodeTest-435747895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:06 devstack sudo[107442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:38:06 devstack sudo[107442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:06 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-46c7d07e-e577-4b79-b22e-ffaca48b5fdb tempest-CinderUnicodeTest-435747895 None] Acquiring lock "cinder-4f19082d-d1ef-4b87-998b-416e6b4ee131-delete_volume" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:38:06 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-46c7d07e-e577-4b79-b22e-ffaca48b5fdb tempest-CinderUnicodeTest-435747895 None] Lock "cinder-4f19082d-d1ef-4b87-998b-416e6b4ee131-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:38:06 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-46c7d07e-e577-4b79-b22e-ffaca48b5fdb tempest-CinderUnicodeTest-435747895 None] Acquiring lock "cinder-quobyte-4f19082d-d1ef-4b87-998b-416e6b4ee131" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:38:06 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-46c7d07e-e577-4b79-b22e-ffaca48b5fdb tempest-CinderUnicodeTest-435747895 None] Lock "cinder-quobyte-4f19082d-d1ef-4b87-998b-416e6b4ee131" acquired by "delete_volume" :: waited 0.018s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:38:06 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[da04d318-f0a1-4db8-bbd9-94196f13466c]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:38:06 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-46c7d07e-e577-4b79-b22e-ffaca48b5fdb tempest-CinderUnicodeTest-435747895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-4f19082d-d1ef-4b87-998b-416e6b4ee131 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:06 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e16b843-7086-46e4-9fb8-ea92263a83f7 tempest-VolumeDependencyTests-652408482 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86512) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:38:06 devstack sudo[107442]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:06 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-c9ca1874-c2d9-4934-8619-8d93f9488807 tempest-CinderUnicodeTest-435747895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.289s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:06 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-c9ca1874-c2d9-4934-8619-8d93f9488807 tempest-CinderUnicodeTest-435747895 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:38:06 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-c9ca1874-c2d9-4934-8619-8d93f9488807 tempest-CinderUnicodeTest-435747895 None] Deleted volume successfully. Sep 29 18:38:06 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-5e16b843-7086-46e4-9fb8-ea92263a83f7 tempest-VolumeDependencyTests-652408482 None] Flow 'volume_create_manager' (78143865-443d-4327-80c5-2a23442d2e6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:38:06 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-5e16b843-7086-46e4-9fb8-ea92263a83f7 tempest-VolumeDependencyTests-652408482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cebed9b-a582-4672-a256-00316b83a972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:38:06 devstack sudo[107444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-4f19082d-d1ef-4b87-998b-416e6b4ee131 Sep 29 18:38:06 devstack sudo[107444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:06 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-5e16b843-7086-46e4-9fb8-ea92263a83f7 tempest-VolumeDependencyTests-652408482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cebed9b-a582-4672-a256-00316b83a972) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:38:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-858472066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de6d0f5a-1c90-498c-ba1e-634daa10cce0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9541ca19a4924e3983a77f3624b8885a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:38:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=03085504-a717-4a09-9427-12e9c41e5a5d,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:38:07Z,use_quota=True,user_id='5207403689124a53831d4c4ca06b4698',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:38:06 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-5e16b843-7086-46e4-9fb8-ea92263a83f7 tempest-VolumeDependencyTests-652408482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (876a3305-d9bb-47e2-920a-936d59bf1a65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:38:06 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-5e16b843-7086-46e4-9fb8-ea92263a83f7 tempest-VolumeDependencyTests-652408482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (876a3305-d9bb-47e2-920a-936d59bf1a65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:38:06 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-5e16b843-7086-46e4-9fb8-ea92263a83f7 tempest-VolumeDependencyTests-652408482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a81d20ce-549b-4c9b-81f4-2da1eb765711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:38:06 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-5e16b843-7086-46e4-9fb8-ea92263a83f7 tempest-VolumeDependencyTests-652408482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a81d20ce-549b-4c9b-81f4-2da1eb765711) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'de6d0f5a-1c90-498c-ba1e-634daa10cce0', 'volume_name': 'volume-de6d0f5a-1c90-498c-ba1e-634daa10cce0', 'volume_size': 1, 'snapshot_id': '03085504-a717-4a09-9427-12e9c41e5a5d'}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:38:06 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-5e16b843-7086-46e4-9fb8-ea92263a83f7 tempest-VolumeDependencyTests-652408482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f3074d4-f7f1-40e9-be02-0f9624a2919e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:38:06 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-5e16b843-7086-46e4-9fb8-ea92263a83f7 tempest-VolumeDependencyTests-652408482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f3074d4-f7f1-40e9-be02-0f9624a2919e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:38:06 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-5e16b843-7086-46e4-9fb8-ea92263a83f7 tempest-VolumeDependencyTests-652408482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d9077dd-50fe-4639-8436-814d4960bd66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:38:06 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-5e16b843-7086-46e4-9fb8-ea92263a83f7 tempest-VolumeDependencyTests-652408482 None] Volume de6d0f5a-1c90-498c-ba1e-634daa10cce0: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-de6d0f5a-1c90-498c-ba1e-634daa10cce0', 'volume_size': 1, 'snapshot_id': '03085504-a717-4a09-9427-12e9c41e5a5d'} Sep 29 18:38:06 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-c9ca1874-c2d9-4934-8619-8d93f9488807 tempest-CinderUnicodeTest-435747895 None] Lock "cinder-ce447f64-1e86-45dc-a9a0-14eac625e568-delete_volume" released by "delete_volume" :: held 1.472s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:38:06 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-5e16b843-7086-46e4-9fb8-ea92263a83f7 tempest-VolumeDependencyTests-652408482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:38:06 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-5e16b843-7086-46e4-9fb8-ea92263a83f7 tempest-VolumeDependencyTests-652408482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:38:06 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-5e16b843-7086-46e4-9fb8-ea92263a83f7 tempest-VolumeDependencyTests-652408482 None] Acquiring lock "cinder-quobyte-03085504-a717-4a09-9427-12e9c41e5a5d-de6d0f5a-1c90-498c-ba1e-634daa10cce0" by "_create_volume_from_snapshot" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:38:06 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-5e16b843-7086-46e4-9fb8-ea92263a83f7 tempest-VolumeDependencyTests-652408482 None] Lock "cinder-quobyte-03085504-a717-4a09-9427-12e9c41e5a5d-de6d0f5a-1c90-498c-ba1e-634daa10cce0" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:38:06 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-5e16b843-7086-46e4-9fb8-ea92263a83f7 tempest-VolumeDependencyTests-652408482 None] Creating volume de6d0f5a-1c90-498c-ba1e-634daa10cce0 from snapshot 03085504-a717-4a09-9427-12e9c41e5a5d {{(pid=86512) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 29 18:38:06 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-5e16b843-7086-46e4-9fb8-ea92263a83f7 tempest-VolumeDependencyTests-652408482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:38:06 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-5e16b843-7086-46e4-9fb8-ea92263a83f7 tempest-VolumeDependencyTests-652408482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:38:06 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-5e16b843-7086-46e4-9fb8-ea92263a83f7 tempest-VolumeDependencyTests-652408482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:38:06 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-5e16b843-7086-46e4-9fb8-ea92263a83f7 tempest-VolumeDependencyTests-652408482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:38:06 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-5e16b843-7086-46e4-9fb8-ea92263a83f7 tempest-VolumeDependencyTests-652408482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:38:06 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-5e16b843-7086-46e4-9fb8-ea92263a83f7 tempest-VolumeDependencyTests-652408482 None] Selected osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 as target Quobyte volume. {{(pid=86512) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:38:06 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-5e16b843-7086-46e4-9fb8-ea92263a83f7 tempest-VolumeDependencyTests-652408482 None] Acquiring lock "cinder-quobyte-de6d0f5a-1c90-498c-ba1e-634daa10cce0" by "_copy_volume_from_snapshot" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:38:06 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-5e16b843-7086-46e4-9fb8-ea92263a83f7 tempest-VolumeDependencyTests-652408482 None] Lock "cinder-quobyte-de6d0f5a-1c90-498c-ba1e-634daa10cce0" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:38:06 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-5e16b843-7086-46e4-9fb8-ea92263a83f7 tempest-VolumeDependencyTests-652408482 None] snapshot: 03085504-a717-4a09-9427-12e9c41e5a5d, volume: de6d0f5a-1c90-498c-ba1e-634daa10cce0, {{(pid=86512) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 29 18:38:06 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-5e16b843-7086-46e4-9fb8-ea92263a83f7 tempest-VolumeDependencyTests-652408482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:38:06 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-5e16b843-7086-46e4-9fb8-ea92263a83f7 tempest-VolumeDependencyTests-652408482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:38:06 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-5e16b843-7086-46e4-9fb8-ea92263a83f7 tempest-VolumeDependencyTests-652408482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:38:06 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-5e16b843-7086-46e4-9fb8-ea92263a83f7 tempest-VolumeDependencyTests-652408482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:38:06 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-5e16b843-7086-46e4-9fb8-ea92263a83f7 tempest-VolumeDependencyTests-652408482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:38:06 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f7c8ce3-986b-4b53-844c-3deda10cf38b]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:38:06 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-5e16b843-7086-46e4-9fb8-ea92263a83f7 tempest-VolumeDependencyTests-652408482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ff95edf6-baaa-4fe3-b16b-ed422d627d22.03085504-a717-4a09-9427-12e9c41e5a5d {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:06 devstack sudo[107447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ff95edf6-baaa-4fe3-b16b-ed422d627d22.03085504-a717-4a09-9427-12e9c41e5a5d Sep 29 18:38:06 devstack sudo[107447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:06 devstack sudo[107444]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:06 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-46c7d07e-e577-4b79-b22e-ffaca48b5fdb tempest-CinderUnicodeTest-435747895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-4f19082d-d1ef-4b87-998b-416e6b4ee131" returned: 0 in 0.386s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:06 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-46c7d07e-e577-4b79-b22e-ffaca48b5fdb tempest-CinderUnicodeTest-435747895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-4f19082d-d1ef-4b87-998b-416e6b4ee131 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:06 devstack sudo[107452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-4f19082d-d1ef-4b87-998b-416e6b4ee131 Sep 29 18:38:06 devstack sudo[107452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:07 devstack sudo[107452]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:07 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-46c7d07e-e577-4b79-b22e-ffaca48b5fdb tempest-CinderUnicodeTest-435747895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-4f19082d-d1ef-4b87-998b-416e6b4ee131" returned: 0 in 0.241s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:07 devstack sudo[107447]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:07 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-5e16b843-7086-46e4-9fb8-ea92263a83f7 tempest-VolumeDependencyTests-652408482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ff95edf6-baaa-4fe3-b16b-ed422d627d22.03085504-a717-4a09-9427-12e9c41e5a5d" returned: 0 in 0.371s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:07 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-5e16b843-7086-46e4-9fb8-ea92263a83f7 tempest-VolumeDependencyTests-652408482 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ff95edf6-baaa-4fe3-b16b-ed422d627d22(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86512) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 18:38:07 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-46c7d07e-e577-4b79-b22e-ffaca48b5fdb tempest-CinderUnicodeTest-435747895 None] Lock "cinder-quobyte-4f19082d-d1ef-4b87-998b-416e6b4ee131" released by "delete_volume" :: held 0.678s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:38:07 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[90c046a5-e5cd-42a1-86f6-2fa64781456a]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:38:07 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-5e16b843-7086-46e4-9fb8-ea92263a83f7 tempest-VolumeDependencyTests-652408482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ff95edf6-baaa-4fe3-b16b-ed422d627d22 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:07 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-46c7d07e-e577-4b79-b22e-ffaca48b5fdb tempest-CinderUnicodeTest-435747895 None] Created reservations ['0741eaf3-2fe1-43ca-a0d4-879b33a26b53', 'cfff5ba4-0343-44b9-bcbc-92990291ac50', 'd7341932-d745-4b8b-a0ec-4086bfa73839', 'f0ecb19f-6471-4b27-b5d7-52c1d8df8ed6'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:38:07 devstack sudo[107458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ff95edf6-baaa-4fe3-b16b-ed422d627d22 Sep 29 18:38:07 devstack sudo[107458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:07 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-46c7d07e-e577-4b79-b22e-ffaca48b5fdb tempest-CinderUnicodeTest-435747895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:38:07 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-46c7d07e-e577-4b79-b22e-ffaca48b5fdb tempest-CinderUnicodeTest-435747895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:38:07 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-46c7d07e-e577-4b79-b22e-ffaca48b5fdb tempest-CinderUnicodeTest-435747895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:38:07 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-46c7d07e-e577-4b79-b22e-ffaca48b5fdb tempest-CinderUnicodeTest-435747895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:38:07 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-46c7d07e-e577-4b79-b22e-ffaca48b5fdb tempest-CinderUnicodeTest-435747895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:38:07 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-46c7d07e-e577-4b79-b22e-ffaca48b5fdb tempest-CinderUnicodeTest-435747895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:07 devstack sudo[107460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:38:07 devstack sudo[107460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:07 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-46567d79-29d2-4d7f-9318-1c579644a72c tempest-ProjectReaderTests-1071181519 None] Acquiring lock "cinder-b973dbb1-7b77-440c-86e3-21f08d25fd45-delete_volume" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:38:07 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-46567d79-29d2-4d7f-9318-1c579644a72c tempest-ProjectReaderTests-1071181519 None] Lock "cinder-b973dbb1-7b77-440c-86e3-21f08d25fd45-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:38:07 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-46567d79-29d2-4d7f-9318-1c579644a72c tempest-ProjectReaderTests-1071181519 None] Acquiring lock "cinder-quobyte-b973dbb1-7b77-440c-86e3-21f08d25fd45" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:38:07 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-46567d79-29d2-4d7f-9318-1c579644a72c tempest-ProjectReaderTests-1071181519 None] Lock "cinder-quobyte-b973dbb1-7b77-440c-86e3-21f08d25fd45" acquired by "delete_volume" :: waited 0.022s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:38:07 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fca2f24-63a2-471f-84ed-2d75f5b0db11]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:38:07 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-46567d79-29d2-4d7f-9318-1c579644a72c tempest-ProjectReaderTests-1071181519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-b973dbb1-7b77-440c-86e3-21f08d25fd45 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:07 devstack sudo[107458]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:07 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-5e16b843-7086-46e4-9fb8-ea92263a83f7 tempest-VolumeDependencyTests-652408482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ff95edf6-baaa-4fe3-b16b-ed422d627d22" returned: 0 in 0.424s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:07 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-5e16b843-7086-46e4-9fb8-ea92263a83f7 tempest-VolumeDependencyTests-652408482 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ff95edf6-baaa-4fe3-b16b-ed422d627d22 {{(pid=86512) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 29 18:38:07 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-5e16b843-7086-46e4-9fb8-ea92263a83f7 tempest-VolumeDependencyTests-652408482 None] Creating direct copy from snapshot {{(pid=86512) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 29 18:38:07 devstack cinder-volume[86512]: DEBUG cinder.utils [None req-5e16b843-7086-46e4-9fb8-ea92263a83f7 tempest-VolumeDependencyTests-652408482 None] Path /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-de6d0f5a-1c90-498c-ba1e-634daa10cce0 not found in is_blk_device check {{(pid=86512) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 29 18:38:07 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-5e16b843-7086-46e4-9fb8-ea92263a83f7 tempest-VolumeDependencyTests-652408482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ff95edf6-baaa-4fe3-b16b-ed422d627d22 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-de6d0f5a-1c90-498c-ba1e-634daa10cce0 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:07 devstack sudo[107467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ff95edf6-baaa-4fe3-b16b-ed422d627d22 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-de6d0f5a-1c90-498c-ba1e-634daa10cce0 Sep 29 18:38:07 devstack sudo[107467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:07 devstack sudo[107460]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:07 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-46c7d07e-e577-4b79-b22e-ffaca48b5fdb tempest-CinderUnicodeTest-435747895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.331s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:07 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-46c7d07e-e577-4b79-b22e-ffaca48b5fdb tempest-CinderUnicodeTest-435747895 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:38:07 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-46c7d07e-e577-4b79-b22e-ffaca48b5fdb tempest-CinderUnicodeTest-435747895 None] Deleted volume successfully. Sep 29 18:38:07 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-46c7d07e-e577-4b79-b22e-ffaca48b5fdb tempest-CinderUnicodeTest-435747895 None] Lock "cinder-4f19082d-d1ef-4b87-998b-416e6b4ee131-delete_volume" released by "delete_volume" :: held 1.272s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:38:07 devstack sudo[107465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-b973dbb1-7b77-440c-86e3-21f08d25fd45 Sep 29 18:38:07 devstack sudo[107465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:08 devstack sudo[107465]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:08 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-46567d79-29d2-4d7f-9318-1c579644a72c tempest-ProjectReaderTests-1071181519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-b973dbb1-7b77-440c-86e3-21f08d25fd45" returned: 0 in 0.417s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:08 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-46567d79-29d2-4d7f-9318-1c579644a72c tempest-ProjectReaderTests-1071181519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-b973dbb1-7b77-440c-86e3-21f08d25fd45 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:08 devstack sudo[107477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-b973dbb1-7b77-440c-86e3-21f08d25fd45 Sep 29 18:38:08 devstack sudo[107477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:08 devstack sudo[107477]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:08 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-46567d79-29d2-4d7f-9318-1c579644a72c tempest-ProjectReaderTests-1071181519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-b973dbb1-7b77-440c-86e3-21f08d25fd45" returned: 0 in 0.335s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:08 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-46567d79-29d2-4d7f-9318-1c579644a72c tempest-ProjectReaderTests-1071181519 None] Lock "cinder-quobyte-b973dbb1-7b77-440c-86e3-21f08d25fd45" released by "delete_volume" :: held 0.819s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:38:08 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-46567d79-29d2-4d7f-9318-1c579644a72c tempest-ProjectReaderTests-1071181519 None] Created reservations ['d49144b6-5bc1-4200-893b-cb9560b72d6b', '2614df33-b105-407e-ab67-e7594162083b', 'a193aa76-93e0-44bb-b501-c333e0371f3c', '7f107ddc-e89a-4942-8571-d23194e302c2'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:38:08 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-46567d79-29d2-4d7f-9318-1c579644a72c tempest-ProjectReaderTests-1071181519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:38:08 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-46567d79-29d2-4d7f-9318-1c579644a72c tempest-ProjectReaderTests-1071181519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:38:08 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-46567d79-29d2-4d7f-9318-1c579644a72c tempest-ProjectReaderTests-1071181519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:38:08 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-46567d79-29d2-4d7f-9318-1c579644a72c tempest-ProjectReaderTests-1071181519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:38:08 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-46567d79-29d2-4d7f-9318-1c579644a72c tempest-ProjectReaderTests-1071181519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:38:08 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-46567d79-29d2-4d7f-9318-1c579644a72c tempest-ProjectReaderTests-1071181519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:08 devstack sudo[107488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:38:08 devstack sudo[107488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:09 devstack sudo[107488]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:09 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-46567d79-29d2-4d7f-9318-1c579644a72c tempest-ProjectReaderTests-1071181519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.707s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:09 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-46567d79-29d2-4d7f-9318-1c579644a72c tempest-ProjectReaderTests-1071181519 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:38:09 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-46567d79-29d2-4d7f-9318-1c579644a72c tempest-ProjectReaderTests-1071181519 None] Deleted volume successfully. Sep 29 18:38:09 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-46567d79-29d2-4d7f-9318-1c579644a72c tempest-ProjectReaderTests-1071181519 None] Lock "cinder-b973dbb1-7b77-440c-86e3-21f08d25fd45-delete_volume" released by "delete_volume" :: held 2.055s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:38:15 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf7b2bbb-7c0f-4142-9f77-b2532158cf92 tempest-ProjectReaderTests-1679623781 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86512) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:38:15 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-cf7b2bbb-7c0f-4142-9f77-b2532158cf92 tempest-ProjectReaderTests-1679623781 None] Flow 'volume_create_manager' (b4e1143f-0833-443e-8a44-7cc830d14c40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:38:15 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-cf7b2bbb-7c0f-4142-9f77-b2532158cf92 tempest-ProjectReaderTests-1679623781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6adef7b3-3e42-4d9e-9a23-013a5d023d32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:38:15 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-cf7b2bbb-7c0f-4142-9f77-b2532158cf92 tempest-ProjectReaderTests-1679623781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6adef7b3-3e42-4d9e-9a23-013a5d023d32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:38:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-256451528',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4f1a549-2df0-4a92-9b59-9f59059cd05b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f41aed7ee5b34e4bbad59bc32c08b236',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:38:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:38:15Z,use_quota=True,user_id='3baa3f73c40542b9b511c21345fa9a4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:38:15 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-cf7b2bbb-7c0f-4142-9f77-b2532158cf92 tempest-ProjectReaderTests-1679623781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14f828b4-c182-48da-a904-618d7dfece5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:38:15 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-cf7b2bbb-7c0f-4142-9f77-b2532158cf92 tempest-ProjectReaderTests-1679623781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14f828b4-c182-48da-a904-618d7dfece5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:38:15 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-cf7b2bbb-7c0f-4142-9f77-b2532158cf92 tempest-ProjectReaderTests-1679623781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11a2f461-043a-4ed0-af9a-e7751cfae421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:38:15 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-cf7b2bbb-7c0f-4142-9f77-b2532158cf92 tempest-ProjectReaderTests-1679623781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11a2f461-043a-4ed0-af9a-e7751cfae421) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4f1a549-2df0-4a92-9b59-9f59059cd05b', 'volume_name': 'volume-e4f1a549-2df0-4a92-9b59-9f59059cd05b', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:38:15 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-cf7b2bbb-7c0f-4142-9f77-b2532158cf92 tempest-ProjectReaderTests-1679623781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76460655-60d6-4ef0-85a9-e9f0112c9e02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:38:15 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-cf7b2bbb-7c0f-4142-9f77-b2532158cf92 tempest-ProjectReaderTests-1679623781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76460655-60d6-4ef0-85a9-e9f0112c9e02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:38:15 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-cf7b2bbb-7c0f-4142-9f77-b2532158cf92 tempest-ProjectReaderTests-1679623781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e558ab2-4fae-43ad-8111-fa68696d78d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:38:15 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-cf7b2bbb-7c0f-4142-9f77-b2532158cf92 tempest-ProjectReaderTests-1679623781 None] Volume e4f1a549-2df0-4a92-9b59-9f59059cd05b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4f1a549-2df0-4a92-9b59-9f59059cd05b', 'volume_size': 1} Sep 29 18:38:15 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-cf7b2bbb-7c0f-4142-9f77-b2532158cf92 tempest-ProjectReaderTests-1679623781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:38:15 devstack sudo[107467]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:15 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-5e16b843-7086-46e4-9fb8-ea92263a83f7 tempest-VolumeDependencyTests-652408482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ff95edf6-baaa-4fe3-b16b-ed422d627d22 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-de6d0f5a-1c90-498c-ba1e-634daa10cce0" returned: 0 in 8.209s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:15 devstack cinder-volume[86512]: DEBUG cinder.image.image_utils [None req-5e16b843-7086-46e4-9fb8-ea92263a83f7 tempest-VolumeDependencyTests-652408482 None] Image conversion details: src /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ff95edf6-baaa-4fe3-b16b-ed422d627d22, size 1024.00 MB, duration 8.21 sec, destination /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-de6d0f5a-1c90-498c-ba1e-634daa10cce0 {{(pid=86512) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 29 18:38:15 devstack cinder-volume[86512]: INFO cinder.image.image_utils [None req-5e16b843-7086-46e4-9fb8-ea92263a83f7 tempest-VolumeDependencyTests-652408482 None] Converted 1024.00 MB image at 124.73 MB/s Sep 29 18:38:15 devstack cinder-volume[86512]: WARNING cinder.volume.drivers.remotefs [None req-5e16b843-7086-46e4-9fb8-ea92263a83f7 tempest-VolumeDependencyTests-652408482 None] /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-de6d0f5a-1c90-498c-ba1e-634daa10cce0 is being set with open permissions: ugo+rw Sep 29 18:38:15 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-5e16b843-7086-46e4-9fb8-ea92263a83f7 tempest-VolumeDependencyTests-652408482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-de6d0f5a-1c90-498c-ba1e-634daa10cce0 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:15 devstack sudo[107493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-de6d0f5a-1c90-498c-ba1e-634daa10cce0 Sep 29 18:38:15 devstack sudo[107493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:16 devstack sudo[107493]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:16 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-5e16b843-7086-46e4-9fb8-ea92263a83f7 tempest-VolumeDependencyTests-652408482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-de6d0f5a-1c90-498c-ba1e-634daa10cce0" returned: 0 in 0.266s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:16 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-5e16b843-7086-46e4-9fb8-ea92263a83f7 tempest-VolumeDependencyTests-652408482 None] Lock "cinder-quobyte-de6d0f5a-1c90-498c-ba1e-634daa10cce0" released by "_copy_volume_from_snapshot" :: held 9.365s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:38:16 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-5e16b843-7086-46e4-9fb8-ea92263a83f7 tempest-VolumeDependencyTests-652408482 None] Lock "cinder-quobyte-03085504-a717-4a09-9427-12e9c41e5a5d-de6d0f5a-1c90-498c-ba1e-634daa10cce0" released by "_create_volume_from_snapshot" :: held 9.429s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:38:16 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-5e16b843-7086-46e4-9fb8-ea92263a83f7 tempest-VolumeDependencyTests-652408482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.445s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:38:16 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-cf7b2bbb-7c0f-4142-9f77-b2532158cf92 tempest-ProjectReaderTests-1679623781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.943s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:38:16 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-cf7b2bbb-7c0f-4142-9f77-b2532158cf92 tempest-ProjectReaderTests-1679623781 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:38:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-256451528',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4f1a549-2df0-4a92-9b59-9f59059cd05b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f41aed7ee5b34e4bbad59bc32c08b236',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:38:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:38:15Z,use_quota=True,user_id='3baa3f73c40542b9b511c21345fa9a4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)}" {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:38:16 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-cf7b2bbb-7c0f-4142-9f77-b2532158cf92 tempest-ProjectReaderTests-1679623781 None] Creating volume e4f1a549-2df0-4a92-9b59-9f59059cd05b {{(pid=86512) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:38:16 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-cf7b2bbb-7c0f-4142-9f77-b2532158cf92 tempest-ProjectReaderTests-1679623781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:38:16 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-cf7b2bbb-7c0f-4142-9f77-b2532158cf92 tempest-ProjectReaderTests-1679623781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:38:16 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-cf7b2bbb-7c0f-4142-9f77-b2532158cf92 tempest-ProjectReaderTests-1679623781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:38:16 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-cf7b2bbb-7c0f-4142-9f77-b2532158cf92 tempest-ProjectReaderTests-1679623781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:38:16 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-cf7b2bbb-7c0f-4142-9f77-b2532158cf92 tempest-ProjectReaderTests-1679623781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:38:16 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-cf7b2bbb-7c0f-4142-9f77-b2532158cf92 tempest-ProjectReaderTests-1679623781 None] Selected osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 as target Quobyte volume. {{(pid=86512) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:38:16 devstack cinder-volume[86512]: INFO cinder.volume.drivers.remotefs [None req-cf7b2bbb-7c0f-4142-9f77-b2532158cf92 tempest-ProjectReaderTests-1679623781 None] casted to osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 Sep 29 18:38:16 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-cf7b2bbb-7c0f-4142-9f77-b2532158cf92 tempest-ProjectReaderTests-1679623781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e4f1a549-2df0-4a92-9b59-9f59059cd05b 1073741824 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:16 devstack sudo[107496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e4f1a549-2df0-4a92-9b59-9f59059cd05b 1073741824 Sep 29 18:38:16 devstack sudo[107496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:16 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-5e16b843-7086-46e4-9fb8-ea92263a83f7 tempest-VolumeDependencyTests-652408482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d9077dd-50fe-4639-8436-814d4960bd66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de6d0f5a-1c90-498c-ba1e-634daa10cce0', 'volume_size': 1, 'snapshot_id': '03085504-a717-4a09-9427-12e9c41e5a5d'}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:38:16 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-5e16b843-7086-46e4-9fb8-ea92263a83f7 tempest-VolumeDependencyTests-652408482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfb8e73b-61f2-4b6c-a6f9-be9a40104f3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:38:16 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-5e16b843-7086-46e4-9fb8-ea92263a83f7 tempest-VolumeDependencyTests-652408482 None] Volume volume-de6d0f5a-1c90-498c-ba1e-634daa10cce0 (de6d0f5a-1c90-498c-ba1e-634daa10cce0): created successfully Sep 29 18:38:16 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-5e16b843-7086-46e4-9fb8-ea92263a83f7 tempest-VolumeDependencyTests-652408482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfb8e73b-61f2-4b6c-a6f9-be9a40104f3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:38:16 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-5e16b843-7086-46e4-9fb8-ea92263a83f7 tempest-VolumeDependencyTests-652408482 None] Flow 'volume_create_manager' (78143865-443d-4327-80c5-2a23442d2e6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:38:16 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-5e16b843-7086-46e4-9fb8-ea92263a83f7 tempest-VolumeDependencyTests-652408482 None] Created volume successfully. Sep 29 18:38:16 devstack sudo[107496]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:16 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-cf7b2bbb-7c0f-4142-9f77-b2532158cf92 tempest-ProjectReaderTests-1679623781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e4f1a549-2df0-4a92-9b59-9f59059cd05b 1073741824" returned: 0 in 0.489s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:16 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-cf7b2bbb-7c0f-4142-9f77-b2532158cf92 tempest-ProjectReaderTests-1679623781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e4f1a549-2df0-4a92-9b59-9f59059cd05b {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:16 devstack sudo[107502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e4f1a549-2df0-4a92-9b59-9f59059cd05b Sep 29 18:38:16 devstack sudo[107502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:16 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-085965f3-e537-47b9-b370-d5622a9cb50a tempest-VolumeDependencyTests-652408482 None] Acquiring lock "cinder-03085504-a717-4a09-9427-12e9c41e5a5d-delete_snapshot" by "delete_snapshot" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:38:16 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-085965f3-e537-47b9-b370-d5622a9cb50a tempest-VolumeDependencyTests-652408482 None] Lock "cinder-03085504-a717-4a09-9427-12e9c41e5a5d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:38:16 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-085965f3-e537-47b9-b370-d5622a9cb50a tempest-VolumeDependencyTests-652408482 None] Acquiring lock "cinder-quobyte-ff95edf6-baaa-4fe3-b16b-ed422d627d22" by "delete_snapshot" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:38:16 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-085965f3-e537-47b9-b370-d5622a9cb50a tempest-VolumeDependencyTests-652408482 None] Lock "cinder-quobyte-ff95edf6-baaa-4fe3-b16b-ed422d627d22" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:38:16 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-085965f3-e537-47b9-b370-d5622a9cb50a tempest-VolumeDependencyTests-652408482 None] Acquiring lock "cinder-quobyte-03085504-a717-4a09-9427-12e9c41e5a5d" by "_delete_snapshot" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:38:16 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-085965f3-e537-47b9-b370-d5622a9cb50a tempest-VolumeDependencyTests-652408482 None] Lock "cinder-quobyte-03085504-a717-4a09-9427-12e9c41e5a5d" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:38:16 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-085965f3-e537-47b9-b370-d5622a9cb50a tempest-VolumeDependencyTests-652408482 None] Deleting offline snapshot 03085504-a717-4a09-9427-12e9c41e5a5d of volume ff95edf6-baaa-4fe3-b16b-ed422d627d22 {{(pid=86512) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 18:38:16 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-085965f3-e537-47b9-b370-d5622a9cb50a tempest-VolumeDependencyTests-652408482 None] snapshot_file for this snap is: volume-ff95edf6-baaa-4fe3-b16b-ed422d627d22.03085504-a717-4a09-9427-12e9c41e5a5d {{(pid=86512) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 18:38:16 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed88ee3e-b4fe-4a3e-9701-4d52472ac967]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:38:16 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-085965f3-e537-47b9-b370-d5622a9cb50a tempest-VolumeDependencyTests-652408482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ff95edf6-baaa-4fe3-b16b-ed422d627d22.03085504-a717-4a09-9427-12e9c41e5a5d {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:17 devstack sudo[107504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ff95edf6-baaa-4fe3-b16b-ed422d627d22.03085504-a717-4a09-9427-12e9c41e5a5d Sep 29 18:38:17 devstack sudo[107504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:17 devstack sudo[107502]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:17 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-cf7b2bbb-7c0f-4142-9f77-b2532158cf92 tempest-ProjectReaderTests-1679623781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e4f1a549-2df0-4a92-9b59-9f59059cd05b" returned: 0 in 0.328s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:17 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-cf7b2bbb-7c0f-4142-9f77-b2532158cf92 tempest-ProjectReaderTests-1679623781 None] <== create_volume: return (865ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'} {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:38:17 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-cf7b2bbb-7c0f-4142-9f77-b2532158cf92 tempest-ProjectReaderTests-1679623781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.869s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:38:17 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-cf7b2bbb-7c0f-4142-9f77-b2532158cf92 tempest-ProjectReaderTests-1679623781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e558ab2-4fae-43ad-8111-fa68696d78d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4f1a549-2df0-4a92-9b59-9f59059cd05b', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:38:17 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-cf7b2bbb-7c0f-4142-9f77-b2532158cf92 tempest-ProjectReaderTests-1679623781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e1979e3-71d1-4b88-80c5-d9490157e183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:38:17 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-cf7b2bbb-7c0f-4142-9f77-b2532158cf92 tempest-ProjectReaderTests-1679623781 None] Volume volume-e4f1a549-2df0-4a92-9b59-9f59059cd05b (e4f1a549-2df0-4a92-9b59-9f59059cd05b): created successfully Sep 29 18:38:17 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-cf7b2bbb-7c0f-4142-9f77-b2532158cf92 tempest-ProjectReaderTests-1679623781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e1979e3-71d1-4b88-80c5-d9490157e183) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:38:17 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-cf7b2bbb-7c0f-4142-9f77-b2532158cf92 tempest-ProjectReaderTests-1679623781 None] Flow 'volume_create_manager' (b4e1143f-0833-443e-8a44-7cc830d14c40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:38:17 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-cf7b2bbb-7c0f-4142-9f77-b2532158cf92 tempest-ProjectReaderTests-1679623781 None] Created volume successfully. Sep 29 18:38:17 devstack sudo[107504]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:17 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-085965f3-e537-47b9-b370-d5622a9cb50a tempest-VolumeDependencyTests-652408482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ff95edf6-baaa-4fe3-b16b-ed422d627d22.03085504-a717-4a09-9427-12e9c41e5a5d" returned: 0 in 0.389s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:17 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-085965f3-e537-47b9-b370-d5622a9cb50a tempest-VolumeDependencyTests-652408482 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ff95edf6-baaa-4fe3-b16b-ed422d627d22(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86512) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 18:38:17 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[afba7dc6-0690-49f7-9174-993a20789f50]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:38:17 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-085965f3-e537-47b9-b370-d5622a9cb50a tempest-VolumeDependencyTests-652408482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ff95edf6-baaa-4fe3-b16b-ed422d627d22 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:17 devstack sudo[107510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ff95edf6-baaa-4fe3-b16b-ed422d627d22 Sep 29 18:38:17 devstack sudo[107510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:17 devstack sudo[107510]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:17 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-085965f3-e537-47b9-b370-d5622a9cb50a tempest-VolumeDependencyTests-652408482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ff95edf6-baaa-4fe3-b16b-ed422d627d22" returned: 0 in 0.538s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:17 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-085965f3-e537-47b9-b370-d5622a9cb50a tempest-VolumeDependencyTests-652408482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ff95edf6-baaa-4fe3-b16b-ed422d627d22.03085504-a717-4a09-9427-12e9c41e5a5d {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:17 devstack sudo[107515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ff95edf6-baaa-4fe3-b16b-ed422d627d22.03085504-a717-4a09-9427-12e9c41e5a5d Sep 29 18:38:17 devstack sudo[107515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:18 devstack sudo[107515]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:18 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-085965f3-e537-47b9-b370-d5622a9cb50a tempest-VolumeDependencyTests-652408482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ff95edf6-baaa-4fe3-b16b-ed422d627d22.03085504-a717-4a09-9427-12e9c41e5a5d" returned: 0 in 0.458s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:18 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-085965f3-e537-47b9-b370-d5622a9cb50a tempest-VolumeDependencyTests-652408482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ff95edf6-baaa-4fe3-b16b-ed422d627d22.03085504-a717-4a09-9427-12e9c41e5a5d {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:18 devstack sudo[107520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ff95edf6-baaa-4fe3-b16b-ed422d627d22.03085504-a717-4a09-9427-12e9c41e5a5d Sep 29 18:38:18 devstack sudo[107520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:18 devstack cinder-volume[86512]: DEBUG dbcounter [-] [86512] Writing DB stats cinder:SELECT=202,cinder:INSERT=72,cinder:UPDATE=311,cinder:DELETE=30 {{(pid=86512) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 18:38:18 devstack cinder-volume[86512]: DEBUG dbcounter [-] [86512] Writing DB stats cinder:SELECT=233,cinder:UPDATE=314,cinder:INSERT=82,cinder:DELETE=28 {{(pid=86512) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 18:38:18 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-e542556c-4ccd-43b2-9f1f-ce855b9fccda tempest-ProjectReaderTests-1679623781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:38:18 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-e542556c-4ccd-43b2-9f1f-ce855b9fccda tempest-ProjectReaderTests-1679623781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:38:18 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-e542556c-4ccd-43b2-9f1f-ce855b9fccda tempest-ProjectReaderTests-1679623781 None] Creating offline snapshot b82e572e-c3c5-483b-994e-723d4788acbc of volume e4f1a549-2df0-4a92-9b59-9f59059cd05b {{(pid=86512) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 18:38:18 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[b475172e-6fa3-4742-a693-39baaed143fd]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:38:18 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-e542556c-4ccd-43b2-9f1f-ce855b9fccda tempest-ProjectReaderTests-1679623781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e4f1a549-2df0-4a92-9b59-9f59059cd05b {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:18 devstack sudo[107520]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:18 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-085965f3-e537-47b9-b370-d5622a9cb50a tempest-VolumeDependencyTests-652408482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ff95edf6-baaa-4fe3-b16b-ed422d627d22.03085504-a717-4a09-9427-12e9c41e5a5d" returned: 0 in 0.311s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:18 devstack sudo[107522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e4f1a549-2df0-4a92-9b59-9f59059cd05b Sep 29 18:38:18 devstack sudo[107522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:18 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-085965f3-e537-47b9-b370-d5622a9cb50a tempest-VolumeDependencyTests-652408482 None] Lock "cinder-quobyte-03085504-a717-4a09-9427-12e9c41e5a5d" released by "_delete_snapshot" :: held 1.826s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:38:18 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-085965f3-e537-47b9-b370-d5622a9cb50a tempest-VolumeDependencyTests-652408482 None] Lock "cinder-quobyte-ff95edf6-baaa-4fe3-b16b-ed422d627d22" released by "delete_snapshot" :: held 1.857s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:38:18 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-085965f3-e537-47b9-b370-d5622a9cb50a tempest-VolumeDependencyTests-652408482 None] Created reservations ['f8639908-8697-44f8-b267-99662733fcb2', 'bc03a7c1-fb07-400b-81a8-1a850539848b', 'bf7b695e-8b76-4756-8029-410e1213bb28', '8ff19ae3-c96d-4ee6-8b6d-c2ac7e7f96ed'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:38:18 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-085965f3-e537-47b9-b370-d5622a9cb50a tempest-VolumeDependencyTests-652408482 None] Delete snapshot completed successfully. Sep 29 18:38:18 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-085965f3-e537-47b9-b370-d5622a9cb50a tempest-VolumeDependencyTests-652408482 None] Lock "cinder-03085504-a717-4a09-9427-12e9c41e5a5d-delete_snapshot" released by "delete_snapshot" :: held 2.096s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:38:19 devstack sudo[107522]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:19 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-e542556c-4ccd-43b2-9f1f-ce855b9fccda tempest-ProjectReaderTests-1679623781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e4f1a549-2df0-4a92-9b59-9f59059cd05b" returned: 0 in 0.466s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:19 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-e542556c-4ccd-43b2-9f1f-ce855b9fccda tempest-ProjectReaderTests-1679623781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e4f1a549-2df0-4a92-9b59-9f59059cd05b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e4f1a549-2df0-4a92-9b59-9f59059cd05b.b82e572e-c3c5-483b-994e-723d4788acbc 1G {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:19 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-ce794460-0820-4c7d-be11-8b249510b6ee tempest-VolumeDependencyTests-652408482 None] Acquiring lock "cinder-ff95edf6-baaa-4fe3-b16b-ed422d627d22-delete_volume" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:38:19 devstack sudo[107528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e4f1a549-2df0-4a92-9b59-9f59059cd05b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e4f1a549-2df0-4a92-9b59-9f59059cd05b.b82e572e-c3c5-483b-994e-723d4788acbc 1G Sep 29 18:38:19 devstack sudo[107528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:19 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-ce794460-0820-4c7d-be11-8b249510b6ee tempest-VolumeDependencyTests-652408482 None] Lock "cinder-ff95edf6-baaa-4fe3-b16b-ed422d627d22-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:38:19 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-ce794460-0820-4c7d-be11-8b249510b6ee tempest-VolumeDependencyTests-652408482 None] Acquiring lock "cinder-quobyte-ff95edf6-baaa-4fe3-b16b-ed422d627d22" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:38:19 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-ce794460-0820-4c7d-be11-8b249510b6ee tempest-VolumeDependencyTests-652408482 None] Lock "cinder-quobyte-ff95edf6-baaa-4fe3-b16b-ed422d627d22" acquired by "delete_volume" :: waited 0.020s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:38:19 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eb73732-a333-4df7-b5d1-b115b2253b98]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:38:19 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-ce794460-0820-4c7d-be11-8b249510b6ee tempest-VolumeDependencyTests-652408482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ff95edf6-baaa-4fe3-b16b-ed422d627d22 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:19 devstack sudo[107530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ff95edf6-baaa-4fe3-b16b-ed422d627d22 Sep 29 18:38:19 devstack sudo[107530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:19 devstack sudo[107528]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:19 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-e542556c-4ccd-43b2-9f1f-ce855b9fccda tempest-ProjectReaderTests-1679623781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e4f1a549-2df0-4a92-9b59-9f59059cd05b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e4f1a549-2df0-4a92-9b59-9f59059cd05b.b82e572e-c3c5-483b-994e-723d4788acbc 1G" returned: 0 in 0.485s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:19 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-e542556c-4ccd-43b2-9f1f-ce855b9fccda tempest-ProjectReaderTests-1679623781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e4f1a549-2df0-4a92-9b59-9f59059cd05b -F qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e4f1a549-2df0-4a92-9b59-9f59059cd05b.b82e572e-c3c5-483b-994e-723d4788acbc {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:19 devstack sudo[107536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e4f1a549-2df0-4a92-9b59-9f59059cd05b -F qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e4f1a549-2df0-4a92-9b59-9f59059cd05b.b82e572e-c3c5-483b-994e-723d4788acbc Sep 29 18:38:19 devstack sudo[107536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:19 devstack sudo[107530]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:19 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-ce794460-0820-4c7d-be11-8b249510b6ee tempest-VolumeDependencyTests-652408482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ff95edf6-baaa-4fe3-b16b-ed422d627d22" returned: 0 in 0.429s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:19 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-ce794460-0820-4c7d-be11-8b249510b6ee tempest-VolumeDependencyTests-652408482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ff95edf6-baaa-4fe3-b16b-ed422d627d22 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:19 devstack sudo[107541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ff95edf6-baaa-4fe3-b16b-ed422d627d22 Sep 29 18:38:19 devstack sudo[107541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:19 devstack sudo[107536]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:19 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-e542556c-4ccd-43b2-9f1f-ce855b9fccda tempest-ProjectReaderTests-1679623781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e4f1a549-2df0-4a92-9b59-9f59059cd05b -F qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e4f1a549-2df0-4a92-9b59-9f59059cd05b.b82e572e-c3c5-483b-994e-723d4788acbc" returned: 0 in 0.305s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:19 devstack cinder-volume[86512]: WARNING cinder.volume.drivers.remotefs [None req-e542556c-4ccd-43b2-9f1f-ce855b9fccda tempest-ProjectReaderTests-1679623781 None] /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e4f1a549-2df0-4a92-9b59-9f59059cd05b.b82e572e-c3c5-483b-994e-723d4788acbc is being set with open permissions: ugo+rw Sep 29 18:38:19 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-e542556c-4ccd-43b2-9f1f-ce855b9fccda tempest-ProjectReaderTests-1679623781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e4f1a549-2df0-4a92-9b59-9f59059cd05b.b82e572e-c3c5-483b-994e-723d4788acbc {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:19 devstack sudo[107547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e4f1a549-2df0-4a92-9b59-9f59059cd05b.b82e572e-c3c5-483b-994e-723d4788acbc Sep 29 18:38:19 devstack sudo[107547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:19 devstack sudo[107541]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:19 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-ce794460-0820-4c7d-be11-8b249510b6ee tempest-VolumeDependencyTests-652408482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-ff95edf6-baaa-4fe3-b16b-ed422d627d22" returned: 0 in 0.284s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:19 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-ce794460-0820-4c7d-be11-8b249510b6ee tempest-VolumeDependencyTests-652408482 None] Lock "cinder-quobyte-ff95edf6-baaa-4fe3-b16b-ed422d627d22" released by "delete_volume" :: held 0.802s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:38:20 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-ce794460-0820-4c7d-be11-8b249510b6ee tempest-VolumeDependencyTests-652408482 None] Created reservations ['1dd43f34-7035-433c-8012-8de66e1d3aa9', '6cd1758c-2f80-4330-a083-74df4afb741d', 'e9c0d59a-7675-49ce-999b-f5044baea359', '870e6156-af4d-4c8a-99ce-b96210856535'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:38:20 devstack sudo[107547]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:20 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-e542556c-4ccd-43b2-9f1f-ce855b9fccda tempest-ProjectReaderTests-1679623781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e4f1a549-2df0-4a92-9b59-9f59059cd05b.b82e572e-c3c5-483b-994e-723d4788acbc" returned: 0 in 0.268s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:20 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-e542556c-4ccd-43b2-9f1f-ce855b9fccda tempest-ProjectReaderTests-1679623781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e4f1a549-2df0-4a92-9b59-9f59059cd05b.info {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:20 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-ce794460-0820-4c7d-be11-8b249510b6ee tempest-VolumeDependencyTests-652408482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:38:20 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-ce794460-0820-4c7d-be11-8b249510b6ee tempest-VolumeDependencyTests-652408482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:38:20 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-ce794460-0820-4c7d-be11-8b249510b6ee tempest-VolumeDependencyTests-652408482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:38:20 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-ce794460-0820-4c7d-be11-8b249510b6ee tempest-VolumeDependencyTests-652408482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:38:20 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-ce794460-0820-4c7d-be11-8b249510b6ee tempest-VolumeDependencyTests-652408482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:38:20 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-ce794460-0820-4c7d-be11-8b249510b6ee tempest-VolumeDependencyTests-652408482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:20 devstack sudo[107551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e4f1a549-2df0-4a92-9b59-9f59059cd05b.info Sep 29 18:38:20 devstack sudo[107551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:20 devstack sudo[107552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:38:20 devstack sudo[107552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:20 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-ce27ae46-6659-4895-af2e-eaa91bb0c1db tempest-VolumeDependencyTests-652408482 None] Acquiring lock "cinder-de6d0f5a-1c90-498c-ba1e-634daa10cce0-delete_volume" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:38:20 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-ce27ae46-6659-4895-af2e-eaa91bb0c1db tempest-VolumeDependencyTests-652408482 None] Lock "cinder-de6d0f5a-1c90-498c-ba1e-634daa10cce0-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:38:20 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-ce27ae46-6659-4895-af2e-eaa91bb0c1db tempest-VolumeDependencyTests-652408482 None] Acquiring lock "cinder-quobyte-de6d0f5a-1c90-498c-ba1e-634daa10cce0" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:38:20 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-ce27ae46-6659-4895-af2e-eaa91bb0c1db tempest-VolumeDependencyTests-652408482 None] Lock "cinder-quobyte-de6d0f5a-1c90-498c-ba1e-634daa10cce0" acquired by "delete_volume" :: waited 0.019s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:38:20 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[3751dd35-cee3-4e0a-9dd5-900e4b009a2b]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:38:20 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-ce27ae46-6659-4895-af2e-eaa91bb0c1db tempest-VolumeDependencyTests-652408482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-de6d0f5a-1c90-498c-ba1e-634daa10cce0 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:20 devstack sudo[107551]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:20 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-e542556c-4ccd-43b2-9f1f-ce855b9fccda tempest-ProjectReaderTests-1679623781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e4f1a549-2df0-4a92-9b59-9f59059cd05b.info" returned: 0 in 0.310s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:20 devstack cinder-volume[86512]: WARNING cinder.volume.drivers.remotefs [None req-e542556c-4ccd-43b2-9f1f-ce855b9fccda tempest-ProjectReaderTests-1679623781 None] /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e4f1a549-2df0-4a92-9b59-9f59059cd05b.info is being set with open permissions: ugo+rw Sep 29 18:38:20 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-e542556c-4ccd-43b2-9f1f-ce855b9fccda tempest-ProjectReaderTests-1679623781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e4f1a549-2df0-4a92-9b59-9f59059cd05b.info {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:20 devstack sudo[107552]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:20 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-ce794460-0820-4c7d-be11-8b249510b6ee tempest-VolumeDependencyTests-652408482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.305s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:20 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-ce794460-0820-4c7d-be11-8b249510b6ee tempest-VolumeDependencyTests-652408482 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:38:20 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-ce794460-0820-4c7d-be11-8b249510b6ee tempest-VolumeDependencyTests-652408482 None] Deleted volume successfully. Sep 29 18:38:20 devstack sudo[107558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e4f1a549-2df0-4a92-9b59-9f59059cd05b.info Sep 29 18:38:20 devstack sudo[107558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:20 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-ce794460-0820-4c7d-be11-8b249510b6ee tempest-VolumeDependencyTests-652408482 None] Lock "cinder-ff95edf6-baaa-4fe3-b16b-ed422d627d22-delete_volume" released by "delete_volume" :: held 1.392s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:38:20 devstack sudo[107557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-de6d0f5a-1c90-498c-ba1e-634daa10cce0 Sep 29 18:38:20 devstack sudo[107557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:20 devstack sudo[107558]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:20 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-e542556c-4ccd-43b2-9f1f-ce855b9fccda tempest-ProjectReaderTests-1679623781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e4f1a549-2df0-4a92-9b59-9f59059cd05b.info" returned: 0 in 0.258s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:20 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-e542556c-4ccd-43b2-9f1f-ce855b9fccda tempest-ProjectReaderTests-1679623781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.197s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:38:20 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-e542556c-4ccd-43b2-9f1f-ce855b9fccda tempest-ProjectReaderTests-1679623781 None] Create snapshot completed successfully Sep 29 18:38:20 devstack sudo[107557]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:20 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-ce27ae46-6659-4895-af2e-eaa91bb0c1db tempest-VolumeDependencyTests-652408482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-de6d0f5a-1c90-498c-ba1e-634daa10cce0" returned: 0 in 0.405s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:20 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-ce27ae46-6659-4895-af2e-eaa91bb0c1db tempest-VolumeDependencyTests-652408482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-de6d0f5a-1c90-498c-ba1e-634daa10cce0 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:20 devstack sudo[107565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-de6d0f5a-1c90-498c-ba1e-634daa10cce0 Sep 29 18:38:20 devstack sudo[107565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:21 devstack sudo[107565]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:21 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-ce27ae46-6659-4895-af2e-eaa91bb0c1db tempest-VolumeDependencyTests-652408482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-de6d0f5a-1c90-498c-ba1e-634daa10cce0" returned: 0 in 0.264s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:21 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-ce27ae46-6659-4895-af2e-eaa91bb0c1db tempest-VolumeDependencyTests-652408482 None] Lock "cinder-quobyte-de6d0f5a-1c90-498c-ba1e-634daa10cce0" released by "delete_volume" :: held 0.719s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:38:21 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-ce27ae46-6659-4895-af2e-eaa91bb0c1db tempest-VolumeDependencyTests-652408482 None] Created reservations ['350396a6-6cad-46cc-82b7-9cc766efb713', 'f3c37504-4d0c-4e63-a832-35885d29074a', '042ca7d4-dc01-43ed-b22c-2d7882c81ba6', '98e2d961-0e27-4ef6-bbcd-262c23638213'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:38:21 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-ce27ae46-6659-4895-af2e-eaa91bb0c1db tempest-VolumeDependencyTests-652408482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:38:21 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-ce27ae46-6659-4895-af2e-eaa91bb0c1db tempest-VolumeDependencyTests-652408482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:38:21 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-ce27ae46-6659-4895-af2e-eaa91bb0c1db tempest-VolumeDependencyTests-652408482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:38:21 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-ce27ae46-6659-4895-af2e-eaa91bb0c1db tempest-VolumeDependencyTests-652408482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:38:21 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-ce27ae46-6659-4895-af2e-eaa91bb0c1db tempest-VolumeDependencyTests-652408482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:38:21 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-ce27ae46-6659-4895-af2e-eaa91bb0c1db tempest-VolumeDependencyTests-652408482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:21 devstack sudo[107568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:38:21 devstack sudo[107568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:21 devstack sudo[107568]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:21 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-ce27ae46-6659-4895-af2e-eaa91bb0c1db tempest-VolumeDependencyTests-652408482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.249s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:21 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-ce27ae46-6659-4895-af2e-eaa91bb0c1db tempest-VolumeDependencyTests-652408482 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:38:21 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-ce27ae46-6659-4895-af2e-eaa91bb0c1db tempest-VolumeDependencyTests-652408482 None] Deleted volume successfully. Sep 29 18:38:21 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-ce27ae46-6659-4895-af2e-eaa91bb0c1db tempest-VolumeDependencyTests-652408482 None] Lock "cinder-de6d0f5a-1c90-498c-ba1e-634daa10cce0-delete_volume" released by "delete_volume" :: held 1.185s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:38:21 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-d8743677-6025-463f-9c87-dc3dc622b385 tempest-ProjectReaderTests-1679623781 None] Acquiring lock "cinder-b82e572e-c3c5-483b-994e-723d4788acbc-delete_snapshot" by "delete_snapshot" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:38:21 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-d8743677-6025-463f-9c87-dc3dc622b385 tempest-ProjectReaderTests-1679623781 None] Lock "cinder-b82e572e-c3c5-483b-994e-723d4788acbc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:38:21 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-d8743677-6025-463f-9c87-dc3dc622b385 tempest-ProjectReaderTests-1679623781 None] Acquiring lock "cinder-quobyte-e4f1a549-2df0-4a92-9b59-9f59059cd05b" by "delete_snapshot" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:38:21 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-d8743677-6025-463f-9c87-dc3dc622b385 tempest-ProjectReaderTests-1679623781 None] Lock "cinder-quobyte-e4f1a549-2df0-4a92-9b59-9f59059cd05b" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:38:21 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-d8743677-6025-463f-9c87-dc3dc622b385 tempest-ProjectReaderTests-1679623781 None] Acquiring lock "cinder-quobyte-b82e572e-c3c5-483b-994e-723d4788acbc" by "_delete_snapshot" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:38:21 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-d8743677-6025-463f-9c87-dc3dc622b385 tempest-ProjectReaderTests-1679623781 None] Lock "cinder-quobyte-b82e572e-c3c5-483b-994e-723d4788acbc" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:38:21 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-d8743677-6025-463f-9c87-dc3dc622b385 tempest-ProjectReaderTests-1679623781 None] Deleting offline snapshot b82e572e-c3c5-483b-994e-723d4788acbc of volume e4f1a549-2df0-4a92-9b59-9f59059cd05b {{(pid=86512) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 18:38:21 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-d8743677-6025-463f-9c87-dc3dc622b385 tempest-ProjectReaderTests-1679623781 None] snapshot_file for this snap is: volume-e4f1a549-2df0-4a92-9b59-9f59059cd05b.b82e572e-c3c5-483b-994e-723d4788acbc {{(pid=86512) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 18:38:21 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[7376e922-cb36-48e2-85ec-06f87709a84c]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:38:21 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-d8743677-6025-463f-9c87-dc3dc622b385 tempest-ProjectReaderTests-1679623781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e4f1a549-2df0-4a92-9b59-9f59059cd05b.b82e572e-c3c5-483b-994e-723d4788acbc {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:22 devstack sudo[107572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e4f1a549-2df0-4a92-9b59-9f59059cd05b.b82e572e-c3c5-483b-994e-723d4788acbc Sep 29 18:38:22 devstack sudo[107572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:22 devstack sudo[107572]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:22 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-d8743677-6025-463f-9c87-dc3dc622b385 tempest-ProjectReaderTests-1679623781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e4f1a549-2df0-4a92-9b59-9f59059cd05b.b82e572e-c3c5-483b-994e-723d4788acbc" returned: 0 in 0.400s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:22 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-d8743677-6025-463f-9c87-dc3dc622b385 tempest-ProjectReaderTests-1679623781 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e4f1a549-2df0-4a92-9b59-9f59059cd05b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86512) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 18:38:22 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[7065fe35-9be0-4deb-8ee9-f45f04d5de43]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:38:22 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-d8743677-6025-463f-9c87-dc3dc622b385 tempest-ProjectReaderTests-1679623781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e4f1a549-2df0-4a92-9b59-9f59059cd05b {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:22 devstack sudo[107577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e4f1a549-2df0-4a92-9b59-9f59059cd05b Sep 29 18:38:22 devstack sudo[107577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:22 devstack sudo[107577]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:22 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-d8743677-6025-463f-9c87-dc3dc622b385 tempest-ProjectReaderTests-1679623781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e4f1a549-2df0-4a92-9b59-9f59059cd05b" returned: 0 in 0.389s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:22 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-d8743677-6025-463f-9c87-dc3dc622b385 tempest-ProjectReaderTests-1679623781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e4f1a549-2df0-4a92-9b59-9f59059cd05b.b82e572e-c3c5-483b-994e-723d4788acbc {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:22 devstack sudo[107582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e4f1a549-2df0-4a92-9b59-9f59059cd05b.b82e572e-c3c5-483b-994e-723d4788acbc Sep 29 18:38:22 devstack sudo[107582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:23 devstack sudo[107582]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:23 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-d8743677-6025-463f-9c87-dc3dc622b385 tempest-ProjectReaderTests-1679623781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e4f1a549-2df0-4a92-9b59-9f59059cd05b.b82e572e-c3c5-483b-994e-723d4788acbc" returned: 0 in 0.398s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:23 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-d8743677-6025-463f-9c87-dc3dc622b385 tempest-ProjectReaderTests-1679623781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e4f1a549-2df0-4a92-9b59-9f59059cd05b.b82e572e-c3c5-483b-994e-723d4788acbc {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:23 devstack sudo[107587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e4f1a549-2df0-4a92-9b59-9f59059cd05b.b82e572e-c3c5-483b-994e-723d4788acbc Sep 29 18:38:23 devstack sudo[107587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:23 devstack sudo[107587]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:23 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-d8743677-6025-463f-9c87-dc3dc622b385 tempest-ProjectReaderTests-1679623781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e4f1a549-2df0-4a92-9b59-9f59059cd05b.b82e572e-c3c5-483b-994e-723d4788acbc" returned: 0 in 0.264s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:23 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-d8743677-6025-463f-9c87-dc3dc622b385 tempest-ProjectReaderTests-1679623781 None] Lock "cinder-quobyte-b82e572e-c3c5-483b-994e-723d4788acbc" released by "_delete_snapshot" :: held 1.569s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:38:23 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-d8743677-6025-463f-9c87-dc3dc622b385 tempest-ProjectReaderTests-1679623781 None] Lock "cinder-quobyte-e4f1a549-2df0-4a92-9b59-9f59059cd05b" released by "delete_snapshot" :: held 1.599s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:38:23 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-d8743677-6025-463f-9c87-dc3dc622b385 tempest-ProjectReaderTests-1679623781 None] Created reservations ['833eebe8-3bd3-40b7-9fdc-676b7f0e4598', '9403f826-1e25-48ee-98db-e4223906d15a', '35e4f045-ad78-41fa-b92c-a393538cb739', '3ab81dba-c3f6-4951-83be-69c17f985f59'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:38:23 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-d8743677-6025-463f-9c87-dc3dc622b385 tempest-ProjectReaderTests-1679623781 None] Delete snapshot completed successfully. Sep 29 18:38:23 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-d8743677-6025-463f-9c87-dc3dc622b385 tempest-ProjectReaderTests-1679623781 None] Lock "cinder-b82e572e-c3c5-483b-994e-723d4788acbc-delete_snapshot" released by "delete_snapshot" :: held 1.747s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:38:24 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-ef3026a0-21ba-4728-b928-598a2e7e6359 tempest-ProjectReaderTests-1679623781 None] Acquiring lock "cinder-e4f1a549-2df0-4a92-9b59-9f59059cd05b-delete_volume" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:38:24 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-ef3026a0-21ba-4728-b928-598a2e7e6359 tempest-ProjectReaderTests-1679623781 None] Lock "cinder-e4f1a549-2df0-4a92-9b59-9f59059cd05b-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:38:24 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-ef3026a0-21ba-4728-b928-598a2e7e6359 tempest-ProjectReaderTests-1679623781 None] Acquiring lock "cinder-quobyte-e4f1a549-2df0-4a92-9b59-9f59059cd05b" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:38:24 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-ef3026a0-21ba-4728-b928-598a2e7e6359 tempest-ProjectReaderTests-1679623781 None] Lock "cinder-quobyte-e4f1a549-2df0-4a92-9b59-9f59059cd05b" acquired by "delete_volume" :: waited 0.014s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:38:24 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c13e9f4-5bc3-4228-bbb0-c4a4600e7e4d]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:38:24 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-ef3026a0-21ba-4728-b928-598a2e7e6359 tempest-ProjectReaderTests-1679623781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e4f1a549-2df0-4a92-9b59-9f59059cd05b {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:24 devstack sudo[107593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e4f1a549-2df0-4a92-9b59-9f59059cd05b Sep 29 18:38:24 devstack sudo[107593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:24 devstack sudo[107593]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:24 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-ef3026a0-21ba-4728-b928-598a2e7e6359 tempest-ProjectReaderTests-1679623781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e4f1a549-2df0-4a92-9b59-9f59059cd05b" returned: 0 in 0.358s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:24 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-ef3026a0-21ba-4728-b928-598a2e7e6359 tempest-ProjectReaderTests-1679623781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e4f1a549-2df0-4a92-9b59-9f59059cd05b {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:24 devstack sudo[107598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e4f1a549-2df0-4a92-9b59-9f59059cd05b Sep 29 18:38:24 devstack sudo[107598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:24 devstack sudo[107598]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:24 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-ef3026a0-21ba-4728-b928-598a2e7e6359 tempest-ProjectReaderTests-1679623781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-e4f1a549-2df0-4a92-9b59-9f59059cd05b" returned: 0 in 0.255s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:24 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-ef3026a0-21ba-4728-b928-598a2e7e6359 tempest-ProjectReaderTests-1679623781 None] Lock "cinder-quobyte-e4f1a549-2df0-4a92-9b59-9f59059cd05b" released by "delete_volume" :: held 0.684s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:38:24 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-ef3026a0-21ba-4728-b928-598a2e7e6359 tempest-ProjectReaderTests-1679623781 None] Created reservations ['1f7d388c-1641-49c8-a19e-6fff9e0033c6', 'e663d2c8-b3d4-4b36-b4de-8e3378e42d62', '8b2d97eb-2365-4577-98eb-fa9d8e8c7fdf', '26bfddf2-ef97-4509-a2c7-b275a33f1855'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:38:24 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-ef3026a0-21ba-4728-b928-598a2e7e6359 tempest-ProjectReaderTests-1679623781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:38:24 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-ef3026a0-21ba-4728-b928-598a2e7e6359 tempest-ProjectReaderTests-1679623781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:38:24 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-ef3026a0-21ba-4728-b928-598a2e7e6359 tempest-ProjectReaderTests-1679623781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:38:24 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-ef3026a0-21ba-4728-b928-598a2e7e6359 tempest-ProjectReaderTests-1679623781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:38:24 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-ef3026a0-21ba-4728-b928-598a2e7e6359 tempest-ProjectReaderTests-1679623781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:38:24 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-ef3026a0-21ba-4728-b928-598a2e7e6359 tempest-ProjectReaderTests-1679623781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:24 devstack sudo[107601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:38:24 devstack sudo[107601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:25 devstack sudo[107601]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:25 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-ef3026a0-21ba-4728-b928-598a2e7e6359 tempest-ProjectReaderTests-1679623781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.265s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:25 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-ef3026a0-21ba-4728-b928-598a2e7e6359 tempest-ProjectReaderTests-1679623781 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:38:25 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-ef3026a0-21ba-4728-b928-598a2e7e6359 tempest-ProjectReaderTests-1679623781 None] Deleted volume successfully. Sep 29 18:38:25 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-ef3026a0-21ba-4728-b928-598a2e7e6359 tempest-ProjectReaderTests-1679623781 None] Lock "cinder-e4f1a549-2df0-4a92-9b59-9f59059cd05b-delete_volume" released by "delete_volume" :: held 1.172s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:38:25 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-b00e0649-4d3b-41ed-94a6-744f38888dfb tempest-ProjectReaderTests-1679623781 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86512) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:38:25 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-b00e0649-4d3b-41ed-94a6-744f38888dfb tempest-ProjectReaderTests-1679623781 None] Flow 'volume_create_manager' (62a9bcc0-c387-4a9c-992c-9a6452f6cad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:38:25 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-b00e0649-4d3b-41ed-94a6-744f38888dfb tempest-ProjectReaderTests-1679623781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb5961b8-b703-41ed-9b1e-2d1722177b06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:38:25 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-b00e0649-4d3b-41ed-94a6-744f38888dfb tempest-ProjectReaderTests-1679623781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb5961b8-b703-41ed-9b1e-2d1722177b06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:38:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1082574432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97bf4d09-5b6e-46e8-8bc0-812357513a56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f41aed7ee5b34e4bbad59bc32c08b236',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:38:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:38:26Z,use_quota=True,user_id='3baa3f73c40542b9b511c21345fa9a4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:38:25 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-b00e0649-4d3b-41ed-94a6-744f38888dfb tempest-ProjectReaderTests-1679623781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06adb967-9448-431e-8a71-40ff078ed6cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:38:25 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-b00e0649-4d3b-41ed-94a6-744f38888dfb tempest-ProjectReaderTests-1679623781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06adb967-9448-431e-8a71-40ff078ed6cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:38:25 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-b00e0649-4d3b-41ed-94a6-744f38888dfb tempest-ProjectReaderTests-1679623781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6843fc7-fdc2-4c69-92db-d314e29ccb9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:38:25 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-b00e0649-4d3b-41ed-94a6-744f38888dfb tempest-ProjectReaderTests-1679623781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6843fc7-fdc2-4c69-92db-d314e29ccb9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97bf4d09-5b6e-46e8-8bc0-812357513a56', 'volume_name': 'volume-97bf4d09-5b6e-46e8-8bc0-812357513a56', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:38:25 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-b00e0649-4d3b-41ed-94a6-744f38888dfb tempest-ProjectReaderTests-1679623781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b238490-9385-421b-92c3-85dbc0eeeae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:38:25 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-b00e0649-4d3b-41ed-94a6-744f38888dfb tempest-ProjectReaderTests-1679623781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b238490-9385-421b-92c3-85dbc0eeeae6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:38:25 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-b00e0649-4d3b-41ed-94a6-744f38888dfb tempest-ProjectReaderTests-1679623781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12eba3dc-8d4b-4182-a417-b89cb29061eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:38:25 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-b00e0649-4d3b-41ed-94a6-744f38888dfb tempest-ProjectReaderTests-1679623781 None] Volume 97bf4d09-5b6e-46e8-8bc0-812357513a56: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97bf4d09-5b6e-46e8-8bc0-812357513a56', 'volume_size': 1} Sep 29 18:38:25 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-b00e0649-4d3b-41ed-94a6-744f38888dfb tempest-ProjectReaderTests-1679623781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:38:25 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-b00e0649-4d3b-41ed-94a6-744f38888dfb tempest-ProjectReaderTests-1679623781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:38:25 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-b00e0649-4d3b-41ed-94a6-744f38888dfb tempest-ProjectReaderTests-1679623781 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:38:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1082574432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97bf4d09-5b6e-46e8-8bc0-812357513a56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f41aed7ee5b34e4bbad59bc32c08b236',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:38:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:38:26Z,use_quota=True,user_id='3baa3f73c40542b9b511c21345fa9a4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)}" {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:38:25 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-b00e0649-4d3b-41ed-94a6-744f38888dfb tempest-ProjectReaderTests-1679623781 None] Creating volume 97bf4d09-5b6e-46e8-8bc0-812357513a56 {{(pid=86512) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:38:25 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-b00e0649-4d3b-41ed-94a6-744f38888dfb tempest-ProjectReaderTests-1679623781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:38:25 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-b00e0649-4d3b-41ed-94a6-744f38888dfb tempest-ProjectReaderTests-1679623781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:38:25 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-b00e0649-4d3b-41ed-94a6-744f38888dfb tempest-ProjectReaderTests-1679623781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:38:25 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-b00e0649-4d3b-41ed-94a6-744f38888dfb tempest-ProjectReaderTests-1679623781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:38:25 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-b00e0649-4d3b-41ed-94a6-744f38888dfb tempest-ProjectReaderTests-1679623781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:38:25 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-b00e0649-4d3b-41ed-94a6-744f38888dfb tempest-ProjectReaderTests-1679623781 None] Selected osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 as target Quobyte volume. {{(pid=86512) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:38:25 devstack cinder-volume[86512]: INFO cinder.volume.drivers.remotefs [None req-b00e0649-4d3b-41ed-94a6-744f38888dfb tempest-ProjectReaderTests-1679623781 None] casted to osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 Sep 29 18:38:25 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-b00e0649-4d3b-41ed-94a6-744f38888dfb tempest-ProjectReaderTests-1679623781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-97bf4d09-5b6e-46e8-8bc0-812357513a56 1073741824 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:25 devstack sudo[107604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-97bf4d09-5b6e-46e8-8bc0-812357513a56 1073741824 Sep 29 18:38:25 devstack sudo[107604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:26 devstack sudo[107604]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:26 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-b00e0649-4d3b-41ed-94a6-744f38888dfb tempest-ProjectReaderTests-1679623781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-97bf4d09-5b6e-46e8-8bc0-812357513a56 1073741824" returned: 0 in 0.494s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:26 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-b00e0649-4d3b-41ed-94a6-744f38888dfb tempest-ProjectReaderTests-1679623781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-97bf4d09-5b6e-46e8-8bc0-812357513a56 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:26 devstack sudo[107610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-97bf4d09-5b6e-46e8-8bc0-812357513a56 Sep 29 18:38:26 devstack sudo[107610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:26 devstack sudo[107610]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:26 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-b00e0649-4d3b-41ed-94a6-744f38888dfb tempest-ProjectReaderTests-1679623781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-97bf4d09-5b6e-46e8-8bc0-812357513a56" returned: 0 in 0.261s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:26 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-b00e0649-4d3b-41ed-94a6-744f38888dfb tempest-ProjectReaderTests-1679623781 None] <== create_volume: return (810ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'} {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:38:26 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-b00e0649-4d3b-41ed-94a6-744f38888dfb tempest-ProjectReaderTests-1679623781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.813s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:38:26 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-b00e0649-4d3b-41ed-94a6-744f38888dfb tempest-ProjectReaderTests-1679623781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12eba3dc-8d4b-4182-a417-b89cb29061eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97bf4d09-5b6e-46e8-8bc0-812357513a56', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:38:26 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-b00e0649-4d3b-41ed-94a6-744f38888dfb tempest-ProjectReaderTests-1679623781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25428004-1739-485d-b71b-1b4770e428b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:38:26 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-b00e0649-4d3b-41ed-94a6-744f38888dfb tempest-ProjectReaderTests-1679623781 None] Volume volume-97bf4d09-5b6e-46e8-8bc0-812357513a56 (97bf4d09-5b6e-46e8-8bc0-812357513a56): created successfully Sep 29 18:38:26 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-b00e0649-4d3b-41ed-94a6-744f38888dfb tempest-ProjectReaderTests-1679623781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25428004-1739-485d-b71b-1b4770e428b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:38:26 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-b00e0649-4d3b-41ed-94a6-744f38888dfb tempest-ProjectReaderTests-1679623781 None] Flow 'volume_create_manager' (62a9bcc0-c387-4a9c-992c-9a6452f6cad8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:38:26 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-b00e0649-4d3b-41ed-94a6-744f38888dfb tempest-ProjectReaderTests-1679623781 None] Created volume successfully. Sep 29 18:38:26 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff8e4114-0e9a-4b38-96a2-b3ad9be5e82b tempest-VolumeImageDependencyTests-438500041 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86512) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:38:26 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-ff8e4114-0e9a-4b38-96a2-b3ad9be5e82b tempest-VolumeImageDependencyTests-438500041 None] Flow 'volume_create_manager' (62614ccc-d920-4345-b61c-231c000958d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:38:26 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-ff8e4114-0e9a-4b38-96a2-b3ad9be5e82b tempest-VolumeImageDependencyTests-438500041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6f9b6a5-fdd1-4610-9864-bd5515e2ff48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:38:26 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-ff8e4114-0e9a-4b38-96a2-b3ad9be5e82b tempest-VolumeImageDependencyTests-438500041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6f9b6a5-fdd1-4610-9864-bd5515e2ff48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:38:27Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=994594b8-322a-405f-a724-77a011abb8aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='024760734b034b738333c598dd899ead',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:38:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:38:27Z,use_quota=True,user_id='2ebe3f6f68374745809ae11fad6bf939',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:38:26 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-ff8e4114-0e9a-4b38-96a2-b3ad9be5e82b tempest-VolumeImageDependencyTests-438500041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96a6979b-c46e-4dc1-80c1-9fbf520928f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:38:26 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-ff8e4114-0e9a-4b38-96a2-b3ad9be5e82b tempest-VolumeImageDependencyTests-438500041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96a6979b-c46e-4dc1-80c1-9fbf520928f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:38:26 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-ff8e4114-0e9a-4b38-96a2-b3ad9be5e82b tempest-VolumeImageDependencyTests-438500041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dae7208f-04df-400a-956e-5688c7763d1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:38:26 devstack cinder-volume[86512]: DEBUG cinder.image.glance [None req-ff8e4114-0e9a-4b38-96a2-b3ad9be5e82b tempest-VolumeImageDependencyTests-438500041 None] Creating Keystone auth plugin from conf {{(pid=86512) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 29 18:38:27 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-ff8e4114-0e9a-4b38-96a2-b3ad9be5e82b tempest-VolumeImageDependencyTests-438500041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dae7208f-04df-400a-956e-5688c7763d1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '994594b8-322a-405f-a724-77a011abb8aa', 'volume_name': 'volume-994594b8-322a-405f-a724-77a011abb8aa', 'volume_size': 1, 'image_id': 'faa11088-ce91-4514-9ca3-98be373aa114', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/faa11088-ce91-4514-9ca3-98be373aa114', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8053ee4fae6f40e883bc09ef5a0930a8', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '024760734b034b738333c598dd899ead', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '98df1c74b79abf71356157192d723103422c89735823538034a22076d4e4b0515b0c413298bd976ebb69cbcdacae7e62b55ac5dd442ab01e199e01d0aa3c849c', 'id': 'faa11088-ce91-4514-9ca3-98be373aa114', 'created_at': datetime.datetime(2026, 9, 29, 16, 38, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 16, 38, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/faa11088-ce91-4514-9ca3-98be373aa114/file', 'properties': {}}, 'image_service': }' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:38:27 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-ff8e4114-0e9a-4b38-96a2-b3ad9be5e82b tempest-VolumeImageDependencyTests-438500041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (668a015b-26e7-4ea8-b928-68dad26f99b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:38:27 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-ff8e4114-0e9a-4b38-96a2-b3ad9be5e82b tempest-VolumeImageDependencyTests-438500041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (668a015b-26e7-4ea8-b928-68dad26f99b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:38:27 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-ff8e4114-0e9a-4b38-96a2-b3ad9be5e82b tempest-VolumeImageDependencyTests-438500041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc531203-f476-4725-a834-9b97b672c91c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:38:27 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-ff8e4114-0e9a-4b38-96a2-b3ad9be5e82b tempest-VolumeImageDependencyTests-438500041 None] Volume 994594b8-322a-405f-a724-77a011abb8aa: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-994594b8-322a-405f-a724-77a011abb8aa', 'volume_size': 1, 'image_id': 'faa11088-ce91-4514-9ca3-98be373aa114', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/faa11088-ce91-4514-9ca3-98be373aa114', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8053ee4fae6f40e883bc09ef5a0930a8', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '024760734b034b738333c598dd899ead', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '98df1c74b79abf71356157192d723103422c89735823538034a22076d4e4b0515b0c413298bd976ebb69cbcdacae7e62b55ac5dd442ab01e199e01d0aa3c849c', 'id': 'faa11088-ce91-4514-9ca3-98be373aa114', 'created_at': datetime.datetime(2026, 9, 29, 16, 38, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 16, 38, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/faa11088-ce91-4514-9ca3-98be373aa114/file', 'properties': {}}, 'image_service': } Sep 29 18:38:27 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff8e4114-0e9a-4b38-96a2-b3ad9be5e82b tempest-VolumeImageDependencyTests-438500041 None] Trying to clone 994594b8-322a-405f-a724-77a011abb8aa from image faa11088-ce91-4514-9ca3-98be373aa114 at location (None, [{'url': 'file:///opt/stack/data/glance/images/faa11088-ce91-4514-9ca3-98be373aa114', 'metadata': {}}]). {{(pid=86512) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 29 18:38:27 devstack cinder-volume[86512]: DEBUG cinder.image.image_utils [None req-ff8e4114-0e9a-4b38-96a2-b3ad9be5e82b tempest-VolumeImageDependencyTests-438500041 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_faa11088-ce91-4514-9ca3-98be373aa114_y50d9sp0devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86512) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 29 18:38:27 devstack cinder-volume[86512]: INFO cinder.image.image_utils [None req-ff8e4114-0e9a-4b38-96a2-b3ad9be5e82b tempest-VolumeImageDependencyTests-438500041 None] Image download 0.00 MB at 0.00 MB/s Sep 29 18:38:27 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c626475-480d-4cdd-ba2b-7156a5437e0e]: (4, 'raw') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:38:27 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-ff8e4114-0e9a-4b38-96a2-b3ad9be5e82b tempest-VolumeImageDependencyTests-438500041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_faa11088-ce91-4514-9ca3-98be373aa114_y50d9sp0devstack@QuobyteHD {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:27 devstack sudo[107613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_faa11088-ce91-4514-9ca3-98be373aa114_y50d9sp0devstack@QuobyteHD Sep 29 18:38:27 devstack sudo[107613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:27 devstack sudo[107613]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:27 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-ff8e4114-0e9a-4b38-96a2-b3ad9be5e82b tempest-VolumeImageDependencyTests-438500041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_faa11088-ce91-4514-9ca3-98be373aa114_y50d9sp0devstack@QuobyteHD" returned: 0 in 0.321s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:27 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-ff8e4114-0e9a-4b38-96a2-b3ad9be5e82b tempest-VolumeImageDependencyTests-438500041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_faa11088-ce91-4514-9ca3-98be373aa114_y50d9sp0devstack@QuobyteHD {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:27 devstack sudo[107617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_faa11088-ce91-4514-9ca3-98be373aa114_y50d9sp0devstack@QuobyteHD Sep 29 18:38:27 devstack sudo[107617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:27 devstack sudo[107617]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:27 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-d7a3cd0a-dc5f-4e34-9c3e-61c3ccc6e0c4 tempest-ProjectReaderTests-1679623781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:38:27 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-d7a3cd0a-dc5f-4e34-9c3e-61c3ccc6e0c4 tempest-ProjectReaderTests-1679623781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:38:27 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-ff8e4114-0e9a-4b38-96a2-b3ad9be5e82b tempest-VolumeImageDependencyTests-438500041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_faa11088-ce91-4514-9ca3-98be373aa114_y50d9sp0devstack@QuobyteHD" returned: 1 in 0.350s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:27 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-ff8e4114-0e9a-4b38-96a2-b3ad9be5e82b tempest-VolumeImageDependencyTests-438500041 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_faa11088-ce91-4514-9ca3-98be373aa114_y50d9sp0devstack@QuobyteHD' failed. Not Retrying. {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 29 18:38:27 devstack cinder-volume[86512]: DEBUG cinder.image.image_utils [None req-ff8e4114-0e9a-4b38-96a2-b3ad9be5e82b tempest-VolumeImageDependencyTests-438500041 None] Temporary image faa11088-ce91-4514-9ca3-98be373aa114 is fetched for user 2ebe3f6f68374745809ae11fad6bf939. {{(pid=86512) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 29 18:38:27 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-d7a3cd0a-dc5f-4e34-9c3e-61c3ccc6e0c4 tempest-ProjectReaderTests-1679623781 None] Creating offline snapshot 60e8b288-a623-462a-9cae-3ff73a53cd70 of volume 97bf4d09-5b6e-46e8-8bc0-812357513a56 {{(pid=86512) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 18:38:27 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[da28e4f9-3af8-4b88-b317-cce798b41fdf]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:38:27 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-d7a3cd0a-dc5f-4e34-9c3e-61c3ccc6e0c4 tempest-ProjectReaderTests-1679623781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-97bf4d09-5b6e-46e8-8bc0-812357513a56 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:28 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[d90459c4-954b-444a-8383-ba38776c1ca8]: (4, 'raw') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:38:28 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-ff8e4114-0e9a-4b38-96a2-b3ad9be5e82b tempest-VolumeImageDependencyTests-438500041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_faa11088-ce91-4514-9ca3-98be373aa114_y50d9sp0devstack@QuobyteHD {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:28 devstack sudo[107622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-97bf4d09-5b6e-46e8-8bc0-812357513a56 Sep 29 18:38:28 devstack sudo[107622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:28 devstack sudo[107623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_faa11088-ce91-4514-9ca3-98be373aa114_y50d9sp0devstack@QuobyteHD Sep 29 18:38:28 devstack sudo[107623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:28 devstack sudo[107622]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:28 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-d7a3cd0a-dc5f-4e34-9c3e-61c3ccc6e0c4 tempest-ProjectReaderTests-1679623781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-97bf4d09-5b6e-46e8-8bc0-812357513a56" returned: 0 in 0.364s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:28 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-d7a3cd0a-dc5f-4e34-9c3e-61c3ccc6e0c4 tempest-ProjectReaderTests-1679623781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-97bf4d09-5b6e-46e8-8bc0-812357513a56,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-97bf4d09-5b6e-46e8-8bc0-812357513a56.60e8b288-a623-462a-9cae-3ff73a53cd70 1G {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:28 devstack sudo[107623]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:28 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-ff8e4114-0e9a-4b38-96a2-b3ad9be5e82b tempest-VolumeImageDependencyTests-438500041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_faa11088-ce91-4514-9ca3-98be373aa114_y50d9sp0devstack@QuobyteHD" returned: 0 in 0.347s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:28 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-ff8e4114-0e9a-4b38-96a2-b3ad9be5e82b tempest-VolumeImageDependencyTests-438500041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_faa11088-ce91-4514-9ca3-98be373aa114_y50d9sp0devstack@QuobyteHD {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:28 devstack sudo[107631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-97bf4d09-5b6e-46e8-8bc0-812357513a56,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-97bf4d09-5b6e-46e8-8bc0-812357513a56.60e8b288-a623-462a-9cae-3ff73a53cd70 1G Sep 29 18:38:28 devstack sudo[107631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:28 devstack sudo[107632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_faa11088-ce91-4514-9ca3-98be373aa114_y50d9sp0devstack@QuobyteHD Sep 29 18:38:28 devstack sudo[107632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:28 devstack sudo[107632]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:28 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-ff8e4114-0e9a-4b38-96a2-b3ad9be5e82b tempest-VolumeImageDependencyTests-438500041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_faa11088-ce91-4514-9ca3-98be373aa114_y50d9sp0devstack@QuobyteHD" returned: 1 in 0.336s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:28 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-ff8e4114-0e9a-4b38-96a2-b3ad9be5e82b tempest-VolumeImageDependencyTests-438500041 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_faa11088-ce91-4514-9ca3-98be373aa114_y50d9sp0devstack@QuobyteHD' failed. Not Retrying. {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 29 18:38:28 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-ff8e4114-0e9a-4b38-96a2-b3ad9be5e82b tempest-VolumeImageDependencyTests-438500041 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:38:28 devstack sudo[107631]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:28 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-d7a3cd0a-dc5f-4e34-9c3e-61c3ccc6e0c4 tempest-ProjectReaderTests-1679623781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-97bf4d09-5b6e-46e8-8bc0-812357513a56,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-97bf4d09-5b6e-46e8-8bc0-812357513a56.60e8b288-a623-462a-9cae-3ff73a53cd70 1G" returned: 0 in 0.403s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:28 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-d7a3cd0a-dc5f-4e34-9c3e-61c3ccc6e0c4 tempest-ProjectReaderTests-1679623781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97bf4d09-5b6e-46e8-8bc0-812357513a56 -F qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-97bf4d09-5b6e-46e8-8bc0-812357513a56.60e8b288-a623-462a-9cae-3ff73a53cd70 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:28 devstack sudo[107642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97bf4d09-5b6e-46e8-8bc0-812357513a56 -F qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-97bf4d09-5b6e-46e8-8bc0-812357513a56.60e8b288-a623-462a-9cae-3ff73a53cd70 Sep 29 18:38:28 devstack sudo[107642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:29 devstack sudo[107642]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:29 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-d7a3cd0a-dc5f-4e34-9c3e-61c3ccc6e0c4 tempest-ProjectReaderTests-1679623781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-97bf4d09-5b6e-46e8-8bc0-812357513a56 -F qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-97bf4d09-5b6e-46e8-8bc0-812357513a56.60e8b288-a623-462a-9cae-3ff73a53cd70" returned: 0 in 0.296s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:29 devstack cinder-volume[86512]: WARNING cinder.volume.drivers.remotefs [None req-d7a3cd0a-dc5f-4e34-9c3e-61c3ccc6e0c4 tempest-ProjectReaderTests-1679623781 None] /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-97bf4d09-5b6e-46e8-8bc0-812357513a56.60e8b288-a623-462a-9cae-3ff73a53cd70 is being set with open permissions: ugo+rw Sep 29 18:38:29 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-d7a3cd0a-dc5f-4e34-9c3e-61c3ccc6e0c4 tempest-ProjectReaderTests-1679623781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-97bf4d09-5b6e-46e8-8bc0-812357513a56.60e8b288-a623-462a-9cae-3ff73a53cd70 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:29 devstack sudo[107647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-97bf4d09-5b6e-46e8-8bc0-812357513a56.60e8b288-a623-462a-9cae-3ff73a53cd70 Sep 29 18:38:29 devstack sudo[107647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:29 devstack sudo[107647]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:29 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-d7a3cd0a-dc5f-4e34-9c3e-61c3ccc6e0c4 tempest-ProjectReaderTests-1679623781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-97bf4d09-5b6e-46e8-8bc0-812357513a56.60e8b288-a623-462a-9cae-3ff73a53cd70" returned: 0 in 0.236s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:29 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-d7a3cd0a-dc5f-4e34-9c3e-61c3ccc6e0c4 tempest-ProjectReaderTests-1679623781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-97bf4d09-5b6e-46e8-8bc0-812357513a56.info {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:29 devstack sudo[107650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-97bf4d09-5b6e-46e8-8bc0-812357513a56.info Sep 29 18:38:29 devstack sudo[107650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:29 devstack sudo[107650]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:29 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-d7a3cd0a-dc5f-4e34-9c3e-61c3ccc6e0c4 tempest-ProjectReaderTests-1679623781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-97bf4d09-5b6e-46e8-8bc0-812357513a56.info" returned: 0 in 0.259s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:29 devstack cinder-volume[86512]: WARNING cinder.volume.drivers.remotefs [None req-d7a3cd0a-dc5f-4e34-9c3e-61c3ccc6e0c4 tempest-ProjectReaderTests-1679623781 None] /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-97bf4d09-5b6e-46e8-8bc0-812357513a56.info is being set with open permissions: ugo+rw Sep 29 18:38:29 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-d7a3cd0a-dc5f-4e34-9c3e-61c3ccc6e0c4 tempest-ProjectReaderTests-1679623781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-97bf4d09-5b6e-46e8-8bc0-812357513a56.info {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:29 devstack sudo[107653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-97bf4d09-5b6e-46e8-8bc0-812357513a56.info Sep 29 18:38:29 devstack sudo[107653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:29 devstack sudo[107653]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:29 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-d7a3cd0a-dc5f-4e34-9c3e-61c3ccc6e0c4 tempest-ProjectReaderTests-1679623781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-97bf4d09-5b6e-46e8-8bc0-812357513a56.info" returned: 0 in 0.239s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:29 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-d7a3cd0a-dc5f-4e34-9c3e-61c3ccc6e0c4 tempest-ProjectReaderTests-1679623781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.894s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:38:29 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-ff8e4114-0e9a-4b38-96a2-b3ad9be5e82b tempest-VolumeImageDependencyTests-438500041 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.128s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:38:29 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-ff8e4114-0e9a-4b38-96a2-b3ad9be5e82b tempest-VolumeImageDependencyTests-438500041 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:38:27Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=994594b8-322a-405f-a724-77a011abb8aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='024760734b034b738333c598dd899ead',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:38:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:38:27Z,use_quota=True,user_id='2ebe3f6f68374745809ae11fad6bf939',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)}" {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:38:29 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-ff8e4114-0e9a-4b38-96a2-b3ad9be5e82b tempest-VolumeImageDependencyTests-438500041 None] Creating volume 994594b8-322a-405f-a724-77a011abb8aa {{(pid=86512) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:38:29 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-ff8e4114-0e9a-4b38-96a2-b3ad9be5e82b tempest-VolumeImageDependencyTests-438500041 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:38:29 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-ff8e4114-0e9a-4b38-96a2-b3ad9be5e82b tempest-VolumeImageDependencyTests-438500041 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:38:29 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-ff8e4114-0e9a-4b38-96a2-b3ad9be5e82b tempest-VolumeImageDependencyTests-438500041 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:38:29 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-ff8e4114-0e9a-4b38-96a2-b3ad9be5e82b tempest-VolumeImageDependencyTests-438500041 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:38:29 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-ff8e4114-0e9a-4b38-96a2-b3ad9be5e82b tempest-VolumeImageDependencyTests-438500041 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:38:29 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-ff8e4114-0e9a-4b38-96a2-b3ad9be5e82b tempest-VolumeImageDependencyTests-438500041 None] Selected osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 as target Quobyte volume. {{(pid=86512) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:38:29 devstack cinder-volume[86512]: INFO cinder.volume.drivers.remotefs [None req-ff8e4114-0e9a-4b38-96a2-b3ad9be5e82b tempest-VolumeImageDependencyTests-438500041 None] casted to osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 Sep 29 18:38:29 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-ff8e4114-0e9a-4b38-96a2-b3ad9be5e82b tempest-VolumeImageDependencyTests-438500041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-994594b8-322a-405f-a724-77a011abb8aa 1073741824 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:29 devstack sudo[107656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-994594b8-322a-405f-a724-77a011abb8aa 1073741824 Sep 29 18:38:29 devstack sudo[107656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:29 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-d7a3cd0a-dc5f-4e34-9c3e-61c3ccc6e0c4 tempest-ProjectReaderTests-1679623781 None] Create snapshot completed successfully Sep 29 18:38:30 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-b75d344d-981f-41dc-acfc-0f498c8999f1 tempest-ProjectReaderTests-1679623781 None] Acquiring lock "cinder-60e8b288-a623-462a-9cae-3ff73a53cd70-delete_snapshot" by "delete_snapshot" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:38:30 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-b75d344d-981f-41dc-acfc-0f498c8999f1 tempest-ProjectReaderTests-1679623781 None] Lock "cinder-60e8b288-a623-462a-9cae-3ff73a53cd70-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:38:30 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-b75d344d-981f-41dc-acfc-0f498c8999f1 tempest-ProjectReaderTests-1679623781 None] Acquiring lock "cinder-quobyte-97bf4d09-5b6e-46e8-8bc0-812357513a56" by "delete_snapshot" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:38:30 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-b75d344d-981f-41dc-acfc-0f498c8999f1 tempest-ProjectReaderTests-1679623781 None] Lock "cinder-quobyte-97bf4d09-5b6e-46e8-8bc0-812357513a56" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:38:30 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-b75d344d-981f-41dc-acfc-0f498c8999f1 tempest-ProjectReaderTests-1679623781 None] Acquiring lock "cinder-quobyte-60e8b288-a623-462a-9cae-3ff73a53cd70" by "_delete_snapshot" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:38:30 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-b75d344d-981f-41dc-acfc-0f498c8999f1 tempest-ProjectReaderTests-1679623781 None] Lock "cinder-quobyte-60e8b288-a623-462a-9cae-3ff73a53cd70" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:38:30 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-b75d344d-981f-41dc-acfc-0f498c8999f1 tempest-ProjectReaderTests-1679623781 None] Deleting offline snapshot 60e8b288-a623-462a-9cae-3ff73a53cd70 of volume 97bf4d09-5b6e-46e8-8bc0-812357513a56 {{(pid=86512) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 18:38:30 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-b75d344d-981f-41dc-acfc-0f498c8999f1 tempest-ProjectReaderTests-1679623781 None] snapshot_file for this snap is: volume-97bf4d09-5b6e-46e8-8bc0-812357513a56.60e8b288-a623-462a-9cae-3ff73a53cd70 {{(pid=86512) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 18:38:30 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc63526b-5616-4228-89de-d7daad96069d]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:38:30 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-b75d344d-981f-41dc-acfc-0f498c8999f1 tempest-ProjectReaderTests-1679623781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-97bf4d09-5b6e-46e8-8bc0-812357513a56.60e8b288-a623-462a-9cae-3ff73a53cd70 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:30 devstack sudo[107661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-97bf4d09-5b6e-46e8-8bc0-812357513a56.60e8b288-a623-462a-9cae-3ff73a53cd70 Sep 29 18:38:30 devstack sudo[107661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:30 devstack sudo[107656]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:30 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-ff8e4114-0e9a-4b38-96a2-b3ad9be5e82b tempest-VolumeImageDependencyTests-438500041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-994594b8-322a-405f-a724-77a011abb8aa 1073741824" returned: 0 in 0.486s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:30 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-ff8e4114-0e9a-4b38-96a2-b3ad9be5e82b tempest-VolumeImageDependencyTests-438500041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-994594b8-322a-405f-a724-77a011abb8aa {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:30 devstack sudo[107663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-994594b8-322a-405f-a724-77a011abb8aa Sep 29 18:38:30 devstack sudo[107663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:30 devstack sudo[107661]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:30 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-b75d344d-981f-41dc-acfc-0f498c8999f1 tempest-ProjectReaderTests-1679623781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-97bf4d09-5b6e-46e8-8bc0-812357513a56.60e8b288-a623-462a-9cae-3ff73a53cd70" returned: 0 in 0.392s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:30 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-b75d344d-981f-41dc-acfc-0f498c8999f1 tempest-ProjectReaderTests-1679623781 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-97bf4d09-5b6e-46e8-8bc0-812357513a56(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86512) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 18:38:30 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[7884167e-a10c-4263-8e66-1d0cb29a8014]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:38:30 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-b75d344d-981f-41dc-acfc-0f498c8999f1 tempest-ProjectReaderTests-1679623781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-97bf4d09-5b6e-46e8-8bc0-812357513a56 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:30 devstack sudo[107663]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:30 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-ff8e4114-0e9a-4b38-96a2-b3ad9be5e82b tempest-VolumeImageDependencyTests-438500041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-994594b8-322a-405f-a724-77a011abb8aa" returned: 0 in 0.261s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:30 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-ff8e4114-0e9a-4b38-96a2-b3ad9be5e82b tempest-VolumeImageDependencyTests-438500041 None] <== create_volume: return (790ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'} {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:38:30 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-ff8e4114-0e9a-4b38-96a2-b3ad9be5e82b tempest-VolumeImageDependencyTests-438500041 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.792s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:38:30 devstack cinder-volume[86512]: DEBUG cinder.volume.volume_utils [None req-ff8e4114-0e9a-4b38-96a2-b3ad9be5e82b tempest-VolumeImageDependencyTests-438500041 None] Attempting download of faa11088-ce91-4514-9ca3-98be373aa114 ((None, [{'url': 'file:///opt/stack/data/glance/images/faa11088-ce91-4514-9ca3-98be373aa114', 'metadata': {}}])) to volume 994594b8-322a-405f-a724-77a011abb8aa. {{(pid=86512) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 29 18:38:30 devstack sudo[107669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-97bf4d09-5b6e-46e8-8bc0-812357513a56 Sep 29 18:38:30 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[579a25f1-8cbc-4494-83e8-2d1bf9d08173]: (4, 'raw') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:38:30 devstack sudo[107669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:30 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-ff8e4114-0e9a-4b38-96a2-b3ad9be5e82b tempest-VolumeImageDependencyTests-438500041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_faa11088-ce91-4514-9ca3-98be373aa114_aevmpdui {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:30 devstack sudo[107671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_faa11088-ce91-4514-9ca3-98be373aa114_aevmpdui Sep 29 18:38:30 devstack sudo[107671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:30 devstack sudo[107669]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:30 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-b75d344d-981f-41dc-acfc-0f498c8999f1 tempest-ProjectReaderTests-1679623781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-97bf4d09-5b6e-46e8-8bc0-812357513a56" returned: 0 in 0.387s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:30 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-b75d344d-981f-41dc-acfc-0f498c8999f1 tempest-ProjectReaderTests-1679623781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-97bf4d09-5b6e-46e8-8bc0-812357513a56.60e8b288-a623-462a-9cae-3ff73a53cd70 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:31 devstack sudo[107676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-97bf4d09-5b6e-46e8-8bc0-812357513a56.60e8b288-a623-462a-9cae-3ff73a53cd70 Sep 29 18:38:31 devstack sudo[107676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:31 devstack sudo[107671]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:31 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-ff8e4114-0e9a-4b38-96a2-b3ad9be5e82b tempest-VolumeImageDependencyTests-438500041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_faa11088-ce91-4514-9ca3-98be373aa114_aevmpdui" returned: 0 in 0.328s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:31 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-ff8e4114-0e9a-4b38-96a2-b3ad9be5e82b tempest-VolumeImageDependencyTests-438500041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_faa11088-ce91-4514-9ca3-98be373aa114_aevmpdui {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:31 devstack sudo[107680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_faa11088-ce91-4514-9ca3-98be373aa114_aevmpdui Sep 29 18:38:31 devstack sudo[107680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:31 devstack sudo[107676]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:31 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-b75d344d-981f-41dc-acfc-0f498c8999f1 tempest-ProjectReaderTests-1679623781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-97bf4d09-5b6e-46e8-8bc0-812357513a56.60e8b288-a623-462a-9cae-3ff73a53cd70" returned: 0 in 0.371s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:31 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-b75d344d-981f-41dc-acfc-0f498c8999f1 tempest-ProjectReaderTests-1679623781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-97bf4d09-5b6e-46e8-8bc0-812357513a56.60e8b288-a623-462a-9cae-3ff73a53cd70 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:31 devstack sudo[107680]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:31 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-ff8e4114-0e9a-4b38-96a2-b3ad9be5e82b tempest-VolumeImageDependencyTests-438500041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_faa11088-ce91-4514-9ca3-98be373aa114_aevmpdui" returned: 1 in 0.326s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:31 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-ff8e4114-0e9a-4b38-96a2-b3ad9be5e82b tempest-VolumeImageDependencyTests-438500041 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_faa11088-ce91-4514-9ca3-98be373aa114_aevmpdui' failed. Not Retrying. {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 29 18:38:31 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[1789195c-6b91-40b2-962a-e81d02e9183e]: (4, 'raw') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:38:31 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-ff8e4114-0e9a-4b38-96a2-b3ad9be5e82b tempest-VolumeImageDependencyTests-438500041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_faa11088-ce91-4514-9ca3-98be373aa114_y50d9sp0devstack@QuobyteHD {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:31 devstack sudo[107687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-97bf4d09-5b6e-46e8-8bc0-812357513a56.60e8b288-a623-462a-9cae-3ff73a53cd70 Sep 29 18:38:31 devstack sudo[107687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:31 devstack sudo[107688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_faa11088-ce91-4514-9ca3-98be373aa114_y50d9sp0devstack@QuobyteHD Sep 29 18:38:31 devstack sudo[107688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:31 devstack sudo[107687]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:31 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-b75d344d-981f-41dc-acfc-0f498c8999f1 tempest-ProjectReaderTests-1679623781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-97bf4d09-5b6e-46e8-8bc0-812357513a56.60e8b288-a623-462a-9cae-3ff73a53cd70" returned: 0 in 0.280s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:31 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-b75d344d-981f-41dc-acfc-0f498c8999f1 tempest-ProjectReaderTests-1679623781 None] Lock "cinder-quobyte-60e8b288-a623-462a-9cae-3ff73a53cd70" released by "_delete_snapshot" :: held 1.527s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:38:31 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-b75d344d-981f-41dc-acfc-0f498c8999f1 tempest-ProjectReaderTests-1679623781 None] Lock "cinder-quobyte-97bf4d09-5b6e-46e8-8bc0-812357513a56" released by "delete_snapshot" :: held 1.553s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:38:31 devstack sudo[107688]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:31 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-ff8e4114-0e9a-4b38-96a2-b3ad9be5e82b tempest-VolumeImageDependencyTests-438500041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_faa11088-ce91-4514-9ca3-98be373aa114_y50d9sp0devstack@QuobyteHD" returned: 0 in 0.332s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:31 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-ff8e4114-0e9a-4b38-96a2-b3ad9be5e82b tempest-VolumeImageDependencyTests-438500041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_faa11088-ce91-4514-9ca3-98be373aa114_y50d9sp0devstack@QuobyteHD {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:31 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-b75d344d-981f-41dc-acfc-0f498c8999f1 tempest-ProjectReaderTests-1679623781 None] Created reservations ['ffb8d83a-a7da-4ffb-a2bf-df28e8cae1ba', '47ee339a-9282-4d4c-b245-cc4d4aaf8cd1', 'aa0166bd-1989-4237-935c-f785aadd0895', '80c03b76-dab3-4ef2-993d-78c430fd09cf'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:38:31 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-b75d344d-981f-41dc-acfc-0f498c8999f1 tempest-ProjectReaderTests-1679623781 None] Delete snapshot completed successfully. Sep 29 18:38:31 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-b75d344d-981f-41dc-acfc-0f498c8999f1 tempest-ProjectReaderTests-1679623781 None] Lock "cinder-60e8b288-a623-462a-9cae-3ff73a53cd70-delete_snapshot" released by "delete_snapshot" :: held 1.704s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:38:31 devstack sudo[107694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_faa11088-ce91-4514-9ca3-98be373aa114_y50d9sp0devstack@QuobyteHD Sep 29 18:38:31 devstack sudo[107694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:32 devstack sudo[107694]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:32 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-ff8e4114-0e9a-4b38-96a2-b3ad9be5e82b tempest-VolumeImageDependencyTests-438500041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_faa11088-ce91-4514-9ca3-98be373aa114_y50d9sp0devstack@QuobyteHD" returned: 1 in 0.325s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:32 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-ff8e4114-0e9a-4b38-96a2-b3ad9be5e82b tempest-VolumeImageDependencyTests-438500041 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_faa11088-ce91-4514-9ca3-98be373aa114_y50d9sp0devstack@QuobyteHD' failed. Not Retrying. {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 29 18:38:32 devstack cinder-volume[86512]: DEBUG cinder.image.image_utils [None req-ff8e4114-0e9a-4b38-96a2-b3ad9be5e82b tempest-VolumeImageDependencyTests-438500041 None] faa11088-ce91-4514-9ca3-98be373aa114 was raw, converting to qcow2 {{(pid=86512) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 29 18:38:32 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-ff8e4114-0e9a-4b38-96a2-b3ad9be5e82b tempest-VolumeImageDependencyTests-438500041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_faa11088-ce91-4514-9ca3-98be373aa114_y50d9sp0devstack@QuobyteHD /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-994594b8-322a-405f-a724-77a011abb8aa {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:32 devstack sudo[107699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_faa11088-ce91-4514-9ca3-98be373aa114_y50d9sp0devstack@QuobyteHD /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-994594b8-322a-405f-a724-77a011abb8aa Sep 29 18:38:32 devstack sudo[107699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:32 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-09320184-785e-4f0a-8a36-a7b72bef24c6 tempest-ProjectReaderTests-1679623781 None] Acquiring lock "cinder-97bf4d09-5b6e-46e8-8bc0-812357513a56-delete_volume" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:38:32 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-09320184-785e-4f0a-8a36-a7b72bef24c6 tempest-ProjectReaderTests-1679623781 None] Lock "cinder-97bf4d09-5b6e-46e8-8bc0-812357513a56-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:38:32 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-09320184-785e-4f0a-8a36-a7b72bef24c6 tempest-ProjectReaderTests-1679623781 None] Acquiring lock "cinder-quobyte-97bf4d09-5b6e-46e8-8bc0-812357513a56" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:38:32 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-09320184-785e-4f0a-8a36-a7b72bef24c6 tempest-ProjectReaderTests-1679623781 None] Lock "cinder-quobyte-97bf4d09-5b6e-46e8-8bc0-812357513a56" acquired by "delete_volume" :: waited 0.018s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:38:32 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3d8367c-4425-486e-83f8-851d5b74279f]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:38:32 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-09320184-785e-4f0a-8a36-a7b72bef24c6 tempest-ProjectReaderTests-1679623781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-97bf4d09-5b6e-46e8-8bc0-812357513a56 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:32 devstack sudo[107704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-97bf4d09-5b6e-46e8-8bc0-812357513a56 Sep 29 18:38:32 devstack sudo[107704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:32 devstack sudo[107699]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:32 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-ff8e4114-0e9a-4b38-96a2-b3ad9be5e82b tempest-VolumeImageDependencyTests-438500041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_faa11088-ce91-4514-9ca3-98be373aa114_y50d9sp0devstack@QuobyteHD /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-994594b8-322a-405f-a724-77a011abb8aa" returned: 0 in 0.483s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:32 devstack cinder-volume[86512]: DEBUG cinder.image.image_utils [None req-ff8e4114-0e9a-4b38-96a2-b3ad9be5e82b tempest-VolumeImageDependencyTests-438500041 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_faa11088-ce91-4514-9ca3-98be373aa114_y50d9sp0devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-994594b8-322a-405f-a724-77a011abb8aa {{(pid=86512) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 29 18:38:32 devstack cinder-volume[86512]: INFO cinder.image.image_utils [None req-ff8e4114-0e9a-4b38-96a2-b3ad9be5e82b tempest-VolumeImageDependencyTests-438500041 None] Converted 0.00 MB image at 0.00 MB/s Sep 29 18:38:32 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-ff8e4114-0e9a-4b38-96a2-b3ad9be5e82b tempest-VolumeImageDependencyTests-438500041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-994594b8-322a-405f-a724-77a011abb8aa 1G {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:32 devstack sudo[107708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-994594b8-322a-405f-a724-77a011abb8aa 1G Sep 29 18:38:32 devstack sudo[107708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:32 devstack sudo[107704]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:32 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-09320184-785e-4f0a-8a36-a7b72bef24c6 tempest-ProjectReaderTests-1679623781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-97bf4d09-5b6e-46e8-8bc0-812357513a56" returned: 0 in 0.359s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:32 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-09320184-785e-4f0a-8a36-a7b72bef24c6 tempest-ProjectReaderTests-1679623781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-97bf4d09-5b6e-46e8-8bc0-812357513a56 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:32 devstack sudo[107714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-97bf4d09-5b6e-46e8-8bc0-812357513a56 Sep 29 18:38:32 devstack sudo[107714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:32 devstack sudo[107708]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:32 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-ff8e4114-0e9a-4b38-96a2-b3ad9be5e82b tempest-VolumeImageDependencyTests-438500041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-994594b8-322a-405f-a724-77a011abb8aa 1G" returned: 0 in 0.331s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:32 devstack cinder-volume[86512]: DEBUG cinder.volume.volume_utils [None req-ff8e4114-0e9a-4b38-96a2-b3ad9be5e82b tempest-VolumeImageDependencyTests-438500041 None] Downloaded image faa11088-ce91-4514-9ca3-98be373aa114 ((None, [{'url': 'file:///opt/stack/data/glance/images/faa11088-ce91-4514-9ca3-98be373aa114', 'metadata': {}}])) to volume 994594b8-322a-405f-a724-77a011abb8aa successfully. {{(pid=86512) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 29 18:38:32 devstack cinder-volume[86512]: DEBUG cinder.image.image_utils [None req-ff8e4114-0e9a-4b38-96a2-b3ad9be5e82b tempest-VolumeImageDependencyTests-438500041 None] Temporary image faa11088-ce91-4514-9ca3-98be373aa114 for user 2ebe3f6f68374745809ae11fad6bf939 is deleted. {{(pid=86512) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 29 18:38:32 devstack cinder-volume[86512]: DEBUG cinder.volume.volume_utils [None req-ff8e4114-0e9a-4b38-96a2-b3ad9be5e82b tempest-VolumeImageDependencyTests-438500041 None] Marking volume 994594b8-322a-405f-a724-77a011abb8aa as bootable. {{(pid=86512) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 29 18:38:32 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff8e4114-0e9a-4b38-96a2-b3ad9be5e82b tempest-VolumeImageDependencyTests-438500041 None] Copying metadata from image faa11088-ce91-4514-9ca3-98be373aa114 to 994594b8-322a-405f-a724-77a011abb8aa. {{(pid=86512) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 29 18:38:32 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff8e4114-0e9a-4b38-96a2-b3ad9be5e82b tempest-VolumeImageDependencyTests-438500041 None] Creating volume glance metadata for volume 994594b8-322a-405f-a724-77a011abb8aa backed by image faa11088-ce91-4514-9ca3-98be373aa114 with: {'image_id': 'faa11088-ce91-4514-9ca3-98be373aa114', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '8053ee4fae6f40e883bc09ef5a0930a8', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86512) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 29 18:38:32 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-ff8e4114-0e9a-4b38-96a2-b3ad9be5e82b tempest-VolumeImageDependencyTests-438500041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc531203-f476-4725-a834-9b97b672c91c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-994594b8-322a-405f-a724-77a011abb8aa', 'volume_size': 1, 'image_id': 'faa11088-ce91-4514-9ca3-98be373aa114', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/faa11088-ce91-4514-9ca3-98be373aa114', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8053ee4fae6f40e883bc09ef5a0930a8', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '024760734b034b738333c598dd899ead', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '98df1c74b79abf71356157192d723103422c89735823538034a22076d4e4b0515b0c413298bd976ebb69cbcdacae7e62b55ac5dd442ab01e199e01d0aa3c849c', 'id': 'faa11088-ce91-4514-9ca3-98be373aa114', 'created_at': datetime.datetime(2026, 9, 29, 16, 38, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 16, 38, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/faa11088-ce91-4514-9ca3-98be373aa114/file', 'properties': {}}, 'image_service': }' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:38:32 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-ff8e4114-0e9a-4b38-96a2-b3ad9be5e82b tempest-VolumeImageDependencyTests-438500041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59b767f5-e3d4-46f1-8818-41d9e0538e37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:38:32 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-ff8e4114-0e9a-4b38-96a2-b3ad9be5e82b tempest-VolumeImageDependencyTests-438500041 None] Volume volume-994594b8-322a-405f-a724-77a011abb8aa (994594b8-322a-405f-a724-77a011abb8aa): created successfully Sep 29 18:38:32 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-ff8e4114-0e9a-4b38-96a2-b3ad9be5e82b tempest-VolumeImageDependencyTests-438500041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59b767f5-e3d4-46f1-8818-41d9e0538e37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:38:32 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-ff8e4114-0e9a-4b38-96a2-b3ad9be5e82b tempest-VolumeImageDependencyTests-438500041 None] Flow 'volume_create_manager' (62614ccc-d920-4345-b61c-231c000958d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:38:32 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-ff8e4114-0e9a-4b38-96a2-b3ad9be5e82b tempest-VolumeImageDependencyTests-438500041 None] Created volume successfully. Sep 29 18:38:33 devstack sudo[107714]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:33 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-09320184-785e-4f0a-8a36-a7b72bef24c6 tempest-ProjectReaderTests-1679623781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-97bf4d09-5b6e-46e8-8bc0-812357513a56" returned: 0 in 0.270s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:33 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-09320184-785e-4f0a-8a36-a7b72bef24c6 tempest-ProjectReaderTests-1679623781 None] Lock "cinder-quobyte-97bf4d09-5b6e-46e8-8bc0-812357513a56" released by "delete_volume" :: held 0.697s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:38:33 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-09320184-785e-4f0a-8a36-a7b72bef24c6 tempest-ProjectReaderTests-1679623781 None] Created reservations ['e658738a-a9c9-4b3b-91ca-8da7dafd494f', '8c39be8a-c574-4322-94e4-68ea54896ae1', '548cbe4b-0659-426a-8941-d1bf4ff719b4', 'b7667c6b-d94f-42d0-8531-bf9a9762999b'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:38:33 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-09320184-785e-4f0a-8a36-a7b72bef24c6 tempest-ProjectReaderTests-1679623781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:38:33 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-09320184-785e-4f0a-8a36-a7b72bef24c6 tempest-ProjectReaderTests-1679623781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:38:33 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-09320184-785e-4f0a-8a36-a7b72bef24c6 tempest-ProjectReaderTests-1679623781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:38:33 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-09320184-785e-4f0a-8a36-a7b72bef24c6 tempest-ProjectReaderTests-1679623781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:38:33 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-09320184-785e-4f0a-8a36-a7b72bef24c6 tempest-ProjectReaderTests-1679623781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:38:33 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-09320184-785e-4f0a-8a36-a7b72bef24c6 tempest-ProjectReaderTests-1679623781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:33 devstack sudo[107719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:38:33 devstack sudo[107719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:33 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-3ae55e92-2f3c-46c3-8093-b693cb26100e tempest-VolumeImageDependencyTests-438500041 None] Acquiring lock "cinder-994594b8-322a-405f-a724-77a011abb8aa-delete_volume" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:38:33 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-3ae55e92-2f3c-46c3-8093-b693cb26100e tempest-VolumeImageDependencyTests-438500041 None] Lock "cinder-994594b8-322a-405f-a724-77a011abb8aa-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:38:33 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-3ae55e92-2f3c-46c3-8093-b693cb26100e tempest-VolumeImageDependencyTests-438500041 None] Acquiring lock "cinder-quobyte-994594b8-322a-405f-a724-77a011abb8aa" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:38:33 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-3ae55e92-2f3c-46c3-8093-b693cb26100e tempest-VolumeImageDependencyTests-438500041 None] Lock "cinder-quobyte-994594b8-322a-405f-a724-77a011abb8aa" acquired by "delete_volume" :: waited 0.018s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:38:33 devstack sudo[107719]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:33 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[c060445a-9cb5-4b3c-9346-b87be2245f97]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:38:33 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-3ae55e92-2f3c-46c3-8093-b693cb26100e tempest-VolumeImageDependencyTests-438500041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-994594b8-322a-405f-a724-77a011abb8aa {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:33 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-09320184-785e-4f0a-8a36-a7b72bef24c6 tempest-ProjectReaderTests-1679623781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.285s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:33 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-09320184-785e-4f0a-8a36-a7b72bef24c6 tempest-ProjectReaderTests-1679623781 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:38:33 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-09320184-785e-4f0a-8a36-a7b72bef24c6 tempest-ProjectReaderTests-1679623781 None] Deleted volume successfully. Sep 29 18:38:33 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-09320184-785e-4f0a-8a36-a7b72bef24c6 tempest-ProjectReaderTests-1679623781 None] Lock "cinder-97bf4d09-5b6e-46e8-8bc0-812357513a56-delete_volume" released by "delete_volume" :: held 1.185s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:38:33 devstack sudo[107722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-994594b8-322a-405f-a724-77a011abb8aa Sep 29 18:38:33 devstack sudo[107722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:33 devstack sudo[107722]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:33 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-3ae55e92-2f3c-46c3-8093-b693cb26100e tempest-VolumeImageDependencyTests-438500041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-994594b8-322a-405f-a724-77a011abb8aa" returned: 0 in 0.401s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:33 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-3ae55e92-2f3c-46c3-8093-b693cb26100e tempest-VolumeImageDependencyTests-438500041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-994594b8-322a-405f-a724-77a011abb8aa {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:33 devstack sudo[107727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-994594b8-322a-405f-a724-77a011abb8aa Sep 29 18:38:33 devstack sudo[107727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:33 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-e18799da-735b-43e5-97d1-90c02533d679 tempest-ProjectReaderTests-1679623781 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86512) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:38:33 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-e18799da-735b-43e5-97d1-90c02533d679 tempest-ProjectReaderTests-1679623781 None] Flow 'volume_create_manager' (90e9146a-98f3-4a81-abad-ff773cb83ee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:38:33 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-e18799da-735b-43e5-97d1-90c02533d679 tempest-ProjectReaderTests-1679623781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccd4a293-d1de-44cb-bf20-b860cfe8597c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:38:33 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-e18799da-735b-43e5-97d1-90c02533d679 tempest-ProjectReaderTests-1679623781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccd4a293-d1de-44cb-bf20-b860cfe8597c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:38:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1328835092',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72842cbc-ed0b-4d64-bb71-8ebf76c4ec71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f41aed7ee5b34e4bbad59bc32c08b236',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:38:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:38:34Z,use_quota=True,user_id='3baa3f73c40542b9b511c21345fa9a4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:38:33 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-e18799da-735b-43e5-97d1-90c02533d679 tempest-ProjectReaderTests-1679623781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cbb6240-d921-45c5-abf7-925c63e6f2af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:38:33 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-e18799da-735b-43e5-97d1-90c02533d679 tempest-ProjectReaderTests-1679623781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cbb6240-d921-45c5-abf7-925c63e6f2af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:38:33 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-e18799da-735b-43e5-97d1-90c02533d679 tempest-ProjectReaderTests-1679623781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30e9cd06-1b00-48ed-adcb-56e8fe28b0bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:38:33 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-e18799da-735b-43e5-97d1-90c02533d679 tempest-ProjectReaderTests-1679623781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30e9cd06-1b00-48ed-adcb-56e8fe28b0bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72842cbc-ed0b-4d64-bb71-8ebf76c4ec71', 'volume_name': 'volume-72842cbc-ed0b-4d64-bb71-8ebf76c4ec71', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:38:33 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-e18799da-735b-43e5-97d1-90c02533d679 tempest-ProjectReaderTests-1679623781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09ada327-698c-4272-8aa7-43f4cf180a0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:38:33 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-e18799da-735b-43e5-97d1-90c02533d679 tempest-ProjectReaderTests-1679623781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09ada327-698c-4272-8aa7-43f4cf180a0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:38:33 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-e18799da-735b-43e5-97d1-90c02533d679 tempest-ProjectReaderTests-1679623781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (252c9558-b9cd-4e10-997f-98d43c2f4dc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:38:33 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-e18799da-735b-43e5-97d1-90c02533d679 tempest-ProjectReaderTests-1679623781 None] Volume 72842cbc-ed0b-4d64-bb71-8ebf76c4ec71: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72842cbc-ed0b-4d64-bb71-8ebf76c4ec71', 'volume_size': 1} Sep 29 18:38:33 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-e18799da-735b-43e5-97d1-90c02533d679 tempest-ProjectReaderTests-1679623781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:38:33 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-e18799da-735b-43e5-97d1-90c02533d679 tempest-ProjectReaderTests-1679623781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:38:33 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-e18799da-735b-43e5-97d1-90c02533d679 tempest-ProjectReaderTests-1679623781 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:38:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1328835092',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72842cbc-ed0b-4d64-bb71-8ebf76c4ec71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f41aed7ee5b34e4bbad59bc32c08b236',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:38:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:38:34Z,use_quota=True,user_id='3baa3f73c40542b9b511c21345fa9a4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)}" {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:38:33 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-e18799da-735b-43e5-97d1-90c02533d679 tempest-ProjectReaderTests-1679623781 None] Creating volume 72842cbc-ed0b-4d64-bb71-8ebf76c4ec71 {{(pid=86512) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:38:33 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-e18799da-735b-43e5-97d1-90c02533d679 tempest-ProjectReaderTests-1679623781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:38:33 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-e18799da-735b-43e5-97d1-90c02533d679 tempest-ProjectReaderTests-1679623781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:38:33 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-e18799da-735b-43e5-97d1-90c02533d679 tempest-ProjectReaderTests-1679623781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:38:33 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-e18799da-735b-43e5-97d1-90c02533d679 tempest-ProjectReaderTests-1679623781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:38:33 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-e18799da-735b-43e5-97d1-90c02533d679 tempest-ProjectReaderTests-1679623781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:38:33 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-e18799da-735b-43e5-97d1-90c02533d679 tempest-ProjectReaderTests-1679623781 None] Selected osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 as target Quobyte volume. {{(pid=86512) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:38:33 devstack cinder-volume[86512]: INFO cinder.volume.drivers.remotefs [None req-e18799da-735b-43e5-97d1-90c02533d679 tempest-ProjectReaderTests-1679623781 None] casted to osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 Sep 29 18:38:33 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-e18799da-735b-43e5-97d1-90c02533d679 tempest-ProjectReaderTests-1679623781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-72842cbc-ed0b-4d64-bb71-8ebf76c4ec71 1073741824 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:34 devstack sudo[107729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-72842cbc-ed0b-4d64-bb71-8ebf76c4ec71 1073741824 Sep 29 18:38:34 devstack sudo[107729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:34 devstack sudo[107727]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:34 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-3ae55e92-2f3c-46c3-8093-b693cb26100e tempest-VolumeImageDependencyTests-438500041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-994594b8-322a-405f-a724-77a011abb8aa" returned: 0 in 0.256s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:34 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-3ae55e92-2f3c-46c3-8093-b693cb26100e tempest-VolumeImageDependencyTests-438500041 None] Lock "cinder-quobyte-994594b8-322a-405f-a724-77a011abb8aa" released by "delete_volume" :: held 0.728s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:38:34 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-3ae55e92-2f3c-46c3-8093-b693cb26100e tempest-VolumeImageDependencyTests-438500041 None] Created reservations ['5361438b-4c4b-4a7b-80d1-b0ed85f2c5e7', '8deb41c8-af79-493d-99d0-baa7dc4ac1b0', '91214c1b-2cba-4836-8994-37a65c14d136', '1ee79877-b189-44c3-b872-0d483c7df779'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:38:34 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-3ae55e92-2f3c-46c3-8093-b693cb26100e tempest-VolumeImageDependencyTests-438500041 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:38:34 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-3ae55e92-2f3c-46c3-8093-b693cb26100e tempest-VolumeImageDependencyTests-438500041 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:38:34 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-3ae55e92-2f3c-46c3-8093-b693cb26100e tempest-VolumeImageDependencyTests-438500041 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:38:34 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-3ae55e92-2f3c-46c3-8093-b693cb26100e tempest-VolumeImageDependencyTests-438500041 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:38:34 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-3ae55e92-2f3c-46c3-8093-b693cb26100e tempest-VolumeImageDependencyTests-438500041 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:38:34 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-3ae55e92-2f3c-46c3-8093-b693cb26100e tempest-VolumeImageDependencyTests-438500041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:34 devstack sudo[107735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:38:34 devstack sudo[107735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:34 devstack sudo[107729]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:34 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-e18799da-735b-43e5-97d1-90c02533d679 tempest-ProjectReaderTests-1679623781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-72842cbc-ed0b-4d64-bb71-8ebf76c4ec71 1073741824" returned: 0 in 0.461s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:34 devstack sudo[107735]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:34 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-e18799da-735b-43e5-97d1-90c02533d679 tempest-ProjectReaderTests-1679623781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-72842cbc-ed0b-4d64-bb71-8ebf76c4ec71 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:34 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-3ae55e92-2f3c-46c3-8093-b693cb26100e tempest-VolumeImageDependencyTests-438500041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.290s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:34 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-3ae55e92-2f3c-46c3-8093-b693cb26100e tempest-VolumeImageDependencyTests-438500041 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:38:34 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-3ae55e92-2f3c-46c3-8093-b693cb26100e tempest-VolumeImageDependencyTests-438500041 None] Deleted volume successfully. Sep 29 18:38:34 devstack sudo[107739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-72842cbc-ed0b-4d64-bb71-8ebf76c4ec71 Sep 29 18:38:34 devstack sudo[107739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:34 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-3ae55e92-2f3c-46c3-8093-b693cb26100e tempest-VolumeImageDependencyTests-438500041 None] Lock "cinder-994594b8-322a-405f-a724-77a011abb8aa-delete_volume" released by "delete_volume" :: held 1.231s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:38:34 devstack sudo[107739]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:34 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-e18799da-735b-43e5-97d1-90c02533d679 tempest-ProjectReaderTests-1679623781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-72842cbc-ed0b-4d64-bb71-8ebf76c4ec71" returned: 0 in 0.253s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:34 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-e18799da-735b-43e5-97d1-90c02533d679 tempest-ProjectReaderTests-1679623781 None] <== create_volume: return (765ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'} {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:38:34 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-e18799da-735b-43e5-97d1-90c02533d679 tempest-ProjectReaderTests-1679623781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.766s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:38:34 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-e18799da-735b-43e5-97d1-90c02533d679 tempest-ProjectReaderTests-1679623781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (252c9558-b9cd-4e10-997f-98d43c2f4dc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72842cbc-ed0b-4d64-bb71-8ebf76c4ec71', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:38:34 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-e18799da-735b-43e5-97d1-90c02533d679 tempest-ProjectReaderTests-1679623781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4bd0e6b-bb34-4704-aaf2-57215cfcea99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:38:34 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-e18799da-735b-43e5-97d1-90c02533d679 tempest-ProjectReaderTests-1679623781 None] Volume volume-72842cbc-ed0b-4d64-bb71-8ebf76c4ec71 (72842cbc-ed0b-4d64-bb71-8ebf76c4ec71): created successfully Sep 29 18:38:34 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-e18799da-735b-43e5-97d1-90c02533d679 tempest-ProjectReaderTests-1679623781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4bd0e6b-bb34-4704-aaf2-57215cfcea99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:38:34 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-e18799da-735b-43e5-97d1-90c02533d679 tempest-ProjectReaderTests-1679623781 None] Flow 'volume_create_manager' (90e9146a-98f3-4a81-abad-ff773cb83ee8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:38:34 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-e18799da-735b-43e5-97d1-90c02533d679 tempest-ProjectReaderTests-1679623781 None] Created volume successfully. Sep 29 18:38:36 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-daa747a1-b9ec-4dcc-9f4f-0d04d6f685f8 tempest-ProjectReaderTests-1679623781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:38:36 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-daa747a1-b9ec-4dcc-9f4f-0d04d6f685f8 tempest-ProjectReaderTests-1679623781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:38:36 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-daa747a1-b9ec-4dcc-9f4f-0d04d6f685f8 tempest-ProjectReaderTests-1679623781 None] Creating offline snapshot 83ad5806-4c1b-4225-a4cb-8c31a6f2c614 of volume 72842cbc-ed0b-4d64-bb71-8ebf76c4ec71 {{(pid=86512) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 18:38:36 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cfe651c-18bd-47c2-af55-59f4fb64d013]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:38:36 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-daa747a1-b9ec-4dcc-9f4f-0d04d6f685f8 tempest-ProjectReaderTests-1679623781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-72842cbc-ed0b-4d64-bb71-8ebf76c4ec71 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:36 devstack sudo[107742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-72842cbc-ed0b-4d64-bb71-8ebf76c4ec71 Sep 29 18:38:36 devstack sudo[107742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:36 devstack sudo[107742]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:36 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-daa747a1-b9ec-4dcc-9f4f-0d04d6f685f8 tempest-ProjectReaderTests-1679623781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-72842cbc-ed0b-4d64-bb71-8ebf76c4ec71" returned: 0 in 0.367s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:36 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-daa747a1-b9ec-4dcc-9f4f-0d04d6f685f8 tempest-ProjectReaderTests-1679623781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-72842cbc-ed0b-4d64-bb71-8ebf76c4ec71,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-72842cbc-ed0b-4d64-bb71-8ebf76c4ec71.83ad5806-4c1b-4225-a4cb-8c31a6f2c614 1G {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:36 devstack sudo[107747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-72842cbc-ed0b-4d64-bb71-8ebf76c4ec71,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-72842cbc-ed0b-4d64-bb71-8ebf76c4ec71.83ad5806-4c1b-4225-a4cb-8c31a6f2c614 1G Sep 29 18:38:36 devstack sudo[107747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:36 devstack sudo[107747]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:36 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-daa747a1-b9ec-4dcc-9f4f-0d04d6f685f8 tempest-ProjectReaderTests-1679623781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-72842cbc-ed0b-4d64-bb71-8ebf76c4ec71,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-72842cbc-ed0b-4d64-bb71-8ebf76c4ec71.83ad5806-4c1b-4225-a4cb-8c31a6f2c614 1G" returned: 0 in 0.426s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:36 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-daa747a1-b9ec-4dcc-9f4f-0d04d6f685f8 tempest-ProjectReaderTests-1679623781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72842cbc-ed0b-4d64-bb71-8ebf76c4ec71 -F qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-72842cbc-ed0b-4d64-bb71-8ebf76c4ec71.83ad5806-4c1b-4225-a4cb-8c31a6f2c614 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:36 devstack sudo[107753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72842cbc-ed0b-4d64-bb71-8ebf76c4ec71 -F qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-72842cbc-ed0b-4d64-bb71-8ebf76c4ec71.83ad5806-4c1b-4225-a4cb-8c31a6f2c614 Sep 29 18:38:36 devstack sudo[107753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:37 devstack sudo[107753]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:37 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-daa747a1-b9ec-4dcc-9f4f-0d04d6f685f8 tempest-ProjectReaderTests-1679623781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72842cbc-ed0b-4d64-bb71-8ebf76c4ec71 -F qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-72842cbc-ed0b-4d64-bb71-8ebf76c4ec71.83ad5806-4c1b-4225-a4cb-8c31a6f2c614" returned: 0 in 0.296s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:37 devstack cinder-volume[86512]: WARNING cinder.volume.drivers.remotefs [None req-daa747a1-b9ec-4dcc-9f4f-0d04d6f685f8 tempest-ProjectReaderTests-1679623781 None] /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-72842cbc-ed0b-4d64-bb71-8ebf76c4ec71.83ad5806-4c1b-4225-a4cb-8c31a6f2c614 is being set with open permissions: ugo+rw Sep 29 18:38:37 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-daa747a1-b9ec-4dcc-9f4f-0d04d6f685f8 tempest-ProjectReaderTests-1679623781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-72842cbc-ed0b-4d64-bb71-8ebf76c4ec71.83ad5806-4c1b-4225-a4cb-8c31a6f2c614 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:37 devstack sudo[107758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-72842cbc-ed0b-4d64-bb71-8ebf76c4ec71.83ad5806-4c1b-4225-a4cb-8c31a6f2c614 Sep 29 18:38:37 devstack sudo[107758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:37 devstack sudo[107758]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:37 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-daa747a1-b9ec-4dcc-9f4f-0d04d6f685f8 tempest-ProjectReaderTests-1679623781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-72842cbc-ed0b-4d64-bb71-8ebf76c4ec71.83ad5806-4c1b-4225-a4cb-8c31a6f2c614" returned: 0 in 0.241s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:37 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-daa747a1-b9ec-4dcc-9f4f-0d04d6f685f8 tempest-ProjectReaderTests-1679623781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-72842cbc-ed0b-4d64-bb71-8ebf76c4ec71.info {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:37 devstack sudo[107761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-72842cbc-ed0b-4d64-bb71-8ebf76c4ec71.info Sep 29 18:38:37 devstack sudo[107761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:37 devstack sudo[107761]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:37 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-daa747a1-b9ec-4dcc-9f4f-0d04d6f685f8 tempest-ProjectReaderTests-1679623781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-72842cbc-ed0b-4d64-bb71-8ebf76c4ec71.info" returned: 0 in 0.243s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:37 devstack cinder-volume[86512]: WARNING cinder.volume.drivers.remotefs [None req-daa747a1-b9ec-4dcc-9f4f-0d04d6f685f8 tempest-ProjectReaderTests-1679623781 None] /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-72842cbc-ed0b-4d64-bb71-8ebf76c4ec71.info is being set with open permissions: ugo+rw Sep 29 18:38:37 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-daa747a1-b9ec-4dcc-9f4f-0d04d6f685f8 tempest-ProjectReaderTests-1679623781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-72842cbc-ed0b-4d64-bb71-8ebf76c4ec71.info {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:37 devstack sudo[107764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-72842cbc-ed0b-4d64-bb71-8ebf76c4ec71.info Sep 29 18:38:37 devstack sudo[107764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:38 devstack sudo[107764]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:38 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-daa747a1-b9ec-4dcc-9f4f-0d04d6f685f8 tempest-ProjectReaderTests-1679623781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-72842cbc-ed0b-4d64-bb71-8ebf76c4ec71.info" returned: 0 in 0.263s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:38 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-daa747a1-b9ec-4dcc-9f4f-0d04d6f685f8 tempest-ProjectReaderTests-1679623781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.922s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:38:38 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-daa747a1-b9ec-4dcc-9f4f-0d04d6f685f8 tempest-ProjectReaderTests-1679623781 None] Create snapshot completed successfully Sep 29 18:38:38 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-6b41cc7f-0c18-46c2-9fd0-b81f1d94413b tempest-ProjectReaderTests-1679623781 None] Acquiring lock "cinder-83ad5806-4c1b-4225-a4cb-8c31a6f2c614-delete_snapshot" by "delete_snapshot" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:38:38 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-6b41cc7f-0c18-46c2-9fd0-b81f1d94413b tempest-ProjectReaderTests-1679623781 None] Lock "cinder-83ad5806-4c1b-4225-a4cb-8c31a6f2c614-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:38:38 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-6b41cc7f-0c18-46c2-9fd0-b81f1d94413b tempest-ProjectReaderTests-1679623781 None] Acquiring lock "cinder-quobyte-72842cbc-ed0b-4d64-bb71-8ebf76c4ec71" by "delete_snapshot" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:38:38 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-6b41cc7f-0c18-46c2-9fd0-b81f1d94413b tempest-ProjectReaderTests-1679623781 None] Lock "cinder-quobyte-72842cbc-ed0b-4d64-bb71-8ebf76c4ec71" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:38:38 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-6b41cc7f-0c18-46c2-9fd0-b81f1d94413b tempest-ProjectReaderTests-1679623781 None] Acquiring lock "cinder-quobyte-83ad5806-4c1b-4225-a4cb-8c31a6f2c614" by "_delete_snapshot" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:38:38 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-6b41cc7f-0c18-46c2-9fd0-b81f1d94413b tempest-ProjectReaderTests-1679623781 None] Lock "cinder-quobyte-83ad5806-4c1b-4225-a4cb-8c31a6f2c614" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:38:38 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-6b41cc7f-0c18-46c2-9fd0-b81f1d94413b tempest-ProjectReaderTests-1679623781 None] Deleting offline snapshot 83ad5806-4c1b-4225-a4cb-8c31a6f2c614 of volume 72842cbc-ed0b-4d64-bb71-8ebf76c4ec71 {{(pid=86512) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 18:38:38 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-6b41cc7f-0c18-46c2-9fd0-b81f1d94413b tempest-ProjectReaderTests-1679623781 None] snapshot_file for this snap is: volume-72842cbc-ed0b-4d64-bb71-8ebf76c4ec71.83ad5806-4c1b-4225-a4cb-8c31a6f2c614 {{(pid=86512) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 18:38:38 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[59a5429a-1f6b-4bdd-aae6-bf99baec3167]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:38:38 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-6b41cc7f-0c18-46c2-9fd0-b81f1d94413b tempest-ProjectReaderTests-1679623781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-72842cbc-ed0b-4d64-bb71-8ebf76c4ec71.83ad5806-4c1b-4225-a4cb-8c31a6f2c614 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:38 devstack sudo[107767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-72842cbc-ed0b-4d64-bb71-8ebf76c4ec71.83ad5806-4c1b-4225-a4cb-8c31a6f2c614 Sep 29 18:38:38 devstack sudo[107767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:38 devstack sudo[107767]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:38 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-6b41cc7f-0c18-46c2-9fd0-b81f1d94413b tempest-ProjectReaderTests-1679623781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-72842cbc-ed0b-4d64-bb71-8ebf76c4ec71.83ad5806-4c1b-4225-a4cb-8c31a6f2c614" returned: 0 in 0.361s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:38 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-6b41cc7f-0c18-46c2-9fd0-b81f1d94413b tempest-ProjectReaderTests-1679623781 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-72842cbc-ed0b-4d64-bb71-8ebf76c4ec71(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86512) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 18:38:38 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f76af37-a164-4feb-a055-dc481b902fc8]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:38:38 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-6b41cc7f-0c18-46c2-9fd0-b81f1d94413b tempest-ProjectReaderTests-1679623781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-72842cbc-ed0b-4d64-bb71-8ebf76c4ec71 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:38 devstack sudo[107772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-72842cbc-ed0b-4d64-bb71-8ebf76c4ec71 Sep 29 18:38:38 devstack sudo[107772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:39 devstack sudo[107772]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:39 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-6b41cc7f-0c18-46c2-9fd0-b81f1d94413b tempest-ProjectReaderTests-1679623781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-72842cbc-ed0b-4d64-bb71-8ebf76c4ec71" returned: 0 in 0.387s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:39 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-6b41cc7f-0c18-46c2-9fd0-b81f1d94413b tempest-ProjectReaderTests-1679623781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-72842cbc-ed0b-4d64-bb71-8ebf76c4ec71.83ad5806-4c1b-4225-a4cb-8c31a6f2c614 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:39 devstack sudo[107777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-72842cbc-ed0b-4d64-bb71-8ebf76c4ec71.83ad5806-4c1b-4225-a4cb-8c31a6f2c614 Sep 29 18:38:39 devstack sudo[107777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:39 devstack sudo[107777]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:39 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-6b41cc7f-0c18-46c2-9fd0-b81f1d94413b tempest-ProjectReaderTests-1679623781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-72842cbc-ed0b-4d64-bb71-8ebf76c4ec71.83ad5806-4c1b-4225-a4cb-8c31a6f2c614" returned: 0 in 0.372s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:39 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-6b41cc7f-0c18-46c2-9fd0-b81f1d94413b tempest-ProjectReaderTests-1679623781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-72842cbc-ed0b-4d64-bb71-8ebf76c4ec71.83ad5806-4c1b-4225-a4cb-8c31a6f2c614 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:39 devstack sudo[107782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-72842cbc-ed0b-4d64-bb71-8ebf76c4ec71.83ad5806-4c1b-4225-a4cb-8c31a6f2c614 Sep 29 18:38:39 devstack sudo[107782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:39 devstack sudo[107782]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:39 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-6b41cc7f-0c18-46c2-9fd0-b81f1d94413b tempest-ProjectReaderTests-1679623781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-72842cbc-ed0b-4d64-bb71-8ebf76c4ec71.83ad5806-4c1b-4225-a4cb-8c31a6f2c614" returned: 0 in 0.246s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:39 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-6b41cc7f-0c18-46c2-9fd0-b81f1d94413b tempest-ProjectReaderTests-1679623781 None] Lock "cinder-quobyte-83ad5806-4c1b-4225-a4cb-8c31a6f2c614" released by "_delete_snapshot" :: held 1.484s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:38:39 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-6b41cc7f-0c18-46c2-9fd0-b81f1d94413b tempest-ProjectReaderTests-1679623781 None] Lock "cinder-quobyte-72842cbc-ed0b-4d64-bb71-8ebf76c4ec71" released by "delete_snapshot" :: held 1.509s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:38:39 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-6b41cc7f-0c18-46c2-9fd0-b81f1d94413b tempest-ProjectReaderTests-1679623781 None] Created reservations ['f91ed815-2c64-4f3b-b494-81c2fd338319', 'b2411b79-065d-4b8b-865d-fbf108d6a4a2', '428cb3b0-8f6b-4a56-a191-cd9db09322f5', '72edb8b1-03db-45f2-8ebe-f987eaa294c7'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:38:39 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-6b41cc7f-0c18-46c2-9fd0-b81f1d94413b tempest-ProjectReaderTests-1679623781 None] Delete snapshot completed successfully. Sep 29 18:38:39 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-6b41cc7f-0c18-46c2-9fd0-b81f1d94413b tempest-ProjectReaderTests-1679623781 None] Lock "cinder-83ad5806-4c1b-4225-a4cb-8c31a6f2c614-delete_snapshot" released by "delete_snapshot" :: held 1.671s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:38:40 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-811754d0-673e-460a-8447-007b8a16b65e tempest-ProjectReaderTests-1679623781 None] Acquiring lock "cinder-72842cbc-ed0b-4d64-bb71-8ebf76c4ec71-delete_volume" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:38:40 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-811754d0-673e-460a-8447-007b8a16b65e tempest-ProjectReaderTests-1679623781 None] Lock "cinder-72842cbc-ed0b-4d64-bb71-8ebf76c4ec71-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:38:40 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-811754d0-673e-460a-8447-007b8a16b65e tempest-ProjectReaderTests-1679623781 None] Acquiring lock "cinder-quobyte-72842cbc-ed0b-4d64-bb71-8ebf76c4ec71" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:38:40 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-811754d0-673e-460a-8447-007b8a16b65e tempest-ProjectReaderTests-1679623781 None] Lock "cinder-quobyte-72842cbc-ed0b-4d64-bb71-8ebf76c4ec71" acquired by "delete_volume" :: waited 0.021s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:38:40 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b2869fc-62b2-473c-a627-1842d8f407a7]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:38:40 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-811754d0-673e-460a-8447-007b8a16b65e tempest-ProjectReaderTests-1679623781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-72842cbc-ed0b-4d64-bb71-8ebf76c4ec71 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:40 devstack sudo[107785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-72842cbc-ed0b-4d64-bb71-8ebf76c4ec71 Sep 29 18:38:40 devstack sudo[107785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:40 devstack sudo[107785]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:40 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-811754d0-673e-460a-8447-007b8a16b65e tempest-ProjectReaderTests-1679623781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-72842cbc-ed0b-4d64-bb71-8ebf76c4ec71" returned: 0 in 0.361s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:40 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-811754d0-673e-460a-8447-007b8a16b65e tempest-ProjectReaderTests-1679623781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-72842cbc-ed0b-4d64-bb71-8ebf76c4ec71 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:40 devstack sudo[107790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-72842cbc-ed0b-4d64-bb71-8ebf76c4ec71 Sep 29 18:38:40 devstack sudo[107790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:41 devstack sudo[107790]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:41 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-811754d0-673e-460a-8447-007b8a16b65e tempest-ProjectReaderTests-1679623781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-72842cbc-ed0b-4d64-bb71-8ebf76c4ec71" returned: 0 in 0.252s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:41 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-811754d0-673e-460a-8447-007b8a16b65e tempest-ProjectReaderTests-1679623781 None] Lock "cinder-quobyte-72842cbc-ed0b-4d64-bb71-8ebf76c4ec71" released by "delete_volume" :: held 0.676s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:38:41 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-811754d0-673e-460a-8447-007b8a16b65e tempest-ProjectReaderTests-1679623781 None] Created reservations ['5257400d-f918-4dc5-96e4-f7219131aba9', '53de5816-28b5-458f-850f-05619b01ef02', '5ac38dfc-5061-4aae-b5c5-ae02b489fa54', '6c85531c-8ab3-426e-8480-56bfea3e24d6'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:38:41 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-811754d0-673e-460a-8447-007b8a16b65e tempest-ProjectReaderTests-1679623781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:38:41 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-811754d0-673e-460a-8447-007b8a16b65e tempest-ProjectReaderTests-1679623781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:38:41 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-811754d0-673e-460a-8447-007b8a16b65e tempest-ProjectReaderTests-1679623781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:38:41 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-811754d0-673e-460a-8447-007b8a16b65e tempest-ProjectReaderTests-1679623781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:38:41 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-811754d0-673e-460a-8447-007b8a16b65e tempest-ProjectReaderTests-1679623781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:38:41 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-811754d0-673e-460a-8447-007b8a16b65e tempest-ProjectReaderTests-1679623781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:41 devstack sudo[107793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:38:41 devstack sudo[107793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:41 devstack sudo[107793]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:41 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-811754d0-673e-460a-8447-007b8a16b65e tempest-ProjectReaderTests-1679623781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.265s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:41 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-811754d0-673e-460a-8447-007b8a16b65e tempest-ProjectReaderTests-1679623781 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:38:41 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-811754d0-673e-460a-8447-007b8a16b65e tempest-ProjectReaderTests-1679623781 None] Deleted volume successfully. Sep 29 18:38:41 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-811754d0-673e-460a-8447-007b8a16b65e tempest-ProjectReaderTests-1679623781 None] Lock "cinder-72842cbc-ed0b-4d64-bb71-8ebf76c4ec71-delete_volume" released by "delete_volume" :: held 1.141s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:38:42 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-c86dc620-3ce8-4e45-9b29-83feadd71703 tempest-ProjectReaderTests-1679623781 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86512) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:38:42 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-c86dc620-3ce8-4e45-9b29-83feadd71703 tempest-ProjectReaderTests-1679623781 None] Flow 'volume_create_manager' (31769bbd-cf55-4905-84c1-5866db5b430b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:38:42 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-c86dc620-3ce8-4e45-9b29-83feadd71703 tempest-ProjectReaderTests-1679623781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ede0d533-0c71-4519-b523-03340c9e71d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:38:42 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-c86dc620-3ce8-4e45-9b29-83feadd71703 tempest-ProjectReaderTests-1679623781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ede0d533-0c71-4519-b523-03340c9e71d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:38:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1001046479',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0188ded6-8b8b-40c7-a86c-cdd5cfc13b40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f41aed7ee5b34e4bbad59bc32c08b236',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:38:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:38:42Z,use_quota=True,user_id='3baa3f73c40542b9b511c21345fa9a4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:38:42 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-c86dc620-3ce8-4e45-9b29-83feadd71703 tempest-ProjectReaderTests-1679623781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63922cf8-5e68-49c7-b9f8-023645ab077a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:38:42 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-c86dc620-3ce8-4e45-9b29-83feadd71703 tempest-ProjectReaderTests-1679623781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63922cf8-5e68-49c7-b9f8-023645ab077a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:38:42 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-c86dc620-3ce8-4e45-9b29-83feadd71703 tempest-ProjectReaderTests-1679623781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d029bcb-adb8-4ee9-aba7-45da21cb77dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:38:42 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-c86dc620-3ce8-4e45-9b29-83feadd71703 tempest-ProjectReaderTests-1679623781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d029bcb-adb8-4ee9-aba7-45da21cb77dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0188ded6-8b8b-40c7-a86c-cdd5cfc13b40', 'volume_name': 'volume-0188ded6-8b8b-40c7-a86c-cdd5cfc13b40', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:38:42 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-c86dc620-3ce8-4e45-9b29-83feadd71703 tempest-ProjectReaderTests-1679623781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65c66178-f807-4196-a539-fe67c334d473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:38:42 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-c86dc620-3ce8-4e45-9b29-83feadd71703 tempest-ProjectReaderTests-1679623781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65c66178-f807-4196-a539-fe67c334d473) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:38:42 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-c86dc620-3ce8-4e45-9b29-83feadd71703 tempest-ProjectReaderTests-1679623781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae6c12cb-7266-4a41-b0a3-b5afbc481482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:38:42 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-c86dc620-3ce8-4e45-9b29-83feadd71703 tempest-ProjectReaderTests-1679623781 None] Volume 0188ded6-8b8b-40c7-a86c-cdd5cfc13b40: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0188ded6-8b8b-40c7-a86c-cdd5cfc13b40', 'volume_size': 1} Sep 29 18:38:42 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-c86dc620-3ce8-4e45-9b29-83feadd71703 tempest-ProjectReaderTests-1679623781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:38:42 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-c86dc620-3ce8-4e45-9b29-83feadd71703 tempest-ProjectReaderTests-1679623781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:38:42 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-c86dc620-3ce8-4e45-9b29-83feadd71703 tempest-ProjectReaderTests-1679623781 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:38:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1001046479',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0188ded6-8b8b-40c7-a86c-cdd5cfc13b40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f41aed7ee5b34e4bbad59bc32c08b236',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:38:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:38:42Z,use_quota=True,user_id='3baa3f73c40542b9b511c21345fa9a4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)}" {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:38:42 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-c86dc620-3ce8-4e45-9b29-83feadd71703 tempest-ProjectReaderTests-1679623781 None] Creating volume 0188ded6-8b8b-40c7-a86c-cdd5cfc13b40 {{(pid=86512) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:38:42 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-c86dc620-3ce8-4e45-9b29-83feadd71703 tempest-ProjectReaderTests-1679623781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:38:42 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-c86dc620-3ce8-4e45-9b29-83feadd71703 tempest-ProjectReaderTests-1679623781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:38:42 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-c86dc620-3ce8-4e45-9b29-83feadd71703 tempest-ProjectReaderTests-1679623781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:38:42 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-c86dc620-3ce8-4e45-9b29-83feadd71703 tempest-ProjectReaderTests-1679623781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:38:42 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-c86dc620-3ce8-4e45-9b29-83feadd71703 tempest-ProjectReaderTests-1679623781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:38:42 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-c86dc620-3ce8-4e45-9b29-83feadd71703 tempest-ProjectReaderTests-1679623781 None] Selected osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 as target Quobyte volume. {{(pid=86512) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:38:42 devstack cinder-volume[86512]: INFO cinder.volume.drivers.remotefs [None req-c86dc620-3ce8-4e45-9b29-83feadd71703 tempest-ProjectReaderTests-1679623781 None] casted to osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 Sep 29 18:38:42 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-c86dc620-3ce8-4e45-9b29-83feadd71703 tempest-ProjectReaderTests-1679623781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0188ded6-8b8b-40c7-a86c-cdd5cfc13b40 1073741824 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:42 devstack sudo[107796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0188ded6-8b8b-40c7-a86c-cdd5cfc13b40 1073741824 Sep 29 18:38:42 devstack sudo[107796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:42 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-a98974e1-8c37-4312-8863-3b919dce3c85 tempest-ProjectMemberTests-1577701723 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86512) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:38:42 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-a98974e1-8c37-4312-8863-3b919dce3c85 tempest-ProjectMemberTests-1577701723 None] Flow 'volume_create_manager' (33dfbe48-d6a2-4253-a1a8-127e8b5563bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:38:42 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-a98974e1-8c37-4312-8863-3b919dce3c85 tempest-ProjectMemberTests-1577701723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfbc7074-8865-4c32-aa2f-8073f9f04472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:38:42 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-a98974e1-8c37-4312-8863-3b919dce3c85 tempest-ProjectMemberTests-1577701723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfbc7074-8865-4c32-aa2f-8073f9f04472) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:38:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1783063698',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55ee4de1-1a90-44c0-b0a5-f5548369275f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc5a83cdd1e34b24adfa899bf4067f0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:38:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:38:42Z,use_quota=True,user_id='671a2611e03549f08f718ec6a8379db0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:38:42 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-a98974e1-8c37-4312-8863-3b919dce3c85 tempest-ProjectMemberTests-1577701723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (382ad43a-5a28-4661-bb7f-a23f1275b2f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:38:42 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-a98974e1-8c37-4312-8863-3b919dce3c85 tempest-ProjectMemberTests-1577701723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (382ad43a-5a28-4661-bb7f-a23f1275b2f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:38:42 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-a98974e1-8c37-4312-8863-3b919dce3c85 tempest-ProjectMemberTests-1577701723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44bd2933-2cd8-41c3-a7fd-1c3270262abc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:38:42 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-a98974e1-8c37-4312-8863-3b919dce3c85 tempest-ProjectMemberTests-1577701723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44bd2933-2cd8-41c3-a7fd-1c3270262abc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55ee4de1-1a90-44c0-b0a5-f5548369275f', 'volume_name': 'volume-55ee4de1-1a90-44c0-b0a5-f5548369275f', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:38:42 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-a98974e1-8c37-4312-8863-3b919dce3c85 tempest-ProjectMemberTests-1577701723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d69d51b-bb8e-4113-a9ca-add8b14f1b0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:38:42 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-a98974e1-8c37-4312-8863-3b919dce3c85 tempest-ProjectMemberTests-1577701723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d69d51b-bb8e-4113-a9ca-add8b14f1b0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:38:42 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-a98974e1-8c37-4312-8863-3b919dce3c85 tempest-ProjectMemberTests-1577701723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5aefa2d5-9b44-4a76-b8c4-2fa2a83ff35b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:38:42 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-a98974e1-8c37-4312-8863-3b919dce3c85 tempest-ProjectMemberTests-1577701723 None] Volume 55ee4de1-1a90-44c0-b0a5-f5548369275f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55ee4de1-1a90-44c0-b0a5-f5548369275f', 'volume_size': 1} Sep 29 18:38:42 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-a98974e1-8c37-4312-8863-3b919dce3c85 tempest-ProjectMemberTests-1577701723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:38:42 devstack sudo[107796]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:42 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-c86dc620-3ce8-4e45-9b29-83feadd71703 tempest-ProjectReaderTests-1679623781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0188ded6-8b8b-40c7-a86c-cdd5cfc13b40 1073741824" returned: 0 in 0.388s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:42 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-c86dc620-3ce8-4e45-9b29-83feadd71703 tempest-ProjectReaderTests-1679623781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0188ded6-8b8b-40c7-a86c-cdd5cfc13b40 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:42 devstack sudo[107802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0188ded6-8b8b-40c7-a86c-cdd5cfc13b40 Sep 29 18:38:42 devstack sudo[107802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:42 devstack sudo[107802]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:42 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-c86dc620-3ce8-4e45-9b29-83feadd71703 tempest-ProjectReaderTests-1679623781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0188ded6-8b8b-40c7-a86c-cdd5cfc13b40" returned: 0 in 0.260s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:42 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-c86dc620-3ce8-4e45-9b29-83feadd71703 tempest-ProjectReaderTests-1679623781 None] <== create_volume: return (688ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'} {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:38:42 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-c86dc620-3ce8-4e45-9b29-83feadd71703 tempest-ProjectReaderTests-1679623781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.691s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:38:42 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-a98974e1-8c37-4312-8863-3b919dce3c85 tempest-ProjectMemberTests-1577701723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.573s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:38:42 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-a98974e1-8c37-4312-8863-3b919dce3c85 tempest-ProjectMemberTests-1577701723 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:38:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1783063698',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55ee4de1-1a90-44c0-b0a5-f5548369275f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc5a83cdd1e34b24adfa899bf4067f0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:38:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:38:42Z,use_quota=True,user_id='671a2611e03549f08f718ec6a8379db0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)}" {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:38:42 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-a98974e1-8c37-4312-8863-3b919dce3c85 tempest-ProjectMemberTests-1577701723 None] Creating volume 55ee4de1-1a90-44c0-b0a5-f5548369275f {{(pid=86512) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:38:42 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-a98974e1-8c37-4312-8863-3b919dce3c85 tempest-ProjectMemberTests-1577701723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:38:43 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-a98974e1-8c37-4312-8863-3b919dce3c85 tempest-ProjectMemberTests-1577701723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:38:43 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-a98974e1-8c37-4312-8863-3b919dce3c85 tempest-ProjectMemberTests-1577701723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:38:43 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-a98974e1-8c37-4312-8863-3b919dce3c85 tempest-ProjectMemberTests-1577701723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:38:43 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-a98974e1-8c37-4312-8863-3b919dce3c85 tempest-ProjectMemberTests-1577701723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:38:43 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-a98974e1-8c37-4312-8863-3b919dce3c85 tempest-ProjectMemberTests-1577701723 None] Selected osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 as target Quobyte volume. {{(pid=86512) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:38:43 devstack cinder-volume[86512]: INFO cinder.volume.drivers.remotefs [None req-a98974e1-8c37-4312-8863-3b919dce3c85 tempest-ProjectMemberTests-1577701723 None] casted to osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 Sep 29 18:38:43 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a98974e1-8c37-4312-8863-3b919dce3c85 tempest-ProjectMemberTests-1577701723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-55ee4de1-1a90-44c0-b0a5-f5548369275f 1073741824 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:43 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-c86dc620-3ce8-4e45-9b29-83feadd71703 tempest-ProjectReaderTests-1679623781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae6c12cb-7266-4a41-b0a3-b5afbc481482) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0188ded6-8b8b-40c7-a86c-cdd5cfc13b40', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:38:43 devstack sudo[107806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-55ee4de1-1a90-44c0-b0a5-f5548369275f 1073741824 Sep 29 18:38:43 devstack sudo[107806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:43 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-c86dc620-3ce8-4e45-9b29-83feadd71703 tempest-ProjectReaderTests-1679623781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a11e652-0ed7-4bf7-97e3-98da62901a95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:38:43 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-c86dc620-3ce8-4e45-9b29-83feadd71703 tempest-ProjectReaderTests-1679623781 None] Volume volume-0188ded6-8b8b-40c7-a86c-cdd5cfc13b40 (0188ded6-8b8b-40c7-a86c-cdd5cfc13b40): created successfully Sep 29 18:38:43 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-c86dc620-3ce8-4e45-9b29-83feadd71703 tempest-ProjectReaderTests-1679623781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a11e652-0ed7-4bf7-97e3-98da62901a95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:38:43 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-c86dc620-3ce8-4e45-9b29-83feadd71703 tempest-ProjectReaderTests-1679623781 None] Flow 'volume_create_manager' (31769bbd-cf55-4905-84c1-5866db5b430b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:38:43 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-c86dc620-3ce8-4e45-9b29-83feadd71703 tempest-ProjectReaderTests-1679623781 None] Created volume successfully. Sep 29 18:38:43 devstack sudo[107806]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:43 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a98974e1-8c37-4312-8863-3b919dce3c85 tempest-ProjectMemberTests-1577701723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-55ee4de1-1a90-44c0-b0a5-f5548369275f 1073741824" returned: 0 in 0.435s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:43 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a98974e1-8c37-4312-8863-3b919dce3c85 tempest-ProjectMemberTests-1577701723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-55ee4de1-1a90-44c0-b0a5-f5548369275f {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:43 devstack sudo[107812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-55ee4de1-1a90-44c0-b0a5-f5548369275f Sep 29 18:38:43 devstack sudo[107812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:43 devstack sudo[107812]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:43 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a98974e1-8c37-4312-8863-3b919dce3c85 tempest-ProjectMemberTests-1577701723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-55ee4de1-1a90-44c0-b0a5-f5548369275f" returned: 0 in 0.230s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:43 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-a98974e1-8c37-4312-8863-3b919dce3c85 tempest-ProjectMemberTests-1577701723 None] <== create_volume: return (702ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'} {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:38:43 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-a98974e1-8c37-4312-8863-3b919dce3c85 tempest-ProjectMemberTests-1577701723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.706s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:38:43 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-a98974e1-8c37-4312-8863-3b919dce3c85 tempest-ProjectMemberTests-1577701723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5aefa2d5-9b44-4a76-b8c4-2fa2a83ff35b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55ee4de1-1a90-44c0-b0a5-f5548369275f', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:38:43 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-a98974e1-8c37-4312-8863-3b919dce3c85 tempest-ProjectMemberTests-1577701723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e521a85-5dfb-4ead-be87-a6d8e72b97d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:38:43 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-a98974e1-8c37-4312-8863-3b919dce3c85 tempest-ProjectMemberTests-1577701723 None] Volume volume-55ee4de1-1a90-44c0-b0a5-f5548369275f (55ee4de1-1a90-44c0-b0a5-f5548369275f): created successfully Sep 29 18:38:43 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-a98974e1-8c37-4312-8863-3b919dce3c85 tempest-ProjectMemberTests-1577701723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e521a85-5dfb-4ead-be87-a6d8e72b97d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:38:43 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-a98974e1-8c37-4312-8863-3b919dce3c85 tempest-ProjectMemberTests-1577701723 None] Flow 'volume_create_manager' (33dfbe48-d6a2-4253-a1a8-127e8b5563bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:38:43 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-a98974e1-8c37-4312-8863-3b919dce3c85 tempest-ProjectMemberTests-1577701723 None] Created volume successfully. Sep 29 18:38:44 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-114dde05-8fb3-4240-abed-d0fc9c3b323b tempest-ProjectReaderTests-1679623781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:38:44 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-114dde05-8fb3-4240-abed-d0fc9c3b323b tempest-ProjectReaderTests-1679623781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:38:44 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-114dde05-8fb3-4240-abed-d0fc9c3b323b tempest-ProjectReaderTests-1679623781 None] Creating offline snapshot bd719551-a5d4-4cb3-aba4-23e42352a7dc of volume 0188ded6-8b8b-40c7-a86c-cdd5cfc13b40 {{(pid=86512) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 18:38:44 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[283906d6-843a-4bbd-8e38-51baa9932ce5]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:38:44 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-114dde05-8fb3-4240-abed-d0fc9c3b323b tempest-ProjectReaderTests-1679623781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0188ded6-8b8b-40c7-a86c-cdd5cfc13b40 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:44 devstack sudo[107816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0188ded6-8b8b-40c7-a86c-cdd5cfc13b40 Sep 29 18:38:44 devstack sudo[107816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:44 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-ec0813a3-326f-4678-b153-0988ecbb0d15 tempest-ProjectMemberTests-1577701723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:38:44 devstack sudo[107816]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:44 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-114dde05-8fb3-4240-abed-d0fc9c3b323b tempest-ProjectReaderTests-1679623781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0188ded6-8b8b-40c7-a86c-cdd5cfc13b40" returned: 0 in 0.372s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:44 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-114dde05-8fb3-4240-abed-d0fc9c3b323b tempest-ProjectReaderTests-1679623781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0188ded6-8b8b-40c7-a86c-cdd5cfc13b40,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0188ded6-8b8b-40c7-a86c-cdd5cfc13b40.bd719551-a5d4-4cb3-aba4-23e42352a7dc 1G {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:44 devstack sudo[107821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0188ded6-8b8b-40c7-a86c-cdd5cfc13b40,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0188ded6-8b8b-40c7-a86c-cdd5cfc13b40.bd719551-a5d4-4cb3-aba4-23e42352a7dc 1G Sep 29 18:38:44 devstack sudo[107821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:45 devstack sudo[107821]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:45 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-114dde05-8fb3-4240-abed-d0fc9c3b323b tempest-ProjectReaderTests-1679623781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0188ded6-8b8b-40c7-a86c-cdd5cfc13b40,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0188ded6-8b8b-40c7-a86c-cdd5cfc13b40.bd719551-a5d4-4cb3-aba4-23e42352a7dc 1G" returned: 0 in 0.381s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:45 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-114dde05-8fb3-4240-abed-d0fc9c3b323b tempest-ProjectReaderTests-1679623781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0188ded6-8b8b-40c7-a86c-cdd5cfc13b40 -F qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0188ded6-8b8b-40c7-a86c-cdd5cfc13b40.bd719551-a5d4-4cb3-aba4-23e42352a7dc {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:45 devstack sudo[107827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0188ded6-8b8b-40c7-a86c-cdd5cfc13b40 -F qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0188ded6-8b8b-40c7-a86c-cdd5cfc13b40.bd719551-a5d4-4cb3-aba4-23e42352a7dc Sep 29 18:38:45 devstack sudo[107827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:45 devstack sudo[107827]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:45 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-114dde05-8fb3-4240-abed-d0fc9c3b323b tempest-ProjectReaderTests-1679623781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0188ded6-8b8b-40c7-a86c-cdd5cfc13b40 -F qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0188ded6-8b8b-40c7-a86c-cdd5cfc13b40.bd719551-a5d4-4cb3-aba4-23e42352a7dc" returned: 0 in 0.276s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:45 devstack cinder-volume[86512]: WARNING cinder.volume.drivers.remotefs [None req-114dde05-8fb3-4240-abed-d0fc9c3b323b tempest-ProjectReaderTests-1679623781 None] /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0188ded6-8b8b-40c7-a86c-cdd5cfc13b40.bd719551-a5d4-4cb3-aba4-23e42352a7dc is being set with open permissions: ugo+rw Sep 29 18:38:45 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-114dde05-8fb3-4240-abed-d0fc9c3b323b tempest-ProjectReaderTests-1679623781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0188ded6-8b8b-40c7-a86c-cdd5cfc13b40.bd719551-a5d4-4cb3-aba4-23e42352a7dc {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:45 devstack sudo[107832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0188ded6-8b8b-40c7-a86c-cdd5cfc13b40.bd719551-a5d4-4cb3-aba4-23e42352a7dc Sep 29 18:38:45 devstack sudo[107832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:45 devstack sudo[107832]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:45 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-114dde05-8fb3-4240-abed-d0fc9c3b323b tempest-ProjectReaderTests-1679623781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0188ded6-8b8b-40c7-a86c-cdd5cfc13b40.bd719551-a5d4-4cb3-aba4-23e42352a7dc" returned: 0 in 0.242s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:45 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-114dde05-8fb3-4240-abed-d0fc9c3b323b tempest-ProjectReaderTests-1679623781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0188ded6-8b8b-40c7-a86c-cdd5cfc13b40.info {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:45 devstack sudo[107835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0188ded6-8b8b-40c7-a86c-cdd5cfc13b40.info Sep 29 18:38:45 devstack sudo[107835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:45 devstack sudo[107835]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:45 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-114dde05-8fb3-4240-abed-d0fc9c3b323b tempest-ProjectReaderTests-1679623781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0188ded6-8b8b-40c7-a86c-cdd5cfc13b40.info" returned: 0 in 0.240s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:45 devstack cinder-volume[86512]: WARNING cinder.volume.drivers.remotefs [None req-114dde05-8fb3-4240-abed-d0fc9c3b323b tempest-ProjectReaderTests-1679623781 None] /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0188ded6-8b8b-40c7-a86c-cdd5cfc13b40.info is being set with open permissions: ugo+rw Sep 29 18:38:45 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-114dde05-8fb3-4240-abed-d0fc9c3b323b tempest-ProjectReaderTests-1679623781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0188ded6-8b8b-40c7-a86c-cdd5cfc13b40.info {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:45 devstack sudo[107838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0188ded6-8b8b-40c7-a86c-cdd5cfc13b40.info Sep 29 18:38:45 devstack sudo[107838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:46 devstack sudo[107838]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:46 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-114dde05-8fb3-4240-abed-d0fc9c3b323b tempest-ProjectReaderTests-1679623781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0188ded6-8b8b-40c7-a86c-cdd5cfc13b40.info" returned: 0 in 0.233s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:46 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-114dde05-8fb3-4240-abed-d0fc9c3b323b tempest-ProjectReaderTests-1679623781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.819s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:38:46 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-ec0813a3-326f-4678-b153-0988ecbb0d15 tempest-ProjectMemberTests-1577701723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.555s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:38:46 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-ec0813a3-326f-4678-b153-0988ecbb0d15 tempest-ProjectMemberTests-1577701723 None] Creating offline snapshot bc499106-71c9-4dfe-8e5f-80b285f32399 of volume 55ee4de1-1a90-44c0-b0a5-f5548369275f {{(pid=86512) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 18:38:46 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-114dde05-8fb3-4240-abed-d0fc9c3b323b tempest-ProjectReaderTests-1679623781 None] Create snapshot completed successfully Sep 29 18:38:46 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9c47323-21ef-4732-a4fc-f2bb9d8e7093]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:38:46 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-ec0813a3-326f-4678-b153-0988ecbb0d15 tempest-ProjectMemberTests-1577701723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-55ee4de1-1a90-44c0-b0a5-f5548369275f {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:46 devstack sudo[107841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-55ee4de1-1a90-44c0-b0a5-f5548369275f Sep 29 18:38:46 devstack sudo[107841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:46 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-e3ce90be-482c-49cc-993e-7de6d434a290 tempest-ProjectReaderTests-1679623781 None] Acquiring lock "cinder-bd719551-a5d4-4cb3-aba4-23e42352a7dc-delete_snapshot" by "delete_snapshot" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:38:46 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-e3ce90be-482c-49cc-993e-7de6d434a290 tempest-ProjectReaderTests-1679623781 None] Lock "cinder-bd719551-a5d4-4cb3-aba4-23e42352a7dc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:38:46 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-e3ce90be-482c-49cc-993e-7de6d434a290 tempest-ProjectReaderTests-1679623781 None] Acquiring lock "cinder-quobyte-0188ded6-8b8b-40c7-a86c-cdd5cfc13b40" by "delete_snapshot" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:38:46 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-e3ce90be-482c-49cc-993e-7de6d434a290 tempest-ProjectReaderTests-1679623781 None] Lock "cinder-quobyte-0188ded6-8b8b-40c7-a86c-cdd5cfc13b40" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:38:46 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-e3ce90be-482c-49cc-993e-7de6d434a290 tempest-ProjectReaderTests-1679623781 None] Acquiring lock "cinder-quobyte-bd719551-a5d4-4cb3-aba4-23e42352a7dc" by "_delete_snapshot" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:38:46 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-e3ce90be-482c-49cc-993e-7de6d434a290 tempest-ProjectReaderTests-1679623781 None] Lock "cinder-quobyte-bd719551-a5d4-4cb3-aba4-23e42352a7dc" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:38:46 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-e3ce90be-482c-49cc-993e-7de6d434a290 tempest-ProjectReaderTests-1679623781 None] Deleting offline snapshot bd719551-a5d4-4cb3-aba4-23e42352a7dc of volume 0188ded6-8b8b-40c7-a86c-cdd5cfc13b40 {{(pid=86512) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 18:38:46 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-e3ce90be-482c-49cc-993e-7de6d434a290 tempest-ProjectReaderTests-1679623781 None] snapshot_file for this snap is: volume-0188ded6-8b8b-40c7-a86c-cdd5cfc13b40.bd719551-a5d4-4cb3-aba4-23e42352a7dc {{(pid=86512) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 18:38:46 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b352c48-0478-423d-90ec-46a8cc8aaa68]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:38:46 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-e3ce90be-482c-49cc-993e-7de6d434a290 tempest-ProjectReaderTests-1679623781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0188ded6-8b8b-40c7-a86c-cdd5cfc13b40.bd719551-a5d4-4cb3-aba4-23e42352a7dc {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:46 devstack sudo[107841]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:46 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-ec0813a3-326f-4678-b153-0988ecbb0d15 tempest-ProjectMemberTests-1577701723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-55ee4de1-1a90-44c0-b0a5-f5548369275f" returned: 0 in 0.376s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:46 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-ec0813a3-326f-4678-b153-0988ecbb0d15 tempest-ProjectMemberTests-1577701723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-55ee4de1-1a90-44c0-b0a5-f5548369275f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-55ee4de1-1a90-44c0-b0a5-f5548369275f.bc499106-71c9-4dfe-8e5f-80b285f32399 1G {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:46 devstack sudo[107847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-55ee4de1-1a90-44c0-b0a5-f5548369275f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-55ee4de1-1a90-44c0-b0a5-f5548369275f.bc499106-71c9-4dfe-8e5f-80b285f32399 1G Sep 29 18:38:46 devstack sudo[107847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:46 devstack sudo[107846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0188ded6-8b8b-40c7-a86c-cdd5cfc13b40.bd719551-a5d4-4cb3-aba4-23e42352a7dc Sep 29 18:38:46 devstack sudo[107846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:46 devstack sudo[107846]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:46 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-e3ce90be-482c-49cc-993e-7de6d434a290 tempest-ProjectReaderTests-1679623781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0188ded6-8b8b-40c7-a86c-cdd5cfc13b40.bd719551-a5d4-4cb3-aba4-23e42352a7dc" returned: 0 in 0.384s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:46 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-e3ce90be-482c-49cc-993e-7de6d434a290 tempest-ProjectReaderTests-1679623781 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0188ded6-8b8b-40c7-a86c-cdd5cfc13b40(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86512) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 18:38:46 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dc17e4e-d55a-4316-997f-465f540a8aab]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:38:46 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-e3ce90be-482c-49cc-993e-7de6d434a290 tempest-ProjectReaderTests-1679623781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0188ded6-8b8b-40c7-a86c-cdd5cfc13b40 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:46 devstack sudo[107847]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:46 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-ec0813a3-326f-4678-b153-0988ecbb0d15 tempest-ProjectMemberTests-1577701723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-55ee4de1-1a90-44c0-b0a5-f5548369275f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-55ee4de1-1a90-44c0-b0a5-f5548369275f.bc499106-71c9-4dfe-8e5f-80b285f32399 1G" returned: 0 in 0.411s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:46 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-ec0813a3-326f-4678-b153-0988ecbb0d15 tempest-ProjectMemberTests-1577701723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-55ee4de1-1a90-44c0-b0a5-f5548369275f -F qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-55ee4de1-1a90-44c0-b0a5-f5548369275f.bc499106-71c9-4dfe-8e5f-80b285f32399 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:46 devstack sudo[107859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-55ee4de1-1a90-44c0-b0a5-f5548369275f -F qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-55ee4de1-1a90-44c0-b0a5-f5548369275f.bc499106-71c9-4dfe-8e5f-80b285f32399 Sep 29 18:38:46 devstack sudo[107859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:47 devstack sudo[107858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0188ded6-8b8b-40c7-a86c-cdd5cfc13b40 Sep 29 18:38:47 devstack sudo[107858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:47 devstack sudo[107859]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:47 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-ec0813a3-326f-4678-b153-0988ecbb0d15 tempest-ProjectMemberTests-1577701723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-55ee4de1-1a90-44c0-b0a5-f5548369275f -F qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-55ee4de1-1a90-44c0-b0a5-f5548369275f.bc499106-71c9-4dfe-8e5f-80b285f32399" returned: 0 in 0.292s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:47 devstack cinder-volume[86512]: WARNING cinder.volume.drivers.remotefs [None req-ec0813a3-326f-4678-b153-0988ecbb0d15 tempest-ProjectMemberTests-1577701723 None] /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-55ee4de1-1a90-44c0-b0a5-f5548369275f.bc499106-71c9-4dfe-8e5f-80b285f32399 is being set with open permissions: ugo+rw Sep 29 18:38:47 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-ec0813a3-326f-4678-b153-0988ecbb0d15 tempest-ProjectMemberTests-1577701723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-55ee4de1-1a90-44c0-b0a5-f5548369275f.bc499106-71c9-4dfe-8e5f-80b285f32399 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:47 devstack sudo[107868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-55ee4de1-1a90-44c0-b0a5-f5548369275f.bc499106-71c9-4dfe-8e5f-80b285f32399 Sep 29 18:38:47 devstack sudo[107868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:47 devstack sudo[107858]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:47 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-e3ce90be-482c-49cc-993e-7de6d434a290 tempest-ProjectReaderTests-1679623781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0188ded6-8b8b-40c7-a86c-cdd5cfc13b40" returned: 0 in 0.374s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:47 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-e3ce90be-482c-49cc-993e-7de6d434a290 tempest-ProjectReaderTests-1679623781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0188ded6-8b8b-40c7-a86c-cdd5cfc13b40.bd719551-a5d4-4cb3-aba4-23e42352a7dc {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:47 devstack sudo[107871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0188ded6-8b8b-40c7-a86c-cdd5cfc13b40.bd719551-a5d4-4cb3-aba4-23e42352a7dc Sep 29 18:38:47 devstack sudo[107871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:47 devstack sudo[107868]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:47 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-ec0813a3-326f-4678-b153-0988ecbb0d15 tempest-ProjectMemberTests-1577701723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-55ee4de1-1a90-44c0-b0a5-f5548369275f.bc499106-71c9-4dfe-8e5f-80b285f32399" returned: 0 in 0.242s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:47 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-ec0813a3-326f-4678-b153-0988ecbb0d15 tempest-ProjectMemberTests-1577701723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-55ee4de1-1a90-44c0-b0a5-f5548369275f.info {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:47 devstack sudo[107876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-55ee4de1-1a90-44c0-b0a5-f5548369275f.info Sep 29 18:38:47 devstack sudo[107876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:47 devstack sudo[107871]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:47 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-e3ce90be-482c-49cc-993e-7de6d434a290 tempest-ProjectReaderTests-1679623781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0188ded6-8b8b-40c7-a86c-cdd5cfc13b40.bd719551-a5d4-4cb3-aba4-23e42352a7dc" returned: 0 in 0.340s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:47 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-e3ce90be-482c-49cc-993e-7de6d434a290 tempest-ProjectReaderTests-1679623781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0188ded6-8b8b-40c7-a86c-cdd5cfc13b40.bd719551-a5d4-4cb3-aba4-23e42352a7dc {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:47 devstack sudo[107880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0188ded6-8b8b-40c7-a86c-cdd5cfc13b40.bd719551-a5d4-4cb3-aba4-23e42352a7dc Sep 29 18:38:47 devstack sudo[107880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:47 devstack sudo[107876]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:47 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-ec0813a3-326f-4678-b153-0988ecbb0d15 tempest-ProjectMemberTests-1577701723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-55ee4de1-1a90-44c0-b0a5-f5548369275f.info" returned: 0 in 0.266s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:47 devstack cinder-volume[86512]: WARNING cinder.volume.drivers.remotefs [None req-ec0813a3-326f-4678-b153-0988ecbb0d15 tempest-ProjectMemberTests-1577701723 None] /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-55ee4de1-1a90-44c0-b0a5-f5548369275f.info is being set with open permissions: ugo+rw Sep 29 18:38:47 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-ec0813a3-326f-4678-b153-0988ecbb0d15 tempest-ProjectMemberTests-1577701723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-55ee4de1-1a90-44c0-b0a5-f5548369275f.info {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:47 devstack sudo[107883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-55ee4de1-1a90-44c0-b0a5-f5548369275f.info Sep 29 18:38:47 devstack sudo[107883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:47 devstack sudo[107880]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:47 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-e3ce90be-482c-49cc-993e-7de6d434a290 tempest-ProjectReaderTests-1679623781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0188ded6-8b8b-40c7-a86c-cdd5cfc13b40.bd719551-a5d4-4cb3-aba4-23e42352a7dc" returned: 0 in 0.247s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:47 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-e3ce90be-482c-49cc-993e-7de6d434a290 tempest-ProjectReaderTests-1679623781 None] Lock "cinder-quobyte-bd719551-a5d4-4cb3-aba4-23e42352a7dc" released by "_delete_snapshot" :: held 1.453s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:38:47 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-e3ce90be-482c-49cc-993e-7de6d434a290 tempest-ProjectReaderTests-1679623781 None] Lock "cinder-quobyte-0188ded6-8b8b-40c7-a86c-cdd5cfc13b40" released by "delete_snapshot" :: held 1.473s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:38:47 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-e3ce90be-482c-49cc-993e-7de6d434a290 tempest-ProjectReaderTests-1679623781 None] Created reservations ['11997759-3584-4030-a515-2c12dc7f7255', '424efc66-389e-4c6d-90e5-097bf4c5e9d7', '90ce30ea-8943-4dd4-8e37-a3524817bdd6', '575eafac-f1f4-4ef3-8b8f-dcfabdbbb48d'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:38:48 devstack sudo[107883]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:48 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-ec0813a3-326f-4678-b153-0988ecbb0d15 tempest-ProjectMemberTests-1577701723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-55ee4de1-1a90-44c0-b0a5-f5548369275f.info" returned: 0 in 0.246s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:48 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-ec0813a3-326f-4678-b153-0988ecbb0d15 tempest-ProjectMemberTests-1577701723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.932s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:38:48 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-e3ce90be-482c-49cc-993e-7de6d434a290 tempest-ProjectReaderTests-1679623781 None] Delete snapshot completed successfully. Sep 29 18:38:48 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-e3ce90be-482c-49cc-993e-7de6d434a290 tempest-ProjectReaderTests-1679623781 None] Lock "cinder-bd719551-a5d4-4cb3-aba4-23e42352a7dc-delete_snapshot" released by "delete_snapshot" :: held 1.632s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:38:48 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-ec0813a3-326f-4678-b153-0988ecbb0d15 tempest-ProjectMemberTests-1577701723 None] Create snapshot completed successfully Sep 29 18:38:48 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-860d7f13-50ba-4150-88dc-8b87a321c703 tempest-ProjectReaderTests-1679623781 None] Acquiring lock "cinder-0188ded6-8b8b-40c7-a86c-cdd5cfc13b40-delete_volume" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:38:48 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-860d7f13-50ba-4150-88dc-8b87a321c703 tempest-ProjectReaderTests-1679623781 None] Lock "cinder-0188ded6-8b8b-40c7-a86c-cdd5cfc13b40-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:38:48 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-860d7f13-50ba-4150-88dc-8b87a321c703 tempest-ProjectReaderTests-1679623781 None] Acquiring lock "cinder-quobyte-0188ded6-8b8b-40c7-a86c-cdd5cfc13b40" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:38:48 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-860d7f13-50ba-4150-88dc-8b87a321c703 tempest-ProjectReaderTests-1679623781 None] Lock "cinder-quobyte-0188ded6-8b8b-40c7-a86c-cdd5cfc13b40" acquired by "delete_volume" :: waited 0.015s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:38:48 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4e89dcd-9497-4904-9289-35c698925fda]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:38:48 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-860d7f13-50ba-4150-88dc-8b87a321c703 tempest-ProjectReaderTests-1679623781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0188ded6-8b8b-40c7-a86c-cdd5cfc13b40 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:48 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-db6ae77d-a81c-45bf-9371-1a683e61f7c5 tempest-ProjectMemberTests-1577701723 None] Acquiring lock "cinder-bc499106-71c9-4dfe-8e5f-80b285f32399-delete_snapshot" by "delete_snapshot" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:38:48 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-db6ae77d-a81c-45bf-9371-1a683e61f7c5 tempest-ProjectMemberTests-1577701723 None] Lock "cinder-bc499106-71c9-4dfe-8e5f-80b285f32399-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:38:48 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-db6ae77d-a81c-45bf-9371-1a683e61f7c5 tempest-ProjectMemberTests-1577701723 None] Acquiring lock "cinder-quobyte-55ee4de1-1a90-44c0-b0a5-f5548369275f" by "delete_snapshot" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:38:48 devstack sudo[107887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0188ded6-8b8b-40c7-a86c-cdd5cfc13b40 Sep 29 18:38:48 devstack sudo[107887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:48 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-db6ae77d-a81c-45bf-9371-1a683e61f7c5 tempest-ProjectMemberTests-1577701723 None] Lock "cinder-quobyte-55ee4de1-1a90-44c0-b0a5-f5548369275f" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:38:48 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-db6ae77d-a81c-45bf-9371-1a683e61f7c5 tempest-ProjectMemberTests-1577701723 None] Acquiring lock "cinder-quobyte-bc499106-71c9-4dfe-8e5f-80b285f32399" by "_delete_snapshot" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:38:48 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-db6ae77d-a81c-45bf-9371-1a683e61f7c5 tempest-ProjectMemberTests-1577701723 None] Lock "cinder-quobyte-bc499106-71c9-4dfe-8e5f-80b285f32399" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:38:48 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-db6ae77d-a81c-45bf-9371-1a683e61f7c5 tempest-ProjectMemberTests-1577701723 None] Deleting offline snapshot bc499106-71c9-4dfe-8e5f-80b285f32399 of volume 55ee4de1-1a90-44c0-b0a5-f5548369275f {{(pid=86512) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 18:38:48 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-db6ae77d-a81c-45bf-9371-1a683e61f7c5 tempest-ProjectMemberTests-1577701723 None] snapshot_file for this snap is: volume-55ee4de1-1a90-44c0-b0a5-f5548369275f.bc499106-71c9-4dfe-8e5f-80b285f32399 {{(pid=86512) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 18:38:48 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[0be82976-81be-41e9-8baf-0dc1bcd377f4]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:38:48 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-db6ae77d-a81c-45bf-9371-1a683e61f7c5 tempest-ProjectMemberTests-1577701723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-55ee4de1-1a90-44c0-b0a5-f5548369275f.bc499106-71c9-4dfe-8e5f-80b285f32399 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:48 devstack sudo[107889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-55ee4de1-1a90-44c0-b0a5-f5548369275f.bc499106-71c9-4dfe-8e5f-80b285f32399 Sep 29 18:38:48 devstack sudo[107889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:49 devstack sudo[107887]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:49 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-860d7f13-50ba-4150-88dc-8b87a321c703 tempest-ProjectReaderTests-1679623781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0188ded6-8b8b-40c7-a86c-cdd5cfc13b40" returned: 0 in 0.397s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:49 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-860d7f13-50ba-4150-88dc-8b87a321c703 tempest-ProjectReaderTests-1679623781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0188ded6-8b8b-40c7-a86c-cdd5cfc13b40 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:49 devstack sudo[107894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0188ded6-8b8b-40c7-a86c-cdd5cfc13b40 Sep 29 18:38:49 devstack sudo[107894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:49 devstack sudo[107889]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:49 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-db6ae77d-a81c-45bf-9371-1a683e61f7c5 tempest-ProjectMemberTests-1577701723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-55ee4de1-1a90-44c0-b0a5-f5548369275f.bc499106-71c9-4dfe-8e5f-80b285f32399" returned: 0 in 0.370s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:49 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-db6ae77d-a81c-45bf-9371-1a683e61f7c5 tempest-ProjectMemberTests-1577701723 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-55ee4de1-1a90-44c0-b0a5-f5548369275f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86512) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 18:38:49 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[5623575e-d60a-4d58-947a-5517f554ac9c]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:38:49 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-db6ae77d-a81c-45bf-9371-1a683e61f7c5 tempest-ProjectMemberTests-1577701723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-55ee4de1-1a90-44c0-b0a5-f5548369275f {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:49 devstack sudo[107894]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:49 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-860d7f13-50ba-4150-88dc-8b87a321c703 tempest-ProjectReaderTests-1679623781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0188ded6-8b8b-40c7-a86c-cdd5cfc13b40" returned: 0 in 0.273s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:49 devstack sudo[107899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-55ee4de1-1a90-44c0-b0a5-f5548369275f Sep 29 18:38:49 devstack sudo[107899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:49 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-860d7f13-50ba-4150-88dc-8b87a321c703 tempest-ProjectReaderTests-1679623781 None] Lock "cinder-quobyte-0188ded6-8b8b-40c7-a86c-cdd5cfc13b40" released by "delete_volume" :: held 0.759s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:38:49 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-860d7f13-50ba-4150-88dc-8b87a321c703 tempest-ProjectReaderTests-1679623781 None] Created reservations ['335198ee-8b5c-431e-876c-1c2e79c32306', '10a54671-8ff6-4680-bb4c-2aa79dbe0ef8', 'f92a6e6d-f5b8-47b8-9f50-16083d306509', '4601ea8d-b29a-4f73-9565-48e29ab0a5e5'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:38:49 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-860d7f13-50ba-4150-88dc-8b87a321c703 tempest-ProjectReaderTests-1679623781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:38:49 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-860d7f13-50ba-4150-88dc-8b87a321c703 tempest-ProjectReaderTests-1679623781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:38:49 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-860d7f13-50ba-4150-88dc-8b87a321c703 tempest-ProjectReaderTests-1679623781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:38:49 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-860d7f13-50ba-4150-88dc-8b87a321c703 tempest-ProjectReaderTests-1679623781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:38:49 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-860d7f13-50ba-4150-88dc-8b87a321c703 tempest-ProjectReaderTests-1679623781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:38:49 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-860d7f13-50ba-4150-88dc-8b87a321c703 tempest-ProjectReaderTests-1679623781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:49 devstack sudo[107902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:38:49 devstack sudo[107902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:49 devstack sudo[107899]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:49 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-db6ae77d-a81c-45bf-9371-1a683e61f7c5 tempest-ProjectMemberTests-1577701723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-55ee4de1-1a90-44c0-b0a5-f5548369275f" returned: 0 in 0.376s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:49 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-db6ae77d-a81c-45bf-9371-1a683e61f7c5 tempest-ProjectMemberTests-1577701723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-55ee4de1-1a90-44c0-b0a5-f5548369275f.bc499106-71c9-4dfe-8e5f-80b285f32399 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:49 devstack sudo[107907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-55ee4de1-1a90-44c0-b0a5-f5548369275f.bc499106-71c9-4dfe-8e5f-80b285f32399 Sep 29 18:38:49 devstack sudo[107907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:49 devstack sudo[107902]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:49 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-860d7f13-50ba-4150-88dc-8b87a321c703 tempest-ProjectReaderTests-1679623781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.266s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:49 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-860d7f13-50ba-4150-88dc-8b87a321c703 tempest-ProjectReaderTests-1679623781 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:38:49 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-860d7f13-50ba-4150-88dc-8b87a321c703 tempest-ProjectReaderTests-1679623781 None] Deleted volume successfully. Sep 29 18:38:49 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-860d7f13-50ba-4150-88dc-8b87a321c703 tempest-ProjectReaderTests-1679623781 None] Lock "cinder-0188ded6-8b8b-40c7-a86c-cdd5cfc13b40-delete_volume" released by "delete_volume" :: held 1.262s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:38:49 devstack sudo[107907]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:49 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-db6ae77d-a81c-45bf-9371-1a683e61f7c5 tempest-ProjectMemberTests-1577701723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-55ee4de1-1a90-44c0-b0a5-f5548369275f.bc499106-71c9-4dfe-8e5f-80b285f32399" returned: 0 in 0.365s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:49 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-db6ae77d-a81c-45bf-9371-1a683e61f7c5 tempest-ProjectMemberTests-1577701723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-55ee4de1-1a90-44c0-b0a5-f5548369275f.bc499106-71c9-4dfe-8e5f-80b285f32399 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:49 devstack sudo[107913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-55ee4de1-1a90-44c0-b0a5-f5548369275f.bc499106-71c9-4dfe-8e5f-80b285f32399 Sep 29 18:38:49 devstack sudo[107913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:50 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-d41da2a0-d1ec-4c78-b42e-2cf38a2cceb5 tempest-ProjectReaderTests-1679623781 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86512) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:38:50 devstack sudo[107913]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:50 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d41da2a0-d1ec-4c78-b42e-2cf38a2cceb5 tempest-ProjectReaderTests-1679623781 None] Flow 'volume_create_manager' (c3c4b75c-336f-4487-a9a0-011a3dc26e87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:38:50 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d41da2a0-d1ec-4c78-b42e-2cf38a2cceb5 tempest-ProjectReaderTests-1679623781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e91e253-b44b-479b-99dc-57cfefcc9634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:38:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-db6ae77d-a81c-45bf-9371-1a683e61f7c5 tempest-ProjectMemberTests-1577701723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-55ee4de1-1a90-44c0-b0a5-f5548369275f.bc499106-71c9-4dfe-8e5f-80b285f32399" returned: 0 in 0.291s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:50 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d41da2a0-d1ec-4c78-b42e-2cf38a2cceb5 tempest-ProjectReaderTests-1679623781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e91e253-b44b-479b-99dc-57cfefcc9634) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:38:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1446907362',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0823c9ba-6bab-4ae2-9211-db6e2793d195,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f41aed7ee5b34e4bbad59bc32c08b236',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:38:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:38:50Z,use_quota=True,user_id='3baa3f73c40542b9b511c21345fa9a4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:38:50 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d41da2a0-d1ec-4c78-b42e-2cf38a2cceb5 tempest-ProjectReaderTests-1679623781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1bcb1ab-cefb-4fb3-83fb-630421c3a719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:38:50 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d41da2a0-d1ec-4c78-b42e-2cf38a2cceb5 tempest-ProjectReaderTests-1679623781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1bcb1ab-cefb-4fb3-83fb-630421c3a719) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:38:50 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d41da2a0-d1ec-4c78-b42e-2cf38a2cceb5 tempest-ProjectReaderTests-1679623781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (562c9b35-b67e-4698-8a24-05d0ca8afc9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:38:50 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d41da2a0-d1ec-4c78-b42e-2cf38a2cceb5 tempest-ProjectReaderTests-1679623781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (562c9b35-b67e-4698-8a24-05d0ca8afc9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0823c9ba-6bab-4ae2-9211-db6e2793d195', 'volume_name': 'volume-0823c9ba-6bab-4ae2-9211-db6e2793d195', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:38:50 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d41da2a0-d1ec-4c78-b42e-2cf38a2cceb5 tempest-ProjectReaderTests-1679623781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49659702-b71e-4414-b136-db0c626bc601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:38:50 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d41da2a0-d1ec-4c78-b42e-2cf38a2cceb5 tempest-ProjectReaderTests-1679623781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49659702-b71e-4414-b136-db0c626bc601) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:38:50 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d41da2a0-d1ec-4c78-b42e-2cf38a2cceb5 tempest-ProjectReaderTests-1679623781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe808b1d-854c-4430-8e4d-d57904b65500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:38:50 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-d41da2a0-d1ec-4c78-b42e-2cf38a2cceb5 tempest-ProjectReaderTests-1679623781 None] Volume 0823c9ba-6bab-4ae2-9211-db6e2793d195: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0823c9ba-6bab-4ae2-9211-db6e2793d195', 'volume_size': 1} Sep 29 18:38:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-d41da2a0-d1ec-4c78-b42e-2cf38a2cceb5 tempest-ProjectReaderTests-1679623781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:38:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-d41da2a0-d1ec-4c78-b42e-2cf38a2cceb5 tempest-ProjectReaderTests-1679623781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:38:50 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-d41da2a0-d1ec-4c78-b42e-2cf38a2cceb5 tempest-ProjectReaderTests-1679623781 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:38:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1446907362',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0823c9ba-6bab-4ae2-9211-db6e2793d195,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f41aed7ee5b34e4bbad59bc32c08b236',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:38:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:38:50Z,use_quota=True,user_id='3baa3f73c40542b9b511c21345fa9a4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)}" {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:38:50 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-d41da2a0-d1ec-4c78-b42e-2cf38a2cceb5 tempest-ProjectReaderTests-1679623781 None] Creating volume 0823c9ba-6bab-4ae2-9211-db6e2793d195 {{(pid=86512) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:38:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-d41da2a0-d1ec-4c78-b42e-2cf38a2cceb5 tempest-ProjectReaderTests-1679623781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:38:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-d41da2a0-d1ec-4c78-b42e-2cf38a2cceb5 tempest-ProjectReaderTests-1679623781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:38:50 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-d41da2a0-d1ec-4c78-b42e-2cf38a2cceb5 tempest-ProjectReaderTests-1679623781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:38:50 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-d41da2a0-d1ec-4c78-b42e-2cf38a2cceb5 tempest-ProjectReaderTests-1679623781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:38:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-d41da2a0-d1ec-4c78-b42e-2cf38a2cceb5 tempest-ProjectReaderTests-1679623781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:38:50 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-d41da2a0-d1ec-4c78-b42e-2cf38a2cceb5 tempest-ProjectReaderTests-1679623781 None] Selected osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 as target Quobyte volume. {{(pid=86512) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:38:50 devstack cinder-volume[86512]: INFO cinder.volume.drivers.remotefs [None req-d41da2a0-d1ec-4c78-b42e-2cf38a2cceb5 tempest-ProjectReaderTests-1679623781 None] casted to osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 Sep 29 18:38:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-d41da2a0-d1ec-4c78-b42e-2cf38a2cceb5 tempest-ProjectReaderTests-1679623781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0823c9ba-6bab-4ae2-9211-db6e2793d195 1073741824 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:50 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-db6ae77d-a81c-45bf-9371-1a683e61f7c5 tempest-ProjectMemberTests-1577701723 None] Lock "cinder-quobyte-bc499106-71c9-4dfe-8e5f-80b285f32399" released by "_delete_snapshot" :: held 1.582s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:38:50 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-db6ae77d-a81c-45bf-9371-1a683e61f7c5 tempest-ProjectMemberTests-1577701723 None] Lock "cinder-quobyte-55ee4de1-1a90-44c0-b0a5-f5548369275f" released by "delete_snapshot" :: held 1.608s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:38:50 devstack sudo[107950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0823c9ba-6bab-4ae2-9211-db6e2793d195 1073741824 Sep 29 18:38:50 devstack sudo[107950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:50 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-db6ae77d-a81c-45bf-9371-1a683e61f7c5 tempest-ProjectMemberTests-1577701723 None] Created reservations ['49be0e1a-2247-4e9c-adf8-3386f8340440', 'ee0de761-abc1-4d50-b75a-f1395dbe62c3', '00802a5f-a1b8-4147-8c7f-96b1c55d7420', 'bf6a9ef5-5e94-4cab-a3b3-f46ae75c31a1'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:38:50 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-db6ae77d-a81c-45bf-9371-1a683e61f7c5 tempest-ProjectMemberTests-1577701723 None] Delete snapshot completed successfully. Sep 29 18:38:50 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-db6ae77d-a81c-45bf-9371-1a683e61f7c5 tempest-ProjectMemberTests-1577701723 None] Lock "cinder-bc499106-71c9-4dfe-8e5f-80b285f32399-delete_snapshot" released by "delete_snapshot" :: held 1.748s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:38:50 devstack cinder-volume[86512]: DEBUG oslo_service.periodic_task [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86512) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 18:38:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:38:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:38:50 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:38:50 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:38:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:38:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:50 devstack sudo[107957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:38:50 devstack sudo[107957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:50 devstack sudo[107950]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-d41da2a0-d1ec-4c78-b42e-2cf38a2cceb5 tempest-ProjectReaderTests-1679623781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0823c9ba-6bab-4ae2-9211-db6e2793d195 1073741824" returned: 0 in 0.466s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-d41da2a0-d1ec-4c78-b42e-2cf38a2cceb5 tempest-ProjectReaderTests-1679623781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0823c9ba-6bab-4ae2-9211-db6e2793d195 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:50 devstack sudo[107960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0823c9ba-6bab-4ae2-9211-db6e2793d195 Sep 29 18:38:50 devstack sudo[107960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:50 devstack sudo[107957]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:50 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-84360ac0-63bd-45df-8eec-8863ed84134e tempest-ProjectMemberTests-1577701723 None] Acquiring lock "cinder-55ee4de1-1a90-44c0-b0a5-f5548369275f-delete_volume" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:38:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.287s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:50 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:38:50 devstack cinder-volume[86512]: DEBUG oslo_service.periodic_task [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Running periodic task VolumeManager._thread_info {{(pid=86512) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 18:38:50 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] thread count: 29 {{(pid=86512) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 29 18:38:50 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] thread info: [<_MainThread(MainThread, started 135593654804608)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86512) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 29 18:38:50 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-84360ac0-63bd-45df-8eec-8863ed84134e tempest-ProjectMemberTests-1577701723 None] Lock "cinder-55ee4de1-1a90-44c0-b0a5-f5548369275f-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:38:50 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-84360ac0-63bd-45df-8eec-8863ed84134e tempest-ProjectMemberTests-1577701723 None] Acquiring lock "cinder-quobyte-55ee4de1-1a90-44c0-b0a5-f5548369275f" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:38:51 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-84360ac0-63bd-45df-8eec-8863ed84134e tempest-ProjectMemberTests-1577701723 None] Lock "cinder-quobyte-55ee4de1-1a90-44c0-b0a5-f5548369275f" acquired by "delete_volume" :: waited 0.017s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:38:51 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6cf72ad-20b5-4c52-ba98-bfdaaf07fba2]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:38:51 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-84360ac0-63bd-45df-8eec-8863ed84134e tempest-ProjectMemberTests-1577701723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-55ee4de1-1a90-44c0-b0a5-f5548369275f {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:51 devstack sudo[107960]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:51 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-d41da2a0-d1ec-4c78-b42e-2cf38a2cceb5 tempest-ProjectReaderTests-1679623781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0823c9ba-6bab-4ae2-9211-db6e2793d195" returned: 0 in 0.302s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:51 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-d41da2a0-d1ec-4c78-b42e-2cf38a2cceb5 tempest-ProjectReaderTests-1679623781 None] <== create_volume: return (823ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'} {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:38:51 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-d41da2a0-d1ec-4c78-b42e-2cf38a2cceb5 tempest-ProjectReaderTests-1679623781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.826s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:38:51 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d41da2a0-d1ec-4c78-b42e-2cf38a2cceb5 tempest-ProjectReaderTests-1679623781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe808b1d-854c-4430-8e4d-d57904b65500) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0823c9ba-6bab-4ae2-9211-db6e2793d195', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:38:51 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d41da2a0-d1ec-4c78-b42e-2cf38a2cceb5 tempest-ProjectReaderTests-1679623781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee82ca4c-115b-48a7-a65a-ea77997babcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:38:51 devstack sudo[107962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-55ee4de1-1a90-44c0-b0a5-f5548369275f Sep 29 18:38:51 devstack sudo[107962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:51 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-d41da2a0-d1ec-4c78-b42e-2cf38a2cceb5 tempest-ProjectReaderTests-1679623781 None] Volume volume-0823c9ba-6bab-4ae2-9211-db6e2793d195 (0823c9ba-6bab-4ae2-9211-db6e2793d195): created successfully Sep 29 18:38:51 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d41da2a0-d1ec-4c78-b42e-2cf38a2cceb5 tempest-ProjectReaderTests-1679623781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee82ca4c-115b-48a7-a65a-ea77997babcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:38:51 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d41da2a0-d1ec-4c78-b42e-2cf38a2cceb5 tempest-ProjectReaderTests-1679623781 None] Flow 'volume_create_manager' (c3c4b75c-336f-4487-a9a0-011a3dc26e87) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:38:51 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-d41da2a0-d1ec-4c78-b42e-2cf38a2cceb5 tempest-ProjectReaderTests-1679623781 None] Created volume successfully. Sep 29 18:38:51 devstack sudo[107962]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:51 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-84360ac0-63bd-45df-8eec-8863ed84134e tempest-ProjectMemberTests-1577701723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-55ee4de1-1a90-44c0-b0a5-f5548369275f" returned: 0 in 0.387s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:51 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-84360ac0-63bd-45df-8eec-8863ed84134e tempest-ProjectMemberTests-1577701723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-55ee4de1-1a90-44c0-b0a5-f5548369275f {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:51 devstack sudo[107968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-55ee4de1-1a90-44c0-b0a5-f5548369275f Sep 29 18:38:51 devstack sudo[107968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:51 devstack sudo[107968]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:51 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-84360ac0-63bd-45df-8eec-8863ed84134e tempest-ProjectMemberTests-1577701723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-55ee4de1-1a90-44c0-b0a5-f5548369275f" returned: 0 in 0.244s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:51 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-84360ac0-63bd-45df-8eec-8863ed84134e tempest-ProjectMemberTests-1577701723 None] Lock "cinder-quobyte-55ee4de1-1a90-44c0-b0a5-f5548369275f" released by "delete_volume" :: held 0.705s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:38:51 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-84360ac0-63bd-45df-8eec-8863ed84134e tempest-ProjectMemberTests-1577701723 None] Created reservations ['4f843cef-7330-4912-a837-15f9dd968799', '20d1b806-ea52-4f6a-b4e9-c4c293a6c9f6', '323245e7-5790-42c9-a448-d8469a23918c', 'b9ea1350-7a57-4825-879f-b75c9388c329'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:38:51 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-84360ac0-63bd-45df-8eec-8863ed84134e tempest-ProjectMemberTests-1577701723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:38:51 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-84360ac0-63bd-45df-8eec-8863ed84134e tempest-ProjectMemberTests-1577701723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:38:51 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-84360ac0-63bd-45df-8eec-8863ed84134e tempest-ProjectMemberTests-1577701723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:38:51 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-84360ac0-63bd-45df-8eec-8863ed84134e tempest-ProjectMemberTests-1577701723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:38:51 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-84360ac0-63bd-45df-8eec-8863ed84134e tempest-ProjectMemberTests-1577701723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:38:51 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-84360ac0-63bd-45df-8eec-8863ed84134e tempest-ProjectMemberTests-1577701723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:51 devstack sudo[107971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:38:51 devstack sudo[107971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:52 devstack sudo[107971]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:52 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-84360ac0-63bd-45df-8eec-8863ed84134e tempest-ProjectMemberTests-1577701723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.265s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:52 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-84360ac0-63bd-45df-8eec-8863ed84134e tempest-ProjectMemberTests-1577701723 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:38:52 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-84360ac0-63bd-45df-8eec-8863ed84134e tempest-ProjectMemberTests-1577701723 None] Deleted volume successfully. Sep 29 18:38:52 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-84360ac0-63bd-45df-8eec-8863ed84134e tempest-ProjectMemberTests-1577701723 None] Lock "cinder-55ee4de1-1a90-44c0-b0a5-f5548369275f-delete_volume" released by "delete_volume" :: held 1.169s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:38:52 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-3a54a8f9-f57f-4996-b48f-9128f19ac564 tempest-ProjectReaderTests-1679623781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:38:52 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-3a54a8f9-f57f-4996-b48f-9128f19ac564 tempest-ProjectReaderTests-1679623781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:38:52 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-1454c3f6-bdd9-4cac-a476-435b3fbce0fa tempest-ProjectMemberTests-1577701723 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86512) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:38:52 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-1454c3f6-bdd9-4cac-a476-435b3fbce0fa tempest-ProjectMemberTests-1577701723 None] Flow 'volume_create_manager' (8639bc0e-6120-4cdd-a72b-64153dca6d0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:38:52 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-1454c3f6-bdd9-4cac-a476-435b3fbce0fa tempest-ProjectMemberTests-1577701723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87c11898-dbeb-45c7-bf24-c00e44307338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:38:52 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-3a54a8f9-f57f-4996-b48f-9128f19ac564 tempest-ProjectReaderTests-1679623781 None] Creating offline snapshot 207f5701-3005-43d8-b573-fb3ded2c53c2 of volume 0823c9ba-6bab-4ae2-9211-db6e2793d195 {{(pid=86512) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 18:38:52 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-1454c3f6-bdd9-4cac-a476-435b3fbce0fa tempest-ProjectMemberTests-1577701723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87c11898-dbeb-45c7-bf24-c00e44307338) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:38:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1306684040',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46db7476-a06b-479c-acdd-78972325a39f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc5a83cdd1e34b24adfa899bf4067f0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:38:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:38:53Z,use_quota=True,user_id='671a2611e03549f08f718ec6a8379db0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:38:52 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-1454c3f6-bdd9-4cac-a476-435b3fbce0fa tempest-ProjectMemberTests-1577701723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78390f32-c3eb-4944-8e40-d41440721ee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:38:52 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-1454c3f6-bdd9-4cac-a476-435b3fbce0fa tempest-ProjectMemberTests-1577701723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78390f32-c3eb-4944-8e40-d41440721ee6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:38:52 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-1454c3f6-bdd9-4cac-a476-435b3fbce0fa tempest-ProjectMemberTests-1577701723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6dd5e66-2554-42c8-b049-1083bfbdf4a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:38:52 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-1454c3f6-bdd9-4cac-a476-435b3fbce0fa tempest-ProjectMemberTests-1577701723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6dd5e66-2554-42c8-b049-1083bfbdf4a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46db7476-a06b-479c-acdd-78972325a39f', 'volume_name': 'volume-46db7476-a06b-479c-acdd-78972325a39f', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:38:52 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-1454c3f6-bdd9-4cac-a476-435b3fbce0fa tempest-ProjectMemberTests-1577701723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7afce3e-13b4-4d6f-9e19-cb923f8045bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:38:52 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-1454c3f6-bdd9-4cac-a476-435b3fbce0fa tempest-ProjectMemberTests-1577701723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7afce3e-13b4-4d6f-9e19-cb923f8045bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:38:52 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-1454c3f6-bdd9-4cac-a476-435b3fbce0fa tempest-ProjectMemberTests-1577701723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b782979-c919-4f43-bcb6-863852af582b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:38:52 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-1454c3f6-bdd9-4cac-a476-435b3fbce0fa tempest-ProjectMemberTests-1577701723 None] Volume 46db7476-a06b-479c-acdd-78972325a39f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46db7476-a06b-479c-acdd-78972325a39f', 'volume_size': 1} Sep 29 18:38:52 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-1454c3f6-bdd9-4cac-a476-435b3fbce0fa tempest-ProjectMemberTests-1577701723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:38:52 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa8f317e-58dd-4abb-af68-edf284481115]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:38:52 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-3a54a8f9-f57f-4996-b48f-9128f19ac564 tempest-ProjectReaderTests-1679623781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0823c9ba-6bab-4ae2-9211-db6e2793d195 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:52 devstack sudo[107974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0823c9ba-6bab-4ae2-9211-db6e2793d195 Sep 29 18:38:52 devstack sudo[107974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:53 devstack sudo[107974]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:53 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-3a54a8f9-f57f-4996-b48f-9128f19ac564 tempest-ProjectReaderTests-1679623781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0823c9ba-6bab-4ae2-9211-db6e2793d195" returned: 0 in 0.363s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:53 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-3a54a8f9-f57f-4996-b48f-9128f19ac564 tempest-ProjectReaderTests-1679623781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0823c9ba-6bab-4ae2-9211-db6e2793d195,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0823c9ba-6bab-4ae2-9211-db6e2793d195.207f5701-3005-43d8-b573-fb3ded2c53c2 1G {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:53 devstack sudo[107979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0823c9ba-6bab-4ae2-9211-db6e2793d195,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0823c9ba-6bab-4ae2-9211-db6e2793d195.207f5701-3005-43d8-b573-fb3ded2c53c2 1G Sep 29 18:38:53 devstack sudo[107979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:53 devstack sudo[107979]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:53 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-3a54a8f9-f57f-4996-b48f-9128f19ac564 tempest-ProjectReaderTests-1679623781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0823c9ba-6bab-4ae2-9211-db6e2793d195,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0823c9ba-6bab-4ae2-9211-db6e2793d195.207f5701-3005-43d8-b573-fb3ded2c53c2 1G" returned: 0 in 0.401s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:53 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-3a54a8f9-f57f-4996-b48f-9128f19ac564 tempest-ProjectReaderTests-1679623781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0823c9ba-6bab-4ae2-9211-db6e2793d195 -F qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0823c9ba-6bab-4ae2-9211-db6e2793d195.207f5701-3005-43d8-b573-fb3ded2c53c2 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:53 devstack sudo[107985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0823c9ba-6bab-4ae2-9211-db6e2793d195 -F qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0823c9ba-6bab-4ae2-9211-db6e2793d195.207f5701-3005-43d8-b573-fb3ded2c53c2 Sep 29 18:38:53 devstack sudo[107985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:53 devstack sudo[107985]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:53 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-3a54a8f9-f57f-4996-b48f-9128f19ac564 tempest-ProjectReaderTests-1679623781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0823c9ba-6bab-4ae2-9211-db6e2793d195 -F qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0823c9ba-6bab-4ae2-9211-db6e2793d195.207f5701-3005-43d8-b573-fb3ded2c53c2" returned: 0 in 0.286s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:53 devstack cinder-volume[86512]: WARNING cinder.volume.drivers.remotefs [None req-3a54a8f9-f57f-4996-b48f-9128f19ac564 tempest-ProjectReaderTests-1679623781 None] /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0823c9ba-6bab-4ae2-9211-db6e2793d195.207f5701-3005-43d8-b573-fb3ded2c53c2 is being set with open permissions: ugo+rw Sep 29 18:38:53 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-3a54a8f9-f57f-4996-b48f-9128f19ac564 tempest-ProjectReaderTests-1679623781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0823c9ba-6bab-4ae2-9211-db6e2793d195.207f5701-3005-43d8-b573-fb3ded2c53c2 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:53 devstack sudo[107990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0823c9ba-6bab-4ae2-9211-db6e2793d195.207f5701-3005-43d8-b573-fb3ded2c53c2 Sep 29 18:38:53 devstack sudo[107990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:53 devstack sudo[107990]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:54 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-3a54a8f9-f57f-4996-b48f-9128f19ac564 tempest-ProjectReaderTests-1679623781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0823c9ba-6bab-4ae2-9211-db6e2793d195.207f5701-3005-43d8-b573-fb3ded2c53c2" returned: 0 in 0.236s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:54 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-3a54a8f9-f57f-4996-b48f-9128f19ac564 tempest-ProjectReaderTests-1679623781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0823c9ba-6bab-4ae2-9211-db6e2793d195.info {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:54 devstack sudo[107993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0823c9ba-6bab-4ae2-9211-db6e2793d195.info Sep 29 18:38:54 devstack sudo[107993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:54 devstack sudo[107993]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:54 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-3a54a8f9-f57f-4996-b48f-9128f19ac564 tempest-ProjectReaderTests-1679623781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0823c9ba-6bab-4ae2-9211-db6e2793d195.info" returned: 0 in 0.242s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:54 devstack cinder-volume[86512]: WARNING cinder.volume.drivers.remotefs [None req-3a54a8f9-f57f-4996-b48f-9128f19ac564 tempest-ProjectReaderTests-1679623781 None] /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0823c9ba-6bab-4ae2-9211-db6e2793d195.info is being set with open permissions: ugo+rw Sep 29 18:38:54 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-3a54a8f9-f57f-4996-b48f-9128f19ac564 tempest-ProjectReaderTests-1679623781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0823c9ba-6bab-4ae2-9211-db6e2793d195.info {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:54 devstack sudo[107997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0823c9ba-6bab-4ae2-9211-db6e2793d195.info Sep 29 18:38:54 devstack sudo[107997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:54 devstack sudo[107997]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:54 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-3a54a8f9-f57f-4996-b48f-9128f19ac564 tempest-ProjectReaderTests-1679623781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0823c9ba-6bab-4ae2-9211-db6e2793d195.info" returned: 0 in 0.232s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:54 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-3a54a8f9-f57f-4996-b48f-9128f19ac564 tempest-ProjectReaderTests-1679623781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.925s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:38:54 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-1454c3f6-bdd9-4cac-a476-435b3fbce0fa tempest-ProjectMemberTests-1577701723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.830s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:38:54 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-1454c3f6-bdd9-4cac-a476-435b3fbce0fa tempest-ProjectMemberTests-1577701723 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:38:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1306684040',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46db7476-a06b-479c-acdd-78972325a39f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc5a83cdd1e34b24adfa899bf4067f0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:38:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:38:53Z,use_quota=True,user_id='671a2611e03549f08f718ec6a8379db0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)}" {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:38:54 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-1454c3f6-bdd9-4cac-a476-435b3fbce0fa tempest-ProjectMemberTests-1577701723 None] Creating volume 46db7476-a06b-479c-acdd-78972325a39f {{(pid=86512) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:38:54 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-1454c3f6-bdd9-4cac-a476-435b3fbce0fa tempest-ProjectMemberTests-1577701723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:38:54 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-1454c3f6-bdd9-4cac-a476-435b3fbce0fa tempest-ProjectMemberTests-1577701723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:38:54 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-1454c3f6-bdd9-4cac-a476-435b3fbce0fa tempest-ProjectMemberTests-1577701723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:38:54 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-1454c3f6-bdd9-4cac-a476-435b3fbce0fa tempest-ProjectMemberTests-1577701723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:38:54 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-1454c3f6-bdd9-4cac-a476-435b3fbce0fa tempest-ProjectMemberTests-1577701723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:38:54 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-1454c3f6-bdd9-4cac-a476-435b3fbce0fa tempest-ProjectMemberTests-1577701723 None] Selected osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 as target Quobyte volume. {{(pid=86512) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:38:54 devstack cinder-volume[86512]: INFO cinder.volume.drivers.remotefs [None req-1454c3f6-bdd9-4cac-a476-435b3fbce0fa tempest-ProjectMemberTests-1577701723 None] casted to osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 Sep 29 18:38:54 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-1454c3f6-bdd9-4cac-a476-435b3fbce0fa tempest-ProjectMemberTests-1577701723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-46db7476-a06b-479c-acdd-78972325a39f 1073741824 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:54 devstack sudo[108000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-46db7476-a06b-479c-acdd-78972325a39f 1073741824 Sep 29 18:38:54 devstack sudo[108000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:54 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-3a54a8f9-f57f-4996-b48f-9128f19ac564 tempest-ProjectReaderTests-1679623781 None] Create snapshot completed successfully Sep 29 18:38:54 devstack sudo[108000]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:54 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-1454c3f6-bdd9-4cac-a476-435b3fbce0fa tempest-ProjectMemberTests-1577701723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-46db7476-a06b-479c-acdd-78972325a39f 1073741824" returned: 0 in 0.404s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:54 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-1454c3f6-bdd9-4cac-a476-435b3fbce0fa tempest-ProjectMemberTests-1577701723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-46db7476-a06b-479c-acdd-78972325a39f {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:55 devstack sudo[108005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-46db7476-a06b-479c-acdd-78972325a39f Sep 29 18:38:55 devstack sudo[108005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:55 devstack sudo[108005]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:55 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-1454c3f6-bdd9-4cac-a476-435b3fbce0fa tempest-ProjectMemberTests-1577701723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-46db7476-a06b-479c-acdd-78972325a39f" returned: 0 in 0.239s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:55 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-1454c3f6-bdd9-4cac-a476-435b3fbce0fa tempest-ProjectMemberTests-1577701723 None] <== create_volume: return (680ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'} {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:38:55 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-1454c3f6-bdd9-4cac-a476-435b3fbce0fa tempest-ProjectMemberTests-1577701723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.685s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:38:55 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-1454c3f6-bdd9-4cac-a476-435b3fbce0fa tempest-ProjectMemberTests-1577701723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b782979-c919-4f43-bcb6-863852af582b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46db7476-a06b-479c-acdd-78972325a39f', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:38:55 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-1454c3f6-bdd9-4cac-a476-435b3fbce0fa tempest-ProjectMemberTests-1577701723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d21d5845-b0f9-425f-b78e-49a3a524333f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:38:55 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-1454c3f6-bdd9-4cac-a476-435b3fbce0fa tempest-ProjectMemberTests-1577701723 None] Volume volume-46db7476-a06b-479c-acdd-78972325a39f (46db7476-a06b-479c-acdd-78972325a39f): created successfully Sep 29 18:38:55 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-1454c3f6-bdd9-4cac-a476-435b3fbce0fa tempest-ProjectMemberTests-1577701723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d21d5845-b0f9-425f-b78e-49a3a524333f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:38:55 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-1454c3f6-bdd9-4cac-a476-435b3fbce0fa tempest-ProjectMemberTests-1577701723 None] Flow 'volume_create_manager' (8639bc0e-6120-4cdd-a72b-64153dca6d0d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:38:55 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-1454c3f6-bdd9-4cac-a476-435b3fbce0fa tempest-ProjectMemberTests-1577701723 None] Created volume successfully. Sep 29 18:38:55 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-82a08211-4eca-401d-964e-d2884ee9880c tempest-ProjectReaderTests-1679623781 None] Acquiring lock "cinder-207f5701-3005-43d8-b573-fb3ded2c53c2-delete_snapshot" by "delete_snapshot" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:38:55 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-82a08211-4eca-401d-964e-d2884ee9880c tempest-ProjectReaderTests-1679623781 None] Lock "cinder-207f5701-3005-43d8-b573-fb3ded2c53c2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:38:55 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-82a08211-4eca-401d-964e-d2884ee9880c tempest-ProjectReaderTests-1679623781 None] Acquiring lock "cinder-quobyte-0823c9ba-6bab-4ae2-9211-db6e2793d195" by "delete_snapshot" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:38:55 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-82a08211-4eca-401d-964e-d2884ee9880c tempest-ProjectReaderTests-1679623781 None] Lock "cinder-quobyte-0823c9ba-6bab-4ae2-9211-db6e2793d195" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:38:55 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-82a08211-4eca-401d-964e-d2884ee9880c tempest-ProjectReaderTests-1679623781 None] Acquiring lock "cinder-quobyte-207f5701-3005-43d8-b573-fb3ded2c53c2" by "_delete_snapshot" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:38:55 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-82a08211-4eca-401d-964e-d2884ee9880c tempest-ProjectReaderTests-1679623781 None] Lock "cinder-quobyte-207f5701-3005-43d8-b573-fb3ded2c53c2" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:38:55 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-82a08211-4eca-401d-964e-d2884ee9880c tempest-ProjectReaderTests-1679623781 None] Deleting offline snapshot 207f5701-3005-43d8-b573-fb3ded2c53c2 of volume 0823c9ba-6bab-4ae2-9211-db6e2793d195 {{(pid=86512) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 18:38:55 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-82a08211-4eca-401d-964e-d2884ee9880c tempest-ProjectReaderTests-1679623781 None] snapshot_file for this snap is: volume-0823c9ba-6bab-4ae2-9211-db6e2793d195.207f5701-3005-43d8-b573-fb3ded2c53c2 {{(pid=86512) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 18:38:55 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[fda20e09-a260-4c8e-a506-937e06059f97]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:38:55 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-82a08211-4eca-401d-964e-d2884ee9880c tempest-ProjectReaderTests-1679623781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0823c9ba-6bab-4ae2-9211-db6e2793d195.207f5701-3005-43d8-b573-fb3ded2c53c2 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:55 devstack sudo[108008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0823c9ba-6bab-4ae2-9211-db6e2793d195.207f5701-3005-43d8-b573-fb3ded2c53c2 Sep 29 18:38:55 devstack sudo[108008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:55 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-01a18fc2-2008-40cb-8a5d-40a1e2d31d3d tempest-ProjectMemberTests-1577701723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:38:55 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-01a18fc2-2008-40cb-8a5d-40a1e2d31d3d tempest-ProjectMemberTests-1577701723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:38:55 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-01a18fc2-2008-40cb-8a5d-40a1e2d31d3d tempest-ProjectMemberTests-1577701723 None] Creating offline snapshot b365394c-7aa2-454d-bece-52ada558a1df of volume 46db7476-a06b-479c-acdd-78972325a39f {{(pid=86512) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 18:38:55 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6bc861f-3751-411e-b065-93de8d8b332c]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:38:55 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-01a18fc2-2008-40cb-8a5d-40a1e2d31d3d tempest-ProjectMemberTests-1577701723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-46db7476-a06b-479c-acdd-78972325a39f {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:56 devstack sudo[108010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-46db7476-a06b-479c-acdd-78972325a39f Sep 29 18:38:56 devstack sudo[108010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:56 devstack sudo[108008]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:56 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-82a08211-4eca-401d-964e-d2884ee9880c tempest-ProjectReaderTests-1679623781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0823c9ba-6bab-4ae2-9211-db6e2793d195.207f5701-3005-43d8-b573-fb3ded2c53c2" returned: 0 in 0.363s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:56 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-82a08211-4eca-401d-964e-d2884ee9880c tempest-ProjectReaderTests-1679623781 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0823c9ba-6bab-4ae2-9211-db6e2793d195(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86512) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 18:38:56 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[ced7209c-11b4-40ff-b28e-817509a1d4e9]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:38:56 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-82a08211-4eca-401d-964e-d2884ee9880c tempest-ProjectReaderTests-1679623781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0823c9ba-6bab-4ae2-9211-db6e2793d195 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:56 devstack sudo[108015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0823c9ba-6bab-4ae2-9211-db6e2793d195 Sep 29 18:38:56 devstack sudo[108015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:56 devstack sudo[108010]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:56 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-01a18fc2-2008-40cb-8a5d-40a1e2d31d3d tempest-ProjectMemberTests-1577701723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-46db7476-a06b-479c-acdd-78972325a39f" returned: 0 in 0.367s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:56 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-01a18fc2-2008-40cb-8a5d-40a1e2d31d3d tempest-ProjectMemberTests-1577701723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-46db7476-a06b-479c-acdd-78972325a39f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-46db7476-a06b-479c-acdd-78972325a39f.b365394c-7aa2-454d-bece-52ada558a1df 1G {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:56 devstack sudo[108020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-46db7476-a06b-479c-acdd-78972325a39f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-46db7476-a06b-479c-acdd-78972325a39f.b365394c-7aa2-454d-bece-52ada558a1df 1G Sep 29 18:38:56 devstack sudo[108020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:56 devstack sudo[108015]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:56 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-82a08211-4eca-401d-964e-d2884ee9880c tempest-ProjectReaderTests-1679623781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0823c9ba-6bab-4ae2-9211-db6e2793d195" returned: 0 in 0.402s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:56 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-82a08211-4eca-401d-964e-d2884ee9880c tempest-ProjectReaderTests-1679623781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0823c9ba-6bab-4ae2-9211-db6e2793d195.207f5701-3005-43d8-b573-fb3ded2c53c2 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:56 devstack sudo[108031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0823c9ba-6bab-4ae2-9211-db6e2793d195.207f5701-3005-43d8-b573-fb3ded2c53c2 Sep 29 18:38:56 devstack sudo[108031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:56 devstack sudo[108020]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:56 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-01a18fc2-2008-40cb-8a5d-40a1e2d31d3d tempest-ProjectMemberTests-1577701723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-46db7476-a06b-479c-acdd-78972325a39f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-46db7476-a06b-479c-acdd-78972325a39f.b365394c-7aa2-454d-bece-52ada558a1df 1G" returned: 0 in 0.411s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:56 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-01a18fc2-2008-40cb-8a5d-40a1e2d31d3d tempest-ProjectMemberTests-1577701723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46db7476-a06b-479c-acdd-78972325a39f -F qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-46db7476-a06b-479c-acdd-78972325a39f.b365394c-7aa2-454d-bece-52ada558a1df {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:56 devstack sudo[108036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46db7476-a06b-479c-acdd-78972325a39f -F qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-46db7476-a06b-479c-acdd-78972325a39f.b365394c-7aa2-454d-bece-52ada558a1df Sep 29 18:38:56 devstack sudo[108036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:56 devstack sudo[108031]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:56 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-82a08211-4eca-401d-964e-d2884ee9880c tempest-ProjectReaderTests-1679623781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0823c9ba-6bab-4ae2-9211-db6e2793d195.207f5701-3005-43d8-b573-fb3ded2c53c2" returned: 0 in 0.360s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:56 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-82a08211-4eca-401d-964e-d2884ee9880c tempest-ProjectReaderTests-1679623781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0823c9ba-6bab-4ae2-9211-db6e2793d195.207f5701-3005-43d8-b573-fb3ded2c53c2 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:56 devstack sudo[108042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0823c9ba-6bab-4ae2-9211-db6e2793d195.207f5701-3005-43d8-b573-fb3ded2c53c2 Sep 29 18:38:56 devstack sudo[108042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:56 devstack sudo[108036]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:56 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-01a18fc2-2008-40cb-8a5d-40a1e2d31d3d tempest-ProjectMemberTests-1577701723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46db7476-a06b-479c-acdd-78972325a39f -F qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-46db7476-a06b-479c-acdd-78972325a39f.b365394c-7aa2-454d-bece-52ada558a1df" returned: 0 in 0.307s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:56 devstack cinder-volume[86512]: WARNING cinder.volume.drivers.remotefs [None req-01a18fc2-2008-40cb-8a5d-40a1e2d31d3d tempest-ProjectMemberTests-1577701723 None] /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-46db7476-a06b-479c-acdd-78972325a39f.b365394c-7aa2-454d-bece-52ada558a1df is being set with open permissions: ugo+rw Sep 29 18:38:56 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-01a18fc2-2008-40cb-8a5d-40a1e2d31d3d tempest-ProjectMemberTests-1577701723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-46db7476-a06b-479c-acdd-78972325a39f.b365394c-7aa2-454d-bece-52ada558a1df {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:57 devstack sudo[108046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-46db7476-a06b-479c-acdd-78972325a39f.b365394c-7aa2-454d-bece-52ada558a1df Sep 29 18:38:57 devstack sudo[108046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:57 devstack sudo[108042]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:57 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-82a08211-4eca-401d-964e-d2884ee9880c tempest-ProjectReaderTests-1679623781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0823c9ba-6bab-4ae2-9211-db6e2793d195.207f5701-3005-43d8-b573-fb3ded2c53c2" returned: 0 in 0.250s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:57 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-82a08211-4eca-401d-964e-d2884ee9880c tempest-ProjectReaderTests-1679623781 None] Lock "cinder-quobyte-207f5701-3005-43d8-b573-fb3ded2c53c2" released by "_delete_snapshot" :: held 1.485s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:38:57 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-82a08211-4eca-401d-964e-d2884ee9880c tempest-ProjectReaderTests-1679623781 None] Lock "cinder-quobyte-0823c9ba-6bab-4ae2-9211-db6e2793d195" released by "delete_snapshot" :: held 1.512s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:38:57 devstack sudo[108046]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:57 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-01a18fc2-2008-40cb-8a5d-40a1e2d31d3d tempest-ProjectMemberTests-1577701723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-46db7476-a06b-479c-acdd-78972325a39f.b365394c-7aa2-454d-bece-52ada558a1df" returned: 0 in 0.257s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:57 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-82a08211-4eca-401d-964e-d2884ee9880c tempest-ProjectReaderTests-1679623781 None] Created reservations ['3e617b82-c521-4f5e-9640-b8a9041c0e4d', 'e27d47ba-4973-4dd7-a4ca-a0a20eb0e724', '543493e5-d6ad-4bdd-9fc7-858383bac83d', '1958bf8c-2b8d-4811-80d0-434e5564ee08'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:38:57 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-01a18fc2-2008-40cb-8a5d-40a1e2d31d3d tempest-ProjectMemberTests-1577701723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-46db7476-a06b-479c-acdd-78972325a39f.info {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:57 devstack sudo[108050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-46db7476-a06b-479c-acdd-78972325a39f.info Sep 29 18:38:57 devstack sudo[108050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:57 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-82a08211-4eca-401d-964e-d2884ee9880c tempest-ProjectReaderTests-1679623781 None] Delete snapshot completed successfully. Sep 29 18:38:57 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-82a08211-4eca-401d-964e-d2884ee9880c tempest-ProjectReaderTests-1679623781 None] Lock "cinder-207f5701-3005-43d8-b573-fb3ded2c53c2-delete_snapshot" released by "delete_snapshot" :: held 1.678s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:38:57 devstack sudo[108050]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:57 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-01a18fc2-2008-40cb-8a5d-40a1e2d31d3d tempest-ProjectMemberTests-1577701723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-46db7476-a06b-479c-acdd-78972325a39f.info" returned: 0 in 0.232s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:57 devstack cinder-volume[86512]: WARNING cinder.volume.drivers.remotefs [None req-01a18fc2-2008-40cb-8a5d-40a1e2d31d3d tempest-ProjectMemberTests-1577701723 None] /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-46db7476-a06b-479c-acdd-78972325a39f.info is being set with open permissions: ugo+rw Sep 29 18:38:57 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-01a18fc2-2008-40cb-8a5d-40a1e2d31d3d tempest-ProjectMemberTests-1577701723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-46db7476-a06b-479c-acdd-78972325a39f.info {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:57 devstack sudo[108053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-46db7476-a06b-479c-acdd-78972325a39f.info Sep 29 18:38:57 devstack sudo[108053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:57 devstack sudo[108053]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:57 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-01a18fc2-2008-40cb-8a5d-40a1e2d31d3d tempest-ProjectMemberTests-1577701723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-46db7476-a06b-479c-acdd-78972325a39f.info" returned: 0 in 0.229s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:57 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-01a18fc2-2008-40cb-8a5d-40a1e2d31d3d tempest-ProjectMemberTests-1577701723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.900s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:38:57 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-01a18fc2-2008-40cb-8a5d-40a1e2d31d3d tempest-ProjectMemberTests-1577701723 None] Create snapshot completed successfully Sep 29 18:38:57 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-c7a640b7-d7ca-4bce-a19b-f697e7685441 tempest-ProjectReaderTests-1679623781 None] Acquiring lock "cinder-0823c9ba-6bab-4ae2-9211-db6e2793d195-delete_volume" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:38:57 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-c7a640b7-d7ca-4bce-a19b-f697e7685441 tempest-ProjectReaderTests-1679623781 None] Lock "cinder-0823c9ba-6bab-4ae2-9211-db6e2793d195-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:38:57 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-c7a640b7-d7ca-4bce-a19b-f697e7685441 tempest-ProjectReaderTests-1679623781 None] Acquiring lock "cinder-quobyte-0823c9ba-6bab-4ae2-9211-db6e2793d195" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:38:57 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-c7a640b7-d7ca-4bce-a19b-f697e7685441 tempest-ProjectReaderTests-1679623781 None] Lock "cinder-quobyte-0823c9ba-6bab-4ae2-9211-db6e2793d195" acquired by "delete_volume" :: waited 0.021s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:38:57 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3b84dc3-55b9-4190-a718-96113de0fcda]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:38:57 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-c7a640b7-d7ca-4bce-a19b-f697e7685441 tempest-ProjectReaderTests-1679623781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0823c9ba-6bab-4ae2-9211-db6e2793d195 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:57 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-b3fddb06-255e-41d3-87e9-994ff8fe33e0 tempest-ProjectMemberTests-1577701723 None] Acquiring lock "cinder-b365394c-7aa2-454d-bece-52ada558a1df-delete_snapshot" by "delete_snapshot" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:38:57 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-b3fddb06-255e-41d3-87e9-994ff8fe33e0 tempest-ProjectMemberTests-1577701723 None] Lock "cinder-b365394c-7aa2-454d-bece-52ada558a1df-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:38:57 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-b3fddb06-255e-41d3-87e9-994ff8fe33e0 tempest-ProjectMemberTests-1577701723 None] Acquiring lock "cinder-quobyte-46db7476-a06b-479c-acdd-78972325a39f" by "delete_snapshot" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:38:57 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-b3fddb06-255e-41d3-87e9-994ff8fe33e0 tempest-ProjectMemberTests-1577701723 None] Lock "cinder-quobyte-46db7476-a06b-479c-acdd-78972325a39f" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:38:57 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-b3fddb06-255e-41d3-87e9-994ff8fe33e0 tempest-ProjectMemberTests-1577701723 None] Acquiring lock "cinder-quobyte-b365394c-7aa2-454d-bece-52ada558a1df" by "_delete_snapshot" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:38:58 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-b3fddb06-255e-41d3-87e9-994ff8fe33e0 tempest-ProjectMemberTests-1577701723 None] Lock "cinder-quobyte-b365394c-7aa2-454d-bece-52ada558a1df" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:38:58 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-b3fddb06-255e-41d3-87e9-994ff8fe33e0 tempest-ProjectMemberTests-1577701723 None] Deleting offline snapshot b365394c-7aa2-454d-bece-52ada558a1df of volume 46db7476-a06b-479c-acdd-78972325a39f {{(pid=86512) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 18:38:58 devstack sudo[108056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0823c9ba-6bab-4ae2-9211-db6e2793d195 Sep 29 18:38:58 devstack sudo[108056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:58 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-b3fddb06-255e-41d3-87e9-994ff8fe33e0 tempest-ProjectMemberTests-1577701723 None] snapshot_file for this snap is: volume-46db7476-a06b-479c-acdd-78972325a39f.b365394c-7aa2-454d-bece-52ada558a1df {{(pid=86512) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 18:38:58 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aa266cd-244f-495a-b7bb-628477518001]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:38:58 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-b3fddb06-255e-41d3-87e9-994ff8fe33e0 tempest-ProjectMemberTests-1577701723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-46db7476-a06b-479c-acdd-78972325a39f.b365394c-7aa2-454d-bece-52ada558a1df {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:58 devstack sudo[108058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-46db7476-a06b-479c-acdd-78972325a39f.b365394c-7aa2-454d-bece-52ada558a1df Sep 29 18:38:58 devstack sudo[108058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:58 devstack sudo[108056]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:58 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-c7a640b7-d7ca-4bce-a19b-f697e7685441 tempest-ProjectReaderTests-1679623781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0823c9ba-6bab-4ae2-9211-db6e2793d195" returned: 0 in 0.362s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:58 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-c7a640b7-d7ca-4bce-a19b-f697e7685441 tempest-ProjectReaderTests-1679623781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0823c9ba-6bab-4ae2-9211-db6e2793d195 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:58 devstack sudo[108063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0823c9ba-6bab-4ae2-9211-db6e2793d195 Sep 29 18:38:58 devstack sudo[108063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:58 devstack sudo[108058]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:58 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-b3fddb06-255e-41d3-87e9-994ff8fe33e0 tempest-ProjectMemberTests-1577701723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-46db7476-a06b-479c-acdd-78972325a39f.b365394c-7aa2-454d-bece-52ada558a1df" returned: 0 in 0.364s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:58 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-b3fddb06-255e-41d3-87e9-994ff8fe33e0 tempest-ProjectMemberTests-1577701723 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-46db7476-a06b-479c-acdd-78972325a39f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86512) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 18:38:58 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cd0a104-4fad-4c9a-afcc-bb1acce3ed8c]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:38:58 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-b3fddb06-255e-41d3-87e9-994ff8fe33e0 tempest-ProjectMemberTests-1577701723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-46db7476-a06b-479c-acdd-78972325a39f {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:58 devstack sudo[108063]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:58 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-c7a640b7-d7ca-4bce-a19b-f697e7685441 tempest-ProjectReaderTests-1679623781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-0823c9ba-6bab-4ae2-9211-db6e2793d195" returned: 0 in 0.258s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:58 devstack sudo[108068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-46db7476-a06b-479c-acdd-78972325a39f Sep 29 18:38:58 devstack sudo[108068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:58 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-c7a640b7-d7ca-4bce-a19b-f697e7685441 tempest-ProjectReaderTests-1679623781 None] Lock "cinder-quobyte-0823c9ba-6bab-4ae2-9211-db6e2793d195" released by "delete_volume" :: held 0.692s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:38:58 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-c7a640b7-d7ca-4bce-a19b-f697e7685441 tempest-ProjectReaderTests-1679623781 None] Created reservations ['aec4e9c6-58d3-47ca-8842-fbd95e304c0d', 'c647bd83-98bb-4945-8506-7c9bc4dd512d', 'c16bb4f9-6beb-4582-b9ea-19d42c0bb79c', 'f24baa9a-81db-43c0-9d51-4c3e2bea74f6'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:38:58 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-c7a640b7-d7ca-4bce-a19b-f697e7685441 tempest-ProjectReaderTests-1679623781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:38:58 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-c7a640b7-d7ca-4bce-a19b-f697e7685441 tempest-ProjectReaderTests-1679623781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:38:58 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-c7a640b7-d7ca-4bce-a19b-f697e7685441 tempest-ProjectReaderTests-1679623781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:38:58 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-c7a640b7-d7ca-4bce-a19b-f697e7685441 tempest-ProjectReaderTests-1679623781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:38:58 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-c7a640b7-d7ca-4bce-a19b-f697e7685441 tempest-ProjectReaderTests-1679623781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:38:58 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-c7a640b7-d7ca-4bce-a19b-f697e7685441 tempest-ProjectReaderTests-1679623781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:58 devstack sudo[108071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:38:58 devstack sudo[108071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:58 devstack sudo[108068]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:58 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-b3fddb06-255e-41d3-87e9-994ff8fe33e0 tempest-ProjectMemberTests-1577701723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-46db7476-a06b-479c-acdd-78972325a39f" returned: 0 in 0.357s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:58 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-b3fddb06-255e-41d3-87e9-994ff8fe33e0 tempest-ProjectMemberTests-1577701723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-46db7476-a06b-479c-acdd-78972325a39f.b365394c-7aa2-454d-bece-52ada558a1df {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:58 devstack sudo[108076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-46db7476-a06b-479c-acdd-78972325a39f.b365394c-7aa2-454d-bece-52ada558a1df Sep 29 18:38:58 devstack sudo[108076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:58 devstack sudo[108071]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:58 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-c7a640b7-d7ca-4bce-a19b-f697e7685441 tempest-ProjectReaderTests-1679623781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.245s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:58 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-c7a640b7-d7ca-4bce-a19b-f697e7685441 tempest-ProjectReaderTests-1679623781 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:38:58 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-c7a640b7-d7ca-4bce-a19b-f697e7685441 tempest-ProjectReaderTests-1679623781 None] Deleted volume successfully. Sep 29 18:38:58 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-c7a640b7-d7ca-4bce-a19b-f697e7685441 tempest-ProjectReaderTests-1679623781 None] Lock "cinder-0823c9ba-6bab-4ae2-9211-db6e2793d195-delete_volume" released by "delete_volume" :: held 1.140s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:38:59 devstack sudo[108076]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:59 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-b3fddb06-255e-41d3-87e9-994ff8fe33e0 tempest-ProjectMemberTests-1577701723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-46db7476-a06b-479c-acdd-78972325a39f.b365394c-7aa2-454d-bece-52ada558a1df" returned: 0 in 0.367s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:59 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-b3fddb06-255e-41d3-87e9-994ff8fe33e0 tempest-ProjectMemberTests-1577701723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-46db7476-a06b-479c-acdd-78972325a39f.b365394c-7aa2-454d-bece-52ada558a1df {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:59 devstack sudo[108083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-46db7476-a06b-479c-acdd-78972325a39f.b365394c-7aa2-454d-bece-52ada558a1df Sep 29 18:38:59 devstack sudo[108083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:59 devstack sudo[108083]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:59 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-b3fddb06-255e-41d3-87e9-994ff8fe33e0 tempest-ProjectMemberTests-1577701723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-46db7476-a06b-479c-acdd-78972325a39f.b365394c-7aa2-454d-bece-52ada558a1df" returned: 0 in 0.246s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:59 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-b3fddb06-255e-41d3-87e9-994ff8fe33e0 tempest-ProjectMemberTests-1577701723 None] Lock "cinder-quobyte-b365394c-7aa2-454d-bece-52ada558a1df" released by "_delete_snapshot" :: held 1.453s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:38:59 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-b3fddb06-255e-41d3-87e9-994ff8fe33e0 tempest-ProjectMemberTests-1577701723 None] Lock "cinder-quobyte-46db7476-a06b-479c-acdd-78972325a39f" released by "delete_snapshot" :: held 1.476s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:38:59 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-b3fddb06-255e-41d3-87e9-994ff8fe33e0 tempest-ProjectMemberTests-1577701723 None] Created reservations ['73ea9c61-41d2-431f-a3ec-49c9c9466d8e', 'fc2b0bc3-42b0-4f3a-ac87-2ba4ce334a29', '82c2718c-4f21-4e67-9da7-bf17e12fa2ab', 'ad898f5a-356a-41a5-94c1-3705bffe06e7'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:38:59 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-b3fddb06-255e-41d3-87e9-994ff8fe33e0 tempest-ProjectMemberTests-1577701723 None] Delete snapshot completed successfully. Sep 29 18:38:59 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-b3fddb06-255e-41d3-87e9-994ff8fe33e0 tempest-ProjectMemberTests-1577701723 None] Lock "cinder-b365394c-7aa2-454d-bece-52ada558a1df-delete_snapshot" released by "delete_snapshot" :: held 1.610s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:39:00 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-4105b5fe-b032-4272-a8ad-e467b12983da tempest-ProjectMemberTests-1577701723 None] Acquiring lock "cinder-46db7476-a06b-479c-acdd-78972325a39f-delete_volume" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:39:00 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-4105b5fe-b032-4272-a8ad-e467b12983da tempest-ProjectMemberTests-1577701723 None] Lock "cinder-46db7476-a06b-479c-acdd-78972325a39f-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:39:00 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-4105b5fe-b032-4272-a8ad-e467b12983da tempest-ProjectMemberTests-1577701723 None] Acquiring lock "cinder-quobyte-46db7476-a06b-479c-acdd-78972325a39f" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:39:00 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-4105b5fe-b032-4272-a8ad-e467b12983da tempest-ProjectMemberTests-1577701723 None] Lock "cinder-quobyte-46db7476-a06b-479c-acdd-78972325a39f" acquired by "delete_volume" :: waited 0.019s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:39:00 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc60d9ce-e0e3-4f36-858d-80850c12356f]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:39:00 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-4105b5fe-b032-4272-a8ad-e467b12983da tempest-ProjectMemberTests-1577701723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-46db7476-a06b-479c-acdd-78972325a39f {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:00 devstack sudo[108086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-46db7476-a06b-479c-acdd-78972325a39f Sep 29 18:39:00 devstack sudo[108086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:00 devstack sudo[108086]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:00 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-4105b5fe-b032-4272-a8ad-e467b12983da tempest-ProjectMemberTests-1577701723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-46db7476-a06b-479c-acdd-78972325a39f" returned: 0 in 0.371s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:00 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-4105b5fe-b032-4272-a8ad-e467b12983da tempest-ProjectMemberTests-1577701723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-46db7476-a06b-479c-acdd-78972325a39f {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:00 devstack sudo[108091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-46db7476-a06b-479c-acdd-78972325a39f Sep 29 18:39:00 devstack sudo[108091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:00 devstack sudo[108091]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:00 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-4105b5fe-b032-4272-a8ad-e467b12983da tempest-ProjectMemberTests-1577701723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-46db7476-a06b-479c-acdd-78972325a39f" returned: 0 in 0.246s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:00 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-4105b5fe-b032-4272-a8ad-e467b12983da tempest-ProjectMemberTests-1577701723 None] Lock "cinder-quobyte-46db7476-a06b-479c-acdd-78972325a39f" released by "delete_volume" :: held 0.693s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:39:00 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-4105b5fe-b032-4272-a8ad-e467b12983da tempest-ProjectMemberTests-1577701723 None] Created reservations ['6ce3b413-8b34-494f-87a8-b848e302a9ae', 'a0254f70-da94-44d9-be39-f93ccac1cd26', '2649ea27-5cea-42ba-9948-a00b2288dd5b', 'e02d16a8-707b-4c21-9305-3cb3951be246'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:39:01 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-4105b5fe-b032-4272-a8ad-e467b12983da tempest-ProjectMemberTests-1577701723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:39:01 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-4105b5fe-b032-4272-a8ad-e467b12983da tempest-ProjectMemberTests-1577701723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:39:01 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-4105b5fe-b032-4272-a8ad-e467b12983da tempest-ProjectMemberTests-1577701723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:39:01 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-4105b5fe-b032-4272-a8ad-e467b12983da tempest-ProjectMemberTests-1577701723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:39:01 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-4105b5fe-b032-4272-a8ad-e467b12983da tempest-ProjectMemberTests-1577701723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:39:01 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-4105b5fe-b032-4272-a8ad-e467b12983da tempest-ProjectMemberTests-1577701723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:01 devstack sudo[108094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:39:01 devstack sudo[108094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:01 devstack sudo[108094]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:01 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-4105b5fe-b032-4272-a8ad-e467b12983da tempest-ProjectMemberTests-1577701723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.268s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:01 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-4105b5fe-b032-4272-a8ad-e467b12983da tempest-ProjectMemberTests-1577701723 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:39:01 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-4105b5fe-b032-4272-a8ad-e467b12983da tempest-ProjectMemberTests-1577701723 None] Deleted volume successfully. Sep 29 18:39:01 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-4105b5fe-b032-4272-a8ad-e467b12983da tempest-ProjectMemberTests-1577701723 None] Lock "cinder-46db7476-a06b-479c-acdd-78972325a39f-delete_volume" released by "delete_volume" :: held 1.200s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:39:01 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-a81e0bdc-fb20-4adc-9430-c0d85fb712fd tempest-ProjectMemberTests-1577701723 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86512) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:39:01 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-a81e0bdc-fb20-4adc-9430-c0d85fb712fd tempest-ProjectMemberTests-1577701723 None] Flow 'volume_create_manager' (fc479d06-831c-4433-b2c9-fe7f9074a45f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:39:01 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-a81e0bdc-fb20-4adc-9430-c0d85fb712fd tempest-ProjectMemberTests-1577701723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5332ef5-6452-4598-9a9b-28ea84e867cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:39:01 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-a81e0bdc-fb20-4adc-9430-c0d85fb712fd tempest-ProjectMemberTests-1577701723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5332ef5-6452-4598-9a9b-28ea84e867cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:39:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-18256374',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd08db0c-f41c-4997-b52c-12bed713bb74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc5a83cdd1e34b24adfa899bf4067f0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:39:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:39:02Z,use_quota=True,user_id='671a2611e03549f08f718ec6a8379db0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:39:01 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-a81e0bdc-fb20-4adc-9430-c0d85fb712fd tempest-ProjectMemberTests-1577701723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (856b1f2c-a7d0-4cd4-9966-19be19214288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:39:01 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-a81e0bdc-fb20-4adc-9430-c0d85fb712fd tempest-ProjectMemberTests-1577701723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (856b1f2c-a7d0-4cd4-9966-19be19214288) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:39:01 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-a81e0bdc-fb20-4adc-9430-c0d85fb712fd tempest-ProjectMemberTests-1577701723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5f0841d-e699-468b-b275-f5f9b93723f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:39:01 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-a81e0bdc-fb20-4adc-9430-c0d85fb712fd tempest-ProjectMemberTests-1577701723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5f0841d-e699-468b-b275-f5f9b93723f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd08db0c-f41c-4997-b52c-12bed713bb74', 'volume_name': 'volume-fd08db0c-f41c-4997-b52c-12bed713bb74', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:39:01 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-a81e0bdc-fb20-4adc-9430-c0d85fb712fd tempest-ProjectMemberTests-1577701723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a990a89b-4160-450b-8074-aff37b286d29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:39:01 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-a81e0bdc-fb20-4adc-9430-c0d85fb712fd tempest-ProjectMemberTests-1577701723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a990a89b-4160-450b-8074-aff37b286d29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:39:01 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-a81e0bdc-fb20-4adc-9430-c0d85fb712fd tempest-ProjectMemberTests-1577701723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87e3e9c1-8483-4d36-8df7-e907158caa0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:39:01 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-a81e0bdc-fb20-4adc-9430-c0d85fb712fd tempest-ProjectMemberTests-1577701723 None] Volume fd08db0c-f41c-4997-b52c-12bed713bb74: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd08db0c-f41c-4997-b52c-12bed713bb74', 'volume_size': 1} Sep 29 18:39:01 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-a81e0bdc-fb20-4adc-9430-c0d85fb712fd tempest-ProjectMemberTests-1577701723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:39:01 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-a81e0bdc-fb20-4adc-9430-c0d85fb712fd tempest-ProjectMemberTests-1577701723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:39:01 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-a81e0bdc-fb20-4adc-9430-c0d85fb712fd tempest-ProjectMemberTests-1577701723 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:39:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-18256374',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd08db0c-f41c-4997-b52c-12bed713bb74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc5a83cdd1e34b24adfa899bf4067f0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:39:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:39:02Z,use_quota=True,user_id='671a2611e03549f08f718ec6a8379db0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)}" {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:39:01 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-a81e0bdc-fb20-4adc-9430-c0d85fb712fd tempest-ProjectMemberTests-1577701723 None] Creating volume fd08db0c-f41c-4997-b52c-12bed713bb74 {{(pid=86512) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:39:01 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-a81e0bdc-fb20-4adc-9430-c0d85fb712fd tempest-ProjectMemberTests-1577701723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:39:01 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-a81e0bdc-fb20-4adc-9430-c0d85fb712fd tempest-ProjectMemberTests-1577701723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:39:01 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-a81e0bdc-fb20-4adc-9430-c0d85fb712fd tempest-ProjectMemberTests-1577701723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:39:01 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-a81e0bdc-fb20-4adc-9430-c0d85fb712fd tempest-ProjectMemberTests-1577701723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:39:01 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-a81e0bdc-fb20-4adc-9430-c0d85fb712fd tempest-ProjectMemberTests-1577701723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:39:01 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-a81e0bdc-fb20-4adc-9430-c0d85fb712fd tempest-ProjectMemberTests-1577701723 None] Selected osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 as target Quobyte volume. {{(pid=86512) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:39:01 devstack cinder-volume[86512]: INFO cinder.volume.drivers.remotefs [None req-a81e0bdc-fb20-4adc-9430-c0d85fb712fd tempest-ProjectMemberTests-1577701723 None] casted to osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 Sep 29 18:39:01 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a81e0bdc-fb20-4adc-9430-c0d85fb712fd tempest-ProjectMemberTests-1577701723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fd08db0c-f41c-4997-b52c-12bed713bb74 1073741824 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:01 devstack sudo[108097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fd08db0c-f41c-4997-b52c-12bed713bb74 1073741824 Sep 29 18:39:01 devstack sudo[108097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:02 devstack sudo[108097]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:02 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a81e0bdc-fb20-4adc-9430-c0d85fb712fd tempest-ProjectMemberTests-1577701723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fd08db0c-f41c-4997-b52c-12bed713bb74 1073741824" returned: 0 in 0.466s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:02 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a81e0bdc-fb20-4adc-9430-c0d85fb712fd tempest-ProjectMemberTests-1577701723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fd08db0c-f41c-4997-b52c-12bed713bb74 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:02 devstack sudo[108102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fd08db0c-f41c-4997-b52c-12bed713bb74 Sep 29 18:39:02 devstack sudo[108102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:02 devstack sudo[108102]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:02 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a81e0bdc-fb20-4adc-9430-c0d85fb712fd tempest-ProjectMemberTests-1577701723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fd08db0c-f41c-4997-b52c-12bed713bb74" returned: 0 in 0.231s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:02 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-a81e0bdc-fb20-4adc-9430-c0d85fb712fd tempest-ProjectMemberTests-1577701723 None] <== create_volume: return (737ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'} {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:39:02 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-a81e0bdc-fb20-4adc-9430-c0d85fb712fd tempest-ProjectMemberTests-1577701723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.740s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:39:02 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-a81e0bdc-fb20-4adc-9430-c0d85fb712fd tempest-ProjectMemberTests-1577701723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87e3e9c1-8483-4d36-8df7-e907158caa0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd08db0c-f41c-4997-b52c-12bed713bb74', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:39:02 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-a81e0bdc-fb20-4adc-9430-c0d85fb712fd tempest-ProjectMemberTests-1577701723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40e495a3-e93e-43e2-b442-d8b0265b5d61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:39:02 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-a81e0bdc-fb20-4adc-9430-c0d85fb712fd tempest-ProjectMemberTests-1577701723 None] Volume volume-fd08db0c-f41c-4997-b52c-12bed713bb74 (fd08db0c-f41c-4997-b52c-12bed713bb74): created successfully Sep 29 18:39:02 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-a81e0bdc-fb20-4adc-9430-c0d85fb712fd tempest-ProjectMemberTests-1577701723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40e495a3-e93e-43e2-b442-d8b0265b5d61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:39:02 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-a81e0bdc-fb20-4adc-9430-c0d85fb712fd tempest-ProjectMemberTests-1577701723 None] Flow 'volume_create_manager' (fc479d06-831c-4433-b2c9-fe7f9074a45f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:39:02 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-a81e0bdc-fb20-4adc-9430-c0d85fb712fd tempest-ProjectMemberTests-1577701723 None] Created volume successfully. Sep 29 18:39:02 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-c9d0ad84-d858-4c38-84e5-f7434d49ef14 tempest-ProjectMemberTests-1577701723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:39:02 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-c9d0ad84-d858-4c38-84e5-f7434d49ef14 tempest-ProjectMemberTests-1577701723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:39:02 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-c9d0ad84-d858-4c38-84e5-f7434d49ef14 tempest-ProjectMemberTests-1577701723 None] Creating offline snapshot 92fb88a0-f607-4582-90db-edba2e7ddaa8 of volume fd08db0c-f41c-4997-b52c-12bed713bb74 {{(pid=86512) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 18:39:02 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[15983454-769c-42cb-a0ab-2f1c95737fa3]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:39:02 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-c9d0ad84-d858-4c38-84e5-f7434d49ef14 tempest-ProjectMemberTests-1577701723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fd08db0c-f41c-4997-b52c-12bed713bb74 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:03 devstack sudo[108105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fd08db0c-f41c-4997-b52c-12bed713bb74 Sep 29 18:39:03 devstack sudo[108105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:03 devstack sudo[108105]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:03 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-c9d0ad84-d858-4c38-84e5-f7434d49ef14 tempest-ProjectMemberTests-1577701723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fd08db0c-f41c-4997-b52c-12bed713bb74" returned: 0 in 0.353s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:03 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-c9d0ad84-d858-4c38-84e5-f7434d49ef14 tempest-ProjectMemberTests-1577701723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fd08db0c-f41c-4997-b52c-12bed713bb74,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fd08db0c-f41c-4997-b52c-12bed713bb74.92fb88a0-f607-4582-90db-edba2e7ddaa8 1G {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:03 devstack sudo[108110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fd08db0c-f41c-4997-b52c-12bed713bb74,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fd08db0c-f41c-4997-b52c-12bed713bb74.92fb88a0-f607-4582-90db-edba2e7ddaa8 1G Sep 29 18:39:03 devstack sudo[108110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:03 devstack sudo[108110]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:03 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-c9d0ad84-d858-4c38-84e5-f7434d49ef14 tempest-ProjectMemberTests-1577701723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fd08db0c-f41c-4997-b52c-12bed713bb74,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fd08db0c-f41c-4997-b52c-12bed713bb74.92fb88a0-f607-4582-90db-edba2e7ddaa8 1G" returned: 0 in 0.385s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:03 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-c9d0ad84-d858-4c38-84e5-f7434d49ef14 tempest-ProjectMemberTests-1577701723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd08db0c-f41c-4997-b52c-12bed713bb74 -F qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fd08db0c-f41c-4997-b52c-12bed713bb74.92fb88a0-f607-4582-90db-edba2e7ddaa8 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:03 devstack sudo[108115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd08db0c-f41c-4997-b52c-12bed713bb74 -F qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fd08db0c-f41c-4997-b52c-12bed713bb74.92fb88a0-f607-4582-90db-edba2e7ddaa8 Sep 29 18:39:03 devstack sudo[108115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:03 devstack sudo[108115]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:03 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-c9d0ad84-d858-4c38-84e5-f7434d49ef14 tempest-ProjectMemberTests-1577701723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd08db0c-f41c-4997-b52c-12bed713bb74 -F qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fd08db0c-f41c-4997-b52c-12bed713bb74.92fb88a0-f607-4582-90db-edba2e7ddaa8" returned: 0 in 0.304s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:03 devstack cinder-volume[86512]: WARNING cinder.volume.drivers.remotefs [None req-c9d0ad84-d858-4c38-84e5-f7434d49ef14 tempest-ProjectMemberTests-1577701723 None] /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fd08db0c-f41c-4997-b52c-12bed713bb74.92fb88a0-f607-4582-90db-edba2e7ddaa8 is being set with open permissions: ugo+rw Sep 29 18:39:03 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-c9d0ad84-d858-4c38-84e5-f7434d49ef14 tempest-ProjectMemberTests-1577701723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fd08db0c-f41c-4997-b52c-12bed713bb74.92fb88a0-f607-4582-90db-edba2e7ddaa8 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:04 devstack sudo[108120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fd08db0c-f41c-4997-b52c-12bed713bb74.92fb88a0-f607-4582-90db-edba2e7ddaa8 Sep 29 18:39:04 devstack sudo[108120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:04 devstack sudo[108120]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:04 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-c9d0ad84-d858-4c38-84e5-f7434d49ef14 tempest-ProjectMemberTests-1577701723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fd08db0c-f41c-4997-b52c-12bed713bb74.92fb88a0-f607-4582-90db-edba2e7ddaa8" returned: 0 in 0.233s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:04 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-c9d0ad84-d858-4c38-84e5-f7434d49ef14 tempest-ProjectMemberTests-1577701723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fd08db0c-f41c-4997-b52c-12bed713bb74.info {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:04 devstack sudo[108124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fd08db0c-f41c-4997-b52c-12bed713bb74.info Sep 29 18:39:04 devstack sudo[108124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:04 devstack sudo[108124]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:04 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-c9d0ad84-d858-4c38-84e5-f7434d49ef14 tempest-ProjectMemberTests-1577701723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fd08db0c-f41c-4997-b52c-12bed713bb74.info" returned: 0 in 0.230s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:04 devstack cinder-volume[86512]: WARNING cinder.volume.drivers.remotefs [None req-c9d0ad84-d858-4c38-84e5-f7434d49ef14 tempest-ProjectMemberTests-1577701723 None] /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fd08db0c-f41c-4997-b52c-12bed713bb74.info is being set with open permissions: ugo+rw Sep 29 18:39:04 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-c9d0ad84-d858-4c38-84e5-f7434d49ef14 tempest-ProjectMemberTests-1577701723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fd08db0c-f41c-4997-b52c-12bed713bb74.info {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:04 devstack sudo[108127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fd08db0c-f41c-4997-b52c-12bed713bb74.info Sep 29 18:39:04 devstack sudo[108127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:04 devstack sudo[108127]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:04 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-c9d0ad84-d858-4c38-84e5-f7434d49ef14 tempest-ProjectMemberTests-1577701723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fd08db0c-f41c-4997-b52c-12bed713bb74.info" returned: 0 in 0.226s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:04 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-c9d0ad84-d858-4c38-84e5-f7434d49ef14 tempest-ProjectMemberTests-1577701723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.804s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:39:04 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-c9d0ad84-d858-4c38-84e5-f7434d49ef14 tempest-ProjectMemberTests-1577701723 None] Create snapshot completed successfully Sep 29 18:39:05 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-6e1ac5ac-eade-408b-8dff-4928e9313fb3 tempest-ProjectMemberTests-1577701723 None] Acquiring lock "cinder-92fb88a0-f607-4582-90db-edba2e7ddaa8-delete_snapshot" by "delete_snapshot" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:39:05 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-6e1ac5ac-eade-408b-8dff-4928e9313fb3 tempest-ProjectMemberTests-1577701723 None] Lock "cinder-92fb88a0-f607-4582-90db-edba2e7ddaa8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:39:05 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-6e1ac5ac-eade-408b-8dff-4928e9313fb3 tempest-ProjectMemberTests-1577701723 None] Acquiring lock "cinder-quobyte-fd08db0c-f41c-4997-b52c-12bed713bb74" by "delete_snapshot" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:39:05 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-6e1ac5ac-eade-408b-8dff-4928e9313fb3 tempest-ProjectMemberTests-1577701723 None] Lock "cinder-quobyte-fd08db0c-f41c-4997-b52c-12bed713bb74" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:39:05 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-6e1ac5ac-eade-408b-8dff-4928e9313fb3 tempest-ProjectMemberTests-1577701723 None] Acquiring lock "cinder-quobyte-92fb88a0-f607-4582-90db-edba2e7ddaa8" by "_delete_snapshot" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:39:05 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-6e1ac5ac-eade-408b-8dff-4928e9313fb3 tempest-ProjectMemberTests-1577701723 None] Lock "cinder-quobyte-92fb88a0-f607-4582-90db-edba2e7ddaa8" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:39:05 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-6e1ac5ac-eade-408b-8dff-4928e9313fb3 tempest-ProjectMemberTests-1577701723 None] Deleting offline snapshot 92fb88a0-f607-4582-90db-edba2e7ddaa8 of volume fd08db0c-f41c-4997-b52c-12bed713bb74 {{(pid=86512) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 18:39:05 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-6e1ac5ac-eade-408b-8dff-4928e9313fb3 tempest-ProjectMemberTests-1577701723 None] snapshot_file for this snap is: volume-fd08db0c-f41c-4997-b52c-12bed713bb74.92fb88a0-f607-4582-90db-edba2e7ddaa8 {{(pid=86512) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 18:39:05 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba113cfe-5be6-4b4d-b4f1-7fc73310c031]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:39:05 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-6e1ac5ac-eade-408b-8dff-4928e9313fb3 tempest-ProjectMemberTests-1577701723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fd08db0c-f41c-4997-b52c-12bed713bb74.92fb88a0-f607-4582-90db-edba2e7ddaa8 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:05 devstack sudo[108130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fd08db0c-f41c-4997-b52c-12bed713bb74.92fb88a0-f607-4582-90db-edba2e7ddaa8 Sep 29 18:39:05 devstack sudo[108130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:05 devstack sudo[108130]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:05 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-6e1ac5ac-eade-408b-8dff-4928e9313fb3 tempest-ProjectMemberTests-1577701723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fd08db0c-f41c-4997-b52c-12bed713bb74.92fb88a0-f607-4582-90db-edba2e7ddaa8" returned: 0 in 0.365s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:05 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-6e1ac5ac-eade-408b-8dff-4928e9313fb3 tempest-ProjectMemberTests-1577701723 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fd08db0c-f41c-4997-b52c-12bed713bb74(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86512) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 18:39:05 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[66b707f6-91eb-4a0e-9283-3ba2b51faf17]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:39:05 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-6e1ac5ac-eade-408b-8dff-4928e9313fb3 tempest-ProjectMemberTests-1577701723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fd08db0c-f41c-4997-b52c-12bed713bb74 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:05 devstack sudo[108135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fd08db0c-f41c-4997-b52c-12bed713bb74 Sep 29 18:39:05 devstack sudo[108135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:05 devstack sudo[108135]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:05 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-6e1ac5ac-eade-408b-8dff-4928e9313fb3 tempest-ProjectMemberTests-1577701723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fd08db0c-f41c-4997-b52c-12bed713bb74" returned: 0 in 0.374s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:05 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-6e1ac5ac-eade-408b-8dff-4928e9313fb3 tempest-ProjectMemberTests-1577701723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fd08db0c-f41c-4997-b52c-12bed713bb74.92fb88a0-f607-4582-90db-edba2e7ddaa8 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:05 devstack sudo[108140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fd08db0c-f41c-4997-b52c-12bed713bb74.92fb88a0-f607-4582-90db-edba2e7ddaa8 Sep 29 18:39:05 devstack sudo[108140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:06 devstack sudo[108140]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:06 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-6e1ac5ac-eade-408b-8dff-4928e9313fb3 tempest-ProjectMemberTests-1577701723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fd08db0c-f41c-4997-b52c-12bed713bb74.92fb88a0-f607-4582-90db-edba2e7ddaa8" returned: 0 in 0.317s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:06 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-6e1ac5ac-eade-408b-8dff-4928e9313fb3 tempest-ProjectMemberTests-1577701723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fd08db0c-f41c-4997-b52c-12bed713bb74.92fb88a0-f607-4582-90db-edba2e7ddaa8 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:06 devstack sudo[108145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fd08db0c-f41c-4997-b52c-12bed713bb74.92fb88a0-f607-4582-90db-edba2e7ddaa8 Sep 29 18:39:06 devstack sudo[108145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:06 devstack sudo[108145]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:06 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-6e1ac5ac-eade-408b-8dff-4928e9313fb3 tempest-ProjectMemberTests-1577701723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fd08db0c-f41c-4997-b52c-12bed713bb74.92fb88a0-f607-4582-90db-edba2e7ddaa8" returned: 0 in 0.235s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:06 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-6e1ac5ac-eade-408b-8dff-4928e9313fb3 tempest-ProjectMemberTests-1577701723 None] Lock "cinder-quobyte-92fb88a0-f607-4582-90db-edba2e7ddaa8" released by "_delete_snapshot" :: held 1.396s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:39:06 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-6e1ac5ac-eade-408b-8dff-4928e9313fb3 tempest-ProjectMemberTests-1577701723 None] Lock "cinder-quobyte-fd08db0c-f41c-4997-b52c-12bed713bb74" released by "delete_snapshot" :: held 1.418s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:39:06 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-6e1ac5ac-eade-408b-8dff-4928e9313fb3 tempest-ProjectMemberTests-1577701723 None] Created reservations ['1c38cf9b-cffe-4efc-a6b7-092d585af761', '7e7cd389-185c-43db-b92c-071fd45a61c0', '45bb1fb8-db8c-4b78-8bb7-d531d479ba39', '0ac46c6e-4b1b-4b00-9f22-177d43e604bb'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:39:06 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-6e1ac5ac-eade-408b-8dff-4928e9313fb3 tempest-ProjectMemberTests-1577701723 None] Delete snapshot completed successfully. Sep 29 18:39:06 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-6e1ac5ac-eade-408b-8dff-4928e9313fb3 tempest-ProjectMemberTests-1577701723 None] Lock "cinder-92fb88a0-f607-4582-90db-edba2e7ddaa8-delete_snapshot" released by "delete_snapshot" :: held 1.544s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:39:07 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-a1710f9d-e496-4e27-b6f8-3b70cde1e987 tempest-ProjectMemberTests-1577701723 None] Acquiring lock "cinder-fd08db0c-f41c-4997-b52c-12bed713bb74-delete_volume" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:39:07 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-a1710f9d-e496-4e27-b6f8-3b70cde1e987 tempest-ProjectMemberTests-1577701723 None] Lock "cinder-fd08db0c-f41c-4997-b52c-12bed713bb74-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:39:07 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-a1710f9d-e496-4e27-b6f8-3b70cde1e987 tempest-ProjectMemberTests-1577701723 None] Acquiring lock "cinder-quobyte-fd08db0c-f41c-4997-b52c-12bed713bb74" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:39:07 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-a1710f9d-e496-4e27-b6f8-3b70cde1e987 tempest-ProjectMemberTests-1577701723 None] Lock "cinder-quobyte-fd08db0c-f41c-4997-b52c-12bed713bb74" acquired by "delete_volume" :: waited 0.017s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:39:07 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[f60d85de-acfd-4a30-b00f-d9fe9036f9ea]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:39:07 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a1710f9d-e496-4e27-b6f8-3b70cde1e987 tempest-ProjectMemberTests-1577701723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fd08db0c-f41c-4997-b52c-12bed713bb74 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:07 devstack sudo[108148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fd08db0c-f41c-4997-b52c-12bed713bb74 Sep 29 18:39:07 devstack sudo[108148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:07 devstack sudo[108148]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:07 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a1710f9d-e496-4e27-b6f8-3b70cde1e987 tempest-ProjectMemberTests-1577701723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fd08db0c-f41c-4997-b52c-12bed713bb74" returned: 0 in 0.377s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:07 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a1710f9d-e496-4e27-b6f8-3b70cde1e987 tempest-ProjectMemberTests-1577701723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fd08db0c-f41c-4997-b52c-12bed713bb74 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:07 devstack sudo[108154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fd08db0c-f41c-4997-b52c-12bed713bb74 Sep 29 18:39:07 devstack sudo[108154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:08 devstack sudo[108154]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:08 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a1710f9d-e496-4e27-b6f8-3b70cde1e987 tempest-ProjectMemberTests-1577701723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-fd08db0c-f41c-4997-b52c-12bed713bb74" returned: 0 in 0.261s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:08 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-a1710f9d-e496-4e27-b6f8-3b70cde1e987 tempest-ProjectMemberTests-1577701723 None] Lock "cinder-quobyte-fd08db0c-f41c-4997-b52c-12bed713bb74" released by "delete_volume" :: held 0.703s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:39:08 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-a1710f9d-e496-4e27-b6f8-3b70cde1e987 tempest-ProjectMemberTests-1577701723 None] Created reservations ['e11acd5c-defa-4d26-b261-1f8b968c2298', 'c8e32fe2-b365-45a1-922c-1e01929050c5', '8a44b9a4-9162-4da4-a7dd-6fa9bd793805', '67ce673a-ea75-4a99-acc4-163023b6133e'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:39:08 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-a1710f9d-e496-4e27-b6f8-3b70cde1e987 tempest-ProjectMemberTests-1577701723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:39:08 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-a1710f9d-e496-4e27-b6f8-3b70cde1e987 tempest-ProjectMemberTests-1577701723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:39:08 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-a1710f9d-e496-4e27-b6f8-3b70cde1e987 tempest-ProjectMemberTests-1577701723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:39:08 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-a1710f9d-e496-4e27-b6f8-3b70cde1e987 tempest-ProjectMemberTests-1577701723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:39:08 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-a1710f9d-e496-4e27-b6f8-3b70cde1e987 tempest-ProjectMemberTests-1577701723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:39:08 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a1710f9d-e496-4e27-b6f8-3b70cde1e987 tempest-ProjectMemberTests-1577701723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:08 devstack sudo[108157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:39:08 devstack sudo[108157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:08 devstack sudo[108157]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:08 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a1710f9d-e496-4e27-b6f8-3b70cde1e987 tempest-ProjectMemberTests-1577701723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.284s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:08 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-a1710f9d-e496-4e27-b6f8-3b70cde1e987 tempest-ProjectMemberTests-1577701723 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:39:08 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-a1710f9d-e496-4e27-b6f8-3b70cde1e987 tempest-ProjectMemberTests-1577701723 None] Deleted volume successfully. Sep 29 18:39:08 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-a1710f9d-e496-4e27-b6f8-3b70cde1e987 tempest-ProjectMemberTests-1577701723 None] Lock "cinder-fd08db0c-f41c-4997-b52c-12bed713bb74-delete_volume" released by "delete_volume" :: held 1.206s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:39:08 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-455f3a84-5e30-472f-a1aa-3e4870637c5e tempest-ProjectMemberTests-1577701723 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86512) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:39:08 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-455f3a84-5e30-472f-a1aa-3e4870637c5e tempest-ProjectMemberTests-1577701723 None] Flow 'volume_create_manager' (a9eef06a-d10d-4318-94ec-68af884ead40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:39:08 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-455f3a84-5e30-472f-a1aa-3e4870637c5e tempest-ProjectMemberTests-1577701723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebf337d1-cbc5-4516-8cc8-a07ef99d757c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:39:08 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-455f3a84-5e30-472f-a1aa-3e4870637c5e tempest-ProjectMemberTests-1577701723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebf337d1-cbc5-4516-8cc8-a07ef99d757c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:39:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2070255219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9d11ff8-f2dd-4938-87d9-acf268baaae0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc5a83cdd1e34b24adfa899bf4067f0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:39:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:39:09Z,use_quota=True,user_id='671a2611e03549f08f718ec6a8379db0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:39:08 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-455f3a84-5e30-472f-a1aa-3e4870637c5e tempest-ProjectMemberTests-1577701723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea9f0c31-7562-458d-82a5-c83d5f8d6165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:39:08 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-455f3a84-5e30-472f-a1aa-3e4870637c5e tempest-ProjectMemberTests-1577701723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea9f0c31-7562-458d-82a5-c83d5f8d6165) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:39:08 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-455f3a84-5e30-472f-a1aa-3e4870637c5e tempest-ProjectMemberTests-1577701723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11dbe0b9-4dab-4898-8d9e-20cc4ff77618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:39:08 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-455f3a84-5e30-472f-a1aa-3e4870637c5e tempest-ProjectMemberTests-1577701723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11dbe0b9-4dab-4898-8d9e-20cc4ff77618) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9d11ff8-f2dd-4938-87d9-acf268baaae0', 'volume_name': 'volume-a9d11ff8-f2dd-4938-87d9-acf268baaae0', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:39:08 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-455f3a84-5e30-472f-a1aa-3e4870637c5e tempest-ProjectMemberTests-1577701723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8277e798-a06f-44eb-ab8e-15a02850308d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:39:08 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-455f3a84-5e30-472f-a1aa-3e4870637c5e tempest-ProjectMemberTests-1577701723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8277e798-a06f-44eb-ab8e-15a02850308d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:39:08 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-455f3a84-5e30-472f-a1aa-3e4870637c5e tempest-ProjectMemberTests-1577701723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d6acfa2-dc7d-46c6-a83d-5a7632236f3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:39:08 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-455f3a84-5e30-472f-a1aa-3e4870637c5e tempest-ProjectMemberTests-1577701723 None] Volume a9d11ff8-f2dd-4938-87d9-acf268baaae0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9d11ff8-f2dd-4938-87d9-acf268baaae0', 'volume_size': 1} Sep 29 18:39:08 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-455f3a84-5e30-472f-a1aa-3e4870637c5e tempest-ProjectMemberTests-1577701723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:39:09 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-455f3a84-5e30-472f-a1aa-3e4870637c5e tempest-ProjectMemberTests-1577701723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:39:09 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-455f3a84-5e30-472f-a1aa-3e4870637c5e tempest-ProjectMemberTests-1577701723 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:39:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2070255219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9d11ff8-f2dd-4938-87d9-acf268baaae0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc5a83cdd1e34b24adfa899bf4067f0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:39:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:39:09Z,use_quota=True,user_id='671a2611e03549f08f718ec6a8379db0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)}" {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:39:09 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-455f3a84-5e30-472f-a1aa-3e4870637c5e tempest-ProjectMemberTests-1577701723 None] Creating volume a9d11ff8-f2dd-4938-87d9-acf268baaae0 {{(pid=86512) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:39:09 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-455f3a84-5e30-472f-a1aa-3e4870637c5e tempest-ProjectMemberTests-1577701723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:39:09 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-455f3a84-5e30-472f-a1aa-3e4870637c5e tempest-ProjectMemberTests-1577701723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:39:09 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-455f3a84-5e30-472f-a1aa-3e4870637c5e tempest-ProjectMemberTests-1577701723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:39:09 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-455f3a84-5e30-472f-a1aa-3e4870637c5e tempest-ProjectMemberTests-1577701723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:39:09 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-455f3a84-5e30-472f-a1aa-3e4870637c5e tempest-ProjectMemberTests-1577701723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:39:09 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-455f3a84-5e30-472f-a1aa-3e4870637c5e tempest-ProjectMemberTests-1577701723 None] Selected osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 as target Quobyte volume. {{(pid=86512) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:39:09 devstack cinder-volume[86512]: INFO cinder.volume.drivers.remotefs [None req-455f3a84-5e30-472f-a1aa-3e4870637c5e tempest-ProjectMemberTests-1577701723 None] casted to osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 Sep 29 18:39:09 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-455f3a84-5e30-472f-a1aa-3e4870637c5e tempest-ProjectMemberTests-1577701723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a9d11ff8-f2dd-4938-87d9-acf268baaae0 1073741824 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:09 devstack sudo[108160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a9d11ff8-f2dd-4938-87d9-acf268baaae0 1073741824 Sep 29 18:39:09 devstack sudo[108160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:09 devstack sudo[108160]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:09 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-455f3a84-5e30-472f-a1aa-3e4870637c5e tempest-ProjectMemberTests-1577701723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a9d11ff8-f2dd-4938-87d9-acf268baaae0 1073741824" returned: 0 in 0.429s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:09 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-455f3a84-5e30-472f-a1aa-3e4870637c5e tempest-ProjectMemberTests-1577701723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a9d11ff8-f2dd-4938-87d9-acf268baaae0 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:09 devstack sudo[108166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a9d11ff8-f2dd-4938-87d9-acf268baaae0 Sep 29 18:39:09 devstack sudo[108166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:09 devstack sudo[108166]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:09 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-455f3a84-5e30-472f-a1aa-3e4870637c5e tempest-ProjectMemberTests-1577701723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a9d11ff8-f2dd-4938-87d9-acf268baaae0" returned: 0 in 0.257s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:09 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-455f3a84-5e30-472f-a1aa-3e4870637c5e tempest-ProjectMemberTests-1577701723 None] <== create_volume: return (729ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'} {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:39:09 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-455f3a84-5e30-472f-a1aa-3e4870637c5e tempest-ProjectMemberTests-1577701723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.732s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:39:09 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-455f3a84-5e30-472f-a1aa-3e4870637c5e tempest-ProjectMemberTests-1577701723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d6acfa2-dc7d-46c6-a83d-5a7632236f3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9d11ff8-f2dd-4938-87d9-acf268baaae0', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:39:09 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-455f3a84-5e30-472f-a1aa-3e4870637c5e tempest-ProjectMemberTests-1577701723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92974386-c65d-4eb2-8640-58a814d132cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:39:09 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-455f3a84-5e30-472f-a1aa-3e4870637c5e tempest-ProjectMemberTests-1577701723 None] Volume volume-a9d11ff8-f2dd-4938-87d9-acf268baaae0 (a9d11ff8-f2dd-4938-87d9-acf268baaae0): created successfully Sep 29 18:39:09 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-455f3a84-5e30-472f-a1aa-3e4870637c5e tempest-ProjectMemberTests-1577701723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92974386-c65d-4eb2-8640-58a814d132cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:39:09 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-455f3a84-5e30-472f-a1aa-3e4870637c5e tempest-ProjectMemberTests-1577701723 None] Flow 'volume_create_manager' (a9eef06a-d10d-4318-94ec-68af884ead40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:39:09 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-455f3a84-5e30-472f-a1aa-3e4870637c5e tempest-ProjectMemberTests-1577701723 None] Created volume successfully. Sep 29 18:39:10 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-63e11e4e-4b46-4906-bb06-c6513d4ff0fc tempest-ProjectMemberTests-1577701723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:39:10 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-63e11e4e-4b46-4906-bb06-c6513d4ff0fc tempest-ProjectMemberTests-1577701723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:39:10 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-63e11e4e-4b46-4906-bb06-c6513d4ff0fc tempest-ProjectMemberTests-1577701723 None] Creating offline snapshot 18121913-77f7-4818-8741-87bef8eb7e9c of volume a9d11ff8-f2dd-4938-87d9-acf268baaae0 {{(pid=86512) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 18:39:10 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8d995a0-4771-4bec-83cc-397f5ad5bd72]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:39:10 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-63e11e4e-4b46-4906-bb06-c6513d4ff0fc tempest-ProjectMemberTests-1577701723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a9d11ff8-f2dd-4938-87d9-acf268baaae0 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:10 devstack sudo[108169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a9d11ff8-f2dd-4938-87d9-acf268baaae0 Sep 29 18:39:10 devstack sudo[108169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:10 devstack sudo[108169]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:10 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-63e11e4e-4b46-4906-bb06-c6513d4ff0fc tempest-ProjectMemberTests-1577701723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a9d11ff8-f2dd-4938-87d9-acf268baaae0" returned: 0 in 0.390s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:10 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-63e11e4e-4b46-4906-bb06-c6513d4ff0fc tempest-ProjectMemberTests-1577701723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a9d11ff8-f2dd-4938-87d9-acf268baaae0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a9d11ff8-f2dd-4938-87d9-acf268baaae0.18121913-77f7-4818-8741-87bef8eb7e9c 1G {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:10 devstack sudo[108174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a9d11ff8-f2dd-4938-87d9-acf268baaae0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a9d11ff8-f2dd-4938-87d9-acf268baaae0.18121913-77f7-4818-8741-87bef8eb7e9c 1G Sep 29 18:39:10 devstack sudo[108174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:10 devstack sudo[108174]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:10 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-63e11e4e-4b46-4906-bb06-c6513d4ff0fc tempest-ProjectMemberTests-1577701723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a9d11ff8-f2dd-4938-87d9-acf268baaae0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a9d11ff8-f2dd-4938-87d9-acf268baaae0.18121913-77f7-4818-8741-87bef8eb7e9c 1G" returned: 0 in 0.431s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:10 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-63e11e4e-4b46-4906-bb06-c6513d4ff0fc tempest-ProjectMemberTests-1577701723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a9d11ff8-f2dd-4938-87d9-acf268baaae0 -F qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a9d11ff8-f2dd-4938-87d9-acf268baaae0.18121913-77f7-4818-8741-87bef8eb7e9c {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:11 devstack sudo[108180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a9d11ff8-f2dd-4938-87d9-acf268baaae0 -F qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a9d11ff8-f2dd-4938-87d9-acf268baaae0.18121913-77f7-4818-8741-87bef8eb7e9c Sep 29 18:39:11 devstack sudo[108180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:11 devstack sudo[108180]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:11 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-63e11e4e-4b46-4906-bb06-c6513d4ff0fc tempest-ProjectMemberTests-1577701723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a9d11ff8-f2dd-4938-87d9-acf268baaae0 -F qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a9d11ff8-f2dd-4938-87d9-acf268baaae0.18121913-77f7-4818-8741-87bef8eb7e9c" returned: 0 in 0.300s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:11 devstack cinder-volume[86512]: WARNING cinder.volume.drivers.remotefs [None req-63e11e4e-4b46-4906-bb06-c6513d4ff0fc tempest-ProjectMemberTests-1577701723 None] /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a9d11ff8-f2dd-4938-87d9-acf268baaae0.18121913-77f7-4818-8741-87bef8eb7e9c is being set with open permissions: ugo+rw Sep 29 18:39:11 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-63e11e4e-4b46-4906-bb06-c6513d4ff0fc tempest-ProjectMemberTests-1577701723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a9d11ff8-f2dd-4938-87d9-acf268baaae0.18121913-77f7-4818-8741-87bef8eb7e9c {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:11 devstack sudo[108186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a9d11ff8-f2dd-4938-87d9-acf268baaae0.18121913-77f7-4818-8741-87bef8eb7e9c Sep 29 18:39:11 devstack sudo[108186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:11 devstack sudo[108186]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:11 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-63e11e4e-4b46-4906-bb06-c6513d4ff0fc tempest-ProjectMemberTests-1577701723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a9d11ff8-f2dd-4938-87d9-acf268baaae0.18121913-77f7-4818-8741-87bef8eb7e9c" returned: 0 in 0.256s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:11 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-63e11e4e-4b46-4906-bb06-c6513d4ff0fc tempest-ProjectMemberTests-1577701723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a9d11ff8-f2dd-4938-87d9-acf268baaae0.info {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:11 devstack sudo[108189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a9d11ff8-f2dd-4938-87d9-acf268baaae0.info Sep 29 18:39:11 devstack sudo[108189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:11 devstack sudo[108189]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:11 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-63e11e4e-4b46-4906-bb06-c6513d4ff0fc tempest-ProjectMemberTests-1577701723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a9d11ff8-f2dd-4938-87d9-acf268baaae0.info" returned: 0 in 0.253s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:11 devstack cinder-volume[86512]: WARNING cinder.volume.drivers.remotefs [None req-63e11e4e-4b46-4906-bb06-c6513d4ff0fc tempest-ProjectMemberTests-1577701723 None] /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a9d11ff8-f2dd-4938-87d9-acf268baaae0.info is being set with open permissions: ugo+rw Sep 29 18:39:11 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-63e11e4e-4b46-4906-bb06-c6513d4ff0fc tempest-ProjectMemberTests-1577701723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a9d11ff8-f2dd-4938-87d9-acf268baaae0.info {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:11 devstack sudo[108192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a9d11ff8-f2dd-4938-87d9-acf268baaae0.info Sep 29 18:39:11 devstack sudo[108192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:12 devstack sudo[108192]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:12 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-63e11e4e-4b46-4906-bb06-c6513d4ff0fc tempest-ProjectMemberTests-1577701723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a9d11ff8-f2dd-4938-87d9-acf268baaae0.info" returned: 0 in 0.265s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:12 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-63e11e4e-4b46-4906-bb06-c6513d4ff0fc tempest-ProjectMemberTests-1577701723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.998s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:39:12 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-63e11e4e-4b46-4906-bb06-c6513d4ff0fc tempest-ProjectMemberTests-1577701723 None] Create snapshot completed successfully Sep 29 18:39:13 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-db0b3a2a-7e14-4140-8692-abee975c6511 tempest-ProjectMemberTests-1577701723 None] Acquiring lock "cinder-18121913-77f7-4818-8741-87bef8eb7e9c-delete_snapshot" by "delete_snapshot" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:39:13 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-db0b3a2a-7e14-4140-8692-abee975c6511 tempest-ProjectMemberTests-1577701723 None] Lock "cinder-18121913-77f7-4818-8741-87bef8eb7e9c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:39:13 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-db0b3a2a-7e14-4140-8692-abee975c6511 tempest-ProjectMemberTests-1577701723 None] Acquiring lock "cinder-quobyte-a9d11ff8-f2dd-4938-87d9-acf268baaae0" by "delete_snapshot" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:39:13 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-db0b3a2a-7e14-4140-8692-abee975c6511 tempest-ProjectMemberTests-1577701723 None] Lock "cinder-quobyte-a9d11ff8-f2dd-4938-87d9-acf268baaae0" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:39:13 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-db0b3a2a-7e14-4140-8692-abee975c6511 tempest-ProjectMemberTests-1577701723 None] Acquiring lock "cinder-quobyte-18121913-77f7-4818-8741-87bef8eb7e9c" by "_delete_snapshot" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:39:13 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-db0b3a2a-7e14-4140-8692-abee975c6511 tempest-ProjectMemberTests-1577701723 None] Lock "cinder-quobyte-18121913-77f7-4818-8741-87bef8eb7e9c" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:39:13 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-db0b3a2a-7e14-4140-8692-abee975c6511 tempest-ProjectMemberTests-1577701723 None] Deleting offline snapshot 18121913-77f7-4818-8741-87bef8eb7e9c of volume a9d11ff8-f2dd-4938-87d9-acf268baaae0 {{(pid=86512) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 18:39:13 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-db0b3a2a-7e14-4140-8692-abee975c6511 tempest-ProjectMemberTests-1577701723 None] snapshot_file for this snap is: volume-a9d11ff8-f2dd-4938-87d9-acf268baaae0.18121913-77f7-4818-8741-87bef8eb7e9c {{(pid=86512) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 18:39:13 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8e6bb43-1a60-4db7-82de-ed3aa6177fd0]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:39:13 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-db0b3a2a-7e14-4140-8692-abee975c6511 tempest-ProjectMemberTests-1577701723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a9d11ff8-f2dd-4938-87d9-acf268baaae0.18121913-77f7-4818-8741-87bef8eb7e9c {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:13 devstack sudo[108196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a9d11ff8-f2dd-4938-87d9-acf268baaae0.18121913-77f7-4818-8741-87bef8eb7e9c Sep 29 18:39:13 devstack sudo[108196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:13 devstack sudo[108196]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:13 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-db0b3a2a-7e14-4140-8692-abee975c6511 tempest-ProjectMemberTests-1577701723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a9d11ff8-f2dd-4938-87d9-acf268baaae0.18121913-77f7-4818-8741-87bef8eb7e9c" returned: 0 in 0.365s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:13 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-db0b3a2a-7e14-4140-8692-abee975c6511 tempest-ProjectMemberTests-1577701723 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a9d11ff8-f2dd-4938-87d9-acf268baaae0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86512) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 18:39:13 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[535c2787-b2d1-485f-b8f1-9c7a40715747]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:39:13 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-db0b3a2a-7e14-4140-8692-abee975c6511 tempest-ProjectMemberTests-1577701723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a9d11ff8-f2dd-4938-87d9-acf268baaae0 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:13 devstack sudo[108201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a9d11ff8-f2dd-4938-87d9-acf268baaae0 Sep 29 18:39:13 devstack sudo[108201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:14 devstack sudo[108201]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:14 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-db0b3a2a-7e14-4140-8692-abee975c6511 tempest-ProjectMemberTests-1577701723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a9d11ff8-f2dd-4938-87d9-acf268baaae0" returned: 0 in 0.374s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:14 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-db0b3a2a-7e14-4140-8692-abee975c6511 tempest-ProjectMemberTests-1577701723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a9d11ff8-f2dd-4938-87d9-acf268baaae0.18121913-77f7-4818-8741-87bef8eb7e9c {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:14 devstack sudo[108206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a9d11ff8-f2dd-4938-87d9-acf268baaae0.18121913-77f7-4818-8741-87bef8eb7e9c Sep 29 18:39:14 devstack sudo[108206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:14 devstack sudo[108206]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:14 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-db0b3a2a-7e14-4140-8692-abee975c6511 tempest-ProjectMemberTests-1577701723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a9d11ff8-f2dd-4938-87d9-acf268baaae0.18121913-77f7-4818-8741-87bef8eb7e9c" returned: 0 in 0.359s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:14 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-db0b3a2a-7e14-4140-8692-abee975c6511 tempest-ProjectMemberTests-1577701723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a9d11ff8-f2dd-4938-87d9-acf268baaae0.18121913-77f7-4818-8741-87bef8eb7e9c {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:14 devstack sudo[108213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a9d11ff8-f2dd-4938-87d9-acf268baaae0.18121913-77f7-4818-8741-87bef8eb7e9c Sep 29 18:39:14 devstack sudo[108213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:14 devstack sudo[108213]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:14 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-db0b3a2a-7e14-4140-8692-abee975c6511 tempest-ProjectMemberTests-1577701723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a9d11ff8-f2dd-4938-87d9-acf268baaae0.18121913-77f7-4818-8741-87bef8eb7e9c" returned: 0 in 0.267s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:14 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-db0b3a2a-7e14-4140-8692-abee975c6511 tempest-ProjectMemberTests-1577701723 None] Lock "cinder-quobyte-18121913-77f7-4818-8741-87bef8eb7e9c" released by "_delete_snapshot" :: held 1.481s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:39:14 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-db0b3a2a-7e14-4140-8692-abee975c6511 tempest-ProjectMemberTests-1577701723 None] Lock "cinder-quobyte-a9d11ff8-f2dd-4938-87d9-acf268baaae0" released by "delete_snapshot" :: held 1.507s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:39:14 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-db0b3a2a-7e14-4140-8692-abee975c6511 tempest-ProjectMemberTests-1577701723 None] Created reservations ['2915b2a8-528e-4d7b-a11b-89538f185c3b', '56f74242-5b9f-439e-8927-945c5299e409', 'f0439244-b210-4549-8fd2-867ebf01bd62', '05f04f34-1f8e-4d56-8859-efcb524a7bd7'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:39:14 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-db0b3a2a-7e14-4140-8692-abee975c6511 tempest-ProjectMemberTests-1577701723 None] Delete snapshot completed successfully. Sep 29 18:39:14 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-db0b3a2a-7e14-4140-8692-abee975c6511 tempest-ProjectMemberTests-1577701723 None] Lock "cinder-18121913-77f7-4818-8741-87bef8eb7e9c-delete_snapshot" released by "delete_snapshot" :: held 1.661s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:39:15 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-3073ba87-e94c-488d-ae4d-d39d99b8bee1 tempest-ProjectMemberTests-1577701723 None] Acquiring lock "cinder-a9d11ff8-f2dd-4938-87d9-acf268baaae0-delete_volume" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:39:15 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-3073ba87-e94c-488d-ae4d-d39d99b8bee1 tempest-ProjectMemberTests-1577701723 None] Lock "cinder-a9d11ff8-f2dd-4938-87d9-acf268baaae0-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:39:15 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-3073ba87-e94c-488d-ae4d-d39d99b8bee1 tempest-ProjectMemberTests-1577701723 None] Acquiring lock "cinder-quobyte-a9d11ff8-f2dd-4938-87d9-acf268baaae0" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:39:15 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-3073ba87-e94c-488d-ae4d-d39d99b8bee1 tempest-ProjectMemberTests-1577701723 None] Lock "cinder-quobyte-a9d11ff8-f2dd-4938-87d9-acf268baaae0" acquired by "delete_volume" :: waited 0.019s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:39:15 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c5a22b6-d7bc-4505-bc2a-ae37030e358c]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:39:15 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-3073ba87-e94c-488d-ae4d-d39d99b8bee1 tempest-ProjectMemberTests-1577701723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a9d11ff8-f2dd-4938-87d9-acf268baaae0 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:15 devstack sudo[108216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a9d11ff8-f2dd-4938-87d9-acf268baaae0 Sep 29 18:39:15 devstack sudo[108216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:15 devstack sudo[108216]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:15 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-3073ba87-e94c-488d-ae4d-d39d99b8bee1 tempest-ProjectMemberTests-1577701723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a9d11ff8-f2dd-4938-87d9-acf268baaae0" returned: 0 in 0.374s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:15 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-3073ba87-e94c-488d-ae4d-d39d99b8bee1 tempest-ProjectMemberTests-1577701723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a9d11ff8-f2dd-4938-87d9-acf268baaae0 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:15 devstack sudo[108221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a9d11ff8-f2dd-4938-87d9-acf268baaae0 Sep 29 18:39:15 devstack sudo[108221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:16 devstack sudo[108221]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:16 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-3073ba87-e94c-488d-ae4d-d39d99b8bee1 tempest-ProjectMemberTests-1577701723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a9d11ff8-f2dd-4938-87d9-acf268baaae0" returned: 0 in 0.272s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:16 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-3073ba87-e94c-488d-ae4d-d39d99b8bee1 tempest-ProjectMemberTests-1577701723 None] Lock "cinder-quobyte-a9d11ff8-f2dd-4938-87d9-acf268baaae0" released by "delete_volume" :: held 0.714s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:39:16 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-3073ba87-e94c-488d-ae4d-d39d99b8bee1 tempest-ProjectMemberTests-1577701723 None] Created reservations ['c9904255-a966-48f2-a483-c1a6f2a28479', '6376683a-f2e0-47d9-b9a3-501ebd503fd8', '6d398499-73f2-46dc-be2f-55343fa7c6f7', '9b2555ea-7990-43b4-a541-9f5ca3809468'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:39:16 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-3073ba87-e94c-488d-ae4d-d39d99b8bee1 tempest-ProjectMemberTests-1577701723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:39:16 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-3073ba87-e94c-488d-ae4d-d39d99b8bee1 tempest-ProjectMemberTests-1577701723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:39:16 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-3073ba87-e94c-488d-ae4d-d39d99b8bee1 tempest-ProjectMemberTests-1577701723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:39:16 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-3073ba87-e94c-488d-ae4d-d39d99b8bee1 tempest-ProjectMemberTests-1577701723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:39:16 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-3073ba87-e94c-488d-ae4d-d39d99b8bee1 tempest-ProjectMemberTests-1577701723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:39:16 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-3073ba87-e94c-488d-ae4d-d39d99b8bee1 tempest-ProjectMemberTests-1577701723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:16 devstack sudo[108224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:39:16 devstack sudo[108224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:16 devstack sudo[108224]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:16 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-3073ba87-e94c-488d-ae4d-d39d99b8bee1 tempest-ProjectMemberTests-1577701723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.244s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:16 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-3073ba87-e94c-488d-ae4d-d39d99b8bee1 tempest-ProjectMemberTests-1577701723 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:39:16 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-3073ba87-e94c-488d-ae4d-d39d99b8bee1 tempest-ProjectMemberTests-1577701723 None] Deleted volume successfully. Sep 29 18:39:16 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-3073ba87-e94c-488d-ae4d-d39d99b8bee1 tempest-ProjectMemberTests-1577701723 None] Lock "cinder-a9d11ff8-f2dd-4938-87d9-acf268baaae0-delete_volume" released by "delete_volume" :: held 1.180s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:39:17 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-36e26ceb-5c45-4302-a3c0-3d716ec0d2a6 tempest-ProjectMemberTests-1577701723 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86512) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:39:17 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-36e26ceb-5c45-4302-a3c0-3d716ec0d2a6 tempest-ProjectMemberTests-1577701723 None] Flow 'volume_create_manager' (a8383b67-4bba-4e91-9d5f-c920aad2a3f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:39:17 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-36e26ceb-5c45-4302-a3c0-3d716ec0d2a6 tempest-ProjectMemberTests-1577701723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (244e5946-8110-44f0-a037-b27ee8e7682d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:39:17 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-36e26ceb-5c45-4302-a3c0-3d716ec0d2a6 tempest-ProjectMemberTests-1577701723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (244e5946-8110-44f0-a037-b27ee8e7682d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:39:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1882816570',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edc5079b-be84-4c8c-9ca5-feb96cd6f9ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc5a83cdd1e34b24adfa899bf4067f0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:39:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:39:17Z,use_quota=True,user_id='671a2611e03549f08f718ec6a8379db0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:39:17 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-36e26ceb-5c45-4302-a3c0-3d716ec0d2a6 tempest-ProjectMemberTests-1577701723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (609ce322-73d9-453f-8b23-8177c6d5fe74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:39:17 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-36e26ceb-5c45-4302-a3c0-3d716ec0d2a6 tempest-ProjectMemberTests-1577701723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (609ce322-73d9-453f-8b23-8177c6d5fe74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:39:17 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-36e26ceb-5c45-4302-a3c0-3d716ec0d2a6 tempest-ProjectMemberTests-1577701723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba7beb37-39ed-4f55-92e3-87be34fd81f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:39:17 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-36e26ceb-5c45-4302-a3c0-3d716ec0d2a6 tempest-ProjectMemberTests-1577701723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba7beb37-39ed-4f55-92e3-87be34fd81f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'edc5079b-be84-4c8c-9ca5-feb96cd6f9ee', 'volume_name': 'volume-edc5079b-be84-4c8c-9ca5-feb96cd6f9ee', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:39:17 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-36e26ceb-5c45-4302-a3c0-3d716ec0d2a6 tempest-ProjectMemberTests-1577701723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02842fe4-51fd-4548-b8a8-221c7fd9672d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:39:17 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-36e26ceb-5c45-4302-a3c0-3d716ec0d2a6 tempest-ProjectMemberTests-1577701723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02842fe4-51fd-4548-b8a8-221c7fd9672d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:39:17 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-36e26ceb-5c45-4302-a3c0-3d716ec0d2a6 tempest-ProjectMemberTests-1577701723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e517483-e092-40b6-aa38-d8b1315cd4eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:39:17 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-36e26ceb-5c45-4302-a3c0-3d716ec0d2a6 tempest-ProjectMemberTests-1577701723 None] Volume edc5079b-be84-4c8c-9ca5-feb96cd6f9ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-edc5079b-be84-4c8c-9ca5-feb96cd6f9ee', 'volume_size': 1} Sep 29 18:39:17 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-36e26ceb-5c45-4302-a3c0-3d716ec0d2a6 tempest-ProjectMemberTests-1577701723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:39:17 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-36e26ceb-5c45-4302-a3c0-3d716ec0d2a6 tempest-ProjectMemberTests-1577701723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:39:17 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-36e26ceb-5c45-4302-a3c0-3d716ec0d2a6 tempest-ProjectMemberTests-1577701723 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:39:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1882816570',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edc5079b-be84-4c8c-9ca5-feb96cd6f9ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc5a83cdd1e34b24adfa899bf4067f0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:39:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:39:17Z,use_quota=True,user_id='671a2611e03549f08f718ec6a8379db0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)}" {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:39:17 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-36e26ceb-5c45-4302-a3c0-3d716ec0d2a6 tempest-ProjectMemberTests-1577701723 None] Creating volume edc5079b-be84-4c8c-9ca5-feb96cd6f9ee {{(pid=86512) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:39:17 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-36e26ceb-5c45-4302-a3c0-3d716ec0d2a6 tempest-ProjectMemberTests-1577701723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:39:17 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-36e26ceb-5c45-4302-a3c0-3d716ec0d2a6 tempest-ProjectMemberTests-1577701723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:39:17 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-36e26ceb-5c45-4302-a3c0-3d716ec0d2a6 tempest-ProjectMemberTests-1577701723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:39:17 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-36e26ceb-5c45-4302-a3c0-3d716ec0d2a6 tempest-ProjectMemberTests-1577701723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:39:17 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-36e26ceb-5c45-4302-a3c0-3d716ec0d2a6 tempest-ProjectMemberTests-1577701723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:39:17 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-36e26ceb-5c45-4302-a3c0-3d716ec0d2a6 tempest-ProjectMemberTests-1577701723 None] Selected osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 as target Quobyte volume. {{(pid=86512) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:39:17 devstack cinder-volume[86512]: INFO cinder.volume.drivers.remotefs [None req-36e26ceb-5c45-4302-a3c0-3d716ec0d2a6 tempest-ProjectMemberTests-1577701723 None] casted to osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 Sep 29 18:39:17 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-36e26ceb-5c45-4302-a3c0-3d716ec0d2a6 tempest-ProjectMemberTests-1577701723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-edc5079b-be84-4c8c-9ca5-feb96cd6f9ee 1073741824 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:17 devstack sudo[108227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-edc5079b-be84-4c8c-9ca5-feb96cd6f9ee 1073741824 Sep 29 18:39:17 devstack sudo[108227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:17 devstack sudo[108227]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:17 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-36e26ceb-5c45-4302-a3c0-3d716ec0d2a6 tempest-ProjectMemberTests-1577701723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-edc5079b-be84-4c8c-9ca5-feb96cd6f9ee 1073741824" returned: 0 in 0.447s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:17 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-36e26ceb-5c45-4302-a3c0-3d716ec0d2a6 tempest-ProjectMemberTests-1577701723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-edc5079b-be84-4c8c-9ca5-feb96cd6f9ee {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:17 devstack sudo[108233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-edc5079b-be84-4c8c-9ca5-feb96cd6f9ee Sep 29 18:39:17 devstack sudo[108233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:17 devstack sudo[108233]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:17 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-36e26ceb-5c45-4302-a3c0-3d716ec0d2a6 tempest-ProjectMemberTests-1577701723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-edc5079b-be84-4c8c-9ca5-feb96cd6f9ee" returned: 0 in 0.258s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:17 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-36e26ceb-5c45-4302-a3c0-3d716ec0d2a6 tempest-ProjectMemberTests-1577701723 None] <== create_volume: return (785ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'} {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:39:17 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-36e26ceb-5c45-4302-a3c0-3d716ec0d2a6 tempest-ProjectMemberTests-1577701723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.788s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:39:17 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-36e26ceb-5c45-4302-a3c0-3d716ec0d2a6 tempest-ProjectMemberTests-1577701723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e517483-e092-40b6-aa38-d8b1315cd4eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-edc5079b-be84-4c8c-9ca5-feb96cd6f9ee', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:39:17 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-36e26ceb-5c45-4302-a3c0-3d716ec0d2a6 tempest-ProjectMemberTests-1577701723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02d6d44f-342c-4e18-b9e4-1a2003558100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:39:18 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-36e26ceb-5c45-4302-a3c0-3d716ec0d2a6 tempest-ProjectMemberTests-1577701723 None] Volume volume-edc5079b-be84-4c8c-9ca5-feb96cd6f9ee (edc5079b-be84-4c8c-9ca5-feb96cd6f9ee): created successfully Sep 29 18:39:18 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-36e26ceb-5c45-4302-a3c0-3d716ec0d2a6 tempest-ProjectMemberTests-1577701723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02d6d44f-342c-4e18-b9e4-1a2003558100) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:39:18 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-36e26ceb-5c45-4302-a3c0-3d716ec0d2a6 tempest-ProjectMemberTests-1577701723 None] Flow 'volume_create_manager' (a8383b67-4bba-4e91-9d5f-c920aad2a3f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:39:18 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-36e26ceb-5c45-4302-a3c0-3d716ec0d2a6 tempest-ProjectMemberTests-1577701723 None] Created volume successfully. Sep 29 18:39:18 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-af2e395e-dbac-4521-bdd7-ba5353bffbf0 tempest-ProjectMemberTests-1577701723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:39:18 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-af2e395e-dbac-4521-bdd7-ba5353bffbf0 tempest-ProjectMemberTests-1577701723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:39:18 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-af2e395e-dbac-4521-bdd7-ba5353bffbf0 tempest-ProjectMemberTests-1577701723 None] Creating offline snapshot c5ac6bbd-f0ba-412a-9441-959e4270bc67 of volume edc5079b-be84-4c8c-9ca5-feb96cd6f9ee {{(pid=86512) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 18:39:18 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5d5fa7e-918d-437a-a93a-39376645838f]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:39:18 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-af2e395e-dbac-4521-bdd7-ba5353bffbf0 tempest-ProjectMemberTests-1577701723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-edc5079b-be84-4c8c-9ca5-feb96cd6f9ee {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:18 devstack sudo[108236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-edc5079b-be84-4c8c-9ca5-feb96cd6f9ee Sep 29 18:39:18 devstack sudo[108236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:18 devstack sudo[108236]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:18 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-af2e395e-dbac-4521-bdd7-ba5353bffbf0 tempest-ProjectMemberTests-1577701723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-edc5079b-be84-4c8c-9ca5-feb96cd6f9ee" returned: 0 in 0.367s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:18 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-af2e395e-dbac-4521-bdd7-ba5353bffbf0 tempest-ProjectMemberTests-1577701723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-edc5079b-be84-4c8c-9ca5-feb96cd6f9ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-edc5079b-be84-4c8c-9ca5-feb96cd6f9ee.c5ac6bbd-f0ba-412a-9441-959e4270bc67 1G {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:18 devstack sudo[108241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-edc5079b-be84-4c8c-9ca5-feb96cd6f9ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-edc5079b-be84-4c8c-9ca5-feb96cd6f9ee.c5ac6bbd-f0ba-412a-9441-959e4270bc67 1G Sep 29 18:39:18 devstack sudo[108241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:19 devstack sudo[108241]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:19 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-af2e395e-dbac-4521-bdd7-ba5353bffbf0 tempest-ProjectMemberTests-1577701723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-edc5079b-be84-4c8c-9ca5-feb96cd6f9ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-edc5079b-be84-4c8c-9ca5-feb96cd6f9ee.c5ac6bbd-f0ba-412a-9441-959e4270bc67 1G" returned: 0 in 0.446s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:19 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-af2e395e-dbac-4521-bdd7-ba5353bffbf0 tempest-ProjectMemberTests-1577701723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-edc5079b-be84-4c8c-9ca5-feb96cd6f9ee -F qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-edc5079b-be84-4c8c-9ca5-feb96cd6f9ee.c5ac6bbd-f0ba-412a-9441-959e4270bc67 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:19 devstack sudo[108247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-edc5079b-be84-4c8c-9ca5-feb96cd6f9ee -F qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-edc5079b-be84-4c8c-9ca5-feb96cd6f9ee.c5ac6bbd-f0ba-412a-9441-959e4270bc67 Sep 29 18:39:19 devstack sudo[108247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:19 devstack sudo[108247]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:19 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-af2e395e-dbac-4521-bdd7-ba5353bffbf0 tempest-ProjectMemberTests-1577701723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-edc5079b-be84-4c8c-9ca5-feb96cd6f9ee -F qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-edc5079b-be84-4c8c-9ca5-feb96cd6f9ee.c5ac6bbd-f0ba-412a-9441-959e4270bc67" returned: 0 in 0.317s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:19 devstack cinder-volume[86512]: WARNING cinder.volume.drivers.remotefs [None req-af2e395e-dbac-4521-bdd7-ba5353bffbf0 tempest-ProjectMemberTests-1577701723 None] /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-edc5079b-be84-4c8c-9ca5-feb96cd6f9ee.c5ac6bbd-f0ba-412a-9441-959e4270bc67 is being set with open permissions: ugo+rw Sep 29 18:39:19 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-af2e395e-dbac-4521-bdd7-ba5353bffbf0 tempest-ProjectMemberTests-1577701723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-edc5079b-be84-4c8c-9ca5-feb96cd6f9ee.c5ac6bbd-f0ba-412a-9441-959e4270bc67 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:19 devstack sudo[108252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-edc5079b-be84-4c8c-9ca5-feb96cd6f9ee.c5ac6bbd-f0ba-412a-9441-959e4270bc67 Sep 29 18:39:19 devstack sudo[108252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:19 devstack sudo[108252]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:19 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-af2e395e-dbac-4521-bdd7-ba5353bffbf0 tempest-ProjectMemberTests-1577701723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-edc5079b-be84-4c8c-9ca5-feb96cd6f9ee.c5ac6bbd-f0ba-412a-9441-959e4270bc67" returned: 0 in 0.252s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:19 devstack cinder-volume[86512]: DEBUG dbcounter [-] [86512] Writing DB stats cinder:SELECT=163,cinder:INSERT=57,cinder:UPDATE=202,cinder:DELETE=9 {{(pid=86512) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 18:39:19 devstack cinder-volume[86512]: DEBUG dbcounter [-] [86512] Writing DB stats cinder:SELECT=154,cinder:INSERT=59,cinder:UPDATE=192,cinder:DELETE=22 {{(pid=86512) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 18:39:19 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-af2e395e-dbac-4521-bdd7-ba5353bffbf0 tempest-ProjectMemberTests-1577701723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-edc5079b-be84-4c8c-9ca5-feb96cd6f9ee.info {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:19 devstack sudo[108255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-edc5079b-be84-4c8c-9ca5-feb96cd6f9ee.info Sep 29 18:39:19 devstack sudo[108255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:20 devstack sudo[108255]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:20 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-af2e395e-dbac-4521-bdd7-ba5353bffbf0 tempest-ProjectMemberTests-1577701723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-edc5079b-be84-4c8c-9ca5-feb96cd6f9ee.info" returned: 0 in 0.295s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:20 devstack cinder-volume[86512]: WARNING cinder.volume.drivers.remotefs [None req-af2e395e-dbac-4521-bdd7-ba5353bffbf0 tempest-ProjectMemberTests-1577701723 None] /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-edc5079b-be84-4c8c-9ca5-feb96cd6f9ee.info is being set with open permissions: ugo+rw Sep 29 18:39:20 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-af2e395e-dbac-4521-bdd7-ba5353bffbf0 tempest-ProjectMemberTests-1577701723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-edc5079b-be84-4c8c-9ca5-feb96cd6f9ee.info {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:20 devstack sudo[108258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-edc5079b-be84-4c8c-9ca5-feb96cd6f9ee.info Sep 29 18:39:20 devstack sudo[108258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:20 devstack sudo[108258]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:20 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-af2e395e-dbac-4521-bdd7-ba5353bffbf0 tempest-ProjectMemberTests-1577701723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-edc5079b-be84-4c8c-9ca5-feb96cd6f9ee.info" returned: 0 in 0.242s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:20 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-af2e395e-dbac-4521-bdd7-ba5353bffbf0 tempest-ProjectMemberTests-1577701723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.015s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:39:20 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-af2e395e-dbac-4521-bdd7-ba5353bffbf0 tempest-ProjectMemberTests-1577701723 None] Create snapshot completed successfully Sep 29 18:39:21 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-dc4af076-ffaa-4690-b0ea-08500448b26b tempest-ProjectMemberTests-1577701723 None] Acquiring lock "cinder-c5ac6bbd-f0ba-412a-9441-959e4270bc67-delete_snapshot" by "delete_snapshot" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:39:21 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-dc4af076-ffaa-4690-b0ea-08500448b26b tempest-ProjectMemberTests-1577701723 None] Lock "cinder-c5ac6bbd-f0ba-412a-9441-959e4270bc67-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:39:21 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-dc4af076-ffaa-4690-b0ea-08500448b26b tempest-ProjectMemberTests-1577701723 None] Acquiring lock "cinder-quobyte-edc5079b-be84-4c8c-9ca5-feb96cd6f9ee" by "delete_snapshot" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:39:21 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-dc4af076-ffaa-4690-b0ea-08500448b26b tempest-ProjectMemberTests-1577701723 None] Lock "cinder-quobyte-edc5079b-be84-4c8c-9ca5-feb96cd6f9ee" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:39:21 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-dc4af076-ffaa-4690-b0ea-08500448b26b tempest-ProjectMemberTests-1577701723 None] Acquiring lock "cinder-quobyte-c5ac6bbd-f0ba-412a-9441-959e4270bc67" by "_delete_snapshot" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:39:21 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-dc4af076-ffaa-4690-b0ea-08500448b26b tempest-ProjectMemberTests-1577701723 None] Lock "cinder-quobyte-c5ac6bbd-f0ba-412a-9441-959e4270bc67" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:39:21 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-dc4af076-ffaa-4690-b0ea-08500448b26b tempest-ProjectMemberTests-1577701723 None] Deleting offline snapshot c5ac6bbd-f0ba-412a-9441-959e4270bc67 of volume edc5079b-be84-4c8c-9ca5-feb96cd6f9ee {{(pid=86512) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 18:39:21 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-dc4af076-ffaa-4690-b0ea-08500448b26b tempest-ProjectMemberTests-1577701723 None] snapshot_file for this snap is: volume-edc5079b-be84-4c8c-9ca5-feb96cd6f9ee.c5ac6bbd-f0ba-412a-9441-959e4270bc67 {{(pid=86512) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 18:39:21 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[85e30915-5769-421a-a8b7-ea80db6313ec]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:39:21 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-dc4af076-ffaa-4690-b0ea-08500448b26b tempest-ProjectMemberTests-1577701723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-edc5079b-be84-4c8c-9ca5-feb96cd6f9ee.c5ac6bbd-f0ba-412a-9441-959e4270bc67 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:21 devstack sudo[108262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-edc5079b-be84-4c8c-9ca5-feb96cd6f9ee.c5ac6bbd-f0ba-412a-9441-959e4270bc67 Sep 29 18:39:21 devstack sudo[108262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:21 devstack sudo[108262]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:21 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-dc4af076-ffaa-4690-b0ea-08500448b26b tempest-ProjectMemberTests-1577701723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-edc5079b-be84-4c8c-9ca5-feb96cd6f9ee.c5ac6bbd-f0ba-412a-9441-959e4270bc67" returned: 0 in 0.380s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:21 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-dc4af076-ffaa-4690-b0ea-08500448b26b tempest-ProjectMemberTests-1577701723 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-edc5079b-be84-4c8c-9ca5-feb96cd6f9ee(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86512) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 18:39:21 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3d1c43f-af64-4fce-b952-eae5cdb43eed]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:39:21 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-dc4af076-ffaa-4690-b0ea-08500448b26b tempest-ProjectMemberTests-1577701723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-edc5079b-be84-4c8c-9ca5-feb96cd6f9ee {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:22 devstack sudo[108267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-edc5079b-be84-4c8c-9ca5-feb96cd6f9ee Sep 29 18:39:22 devstack sudo[108267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:22 devstack sudo[108267]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:22 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-dc4af076-ffaa-4690-b0ea-08500448b26b tempest-ProjectMemberTests-1577701723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-edc5079b-be84-4c8c-9ca5-feb96cd6f9ee" returned: 0 in 0.379s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:22 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-dc4af076-ffaa-4690-b0ea-08500448b26b tempest-ProjectMemberTests-1577701723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-edc5079b-be84-4c8c-9ca5-feb96cd6f9ee.c5ac6bbd-f0ba-412a-9441-959e4270bc67 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:22 devstack sudo[108272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-edc5079b-be84-4c8c-9ca5-feb96cd6f9ee.c5ac6bbd-f0ba-412a-9441-959e4270bc67 Sep 29 18:39:22 devstack sudo[108272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:22 devstack sudo[108272]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:22 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-dc4af076-ffaa-4690-b0ea-08500448b26b tempest-ProjectMemberTests-1577701723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-edc5079b-be84-4c8c-9ca5-feb96cd6f9ee.c5ac6bbd-f0ba-412a-9441-959e4270bc67" returned: 0 in 0.335s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:22 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-dc4af076-ffaa-4690-b0ea-08500448b26b tempest-ProjectMemberTests-1577701723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-edc5079b-be84-4c8c-9ca5-feb96cd6f9ee.c5ac6bbd-f0ba-412a-9441-959e4270bc67 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:22 devstack sudo[108278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-edc5079b-be84-4c8c-9ca5-feb96cd6f9ee.c5ac6bbd-f0ba-412a-9441-959e4270bc67 Sep 29 18:39:22 devstack sudo[108278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:23 devstack sudo[108278]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:23 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-dc4af076-ffaa-4690-b0ea-08500448b26b tempest-ProjectMemberTests-1577701723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-edc5079b-be84-4c8c-9ca5-feb96cd6f9ee.c5ac6bbd-f0ba-412a-9441-959e4270bc67" returned: 0 in 0.307s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:23 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-dc4af076-ffaa-4690-b0ea-08500448b26b tempest-ProjectMemberTests-1577701723 None] Lock "cinder-quobyte-c5ac6bbd-f0ba-412a-9441-959e4270bc67" released by "_delete_snapshot" :: held 1.524s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:39:23 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-dc4af076-ffaa-4690-b0ea-08500448b26b tempest-ProjectMemberTests-1577701723 None] Lock "cinder-quobyte-edc5079b-be84-4c8c-9ca5-feb96cd6f9ee" released by "delete_snapshot" :: held 1.550s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:39:23 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-dc4af076-ffaa-4690-b0ea-08500448b26b tempest-ProjectMemberTests-1577701723 None] Created reservations ['a172905f-7351-4d4e-b775-d412783939ce', '553d4b4d-f034-4664-8284-caf38ed057af', 'fe980d19-c13d-4e46-b745-83595b98d757', 'e2593402-567e-44c1-b295-d7f990ac503a'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:39:23 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-dc4af076-ffaa-4690-b0ea-08500448b26b tempest-ProjectMemberTests-1577701723 None] Delete snapshot completed successfully. Sep 29 18:39:23 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-dc4af076-ffaa-4690-b0ea-08500448b26b tempest-ProjectMemberTests-1577701723 None] Lock "cinder-c5ac6bbd-f0ba-412a-9441-959e4270bc67-delete_snapshot" released by "delete_snapshot" :: held 1.713s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:39:23 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-678a4ef1-e4fe-4c53-88e6-5c974ace2878 tempest-ProjectMemberTests-1577701723 None] Acquiring lock "cinder-edc5079b-be84-4c8c-9ca5-feb96cd6f9ee-delete_volume" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:39:23 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-678a4ef1-e4fe-4c53-88e6-5c974ace2878 tempest-ProjectMemberTests-1577701723 None] Lock "cinder-edc5079b-be84-4c8c-9ca5-feb96cd6f9ee-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:39:23 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-678a4ef1-e4fe-4c53-88e6-5c974ace2878 tempest-ProjectMemberTests-1577701723 None] Acquiring lock "cinder-quobyte-edc5079b-be84-4c8c-9ca5-feb96cd6f9ee" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:39:23 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-678a4ef1-e4fe-4c53-88e6-5c974ace2878 tempest-ProjectMemberTests-1577701723 None] Lock "cinder-quobyte-edc5079b-be84-4c8c-9ca5-feb96cd6f9ee" acquired by "delete_volume" :: waited 0.018s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:39:23 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[6df08641-bdf6-4831-9c87-051b1c6a544d]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:39:23 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-678a4ef1-e4fe-4c53-88e6-5c974ace2878 tempest-ProjectMemberTests-1577701723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-edc5079b-be84-4c8c-9ca5-feb96cd6f9ee {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:23 devstack sudo[108281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-edc5079b-be84-4c8c-9ca5-feb96cd6f9ee Sep 29 18:39:23 devstack sudo[108281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:24 devstack sudo[108281]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:24 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-678a4ef1-e4fe-4c53-88e6-5c974ace2878 tempest-ProjectMemberTests-1577701723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-edc5079b-be84-4c8c-9ca5-feb96cd6f9ee" returned: 0 in 0.409s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:24 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-678a4ef1-e4fe-4c53-88e6-5c974ace2878 tempest-ProjectMemberTests-1577701723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-edc5079b-be84-4c8c-9ca5-feb96cd6f9ee {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:24 devstack sudo[108288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-edc5079b-be84-4c8c-9ca5-feb96cd6f9ee Sep 29 18:39:24 devstack sudo[108288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:24 devstack sudo[108288]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:24 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-678a4ef1-e4fe-4c53-88e6-5c974ace2878 tempest-ProjectMemberTests-1577701723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-edc5079b-be84-4c8c-9ca5-feb96cd6f9ee" returned: 0 in 0.262s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:24 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-678a4ef1-e4fe-4c53-88e6-5c974ace2878 tempest-ProjectMemberTests-1577701723 None] Lock "cinder-quobyte-edc5079b-be84-4c8c-9ca5-feb96cd6f9ee" released by "delete_volume" :: held 0.744s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:39:24 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-678a4ef1-e4fe-4c53-88e6-5c974ace2878 tempest-ProjectMemberTests-1577701723 None] Created reservations ['05281282-ac78-4b00-a6b3-f2f814d416f1', '61f4203d-a732-46fd-ae90-df126a7fb612', '0c509b41-22de-48b6-82d3-98565f6caf00', '9e40944a-4610-4be2-bb25-598bcc71e80e'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:39:24 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-678a4ef1-e4fe-4c53-88e6-5c974ace2878 tempest-ProjectMemberTests-1577701723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:39:24 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-678a4ef1-e4fe-4c53-88e6-5c974ace2878 tempest-ProjectMemberTests-1577701723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:39:24 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-678a4ef1-e4fe-4c53-88e6-5c974ace2878 tempest-ProjectMemberTests-1577701723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:39:24 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-678a4ef1-e4fe-4c53-88e6-5c974ace2878 tempest-ProjectMemberTests-1577701723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:39:24 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-678a4ef1-e4fe-4c53-88e6-5c974ace2878 tempest-ProjectMemberTests-1577701723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:39:24 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-678a4ef1-e4fe-4c53-88e6-5c974ace2878 tempest-ProjectMemberTests-1577701723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:24 devstack sudo[108292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:39:24 devstack sudo[108292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:24 devstack sudo[108292]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:24 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-678a4ef1-e4fe-4c53-88e6-5c974ace2878 tempest-ProjectMemberTests-1577701723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.280s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:24 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-678a4ef1-e4fe-4c53-88e6-5c974ace2878 tempest-ProjectMemberTests-1577701723 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:39:24 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-678a4ef1-e4fe-4c53-88e6-5c974ace2878 tempest-ProjectMemberTests-1577701723 None] Deleted volume successfully. Sep 29 18:39:24 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-678a4ef1-e4fe-4c53-88e6-5c974ace2878 tempest-ProjectMemberTests-1577701723 None] Lock "cinder-edc5079b-be84-4c8c-9ca5-feb96cd6f9ee-delete_volume" released by "delete_volume" :: held 1.253s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:39:25 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-05925be7-bccc-4940-9ec3-fc4b67988fa3 tempest-ProjectMemberTests-1577701723 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86512) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:39:25 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-05925be7-bccc-4940-9ec3-fc4b67988fa3 tempest-ProjectMemberTests-1577701723 None] Flow 'volume_create_manager' (403dae45-5bcd-4a2a-8b80-7a2c19b6b15f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:39:25 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-05925be7-bccc-4940-9ec3-fc4b67988fa3 tempest-ProjectMemberTests-1577701723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3051c15-4618-418c-a3c0-78e037afeb88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:39:25 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-05925be7-bccc-4940-9ec3-fc4b67988fa3 tempest-ProjectMemberTests-1577701723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3051c15-4618-418c-a3c0-78e037afeb88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:39:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1781932810',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bf08ff9-afd4-4d9b-b994-437825de47a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc5a83cdd1e34b24adfa899bf4067f0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:39:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:39:25Z,use_quota=True,user_id='671a2611e03549f08f718ec6a8379db0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:39:25 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-05925be7-bccc-4940-9ec3-fc4b67988fa3 tempest-ProjectMemberTests-1577701723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fef80a8-a5b8-4a34-8249-e18049666c75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:39:25 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-05925be7-bccc-4940-9ec3-fc4b67988fa3 tempest-ProjectMemberTests-1577701723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fef80a8-a5b8-4a34-8249-e18049666c75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:39:25 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-05925be7-bccc-4940-9ec3-fc4b67988fa3 tempest-ProjectMemberTests-1577701723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e962debe-32c6-4ab9-bc5a-40c46f8dab54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:39:25 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-05925be7-bccc-4940-9ec3-fc4b67988fa3 tempest-ProjectMemberTests-1577701723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e962debe-32c6-4ab9-bc5a-40c46f8dab54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7bf08ff9-afd4-4d9b-b994-437825de47a6', 'volume_name': 'volume-7bf08ff9-afd4-4d9b-b994-437825de47a6', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:39:25 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-05925be7-bccc-4940-9ec3-fc4b67988fa3 tempest-ProjectMemberTests-1577701723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d40bbbb7-b51f-44ec-91b1-0a7cafcbd71f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:39:25 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-05925be7-bccc-4940-9ec3-fc4b67988fa3 tempest-ProjectMemberTests-1577701723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d40bbbb7-b51f-44ec-91b1-0a7cafcbd71f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:39:25 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-05925be7-bccc-4940-9ec3-fc4b67988fa3 tempest-ProjectMemberTests-1577701723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ad118ce-8e6f-4dce-a0e8-dd781a384acb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:39:25 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-05925be7-bccc-4940-9ec3-fc4b67988fa3 tempest-ProjectMemberTests-1577701723 None] Volume 7bf08ff9-afd4-4d9b-b994-437825de47a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7bf08ff9-afd4-4d9b-b994-437825de47a6', 'volume_size': 1} Sep 29 18:39:25 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-05925be7-bccc-4940-9ec3-fc4b67988fa3 tempest-ProjectMemberTests-1577701723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:39:25 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-05925be7-bccc-4940-9ec3-fc4b67988fa3 tempest-ProjectMemberTests-1577701723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:39:25 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-05925be7-bccc-4940-9ec3-fc4b67988fa3 tempest-ProjectMemberTests-1577701723 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:39:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1781932810',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bf08ff9-afd4-4d9b-b994-437825de47a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc5a83cdd1e34b24adfa899bf4067f0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:39:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:39:25Z,use_quota=True,user_id='671a2611e03549f08f718ec6a8379db0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)}" {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:39:25 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-05925be7-bccc-4940-9ec3-fc4b67988fa3 tempest-ProjectMemberTests-1577701723 None] Creating volume 7bf08ff9-afd4-4d9b-b994-437825de47a6 {{(pid=86512) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:39:25 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-05925be7-bccc-4940-9ec3-fc4b67988fa3 tempest-ProjectMemberTests-1577701723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:39:25 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-05925be7-bccc-4940-9ec3-fc4b67988fa3 tempest-ProjectMemberTests-1577701723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:39:25 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-05925be7-bccc-4940-9ec3-fc4b67988fa3 tempest-ProjectMemberTests-1577701723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:39:25 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-05925be7-bccc-4940-9ec3-fc4b67988fa3 tempest-ProjectMemberTests-1577701723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:39:25 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-05925be7-bccc-4940-9ec3-fc4b67988fa3 tempest-ProjectMemberTests-1577701723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:39:25 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-05925be7-bccc-4940-9ec3-fc4b67988fa3 tempest-ProjectMemberTests-1577701723 None] Selected osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 as target Quobyte volume. {{(pid=86512) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:39:25 devstack cinder-volume[86512]: INFO cinder.volume.drivers.remotefs [None req-05925be7-bccc-4940-9ec3-fc4b67988fa3 tempest-ProjectMemberTests-1577701723 None] casted to osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 Sep 29 18:39:25 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-05925be7-bccc-4940-9ec3-fc4b67988fa3 tempest-ProjectMemberTests-1577701723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7bf08ff9-afd4-4d9b-b994-437825de47a6 1073741824 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:25 devstack sudo[108295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7bf08ff9-afd4-4d9b-b994-437825de47a6 1073741824 Sep 29 18:39:25 devstack sudo[108295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:25 devstack sudo[108295]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:25 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-05925be7-bccc-4940-9ec3-fc4b67988fa3 tempest-ProjectMemberTests-1577701723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7bf08ff9-afd4-4d9b-b994-437825de47a6 1073741824" returned: 0 in 0.465s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:25 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-05925be7-bccc-4940-9ec3-fc4b67988fa3 tempest-ProjectMemberTests-1577701723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7bf08ff9-afd4-4d9b-b994-437825de47a6 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:25 devstack sudo[108301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7bf08ff9-afd4-4d9b-b994-437825de47a6 Sep 29 18:39:25 devstack sudo[108301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:26 devstack sudo[108301]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:26 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-05925be7-bccc-4940-9ec3-fc4b67988fa3 tempest-ProjectMemberTests-1577701723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7bf08ff9-afd4-4d9b-b994-437825de47a6" returned: 0 in 0.272s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:26 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-05925be7-bccc-4940-9ec3-fc4b67988fa3 tempest-ProjectMemberTests-1577701723 None] <== create_volume: return (796ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'} {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:39:26 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-05925be7-bccc-4940-9ec3-fc4b67988fa3 tempest-ProjectMemberTests-1577701723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.799s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:39:26 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-05925be7-bccc-4940-9ec3-fc4b67988fa3 tempest-ProjectMemberTests-1577701723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ad118ce-8e6f-4dce-a0e8-dd781a384acb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7bf08ff9-afd4-4d9b-b994-437825de47a6', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:39:26 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-05925be7-bccc-4940-9ec3-fc4b67988fa3 tempest-ProjectMemberTests-1577701723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (819f00d8-ea7f-4c58-9df4-4490df206fe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:39:26 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-05925be7-bccc-4940-9ec3-fc4b67988fa3 tempest-ProjectMemberTests-1577701723 None] Volume volume-7bf08ff9-afd4-4d9b-b994-437825de47a6 (7bf08ff9-afd4-4d9b-b994-437825de47a6): created successfully Sep 29 18:39:26 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-05925be7-bccc-4940-9ec3-fc4b67988fa3 tempest-ProjectMemberTests-1577701723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (819f00d8-ea7f-4c58-9df4-4490df206fe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:39:26 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-05925be7-bccc-4940-9ec3-fc4b67988fa3 tempest-ProjectMemberTests-1577701723 None] Flow 'volume_create_manager' (403dae45-5bcd-4a2a-8b80-7a2c19b6b15f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:39:26 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-05925be7-bccc-4940-9ec3-fc4b67988fa3 tempest-ProjectMemberTests-1577701723 None] Created volume successfully. Sep 29 18:39:27 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-dc8523f6-4225-41bf-9429-9ed771ef3b6e tempest-ProjectMemberTests-1577701723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:39:27 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-dc8523f6-4225-41bf-9429-9ed771ef3b6e tempest-ProjectMemberTests-1577701723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:39:27 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-dc8523f6-4225-41bf-9429-9ed771ef3b6e tempest-ProjectMemberTests-1577701723 None] Creating offline snapshot 96911f23-8509-41b6-95a6-142e33cbda55 of volume 7bf08ff9-afd4-4d9b-b994-437825de47a6 {{(pid=86512) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 18:39:27 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[087fe575-45ce-42ff-86ea-5991bc94f971]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:39:27 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-dc8523f6-4225-41bf-9429-9ed771ef3b6e tempest-ProjectMemberTests-1577701723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7bf08ff9-afd4-4d9b-b994-437825de47a6 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:27 devstack sudo[108304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7bf08ff9-afd4-4d9b-b994-437825de47a6 Sep 29 18:39:27 devstack sudo[108304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:28 devstack sudo[108304]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:28 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-dc8523f6-4225-41bf-9429-9ed771ef3b6e tempest-ProjectMemberTests-1577701723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7bf08ff9-afd4-4d9b-b994-437825de47a6" returned: 0 in 0.359s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:28 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-dc8523f6-4225-41bf-9429-9ed771ef3b6e tempest-ProjectMemberTests-1577701723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7bf08ff9-afd4-4d9b-b994-437825de47a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7bf08ff9-afd4-4d9b-b994-437825de47a6.96911f23-8509-41b6-95a6-142e33cbda55 1G {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:28 devstack sudo[108309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7bf08ff9-afd4-4d9b-b994-437825de47a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7bf08ff9-afd4-4d9b-b994-437825de47a6.96911f23-8509-41b6-95a6-142e33cbda55 1G Sep 29 18:39:28 devstack sudo[108309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:28 devstack sudo[108309]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:28 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-dc8523f6-4225-41bf-9429-9ed771ef3b6e tempest-ProjectMemberTests-1577701723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7bf08ff9-afd4-4d9b-b994-437825de47a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7bf08ff9-afd4-4d9b-b994-437825de47a6.96911f23-8509-41b6-95a6-142e33cbda55 1G" returned: 0 in 0.514s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:28 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-dc8523f6-4225-41bf-9429-9ed771ef3b6e tempest-ProjectMemberTests-1577701723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7bf08ff9-afd4-4d9b-b994-437825de47a6 -F qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7bf08ff9-afd4-4d9b-b994-437825de47a6.96911f23-8509-41b6-95a6-142e33cbda55 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:28 devstack sudo[108315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7bf08ff9-afd4-4d9b-b994-437825de47a6 -F qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7bf08ff9-afd4-4d9b-b994-437825de47a6.96911f23-8509-41b6-95a6-142e33cbda55 Sep 29 18:39:28 devstack sudo[108315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:28 devstack sudo[108315]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:28 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-dc8523f6-4225-41bf-9429-9ed771ef3b6e tempest-ProjectMemberTests-1577701723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7bf08ff9-afd4-4d9b-b994-437825de47a6 -F qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7bf08ff9-afd4-4d9b-b994-437825de47a6.96911f23-8509-41b6-95a6-142e33cbda55" returned: 0 in 0.321s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:28 devstack cinder-volume[86512]: WARNING cinder.volume.drivers.remotefs [None req-dc8523f6-4225-41bf-9429-9ed771ef3b6e tempest-ProjectMemberTests-1577701723 None] /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7bf08ff9-afd4-4d9b-b994-437825de47a6.96911f23-8509-41b6-95a6-142e33cbda55 is being set with open permissions: ugo+rw Sep 29 18:39:28 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-dc8523f6-4225-41bf-9429-9ed771ef3b6e tempest-ProjectMemberTests-1577701723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7bf08ff9-afd4-4d9b-b994-437825de47a6.96911f23-8509-41b6-95a6-142e33cbda55 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:28 devstack sudo[108320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7bf08ff9-afd4-4d9b-b994-437825de47a6.96911f23-8509-41b6-95a6-142e33cbda55 Sep 29 18:39:28 devstack sudo[108320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:29 devstack sudo[108320]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:29 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-dc8523f6-4225-41bf-9429-9ed771ef3b6e tempest-ProjectMemberTests-1577701723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7bf08ff9-afd4-4d9b-b994-437825de47a6.96911f23-8509-41b6-95a6-142e33cbda55" returned: 0 in 0.240s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:29 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-dc8523f6-4225-41bf-9429-9ed771ef3b6e tempest-ProjectMemberTests-1577701723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7bf08ff9-afd4-4d9b-b994-437825de47a6.info {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:29 devstack sudo[108323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7bf08ff9-afd4-4d9b-b994-437825de47a6.info Sep 29 18:39:29 devstack sudo[108323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:29 devstack sudo[108323]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:29 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-dc8523f6-4225-41bf-9429-9ed771ef3b6e tempest-ProjectMemberTests-1577701723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7bf08ff9-afd4-4d9b-b994-437825de47a6.info" returned: 0 in 0.250s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:29 devstack cinder-volume[86512]: WARNING cinder.volume.drivers.remotefs [None req-dc8523f6-4225-41bf-9429-9ed771ef3b6e tempest-ProjectMemberTests-1577701723 None] /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7bf08ff9-afd4-4d9b-b994-437825de47a6.info is being set with open permissions: ugo+rw Sep 29 18:39:29 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-dc8523f6-4225-41bf-9429-9ed771ef3b6e tempest-ProjectMemberTests-1577701723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7bf08ff9-afd4-4d9b-b994-437825de47a6.info {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:29 devstack sudo[108326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7bf08ff9-afd4-4d9b-b994-437825de47a6.info Sep 29 18:39:29 devstack sudo[108326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:29 devstack sudo[108326]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:29 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-dc8523f6-4225-41bf-9429-9ed771ef3b6e tempest-ProjectMemberTests-1577701723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7bf08ff9-afd4-4d9b-b994-437825de47a6.info" returned: 0 in 0.249s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:29 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-dc8523f6-4225-41bf-9429-9ed771ef3b6e tempest-ProjectMemberTests-1577701723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.023s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:39:29 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-dc8523f6-4225-41bf-9429-9ed771ef3b6e tempest-ProjectMemberTests-1577701723 None] Create snapshot completed successfully Sep 29 18:39:30 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-9a93d945-4b76-4533-9af4-056ca39a7aed tempest-ProjectMemberTests-1577701723 None] Acquiring lock "cinder-96911f23-8509-41b6-95a6-142e33cbda55-delete_snapshot" by "delete_snapshot" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:39:30 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-9a93d945-4b76-4533-9af4-056ca39a7aed tempest-ProjectMemberTests-1577701723 None] Lock "cinder-96911f23-8509-41b6-95a6-142e33cbda55-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:39:30 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-9a93d945-4b76-4533-9af4-056ca39a7aed tempest-ProjectMemberTests-1577701723 None] Acquiring lock "cinder-quobyte-7bf08ff9-afd4-4d9b-b994-437825de47a6" by "delete_snapshot" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:39:30 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-9a93d945-4b76-4533-9af4-056ca39a7aed tempest-ProjectMemberTests-1577701723 None] Lock "cinder-quobyte-7bf08ff9-afd4-4d9b-b994-437825de47a6" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:39:30 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-9a93d945-4b76-4533-9af4-056ca39a7aed tempest-ProjectMemberTests-1577701723 None] Acquiring lock "cinder-quobyte-96911f23-8509-41b6-95a6-142e33cbda55" by "_delete_snapshot" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:39:30 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-9a93d945-4b76-4533-9af4-056ca39a7aed tempest-ProjectMemberTests-1577701723 None] Lock "cinder-quobyte-96911f23-8509-41b6-95a6-142e33cbda55" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:39:30 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-9a93d945-4b76-4533-9af4-056ca39a7aed tempest-ProjectMemberTests-1577701723 None] Deleting offline snapshot 96911f23-8509-41b6-95a6-142e33cbda55 of volume 7bf08ff9-afd4-4d9b-b994-437825de47a6 {{(pid=86512) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 18:39:30 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-9a93d945-4b76-4533-9af4-056ca39a7aed tempest-ProjectMemberTests-1577701723 None] snapshot_file for this snap is: volume-7bf08ff9-afd4-4d9b-b994-437825de47a6.96911f23-8509-41b6-95a6-142e33cbda55 {{(pid=86512) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 18:39:30 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d28831e-5909-4fb2-8896-9a70093958f4]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:39:30 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-9a93d945-4b76-4533-9af4-056ca39a7aed tempest-ProjectMemberTests-1577701723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7bf08ff9-afd4-4d9b-b994-437825de47a6.96911f23-8509-41b6-95a6-142e33cbda55 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:30 devstack sudo[108329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7bf08ff9-afd4-4d9b-b994-437825de47a6.96911f23-8509-41b6-95a6-142e33cbda55 Sep 29 18:39:30 devstack sudo[108329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:31 devstack sudo[108329]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:31 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-9a93d945-4b76-4533-9af4-056ca39a7aed tempest-ProjectMemberTests-1577701723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7bf08ff9-afd4-4d9b-b994-437825de47a6.96911f23-8509-41b6-95a6-142e33cbda55" returned: 0 in 0.364s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:31 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-9a93d945-4b76-4533-9af4-056ca39a7aed tempest-ProjectMemberTests-1577701723 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7bf08ff9-afd4-4d9b-b994-437825de47a6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86512) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 18:39:31 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[f07b56a4-f64b-4a8f-9687-28a9303dba67]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:39:31 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-9a93d945-4b76-4533-9af4-056ca39a7aed tempest-ProjectMemberTests-1577701723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7bf08ff9-afd4-4d9b-b994-437825de47a6 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:31 devstack sudo[108334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7bf08ff9-afd4-4d9b-b994-437825de47a6 Sep 29 18:39:31 devstack sudo[108334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:31 devstack sudo[108334]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:31 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-9a93d945-4b76-4533-9af4-056ca39a7aed tempest-ProjectMemberTests-1577701723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7bf08ff9-afd4-4d9b-b994-437825de47a6" returned: 0 in 0.400s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:31 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-9a93d945-4b76-4533-9af4-056ca39a7aed tempest-ProjectMemberTests-1577701723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7bf08ff9-afd4-4d9b-b994-437825de47a6.96911f23-8509-41b6-95a6-142e33cbda55 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:31 devstack sudo[108340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7bf08ff9-afd4-4d9b-b994-437825de47a6.96911f23-8509-41b6-95a6-142e33cbda55 Sep 29 18:39:31 devstack sudo[108340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:32 devstack sudo[108340]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:32 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-9a93d945-4b76-4533-9af4-056ca39a7aed tempest-ProjectMemberTests-1577701723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7bf08ff9-afd4-4d9b-b994-437825de47a6.96911f23-8509-41b6-95a6-142e33cbda55" returned: 0 in 0.355s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:32 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-9a93d945-4b76-4533-9af4-056ca39a7aed tempest-ProjectMemberTests-1577701723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7bf08ff9-afd4-4d9b-b994-437825de47a6.96911f23-8509-41b6-95a6-142e33cbda55 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:32 devstack sudo[108345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7bf08ff9-afd4-4d9b-b994-437825de47a6.96911f23-8509-41b6-95a6-142e33cbda55 Sep 29 18:39:32 devstack sudo[108345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:32 devstack sudo[108345]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:32 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-9a93d945-4b76-4533-9af4-056ca39a7aed tempest-ProjectMemberTests-1577701723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7bf08ff9-afd4-4d9b-b994-437825de47a6.96911f23-8509-41b6-95a6-142e33cbda55" returned: 0 in 0.247s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:32 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-9a93d945-4b76-4533-9af4-056ca39a7aed tempest-ProjectMemberTests-1577701723 None] Lock "cinder-quobyte-96911f23-8509-41b6-95a6-142e33cbda55" released by "_delete_snapshot" :: held 1.478s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:39:32 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-9a93d945-4b76-4533-9af4-056ca39a7aed tempest-ProjectMemberTests-1577701723 None] Lock "cinder-quobyte-7bf08ff9-afd4-4d9b-b994-437825de47a6" released by "delete_snapshot" :: held 1.500s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:39:32 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-9a93d945-4b76-4533-9af4-056ca39a7aed tempest-ProjectMemberTests-1577701723 None] Created reservations ['89186577-b70a-4bdb-8db2-b1147ddbb4b5', 'c8195374-41aa-4c02-a44b-d8a4ff45cbc2', '697d6fa8-a21e-4b9e-8af3-0077819b180e', '3054cc96-e3e3-4734-a5d8-fb3de20acbfe'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:39:32 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-9a93d945-4b76-4533-9af4-056ca39a7aed tempest-ProjectMemberTests-1577701723 None] Delete snapshot completed successfully. Sep 29 18:39:32 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-9a93d945-4b76-4533-9af4-056ca39a7aed tempest-ProjectMemberTests-1577701723 None] Lock "cinder-96911f23-8509-41b6-95a6-142e33cbda55-delete_snapshot" released by "delete_snapshot" :: held 1.662s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:39:32 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-f3fcc11b-2fd5-4267-b27c-fc2bccd715e8 tempest-ProjectMemberTests-1577701723 None] Acquiring lock "cinder-7bf08ff9-afd4-4d9b-b994-437825de47a6-delete_volume" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:39:32 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-f3fcc11b-2fd5-4267-b27c-fc2bccd715e8 tempest-ProjectMemberTests-1577701723 None] Lock "cinder-7bf08ff9-afd4-4d9b-b994-437825de47a6-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:39:32 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-f3fcc11b-2fd5-4267-b27c-fc2bccd715e8 tempest-ProjectMemberTests-1577701723 None] Acquiring lock "cinder-quobyte-7bf08ff9-afd4-4d9b-b994-437825de47a6" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:39:32 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-f3fcc11b-2fd5-4267-b27c-fc2bccd715e8 tempest-ProjectMemberTests-1577701723 None] Lock "cinder-quobyte-7bf08ff9-afd4-4d9b-b994-437825de47a6" acquired by "delete_volume" :: waited 0.019s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:39:33 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[43c83955-6fc2-42c3-a1cd-c9e9a48c47f5]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:39:33 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-f3fcc11b-2fd5-4267-b27c-fc2bccd715e8 tempest-ProjectMemberTests-1577701723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7bf08ff9-afd4-4d9b-b994-437825de47a6 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:33 devstack sudo[108348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7bf08ff9-afd4-4d9b-b994-437825de47a6 Sep 29 18:39:33 devstack sudo[108348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:33 devstack sudo[108348]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:33 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-f3fcc11b-2fd5-4267-b27c-fc2bccd715e8 tempest-ProjectMemberTests-1577701723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7bf08ff9-afd4-4d9b-b994-437825de47a6" returned: 0 in 0.375s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:33 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-f3fcc11b-2fd5-4267-b27c-fc2bccd715e8 tempest-ProjectMemberTests-1577701723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7bf08ff9-afd4-4d9b-b994-437825de47a6 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:33 devstack sudo[108353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7bf08ff9-afd4-4d9b-b994-437825de47a6 Sep 29 18:39:33 devstack sudo[108353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:33 devstack sudo[108353]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:33 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-f3fcc11b-2fd5-4267-b27c-fc2bccd715e8 tempest-ProjectMemberTests-1577701723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-7bf08ff9-afd4-4d9b-b994-437825de47a6" returned: 0 in 0.330s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:33 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-f3fcc11b-2fd5-4267-b27c-fc2bccd715e8 tempest-ProjectMemberTests-1577701723 None] Lock "cinder-quobyte-7bf08ff9-afd4-4d9b-b994-437825de47a6" released by "delete_volume" :: held 0.778s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:39:33 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-f3fcc11b-2fd5-4267-b27c-fc2bccd715e8 tempest-ProjectMemberTests-1577701723 None] Created reservations ['43241f1d-38fc-488f-a1d1-dfdb82ee104b', '6587cc7c-53fb-423f-81e8-f30afd0c0325', 'e1923f90-f619-4671-a6c6-69755099e40f', '7afdd720-7943-4cdf-a520-08a9426a9b84'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:39:33 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-f3fcc11b-2fd5-4267-b27c-fc2bccd715e8 tempest-ProjectMemberTests-1577701723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:39:33 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-f3fcc11b-2fd5-4267-b27c-fc2bccd715e8 tempest-ProjectMemberTests-1577701723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:39:33 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-f3fcc11b-2fd5-4267-b27c-fc2bccd715e8 tempest-ProjectMemberTests-1577701723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:39:33 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-f3fcc11b-2fd5-4267-b27c-fc2bccd715e8 tempest-ProjectMemberTests-1577701723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:39:33 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-f3fcc11b-2fd5-4267-b27c-fc2bccd715e8 tempest-ProjectMemberTests-1577701723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:39:33 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-f3fcc11b-2fd5-4267-b27c-fc2bccd715e8 tempest-ProjectMemberTests-1577701723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:33 devstack sudo[108356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:39:33 devstack sudo[108356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:34 devstack sudo[108356]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:34 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-f3fcc11b-2fd5-4267-b27c-fc2bccd715e8 tempest-ProjectMemberTests-1577701723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.264s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:34 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-f3fcc11b-2fd5-4267-b27c-fc2bccd715e8 tempest-ProjectMemberTests-1577701723 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:39:34 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-f3fcc11b-2fd5-4267-b27c-fc2bccd715e8 tempest-ProjectMemberTests-1577701723 None] Deleted volume successfully. Sep 29 18:39:34 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-f3fcc11b-2fd5-4267-b27c-fc2bccd715e8 tempest-ProjectMemberTests-1577701723 None] Lock "cinder-7bf08ff9-afd4-4d9b-b994-437825de47a6-delete_volume" released by "delete_volume" :: held 1.255s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:39:34 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-980d3fb4-697d-4de0-92ce-d7b391d7469f tempest-ProjectMemberTests-1577701723 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86512) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:39:34 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-980d3fb4-697d-4de0-92ce-d7b391d7469f tempest-ProjectMemberTests-1577701723 None] Flow 'volume_create_manager' (8a413462-a593-4d1c-8cfb-88fe53250cc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:39:34 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-980d3fb4-697d-4de0-92ce-d7b391d7469f tempest-ProjectMemberTests-1577701723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (255b9401-0360-4315-a3d8-37f0e8ce0d16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:39:34 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-980d3fb4-697d-4de0-92ce-d7b391d7469f tempest-ProjectMemberTests-1577701723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (255b9401-0360-4315-a3d8-37f0e8ce0d16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:39:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-939257682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6fb34e1-8399-44c5-b5c6-d89b3efbc699,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc5a83cdd1e34b24adfa899bf4067f0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:39:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:39:35Z,use_quota=True,user_id='671a2611e03549f08f718ec6a8379db0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:39:34 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-980d3fb4-697d-4de0-92ce-d7b391d7469f tempest-ProjectMemberTests-1577701723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63a643f9-58c2-40d3-8ef1-da9de090dcb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:39:34 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-980d3fb4-697d-4de0-92ce-d7b391d7469f tempest-ProjectMemberTests-1577701723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63a643f9-58c2-40d3-8ef1-da9de090dcb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:39:34 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-980d3fb4-697d-4de0-92ce-d7b391d7469f tempest-ProjectMemberTests-1577701723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0443974e-77cf-4cc0-8cc1-1700ac306959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:39:34 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-980d3fb4-697d-4de0-92ce-d7b391d7469f tempest-ProjectMemberTests-1577701723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0443974e-77cf-4cc0-8cc1-1700ac306959) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6fb34e1-8399-44c5-b5c6-d89b3efbc699', 'volume_name': 'volume-a6fb34e1-8399-44c5-b5c6-d89b3efbc699', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:39:34 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-980d3fb4-697d-4de0-92ce-d7b391d7469f tempest-ProjectMemberTests-1577701723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ee31bd2-4a1a-45c9-9d66-4caf86616095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:39:34 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-980d3fb4-697d-4de0-92ce-d7b391d7469f tempest-ProjectMemberTests-1577701723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ee31bd2-4a1a-45c9-9d66-4caf86616095) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:39:34 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-980d3fb4-697d-4de0-92ce-d7b391d7469f tempest-ProjectMemberTests-1577701723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af01c7ad-e375-467c-89cc-0204ed9787b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:39:34 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-980d3fb4-697d-4de0-92ce-d7b391d7469f tempest-ProjectMemberTests-1577701723 None] Volume a6fb34e1-8399-44c5-b5c6-d89b3efbc699: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6fb34e1-8399-44c5-b5c6-d89b3efbc699', 'volume_size': 1} Sep 29 18:39:34 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-980d3fb4-697d-4de0-92ce-d7b391d7469f tempest-ProjectMemberTests-1577701723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:39:34 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-980d3fb4-697d-4de0-92ce-d7b391d7469f tempest-ProjectMemberTests-1577701723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:39:34 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-980d3fb4-697d-4de0-92ce-d7b391d7469f tempest-ProjectMemberTests-1577701723 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:39:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-939257682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6fb34e1-8399-44c5-b5c6-d89b3efbc699,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc5a83cdd1e34b24adfa899bf4067f0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:39:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:39:35Z,use_quota=True,user_id='671a2611e03549f08f718ec6a8379db0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)}" {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:39:34 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-980d3fb4-697d-4de0-92ce-d7b391d7469f tempest-ProjectMemberTests-1577701723 None] Creating volume a6fb34e1-8399-44c5-b5c6-d89b3efbc699 {{(pid=86512) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:39:34 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-980d3fb4-697d-4de0-92ce-d7b391d7469f tempest-ProjectMemberTests-1577701723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:39:34 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-980d3fb4-697d-4de0-92ce-d7b391d7469f tempest-ProjectMemberTests-1577701723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:39:34 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-980d3fb4-697d-4de0-92ce-d7b391d7469f tempest-ProjectMemberTests-1577701723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:39:34 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-980d3fb4-697d-4de0-92ce-d7b391d7469f tempest-ProjectMemberTests-1577701723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:39:34 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-980d3fb4-697d-4de0-92ce-d7b391d7469f tempest-ProjectMemberTests-1577701723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:39:34 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-980d3fb4-697d-4de0-92ce-d7b391d7469f tempest-ProjectMemberTests-1577701723 None] Selected osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 as target Quobyte volume. {{(pid=86512) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:39:34 devstack cinder-volume[86512]: INFO cinder.volume.drivers.remotefs [None req-980d3fb4-697d-4de0-92ce-d7b391d7469f tempest-ProjectMemberTests-1577701723 None] casted to osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 Sep 29 18:39:34 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-980d3fb4-697d-4de0-92ce-d7b391d7469f tempest-ProjectMemberTests-1577701723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a6fb34e1-8399-44c5-b5c6-d89b3efbc699 1073741824 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:34 devstack sudo[108360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a6fb34e1-8399-44c5-b5c6-d89b3efbc699 1073741824 Sep 29 18:39:34 devstack sudo[108360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:35 devstack sudo[108360]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:35 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-980d3fb4-697d-4de0-92ce-d7b391d7469f tempest-ProjectMemberTests-1577701723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a6fb34e1-8399-44c5-b5c6-d89b3efbc699 1073741824" returned: 0 in 0.445s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:35 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-980d3fb4-697d-4de0-92ce-d7b391d7469f tempest-ProjectMemberTests-1577701723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a6fb34e1-8399-44c5-b5c6-d89b3efbc699 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:35 devstack sudo[108366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a6fb34e1-8399-44c5-b5c6-d89b3efbc699 Sep 29 18:39:35 devstack sudo[108366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:35 devstack sudo[108366]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:35 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-980d3fb4-697d-4de0-92ce-d7b391d7469f tempest-ProjectMemberTests-1577701723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a6fb34e1-8399-44c5-b5c6-d89b3efbc699" returned: 0 in 0.254s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:35 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-980d3fb4-697d-4de0-92ce-d7b391d7469f tempest-ProjectMemberTests-1577701723 None] <== create_volume: return (743ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'} {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:39:35 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-980d3fb4-697d-4de0-92ce-d7b391d7469f tempest-ProjectMemberTests-1577701723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.745s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:39:35 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-980d3fb4-697d-4de0-92ce-d7b391d7469f tempest-ProjectMemberTests-1577701723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af01c7ad-e375-467c-89cc-0204ed9787b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6fb34e1-8399-44c5-b5c6-d89b3efbc699', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:39:35 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-980d3fb4-697d-4de0-92ce-d7b391d7469f tempest-ProjectMemberTests-1577701723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea4d3f9c-826e-410c-929d-bd35f9b19f57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:39:35 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-980d3fb4-697d-4de0-92ce-d7b391d7469f tempest-ProjectMemberTests-1577701723 None] Volume volume-a6fb34e1-8399-44c5-b5c6-d89b3efbc699 (a6fb34e1-8399-44c5-b5c6-d89b3efbc699): created successfully Sep 29 18:39:35 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-980d3fb4-697d-4de0-92ce-d7b391d7469f tempest-ProjectMemberTests-1577701723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea4d3f9c-826e-410c-929d-bd35f9b19f57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:39:35 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-980d3fb4-697d-4de0-92ce-d7b391d7469f tempest-ProjectMemberTests-1577701723 None] Flow 'volume_create_manager' (8a413462-a593-4d1c-8cfb-88fe53250cc5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:39:35 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-980d3fb4-697d-4de0-92ce-d7b391d7469f tempest-ProjectMemberTests-1577701723 None] Created volume successfully. Sep 29 18:39:35 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-fcca3b27-7613-4de5-b38a-371e9af072fd tempest-ProjectMemberTests-1577701723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:39:35 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-fcca3b27-7613-4de5-b38a-371e9af072fd tempest-ProjectMemberTests-1577701723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:39:35 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-fcca3b27-7613-4de5-b38a-371e9af072fd tempest-ProjectMemberTests-1577701723 None] Creating offline snapshot 800ae76e-fe3c-4e0b-90e1-af7c69b24a36 of volume a6fb34e1-8399-44c5-b5c6-d89b3efbc699 {{(pid=86512) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 18:39:35 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[081c3608-74b7-411b-a913-65d16371ceef]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:39:35 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-fcca3b27-7613-4de5-b38a-371e9af072fd tempest-ProjectMemberTests-1577701723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a6fb34e1-8399-44c5-b5c6-d89b3efbc699 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:35 devstack sudo[108369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a6fb34e1-8399-44c5-b5c6-d89b3efbc699 Sep 29 18:39:35 devstack sudo[108369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:36 devstack sudo[108369]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:36 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-fcca3b27-7613-4de5-b38a-371e9af072fd tempest-ProjectMemberTests-1577701723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a6fb34e1-8399-44c5-b5c6-d89b3efbc699" returned: 0 in 0.389s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:36 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-fcca3b27-7613-4de5-b38a-371e9af072fd tempest-ProjectMemberTests-1577701723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a6fb34e1-8399-44c5-b5c6-d89b3efbc699,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a6fb34e1-8399-44c5-b5c6-d89b3efbc699.800ae76e-fe3c-4e0b-90e1-af7c69b24a36 1G {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:36 devstack sudo[108375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a6fb34e1-8399-44c5-b5c6-d89b3efbc699,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a6fb34e1-8399-44c5-b5c6-d89b3efbc699.800ae76e-fe3c-4e0b-90e1-af7c69b24a36 1G Sep 29 18:39:36 devstack sudo[108375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:36 devstack sudo[108375]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:36 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-fcca3b27-7613-4de5-b38a-371e9af072fd tempest-ProjectMemberTests-1577701723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a6fb34e1-8399-44c5-b5c6-d89b3efbc699,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a6fb34e1-8399-44c5-b5c6-d89b3efbc699.800ae76e-fe3c-4e0b-90e1-af7c69b24a36 1G" returned: 0 in 0.434s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:36 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-fcca3b27-7613-4de5-b38a-371e9af072fd tempest-ProjectMemberTests-1577701723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a6fb34e1-8399-44c5-b5c6-d89b3efbc699 -F qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a6fb34e1-8399-44c5-b5c6-d89b3efbc699.800ae76e-fe3c-4e0b-90e1-af7c69b24a36 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:36 devstack sudo[108381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a6fb34e1-8399-44c5-b5c6-d89b3efbc699 -F qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a6fb34e1-8399-44c5-b5c6-d89b3efbc699.800ae76e-fe3c-4e0b-90e1-af7c69b24a36 Sep 29 18:39:36 devstack sudo[108381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:36 devstack sudo[108381]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:36 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-fcca3b27-7613-4de5-b38a-371e9af072fd tempest-ProjectMemberTests-1577701723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a6fb34e1-8399-44c5-b5c6-d89b3efbc699 -F qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a6fb34e1-8399-44c5-b5c6-d89b3efbc699.800ae76e-fe3c-4e0b-90e1-af7c69b24a36" returned: 0 in 0.305s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:36 devstack cinder-volume[86512]: WARNING cinder.volume.drivers.remotefs [None req-fcca3b27-7613-4de5-b38a-371e9af072fd tempest-ProjectMemberTests-1577701723 None] /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a6fb34e1-8399-44c5-b5c6-d89b3efbc699.800ae76e-fe3c-4e0b-90e1-af7c69b24a36 is being set with open permissions: ugo+rw Sep 29 18:39:36 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-fcca3b27-7613-4de5-b38a-371e9af072fd tempest-ProjectMemberTests-1577701723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a6fb34e1-8399-44c5-b5c6-d89b3efbc699.800ae76e-fe3c-4e0b-90e1-af7c69b24a36 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:36 devstack sudo[108386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a6fb34e1-8399-44c5-b5c6-d89b3efbc699.800ae76e-fe3c-4e0b-90e1-af7c69b24a36 Sep 29 18:39:36 devstack sudo[108386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:37 devstack sudo[108386]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:37 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-fcca3b27-7613-4de5-b38a-371e9af072fd tempest-ProjectMemberTests-1577701723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a6fb34e1-8399-44c5-b5c6-d89b3efbc699.800ae76e-fe3c-4e0b-90e1-af7c69b24a36" returned: 0 in 0.240s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:37 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-fcca3b27-7613-4de5-b38a-371e9af072fd tempest-ProjectMemberTests-1577701723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a6fb34e1-8399-44c5-b5c6-d89b3efbc699.info {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:37 devstack sudo[108389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a6fb34e1-8399-44c5-b5c6-d89b3efbc699.info Sep 29 18:39:37 devstack sudo[108389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:37 devstack sudo[108389]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:37 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-fcca3b27-7613-4de5-b38a-371e9af072fd tempest-ProjectMemberTests-1577701723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a6fb34e1-8399-44c5-b5c6-d89b3efbc699.info" returned: 0 in 0.253s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:37 devstack cinder-volume[86512]: WARNING cinder.volume.drivers.remotefs [None req-fcca3b27-7613-4de5-b38a-371e9af072fd tempest-ProjectMemberTests-1577701723 None] /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a6fb34e1-8399-44c5-b5c6-d89b3efbc699.info is being set with open permissions: ugo+rw Sep 29 18:39:37 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-fcca3b27-7613-4de5-b38a-371e9af072fd tempest-ProjectMemberTests-1577701723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a6fb34e1-8399-44c5-b5c6-d89b3efbc699.info {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:37 devstack sudo[108392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a6fb34e1-8399-44c5-b5c6-d89b3efbc699.info Sep 29 18:39:37 devstack sudo[108392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:37 devstack sudo[108392]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:37 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-fcca3b27-7613-4de5-b38a-371e9af072fd tempest-ProjectMemberTests-1577701723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a6fb34e1-8399-44c5-b5c6-d89b3efbc699.info" returned: 0 in 0.268s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:37 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-fcca3b27-7613-4de5-b38a-371e9af072fd tempest-ProjectMemberTests-1577701723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.987s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:39:37 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-fcca3b27-7613-4de5-b38a-371e9af072fd tempest-ProjectMemberTests-1577701723 None] Create snapshot completed successfully Sep 29 18:39:37 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-0ec5b780-221e-42b2-a5f0-9942a432ca0c tempest-ProjectMemberTests-1577701723 None] Acquiring lock "cinder-800ae76e-fe3c-4e0b-90e1-af7c69b24a36-delete_snapshot" by "delete_snapshot" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:39:37 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-0ec5b780-221e-42b2-a5f0-9942a432ca0c tempest-ProjectMemberTests-1577701723 None] Lock "cinder-800ae76e-fe3c-4e0b-90e1-af7c69b24a36-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:39:38 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-0ec5b780-221e-42b2-a5f0-9942a432ca0c tempest-ProjectMemberTests-1577701723 None] Acquiring lock "cinder-quobyte-a6fb34e1-8399-44c5-b5c6-d89b3efbc699" by "delete_snapshot" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:39:38 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-0ec5b780-221e-42b2-a5f0-9942a432ca0c tempest-ProjectMemberTests-1577701723 None] Lock "cinder-quobyte-a6fb34e1-8399-44c5-b5c6-d89b3efbc699" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:39:38 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-0ec5b780-221e-42b2-a5f0-9942a432ca0c tempest-ProjectMemberTests-1577701723 None] Acquiring lock "cinder-quobyte-800ae76e-fe3c-4e0b-90e1-af7c69b24a36" by "_delete_snapshot" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:39:38 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-0ec5b780-221e-42b2-a5f0-9942a432ca0c tempest-ProjectMemberTests-1577701723 None] Lock "cinder-quobyte-800ae76e-fe3c-4e0b-90e1-af7c69b24a36" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:39:38 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-0ec5b780-221e-42b2-a5f0-9942a432ca0c tempest-ProjectMemberTests-1577701723 None] Deleting offline snapshot 800ae76e-fe3c-4e0b-90e1-af7c69b24a36 of volume a6fb34e1-8399-44c5-b5c6-d89b3efbc699 {{(pid=86512) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 18:39:38 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-0ec5b780-221e-42b2-a5f0-9942a432ca0c tempest-ProjectMemberTests-1577701723 None] snapshot_file for this snap is: volume-a6fb34e1-8399-44c5-b5c6-d89b3efbc699.800ae76e-fe3c-4e0b-90e1-af7c69b24a36 {{(pid=86512) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 18:39:38 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dd88aba-a6ba-4e41-9bb3-585791316d2f]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:39:38 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-0ec5b780-221e-42b2-a5f0-9942a432ca0c tempest-ProjectMemberTests-1577701723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a6fb34e1-8399-44c5-b5c6-d89b3efbc699.800ae76e-fe3c-4e0b-90e1-af7c69b24a36 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:38 devstack sudo[108395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a6fb34e1-8399-44c5-b5c6-d89b3efbc699.800ae76e-fe3c-4e0b-90e1-af7c69b24a36 Sep 29 18:39:38 devstack sudo[108395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:38 devstack sudo[108395]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:38 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-0ec5b780-221e-42b2-a5f0-9942a432ca0c tempest-ProjectMemberTests-1577701723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a6fb34e1-8399-44c5-b5c6-d89b3efbc699.800ae76e-fe3c-4e0b-90e1-af7c69b24a36" returned: 0 in 0.487s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:38 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-0ec5b780-221e-42b2-a5f0-9942a432ca0c tempest-ProjectMemberTests-1577701723 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a6fb34e1-8399-44c5-b5c6-d89b3efbc699(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86512) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 18:39:38 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac9c04c3-0729-4dcd-b620-8ffec8da6fa6]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:39:38 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-0ec5b780-221e-42b2-a5f0-9942a432ca0c tempest-ProjectMemberTests-1577701723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a6fb34e1-8399-44c5-b5c6-d89b3efbc699 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:38 devstack sudo[108400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a6fb34e1-8399-44c5-b5c6-d89b3efbc699 Sep 29 18:39:38 devstack sudo[108400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:38 devstack sudo[108400]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:39 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-0ec5b780-221e-42b2-a5f0-9942a432ca0c tempest-ProjectMemberTests-1577701723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a6fb34e1-8399-44c5-b5c6-d89b3efbc699" returned: 0 in 0.383s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:39 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-0ec5b780-221e-42b2-a5f0-9942a432ca0c tempest-ProjectMemberTests-1577701723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a6fb34e1-8399-44c5-b5c6-d89b3efbc699.800ae76e-fe3c-4e0b-90e1-af7c69b24a36 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:39 devstack sudo[108405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a6fb34e1-8399-44c5-b5c6-d89b3efbc699.800ae76e-fe3c-4e0b-90e1-af7c69b24a36 Sep 29 18:39:39 devstack sudo[108405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:39 devstack sudo[108405]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:39 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-0ec5b780-221e-42b2-a5f0-9942a432ca0c tempest-ProjectMemberTests-1577701723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a6fb34e1-8399-44c5-b5c6-d89b3efbc699.800ae76e-fe3c-4e0b-90e1-af7c69b24a36" returned: 0 in 0.336s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:39 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-0ec5b780-221e-42b2-a5f0-9942a432ca0c tempest-ProjectMemberTests-1577701723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a6fb34e1-8399-44c5-b5c6-d89b3efbc699.800ae76e-fe3c-4e0b-90e1-af7c69b24a36 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:39 devstack sudo[108410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a6fb34e1-8399-44c5-b5c6-d89b3efbc699.800ae76e-fe3c-4e0b-90e1-af7c69b24a36 Sep 29 18:39:39 devstack sudo[108410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:39 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7e8d6aa-b948-4d2b-8ca2-5c0a681caaa1 tempest-SnapshotDependencyTests-315911834 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86512) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:39:39 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d7e8d6aa-b948-4d2b-8ca2-5c0a681caaa1 tempest-SnapshotDependencyTests-315911834 None] Flow 'volume_create_manager' (92f4aee9-39e9-49b8-ae4d-7d38dbfa2a63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:39:39 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d7e8d6aa-b948-4d2b-8ca2-5c0a681caaa1 tempest-SnapshotDependencyTests-315911834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (235552e3-c697-46c8-9a6c-891de309663f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:39:39 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d7e8d6aa-b948-4d2b-8ca2-5c0a681caaa1 tempest-SnapshotDependencyTests-315911834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (235552e3-c697-46c8-9a6c-891de309663f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:39:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-316645108',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b102db0f-359d-4ad5-8ef3-9de9d149eff7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ce449fc24c947f28f7246c7bfeef969',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:39:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:39:39Z,use_quota=True,user_id='e93ec8027a4d4ab99e0eab9ba203cca9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:39:39 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d7e8d6aa-b948-4d2b-8ca2-5c0a681caaa1 tempest-SnapshotDependencyTests-315911834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fe000ea-a0e2-4747-9d5c-f07d13ae19bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:39:39 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d7e8d6aa-b948-4d2b-8ca2-5c0a681caaa1 tempest-SnapshotDependencyTests-315911834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fe000ea-a0e2-4747-9d5c-f07d13ae19bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:39:39 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d7e8d6aa-b948-4d2b-8ca2-5c0a681caaa1 tempest-SnapshotDependencyTests-315911834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (077e20e2-62df-48bf-b235-ae84803d64e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:39:39 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d7e8d6aa-b948-4d2b-8ca2-5c0a681caaa1 tempest-SnapshotDependencyTests-315911834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (077e20e2-62df-48bf-b235-ae84803d64e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b102db0f-359d-4ad5-8ef3-9de9d149eff7', 'volume_name': 'volume-b102db0f-359d-4ad5-8ef3-9de9d149eff7', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:39:39 devstack sudo[108410]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:39 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d7e8d6aa-b948-4d2b-8ca2-5c0a681caaa1 tempest-SnapshotDependencyTests-315911834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d696a79-f5af-4a4c-83c3-8e00b044b8b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:39:39 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d7e8d6aa-b948-4d2b-8ca2-5c0a681caaa1 tempest-SnapshotDependencyTests-315911834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d696a79-f5af-4a4c-83c3-8e00b044b8b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:39:39 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d7e8d6aa-b948-4d2b-8ca2-5c0a681caaa1 tempest-SnapshotDependencyTests-315911834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e69aacdf-06f1-4075-9a61-edfc0b01451e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:39:39 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-d7e8d6aa-b948-4d2b-8ca2-5c0a681caaa1 tempest-SnapshotDependencyTests-315911834 None] Volume b102db0f-359d-4ad5-8ef3-9de9d149eff7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b102db0f-359d-4ad5-8ef3-9de9d149eff7', 'volume_size': 1} Sep 29 18:39:39 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-d7e8d6aa-b948-4d2b-8ca2-5c0a681caaa1 tempest-SnapshotDependencyTests-315911834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:39:39 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-d7e8d6aa-b948-4d2b-8ca2-5c0a681caaa1 tempest-SnapshotDependencyTests-315911834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:39:39 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-d7e8d6aa-b948-4d2b-8ca2-5c0a681caaa1 tempest-SnapshotDependencyTests-315911834 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:39:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-316645108',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b102db0f-359d-4ad5-8ef3-9de9d149eff7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ce449fc24c947f28f7246c7bfeef969',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:39:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:39:39Z,use_quota=True,user_id='e93ec8027a4d4ab99e0eab9ba203cca9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)}" {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:39:39 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-d7e8d6aa-b948-4d2b-8ca2-5c0a681caaa1 tempest-SnapshotDependencyTests-315911834 None] Creating volume b102db0f-359d-4ad5-8ef3-9de9d149eff7 {{(pid=86512) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:39:39 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-d7e8d6aa-b948-4d2b-8ca2-5c0a681caaa1 tempest-SnapshotDependencyTests-315911834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:39:39 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-d7e8d6aa-b948-4d2b-8ca2-5c0a681caaa1 tempest-SnapshotDependencyTests-315911834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:39:39 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-d7e8d6aa-b948-4d2b-8ca2-5c0a681caaa1 tempest-SnapshotDependencyTests-315911834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:39:39 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-d7e8d6aa-b948-4d2b-8ca2-5c0a681caaa1 tempest-SnapshotDependencyTests-315911834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:39:39 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-d7e8d6aa-b948-4d2b-8ca2-5c0a681caaa1 tempest-SnapshotDependencyTests-315911834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:39:39 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-d7e8d6aa-b948-4d2b-8ca2-5c0a681caaa1 tempest-SnapshotDependencyTests-315911834 None] Selected osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 as target Quobyte volume. {{(pid=86512) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:39:39 devstack cinder-volume[86512]: INFO cinder.volume.drivers.remotefs [None req-d7e8d6aa-b948-4d2b-8ca2-5c0a681caaa1 tempest-SnapshotDependencyTests-315911834 None] casted to osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 Sep 29 18:39:39 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-d7e8d6aa-b948-4d2b-8ca2-5c0a681caaa1 tempest-SnapshotDependencyTests-315911834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-b102db0f-359d-4ad5-8ef3-9de9d149eff7 1073741824 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:39 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-0ec5b780-221e-42b2-a5f0-9942a432ca0c tempest-ProjectMemberTests-1577701723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a6fb34e1-8399-44c5-b5c6-d89b3efbc699.800ae76e-fe3c-4e0b-90e1-af7c69b24a36" returned: 0 in 0.297s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:39 devstack sudo[108413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-b102db0f-359d-4ad5-8ef3-9de9d149eff7 1073741824 Sep 29 18:39:39 devstack sudo[108413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:39 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-0ec5b780-221e-42b2-a5f0-9942a432ca0c tempest-ProjectMemberTests-1577701723 None] Lock "cinder-quobyte-800ae76e-fe3c-4e0b-90e1-af7c69b24a36" released by "_delete_snapshot" :: held 1.624s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:39:39 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-0ec5b780-221e-42b2-a5f0-9942a432ca0c tempest-ProjectMemberTests-1577701723 None] Lock "cinder-quobyte-a6fb34e1-8399-44c5-b5c6-d89b3efbc699" released by "delete_snapshot" :: held 1.662s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:39:39 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-0ec5b780-221e-42b2-a5f0-9942a432ca0c tempest-ProjectMemberTests-1577701723 None] Created reservations ['94f69f62-0b97-468a-a368-53bdfa79efcb', '6fca7f4c-098e-42e3-9ef2-d53c3c79a64c', '8cd703f9-fa4b-4d5e-9515-379f8610fd24', '4b1b06be-e304-48e2-81fe-7cdd2cc206fa'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:39:39 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-0ec5b780-221e-42b2-a5f0-9942a432ca0c tempest-ProjectMemberTests-1577701723 None] Delete snapshot completed successfully. Sep 29 18:39:39 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-0ec5b780-221e-42b2-a5f0-9942a432ca0c tempest-ProjectMemberTests-1577701723 None] Lock "cinder-800ae76e-fe3c-4e0b-90e1-af7c69b24a36-delete_snapshot" released by "delete_snapshot" :: held 1.803s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:39:40 devstack sudo[108413]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:40 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-d7e8d6aa-b948-4d2b-8ca2-5c0a681caaa1 tempest-SnapshotDependencyTests-315911834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-b102db0f-359d-4ad5-8ef3-9de9d149eff7 1073741824" returned: 0 in 0.413s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:40 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-d7e8d6aa-b948-4d2b-8ca2-5c0a681caaa1 tempest-SnapshotDependencyTests-315911834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-b102db0f-359d-4ad5-8ef3-9de9d149eff7 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:40 devstack sudo[108419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-b102db0f-359d-4ad5-8ef3-9de9d149eff7 Sep 29 18:39:40 devstack sudo[108419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:40 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-81ec3fcc-464c-44b4-ba59-0a3683b7acf0 tempest-ProjectMemberTests-1577701723 None] Acquiring lock "cinder-a6fb34e1-8399-44c5-b5c6-d89b3efbc699-delete_volume" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:39:40 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-81ec3fcc-464c-44b4-ba59-0a3683b7acf0 tempest-ProjectMemberTests-1577701723 None] Lock "cinder-a6fb34e1-8399-44c5-b5c6-d89b3efbc699-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:39:40 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-81ec3fcc-464c-44b4-ba59-0a3683b7acf0 tempest-ProjectMemberTests-1577701723 None] Acquiring lock "cinder-quobyte-a6fb34e1-8399-44c5-b5c6-d89b3efbc699" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:39:40 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-81ec3fcc-464c-44b4-ba59-0a3683b7acf0 tempest-ProjectMemberTests-1577701723 None] Lock "cinder-quobyte-a6fb34e1-8399-44c5-b5c6-d89b3efbc699" acquired by "delete_volume" :: waited 0.016s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:39:40 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[edd846e1-d370-4c85-8a52-de205e09776f]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:39:40 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-81ec3fcc-464c-44b4-ba59-0a3683b7acf0 tempest-ProjectMemberTests-1577701723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a6fb34e1-8399-44c5-b5c6-d89b3efbc699 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:40 devstack sudo[108419]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:40 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-d7e8d6aa-b948-4d2b-8ca2-5c0a681caaa1 tempest-SnapshotDependencyTests-315911834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-b102db0f-359d-4ad5-8ef3-9de9d149eff7" returned: 0 in 0.264s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:40 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-d7e8d6aa-b948-4d2b-8ca2-5c0a681caaa1 tempest-SnapshotDependencyTests-315911834 None] <== create_volume: return (720ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'} {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:39:40 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-d7e8d6aa-b948-4d2b-8ca2-5c0a681caaa1 tempest-SnapshotDependencyTests-315911834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.723s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:39:40 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d7e8d6aa-b948-4d2b-8ca2-5c0a681caaa1 tempest-SnapshotDependencyTests-315911834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e69aacdf-06f1-4075-9a61-edfc0b01451e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b102db0f-359d-4ad5-8ef3-9de9d149eff7', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:39:40 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d7e8d6aa-b948-4d2b-8ca2-5c0a681caaa1 tempest-SnapshotDependencyTests-315911834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfefee53-a6f3-4d81-ae39-626dfad79de1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:39:40 devstack sudo[108421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a6fb34e1-8399-44c5-b5c6-d89b3efbc699 Sep 29 18:39:40 devstack sudo[108421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:40 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-d7e8d6aa-b948-4d2b-8ca2-5c0a681caaa1 tempest-SnapshotDependencyTests-315911834 None] Volume volume-b102db0f-359d-4ad5-8ef3-9de9d149eff7 (b102db0f-359d-4ad5-8ef3-9de9d149eff7): created successfully Sep 29 18:39:40 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d7e8d6aa-b948-4d2b-8ca2-5c0a681caaa1 tempest-SnapshotDependencyTests-315911834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfefee53-a6f3-4d81-ae39-626dfad79de1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:39:40 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-d7e8d6aa-b948-4d2b-8ca2-5c0a681caaa1 tempest-SnapshotDependencyTests-315911834 None] Flow 'volume_create_manager' (92f4aee9-39e9-49b8-ae4d-7d38dbfa2a63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:39:40 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-d7e8d6aa-b948-4d2b-8ca2-5c0a681caaa1 tempest-SnapshotDependencyTests-315911834 None] Created volume successfully. Sep 29 18:39:40 devstack sudo[108421]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:40 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-81ec3fcc-464c-44b4-ba59-0a3683b7acf0 tempest-ProjectMemberTests-1577701723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a6fb34e1-8399-44c5-b5c6-d89b3efbc699" returned: 0 in 0.381s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:40 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-81ec3fcc-464c-44b4-ba59-0a3683b7acf0 tempest-ProjectMemberTests-1577701723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a6fb34e1-8399-44c5-b5c6-d89b3efbc699 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:40 devstack sudo[108427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a6fb34e1-8399-44c5-b5c6-d89b3efbc699 Sep 29 18:39:40 devstack sudo[108427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:40 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-98a446d9-237e-4799-8ab1-e39e5579604c tempest-SnapshotDependencyTests-315911834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:39:40 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-98a446d9-237e-4799-8ab1-e39e5579604c tempest-SnapshotDependencyTests-315911834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:39:40 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-98a446d9-237e-4799-8ab1-e39e5579604c tempest-SnapshotDependencyTests-315911834 None] Creating offline snapshot 5e308abc-3698-4da7-abf5-7ee71f6e58f3 of volume b102db0f-359d-4ad5-8ef3-9de9d149eff7 {{(pid=86512) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 18:39:40 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[385550d4-cb2a-449a-8929-266d7cac3e22]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:39:40 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-98a446d9-237e-4799-8ab1-e39e5579604c tempest-SnapshotDependencyTests-315911834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-b102db0f-359d-4ad5-8ef3-9de9d149eff7 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:40 devstack sudo[108427]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:40 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-81ec3fcc-464c-44b4-ba59-0a3683b7acf0 tempest-ProjectMemberTests-1577701723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-a6fb34e1-8399-44c5-b5c6-d89b3efbc699" returned: 0 in 0.251s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:40 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-81ec3fcc-464c-44b4-ba59-0a3683b7acf0 tempest-ProjectMemberTests-1577701723 None] Lock "cinder-quobyte-a6fb34e1-8399-44c5-b5c6-d89b3efbc699" released by "delete_volume" :: held 0.698s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:39:40 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-81ec3fcc-464c-44b4-ba59-0a3683b7acf0 tempest-ProjectMemberTests-1577701723 None] Created reservations ['25e409ed-348e-4233-91d1-81306518d2a2', '605d2258-5f35-4eef-942e-1efd3d909ec0', '6d616e5f-9776-4b0d-b1ca-939cc4db84ed', '7092b1c1-8d04-451e-bb50-a1ec168f52a6'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:39:40 devstack sudo[108430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-b102db0f-359d-4ad5-8ef3-9de9d149eff7 Sep 29 18:39:40 devstack sudo[108430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:40 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-81ec3fcc-464c-44b4-ba59-0a3683b7acf0 tempest-ProjectMemberTests-1577701723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:39:41 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-81ec3fcc-464c-44b4-ba59-0a3683b7acf0 tempest-ProjectMemberTests-1577701723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:39:41 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-81ec3fcc-464c-44b4-ba59-0a3683b7acf0 tempest-ProjectMemberTests-1577701723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:39:41 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-81ec3fcc-464c-44b4-ba59-0a3683b7acf0 tempest-ProjectMemberTests-1577701723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:39:41 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-81ec3fcc-464c-44b4-ba59-0a3683b7acf0 tempest-ProjectMemberTests-1577701723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:39:41 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-81ec3fcc-464c-44b4-ba59-0a3683b7acf0 tempest-ProjectMemberTests-1577701723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:41 devstack sudo[108432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:39:41 devstack sudo[108432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:41 devstack sudo[108430]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:41 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-98a446d9-237e-4799-8ab1-e39e5579604c tempest-SnapshotDependencyTests-315911834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-b102db0f-359d-4ad5-8ef3-9de9d149eff7" returned: 0 in 0.407s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:41 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-98a446d9-237e-4799-8ab1-e39e5579604c tempest-SnapshotDependencyTests-315911834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-b102db0f-359d-4ad5-8ef3-9de9d149eff7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-b102db0f-359d-4ad5-8ef3-9de9d149eff7.5e308abc-3698-4da7-abf5-7ee71f6e58f3 1G {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:41 devstack sudo[108432]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:41 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-81ec3fcc-464c-44b4-ba59-0a3683b7acf0 tempest-ProjectMemberTests-1577701723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.279s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:41 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-81ec3fcc-464c-44b4-ba59-0a3683b7acf0 tempest-ProjectMemberTests-1577701723 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:39:41 devstack sudo[108438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-b102db0f-359d-4ad5-8ef3-9de9d149eff7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-b102db0f-359d-4ad5-8ef3-9de9d149eff7.5e308abc-3698-4da7-abf5-7ee71f6e58f3 1G Sep 29 18:39:41 devstack sudo[108438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:41 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-81ec3fcc-464c-44b4-ba59-0a3683b7acf0 tempest-ProjectMemberTests-1577701723 None] Deleted volume successfully. Sep 29 18:39:41 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-81ec3fcc-464c-44b4-ba59-0a3683b7acf0 tempest-ProjectMemberTests-1577701723 None] Lock "cinder-a6fb34e1-8399-44c5-b5c6-d89b3efbc699-delete_volume" released by "delete_volume" :: held 1.168s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:39:41 devstack sudo[108438]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:41 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-98a446d9-237e-4799-8ab1-e39e5579604c tempest-SnapshotDependencyTests-315911834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-b102db0f-359d-4ad5-8ef3-9de9d149eff7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-b102db0f-359d-4ad5-8ef3-9de9d149eff7.5e308abc-3698-4da7-abf5-7ee71f6e58f3 1G" returned: 0 in 0.439s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:41 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-98a446d9-237e-4799-8ab1-e39e5579604c tempest-SnapshotDependencyTests-315911834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b102db0f-359d-4ad5-8ef3-9de9d149eff7 -F qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-b102db0f-359d-4ad5-8ef3-9de9d149eff7.5e308abc-3698-4da7-abf5-7ee71f6e58f3 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:41 devstack sudo[108444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b102db0f-359d-4ad5-8ef3-9de9d149eff7 -F qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-b102db0f-359d-4ad5-8ef3-9de9d149eff7.5e308abc-3698-4da7-abf5-7ee71f6e58f3 Sep 29 18:39:41 devstack sudo[108444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:41 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-754162ee-19db-4b73-967e-2dbf21adab89 tempest-ProjectMemberTests-1577701723 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86512) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:39:41 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-754162ee-19db-4b73-967e-2dbf21adab89 tempest-ProjectMemberTests-1577701723 None] Flow 'volume_create_manager' (415e5035-395f-41a3-92b2-5fdfb79b95be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:39:41 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-754162ee-19db-4b73-967e-2dbf21adab89 tempest-ProjectMemberTests-1577701723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0561b4db-9a2d-4f38-b261-e2a2d6522aae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:39:41 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-754162ee-19db-4b73-967e-2dbf21adab89 tempest-ProjectMemberTests-1577701723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0561b4db-9a2d-4f38-b261-e2a2d6522aae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:39:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1572171683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c22247d-2f5e-4d87-bd83-3ec60986e89d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc5a83cdd1e34b24adfa899bf4067f0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:39:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:39:42Z,use_quota=True,user_id='671a2611e03549f08f718ec6a8379db0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:39:41 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-754162ee-19db-4b73-967e-2dbf21adab89 tempest-ProjectMemberTests-1577701723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29329043-0c58-49ab-80c9-80aa92b8223f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:39:41 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-754162ee-19db-4b73-967e-2dbf21adab89 tempest-ProjectMemberTests-1577701723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29329043-0c58-49ab-80c9-80aa92b8223f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:39:41 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-754162ee-19db-4b73-967e-2dbf21adab89 tempest-ProjectMemberTests-1577701723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (021b33dd-7b5b-4285-a026-f6072f9c211e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:39:41 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-754162ee-19db-4b73-967e-2dbf21adab89 tempest-ProjectMemberTests-1577701723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (021b33dd-7b5b-4285-a026-f6072f9c211e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c22247d-2f5e-4d87-bd83-3ec60986e89d', 'volume_name': 'volume-5c22247d-2f5e-4d87-bd83-3ec60986e89d', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:39:41 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-754162ee-19db-4b73-967e-2dbf21adab89 tempest-ProjectMemberTests-1577701723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1ad9027-8b6c-4ead-af09-fb5809d58417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:39:41 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-754162ee-19db-4b73-967e-2dbf21adab89 tempest-ProjectMemberTests-1577701723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1ad9027-8b6c-4ead-af09-fb5809d58417) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:39:41 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-754162ee-19db-4b73-967e-2dbf21adab89 tempest-ProjectMemberTests-1577701723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4134251-09e3-434c-9369-3467e9678424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:39:41 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-754162ee-19db-4b73-967e-2dbf21adab89 tempest-ProjectMemberTests-1577701723 None] Volume 5c22247d-2f5e-4d87-bd83-3ec60986e89d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c22247d-2f5e-4d87-bd83-3ec60986e89d', 'volume_size': 1} Sep 29 18:39:41 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-754162ee-19db-4b73-967e-2dbf21adab89 tempest-ProjectMemberTests-1577701723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:39:41 devstack sudo[108444]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:42 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-98a446d9-237e-4799-8ab1-e39e5579604c tempest-SnapshotDependencyTests-315911834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b102db0f-359d-4ad5-8ef3-9de9d149eff7 -F qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-b102db0f-359d-4ad5-8ef3-9de9d149eff7.5e308abc-3698-4da7-abf5-7ee71f6e58f3" returned: 0 in 0.298s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:42 devstack cinder-volume[86512]: WARNING cinder.volume.drivers.remotefs [None req-98a446d9-237e-4799-8ab1-e39e5579604c tempest-SnapshotDependencyTests-315911834 None] /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-b102db0f-359d-4ad5-8ef3-9de9d149eff7.5e308abc-3698-4da7-abf5-7ee71f6e58f3 is being set with open permissions: ugo+rw Sep 29 18:39:42 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-98a446d9-237e-4799-8ab1-e39e5579604c tempest-SnapshotDependencyTests-315911834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-b102db0f-359d-4ad5-8ef3-9de9d149eff7.5e308abc-3698-4da7-abf5-7ee71f6e58f3 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:42 devstack sudo[108449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-b102db0f-359d-4ad5-8ef3-9de9d149eff7.5e308abc-3698-4da7-abf5-7ee71f6e58f3 Sep 29 18:39:42 devstack sudo[108449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:42 devstack sudo[108449]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:42 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-98a446d9-237e-4799-8ab1-e39e5579604c tempest-SnapshotDependencyTests-315911834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-b102db0f-359d-4ad5-8ef3-9de9d149eff7.5e308abc-3698-4da7-abf5-7ee71f6e58f3" returned: 0 in 0.234s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:42 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-98a446d9-237e-4799-8ab1-e39e5579604c tempest-SnapshotDependencyTests-315911834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-b102db0f-359d-4ad5-8ef3-9de9d149eff7.info {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:42 devstack sudo[108452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-b102db0f-359d-4ad5-8ef3-9de9d149eff7.info Sep 29 18:39:42 devstack sudo[108452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:42 devstack sudo[108452]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:42 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-98a446d9-237e-4799-8ab1-e39e5579604c tempest-SnapshotDependencyTests-315911834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-b102db0f-359d-4ad5-8ef3-9de9d149eff7.info" returned: 0 in 0.233s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:42 devstack cinder-volume[86512]: WARNING cinder.volume.drivers.remotefs [None req-98a446d9-237e-4799-8ab1-e39e5579604c tempest-SnapshotDependencyTests-315911834 None] /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-b102db0f-359d-4ad5-8ef3-9de9d149eff7.info is being set with open permissions: ugo+rw Sep 29 18:39:42 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-98a446d9-237e-4799-8ab1-e39e5579604c tempest-SnapshotDependencyTests-315911834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-b102db0f-359d-4ad5-8ef3-9de9d149eff7.info {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:42 devstack sudo[108455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-b102db0f-359d-4ad5-8ef3-9de9d149eff7.info Sep 29 18:39:42 devstack sudo[108455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:42 devstack sudo[108455]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:42 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-98a446d9-237e-4799-8ab1-e39e5579604c tempest-SnapshotDependencyTests-315911834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-b102db0f-359d-4ad5-8ef3-9de9d149eff7.info" returned: 0 in 0.249s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:42 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-98a446d9-237e-4799-8ab1-e39e5579604c tempest-SnapshotDependencyTests-315911834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.951s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:39:42 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-754162ee-19db-4b73-967e-2dbf21adab89 tempest-ProjectMemberTests-1577701723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.894s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:39:42 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-754162ee-19db-4b73-967e-2dbf21adab89 tempest-ProjectMemberTests-1577701723 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:39:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1572171683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c22247d-2f5e-4d87-bd83-3ec60986e89d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc5a83cdd1e34b24adfa899bf4067f0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:39:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:39:42Z,use_quota=True,user_id='671a2611e03549f08f718ec6a8379db0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)}" {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:39:42 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-754162ee-19db-4b73-967e-2dbf21adab89 tempest-ProjectMemberTests-1577701723 None] Creating volume 5c22247d-2f5e-4d87-bd83-3ec60986e89d {{(pid=86512) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:39:42 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-754162ee-19db-4b73-967e-2dbf21adab89 tempest-ProjectMemberTests-1577701723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:39:42 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-754162ee-19db-4b73-967e-2dbf21adab89 tempest-ProjectMemberTests-1577701723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:39:42 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-754162ee-19db-4b73-967e-2dbf21adab89 tempest-ProjectMemberTests-1577701723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:39:42 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-754162ee-19db-4b73-967e-2dbf21adab89 tempest-ProjectMemberTests-1577701723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:39:42 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-754162ee-19db-4b73-967e-2dbf21adab89 tempest-ProjectMemberTests-1577701723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:39:42 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-754162ee-19db-4b73-967e-2dbf21adab89 tempest-ProjectMemberTests-1577701723 None] Selected osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 as target Quobyte volume. {{(pid=86512) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:39:42 devstack cinder-volume[86512]: INFO cinder.volume.drivers.remotefs [None req-754162ee-19db-4b73-967e-2dbf21adab89 tempest-ProjectMemberTests-1577701723 None] casted to osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 Sep 29 18:39:42 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-754162ee-19db-4b73-967e-2dbf21adab89 tempest-ProjectMemberTests-1577701723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-5c22247d-2f5e-4d87-bd83-3ec60986e89d 1073741824 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:42 devstack sudo[108458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-5c22247d-2f5e-4d87-bd83-3ec60986e89d 1073741824 Sep 29 18:39:42 devstack sudo[108458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:42 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-98a446d9-237e-4799-8ab1-e39e5579604c tempest-SnapshotDependencyTests-315911834 None] Create snapshot completed successfully Sep 29 18:39:43 devstack sudo[108458]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:43 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-754162ee-19db-4b73-967e-2dbf21adab89 tempest-ProjectMemberTests-1577701723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-5c22247d-2f5e-4d87-bd83-3ec60986e89d 1073741824" returned: 0 in 0.541s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:43 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-754162ee-19db-4b73-967e-2dbf21adab89 tempest-ProjectMemberTests-1577701723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-5c22247d-2f5e-4d87-bd83-3ec60986e89d {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:43 devstack sudo[108465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-5c22247d-2f5e-4d87-bd83-3ec60986e89d Sep 29 18:39:43 devstack sudo[108465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:43 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-60fb741e-ea10-4bad-9ef6-de35f70f49f7 tempest-SnapshotDependencyTests-315911834 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86512) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:39:43 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-60fb741e-ea10-4bad-9ef6-de35f70f49f7 tempest-SnapshotDependencyTests-315911834 None] Flow 'volume_create_manager' (a54b44e8-6a61-4527-8a77-8c3872c71ffe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:39:43 devstack sudo[108465]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:43 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-60fb741e-ea10-4bad-9ef6-de35f70f49f7 tempest-SnapshotDependencyTests-315911834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (beab8f50-5366-4f7b-aa57-afe598c7a4e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:39:43 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-754162ee-19db-4b73-967e-2dbf21adab89 tempest-ProjectMemberTests-1577701723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-5c22247d-2f5e-4d87-bd83-3ec60986e89d" returned: 0 in 0.266s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:43 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-754162ee-19db-4b73-967e-2dbf21adab89 tempest-ProjectMemberTests-1577701723 None] <== create_volume: return (846ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'} {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:39:43 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-754162ee-19db-4b73-967e-2dbf21adab89 tempest-ProjectMemberTests-1577701723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.849s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:39:43 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-60fb741e-ea10-4bad-9ef6-de35f70f49f7 tempest-SnapshotDependencyTests-315911834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (beab8f50-5366-4f7b-aa57-afe598c7a4e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:39:43Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=573cca87-d156-4ec5-bf19-45d4ea592766,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ce449fc24c947f28f7246c7bfeef969',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:39:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=5e308abc-3698-4da7-abf5-7ee71f6e58f3,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:39:44Z,use_quota=True,user_id='e93ec8027a4d4ab99e0eab9ba203cca9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:39:43 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-60fb741e-ea10-4bad-9ef6-de35f70f49f7 tempest-SnapshotDependencyTests-315911834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (956ea4ad-0022-4ec0-b852-bfe117690073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:39:43 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-60fb741e-ea10-4bad-9ef6-de35f70f49f7 tempest-SnapshotDependencyTests-315911834 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (956ea4ad-0022-4ec0-b852-bfe117690073) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:39:43 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-60fb741e-ea10-4bad-9ef6-de35f70f49f7 tempest-SnapshotDependencyTests-315911834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d13f5816-0f8c-42bb-bcc3-732f4d56cb77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:39:43 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-60fb741e-ea10-4bad-9ef6-de35f70f49f7 tempest-SnapshotDependencyTests-315911834 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d13f5816-0f8c-42bb-bcc3-732f4d56cb77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '573cca87-d156-4ec5-bf19-45d4ea592766', 'volume_name': 'volume-573cca87-d156-4ec5-bf19-45d4ea592766', 'volume_size': 1, 'snapshot_id': '5e308abc-3698-4da7-abf5-7ee71f6e58f3'}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:39:43 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-60fb741e-ea10-4bad-9ef6-de35f70f49f7 tempest-SnapshotDependencyTests-315911834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb51f391-cf8f-4d4d-9299-cdcdfc935190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:39:43 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-60fb741e-ea10-4bad-9ef6-de35f70f49f7 tempest-SnapshotDependencyTests-315911834 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb51f391-cf8f-4d4d-9299-cdcdfc935190) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:39:43 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-60fb741e-ea10-4bad-9ef6-de35f70f49f7 tempest-SnapshotDependencyTests-315911834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32048a81-baee-4a75-ad9e-196299bd3e65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:39:43 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-60fb741e-ea10-4bad-9ef6-de35f70f49f7 tempest-SnapshotDependencyTests-315911834 None] Volume 573cca87-d156-4ec5-bf19-45d4ea592766: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-573cca87-d156-4ec5-bf19-45d4ea592766', 'volume_size': 1, 'snapshot_id': '5e308abc-3698-4da7-abf5-7ee71f6e58f3'} Sep 29 18:39:43 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-754162ee-19db-4b73-967e-2dbf21adab89 tempest-ProjectMemberTests-1577701723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4134251-09e3-434c-9369-3467e9678424) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c22247d-2f5e-4d87-bd83-3ec60986e89d', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:39:43 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-754162ee-19db-4b73-967e-2dbf21adab89 tempest-ProjectMemberTests-1577701723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a0475c1-24dc-40b3-b27a-599ce8095afc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:39:43 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-60fb741e-ea10-4bad-9ef6-de35f70f49f7 tempest-SnapshotDependencyTests-315911834 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:39:43 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-60fb741e-ea10-4bad-9ef6-de35f70f49f7 tempest-SnapshotDependencyTests-315911834 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:39:43 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-60fb741e-ea10-4bad-9ef6-de35f70f49f7 tempest-SnapshotDependencyTests-315911834 None] Acquiring lock "cinder-quobyte-5e308abc-3698-4da7-abf5-7ee71f6e58f3-573cca87-d156-4ec5-bf19-45d4ea592766" by "_create_volume_from_snapshot" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:39:43 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-754162ee-19db-4b73-967e-2dbf21adab89 tempest-ProjectMemberTests-1577701723 None] Volume volume-5c22247d-2f5e-4d87-bd83-3ec60986e89d (5c22247d-2f5e-4d87-bd83-3ec60986e89d): created successfully Sep 29 18:39:43 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-754162ee-19db-4b73-967e-2dbf21adab89 tempest-ProjectMemberTests-1577701723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a0475c1-24dc-40b3-b27a-599ce8095afc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:39:43 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-754162ee-19db-4b73-967e-2dbf21adab89 tempest-ProjectMemberTests-1577701723 None] Flow 'volume_create_manager' (415e5035-395f-41a3-92b2-5fdfb79b95be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:39:43 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-60fb741e-ea10-4bad-9ef6-de35f70f49f7 tempest-SnapshotDependencyTests-315911834 None] Lock "cinder-quobyte-5e308abc-3698-4da7-abf5-7ee71f6e58f3-573cca87-d156-4ec5-bf19-45d4ea592766" acquired by "_create_volume_from_snapshot" :: waited 0.032s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:39:43 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-60fb741e-ea10-4bad-9ef6-de35f70f49f7 tempest-SnapshotDependencyTests-315911834 None] Creating volume 573cca87-d156-4ec5-bf19-45d4ea592766 from snapshot 5e308abc-3698-4da7-abf5-7ee71f6e58f3 {{(pid=86512) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 29 18:39:43 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-60fb741e-ea10-4bad-9ef6-de35f70f49f7 tempest-SnapshotDependencyTests-315911834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:39:43 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-60fb741e-ea10-4bad-9ef6-de35f70f49f7 tempest-SnapshotDependencyTests-315911834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:39:43 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-60fb741e-ea10-4bad-9ef6-de35f70f49f7 tempest-SnapshotDependencyTests-315911834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:39:43 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-60fb741e-ea10-4bad-9ef6-de35f70f49f7 tempest-SnapshotDependencyTests-315911834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:39:43 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-60fb741e-ea10-4bad-9ef6-de35f70f49f7 tempest-SnapshotDependencyTests-315911834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:39:43 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-60fb741e-ea10-4bad-9ef6-de35f70f49f7 tempest-SnapshotDependencyTests-315911834 None] Selected osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 as target Quobyte volume. {{(pid=86512) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:39:43 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-60fb741e-ea10-4bad-9ef6-de35f70f49f7 tempest-SnapshotDependencyTests-315911834 None] Acquiring lock "cinder-quobyte-573cca87-d156-4ec5-bf19-45d4ea592766" by "_copy_volume_from_snapshot" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:39:43 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-754162ee-19db-4b73-967e-2dbf21adab89 tempest-ProjectMemberTests-1577701723 None] Created volume successfully. Sep 29 18:39:43 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-60fb741e-ea10-4bad-9ef6-de35f70f49f7 tempest-SnapshotDependencyTests-315911834 None] Lock "cinder-quobyte-573cca87-d156-4ec5-bf19-45d4ea592766" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:39:43 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-60fb741e-ea10-4bad-9ef6-de35f70f49f7 tempest-SnapshotDependencyTests-315911834 None] snapshot: 5e308abc-3698-4da7-abf5-7ee71f6e58f3, volume: 573cca87-d156-4ec5-bf19-45d4ea592766, {{(pid=86512) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 29 18:39:43 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-60fb741e-ea10-4bad-9ef6-de35f70f49f7 tempest-SnapshotDependencyTests-315911834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:39:43 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-60fb741e-ea10-4bad-9ef6-de35f70f49f7 tempest-SnapshotDependencyTests-315911834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:39:43 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-60fb741e-ea10-4bad-9ef6-de35f70f49f7 tempest-SnapshotDependencyTests-315911834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:39:43 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-60fb741e-ea10-4bad-9ef6-de35f70f49f7 tempest-SnapshotDependencyTests-315911834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:39:43 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-60fb741e-ea10-4bad-9ef6-de35f70f49f7 tempest-SnapshotDependencyTests-315911834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:39:43 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f315809-5e26-467f-89b1-840aafe6ad4e]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:39:43 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-60fb741e-ea10-4bad-9ef6-de35f70f49f7 tempest-SnapshotDependencyTests-315911834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-b102db0f-359d-4ad5-8ef3-9de9d149eff7.5e308abc-3698-4da7-abf5-7ee71f6e58f3 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:43 devstack sudo[108468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-b102db0f-359d-4ad5-8ef3-9de9d149eff7.5e308abc-3698-4da7-abf5-7ee71f6e58f3 Sep 29 18:39:43 devstack sudo[108468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:44 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-253f22cc-1970-42b0-95d9-f3228d5570bb tempest-ProjectMemberTests-1577701723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:39:44 devstack sudo[108468]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:44 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-60fb741e-ea10-4bad-9ef6-de35f70f49f7 tempest-SnapshotDependencyTests-315911834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-b102db0f-359d-4ad5-8ef3-9de9d149eff7.5e308abc-3698-4da7-abf5-7ee71f6e58f3" returned: 0 in 0.370s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:44 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-60fb741e-ea10-4bad-9ef6-de35f70f49f7 tempest-SnapshotDependencyTests-315911834 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b102db0f-359d-4ad5-8ef3-9de9d149eff7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86512) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 18:39:44 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[e38f3b51-3802-412a-81dd-abf4a452e1d4]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:39:44 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-60fb741e-ea10-4bad-9ef6-de35f70f49f7 tempest-SnapshotDependencyTests-315911834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-b102db0f-359d-4ad5-8ef3-9de9d149eff7 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:44 devstack sudo[108474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-b102db0f-359d-4ad5-8ef3-9de9d149eff7 Sep 29 18:39:44 devstack sudo[108474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:44 devstack sudo[108474]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:44 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-60fb741e-ea10-4bad-9ef6-de35f70f49f7 tempest-SnapshotDependencyTests-315911834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-b102db0f-359d-4ad5-8ef3-9de9d149eff7" returned: 0 in 0.352s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:44 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-60fb741e-ea10-4bad-9ef6-de35f70f49f7 tempest-SnapshotDependencyTests-315911834 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-b102db0f-359d-4ad5-8ef3-9de9d149eff7 {{(pid=86512) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 29 18:39:44 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-60fb741e-ea10-4bad-9ef6-de35f70f49f7 tempest-SnapshotDependencyTests-315911834 None] Creating direct copy from snapshot {{(pid=86512) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 29 18:39:44 devstack cinder-volume[86512]: DEBUG cinder.utils [None req-60fb741e-ea10-4bad-9ef6-de35f70f49f7 tempest-SnapshotDependencyTests-315911834 None] Path /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-573cca87-d156-4ec5-bf19-45d4ea592766 not found in is_blk_device check {{(pid=86512) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 29 18:39:44 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-60fb741e-ea10-4bad-9ef6-de35f70f49f7 tempest-SnapshotDependencyTests-315911834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-b102db0f-359d-4ad5-8ef3-9de9d149eff7 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-573cca87-d156-4ec5-bf19-45d4ea592766 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:44 devstack sudo[108479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-b102db0f-359d-4ad5-8ef3-9de9d149eff7 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-573cca87-d156-4ec5-bf19-45d4ea592766 Sep 29 18:39:44 devstack sudo[108479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:50 devstack sudo[108479]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-60fb741e-ea10-4bad-9ef6-de35f70f49f7 tempest-SnapshotDependencyTests-315911834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-b102db0f-359d-4ad5-8ef3-9de9d149eff7 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-573cca87-d156-4ec5-bf19-45d4ea592766" returned: 0 in 5.831s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:50 devstack cinder-volume[86512]: DEBUG cinder.image.image_utils [None req-60fb741e-ea10-4bad-9ef6-de35f70f49f7 tempest-SnapshotDependencyTests-315911834 None] Image conversion details: src /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-b102db0f-359d-4ad5-8ef3-9de9d149eff7, size 1024.00 MB, duration 5.83 sec, destination /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-573cca87-d156-4ec5-bf19-45d4ea592766 {{(pid=86512) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 29 18:39:50 devstack cinder-volume[86512]: INFO cinder.image.image_utils [None req-60fb741e-ea10-4bad-9ef6-de35f70f49f7 tempest-SnapshotDependencyTests-315911834 None] Converted 1024.00 MB image at 175.57 MB/s Sep 29 18:39:50 devstack cinder-volume[86512]: WARNING cinder.volume.drivers.remotefs [None req-60fb741e-ea10-4bad-9ef6-de35f70f49f7 tempest-SnapshotDependencyTests-315911834 None] /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-573cca87-d156-4ec5-bf19-45d4ea592766 is being set with open permissions: ugo+rw Sep 29 18:39:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-60fb741e-ea10-4bad-9ef6-de35f70f49f7 tempest-SnapshotDependencyTests-315911834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-573cca87-d156-4ec5-bf19-45d4ea592766 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:50 devstack sudo[108492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-573cca87-d156-4ec5-bf19-45d4ea592766 Sep 29 18:39:50 devstack sudo[108492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:50 devstack sudo[108492]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-60fb741e-ea10-4bad-9ef6-de35f70f49f7 tempest-SnapshotDependencyTests-315911834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-573cca87-d156-4ec5-bf19-45d4ea592766" returned: 0 in 0.239s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:50 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-60fb741e-ea10-4bad-9ef6-de35f70f49f7 tempest-SnapshotDependencyTests-315911834 None] Lock "cinder-quobyte-573cca87-d156-4ec5-bf19-45d4ea592766" released by "_copy_volume_from_snapshot" :: held 6.879s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:39:50 devstack cinder-volume[86512]: DEBUG oslo_service.periodic_task [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86512) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 18:39:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:39:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:39:50 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:39:50 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:39:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:39:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:50 devstack sudo[108509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:39:50 devstack sudo[108509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:50 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-60fb741e-ea10-4bad-9ef6-de35f70f49f7 tempest-SnapshotDependencyTests-315911834 None] Lock "cinder-quobyte-5e308abc-3698-4da7-abf5-7ee71f6e58f3-573cca87-d156-4ec5-bf19-45d4ea592766" released by "_create_volume_from_snapshot" :: held 6.986s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:39:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-60fb741e-ea10-4bad-9ef6-de35f70f49f7 tempest-SnapshotDependencyTests-315911834 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.019s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:39:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-253f22cc-1970-42b0-95d9-f3228d5570bb tempest-ProjectMemberTests-1577701723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.696s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:39:50 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-253f22cc-1970-42b0-95d9-f3228d5570bb tempest-ProjectMemberTests-1577701723 None] Creating offline snapshot 0bcb07d6-c07a-4c5b-9f00-f6093a3d775f of volume 5c22247d-2f5e-4d87-bd83-3ec60986e89d {{(pid=86512) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 18:39:50 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-60fb741e-ea10-4bad-9ef6-de35f70f49f7 tempest-SnapshotDependencyTests-315911834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32048a81-baee-4a75-ad9e-196299bd3e65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-573cca87-d156-4ec5-bf19-45d4ea592766', 'volume_size': 1, 'snapshot_id': '5e308abc-3698-4da7-abf5-7ee71f6e58f3'}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:39:50 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-60fb741e-ea10-4bad-9ef6-de35f70f49f7 tempest-SnapshotDependencyTests-315911834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7164949b-224b-4989-9fe5-81e82d815a63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:39:50 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[63510440-021d-4285-80f4-5e1a1e4b1727]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:39:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-253f22cc-1970-42b0-95d9-f3228d5570bb tempest-ProjectMemberTests-1577701723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-5c22247d-2f5e-4d87-bd83-3ec60986e89d {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:50 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-60fb741e-ea10-4bad-9ef6-de35f70f49f7 tempest-SnapshotDependencyTests-315911834 None] Volume volume-573cca87-d156-4ec5-bf19-45d4ea592766 (573cca87-d156-4ec5-bf19-45d4ea592766): created successfully Sep 29 18:39:50 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-60fb741e-ea10-4bad-9ef6-de35f70f49f7 tempest-SnapshotDependencyTests-315911834 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7164949b-224b-4989-9fe5-81e82d815a63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:39:50 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-60fb741e-ea10-4bad-9ef6-de35f70f49f7 tempest-SnapshotDependencyTests-315911834 None] Flow 'volume_create_manager' (a54b44e8-6a61-4527-8a77-8c3872c71ffe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:39:50 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-60fb741e-ea10-4bad-9ef6-de35f70f49f7 tempest-SnapshotDependencyTests-315911834 None] Created volume successfully. Sep 29 18:39:50 devstack sudo[108531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-5c22247d-2f5e-4d87-bd83-3ec60986e89d Sep 29 18:39:50 devstack sudo[108531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:50 devstack sudo[108509]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:50 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.302s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:50 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:39:50 devstack cinder-volume[86512]: DEBUG oslo_service.periodic_task [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] Running periodic task VolumeManager._thread_info {{(pid=86512) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 18:39:50 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] thread count: 29 {{(pid=86512) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 29 18:39:50 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-52e0c763-d0b7-421f-9fee-03dae709b7ac None None] thread info: [<_MainThread(MainThread, started 135593654804608)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86512) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 29 18:39:51 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-5316711d-fb22-4bec-bf12-7466f13a45c9 tempest-SnapshotDependencyTests-315911834 None] Acquiring lock "cinder-5e308abc-3698-4da7-abf5-7ee71f6e58f3-delete_snapshot" by "delete_snapshot" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:39:51 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-5316711d-fb22-4bec-bf12-7466f13a45c9 tempest-SnapshotDependencyTests-315911834 None] Lock "cinder-5e308abc-3698-4da7-abf5-7ee71f6e58f3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:39:51 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-5316711d-fb22-4bec-bf12-7466f13a45c9 tempest-SnapshotDependencyTests-315911834 None] Acquiring lock "cinder-quobyte-b102db0f-359d-4ad5-8ef3-9de9d149eff7" by "delete_snapshot" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:39:51 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-5316711d-fb22-4bec-bf12-7466f13a45c9 tempest-SnapshotDependencyTests-315911834 None] Lock "cinder-quobyte-b102db0f-359d-4ad5-8ef3-9de9d149eff7" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:39:51 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-5316711d-fb22-4bec-bf12-7466f13a45c9 tempest-SnapshotDependencyTests-315911834 None] Acquiring lock "cinder-quobyte-5e308abc-3698-4da7-abf5-7ee71f6e58f3" by "_delete_snapshot" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:39:51 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-5316711d-fb22-4bec-bf12-7466f13a45c9 tempest-SnapshotDependencyTests-315911834 None] Lock "cinder-quobyte-5e308abc-3698-4da7-abf5-7ee71f6e58f3" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:39:51 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-5316711d-fb22-4bec-bf12-7466f13a45c9 tempest-SnapshotDependencyTests-315911834 None] Deleting offline snapshot 5e308abc-3698-4da7-abf5-7ee71f6e58f3 of volume b102db0f-359d-4ad5-8ef3-9de9d149eff7 {{(pid=86512) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 18:39:51 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-5316711d-fb22-4bec-bf12-7466f13a45c9 tempest-SnapshotDependencyTests-315911834 None] snapshot_file for this snap is: volume-b102db0f-359d-4ad5-8ef3-9de9d149eff7.5e308abc-3698-4da7-abf5-7ee71f6e58f3 {{(pid=86512) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 18:39:51 devstack sudo[108531]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:51 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-253f22cc-1970-42b0-95d9-f3228d5570bb tempest-ProjectMemberTests-1577701723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-5c22247d-2f5e-4d87-bd83-3ec60986e89d" returned: 0 in 0.435s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:51 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdf1e425-2bec-4660-9532-331828a281c7]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:39:51 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-253f22cc-1970-42b0-95d9-f3228d5570bb tempest-ProjectMemberTests-1577701723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-5c22247d-2f5e-4d87-bd83-3ec60986e89d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-5c22247d-2f5e-4d87-bd83-3ec60986e89d.0bcb07d6-c07a-4c5b-9f00-f6093a3d775f 1G {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:51 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-5316711d-fb22-4bec-bf12-7466f13a45c9 tempest-SnapshotDependencyTests-315911834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-b102db0f-359d-4ad5-8ef3-9de9d149eff7.5e308abc-3698-4da7-abf5-7ee71f6e58f3 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:51 devstack sudo[108540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-5c22247d-2f5e-4d87-bd83-3ec60986e89d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-5c22247d-2f5e-4d87-bd83-3ec60986e89d.0bcb07d6-c07a-4c5b-9f00-f6093a3d775f 1G Sep 29 18:39:51 devstack sudo[108540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:51 devstack sudo[108541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-b102db0f-359d-4ad5-8ef3-9de9d149eff7.5e308abc-3698-4da7-abf5-7ee71f6e58f3 Sep 29 18:39:51 devstack sudo[108541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:51 devstack sudo[108541]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:51 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-5316711d-fb22-4bec-bf12-7466f13a45c9 tempest-SnapshotDependencyTests-315911834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-b102db0f-359d-4ad5-8ef3-9de9d149eff7.5e308abc-3698-4da7-abf5-7ee71f6e58f3" returned: 0 in 0.367s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:51 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-5316711d-fb22-4bec-bf12-7466f13a45c9 tempest-SnapshotDependencyTests-315911834 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b102db0f-359d-4ad5-8ef3-9de9d149eff7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86512) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 18:39:51 devstack sudo[108540]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:51 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-253f22cc-1970-42b0-95d9-f3228d5570bb tempest-ProjectMemberTests-1577701723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-5c22247d-2f5e-4d87-bd83-3ec60986e89d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-5c22247d-2f5e-4d87-bd83-3ec60986e89d.0bcb07d6-c07a-4c5b-9f00-f6093a3d775f 1G" returned: 0 in 0.406s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:51 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-253f22cc-1970-42b0-95d9-f3228d5570bb tempest-ProjectMemberTests-1577701723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c22247d-2f5e-4d87-bd83-3ec60986e89d -F qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-5c22247d-2f5e-4d87-bd83-3ec60986e89d.0bcb07d6-c07a-4c5b-9f00-f6093a3d775f {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:51 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[faa1246c-a271-4ffe-ab82-d4a0c5740ee4]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:39:51 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-5316711d-fb22-4bec-bf12-7466f13a45c9 tempest-SnapshotDependencyTests-315911834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-b102db0f-359d-4ad5-8ef3-9de9d149eff7 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:51 devstack sudo[108550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c22247d-2f5e-4d87-bd83-3ec60986e89d -F qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-5c22247d-2f5e-4d87-bd83-3ec60986e89d.0bcb07d6-c07a-4c5b-9f00-f6093a3d775f Sep 29 18:39:51 devstack sudo[108550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:51 devstack sudo[108551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-b102db0f-359d-4ad5-8ef3-9de9d149eff7 Sep 29 18:39:51 devstack sudo[108551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:51 devstack sudo[108550]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:51 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-253f22cc-1970-42b0-95d9-f3228d5570bb tempest-ProjectMemberTests-1577701723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c22247d-2f5e-4d87-bd83-3ec60986e89d -F qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-5c22247d-2f5e-4d87-bd83-3ec60986e89d.0bcb07d6-c07a-4c5b-9f00-f6093a3d775f" returned: 0 in 0.280s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:51 devstack cinder-volume[86512]: WARNING cinder.volume.drivers.remotefs [None req-253f22cc-1970-42b0-95d9-f3228d5570bb tempest-ProjectMemberTests-1577701723 None] /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-5c22247d-2f5e-4d87-bd83-3ec60986e89d.0bcb07d6-c07a-4c5b-9f00-f6093a3d775f is being set with open permissions: ugo+rw Sep 29 18:39:51 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-253f22cc-1970-42b0-95d9-f3228d5570bb tempest-ProjectMemberTests-1577701723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-5c22247d-2f5e-4d87-bd83-3ec60986e89d.0bcb07d6-c07a-4c5b-9f00-f6093a3d775f {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:51 devstack sudo[108557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-5c22247d-2f5e-4d87-bd83-3ec60986e89d.0bcb07d6-c07a-4c5b-9f00-f6093a3d775f Sep 29 18:39:51 devstack sudo[108557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:52 devstack sudo[108557]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:52 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-253f22cc-1970-42b0-95d9-f3228d5570bb tempest-ProjectMemberTests-1577701723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-5c22247d-2f5e-4d87-bd83-3ec60986e89d.0bcb07d6-c07a-4c5b-9f00-f6093a3d775f" returned: 0 in 0.236s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:52 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-253f22cc-1970-42b0-95d9-f3228d5570bb tempest-ProjectMemberTests-1577701723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-5c22247d-2f5e-4d87-bd83-3ec60986e89d.info {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:52 devstack sudo[108563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-5c22247d-2f5e-4d87-bd83-3ec60986e89d.info Sep 29 18:39:52 devstack sudo[108563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:52 devstack sudo[108551]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:52 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-5316711d-fb22-4bec-bf12-7466f13a45c9 tempest-SnapshotDependencyTests-315911834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-b102db0f-359d-4ad5-8ef3-9de9d149eff7" returned: 0 in 0.570s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:52 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-5316711d-fb22-4bec-bf12-7466f13a45c9 tempest-SnapshotDependencyTests-315911834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-b102db0f-359d-4ad5-8ef3-9de9d149eff7.5e308abc-3698-4da7-abf5-7ee71f6e58f3 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:52 devstack sudo[108565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-b102db0f-359d-4ad5-8ef3-9de9d149eff7.5e308abc-3698-4da7-abf5-7ee71f6e58f3 Sep 29 18:39:52 devstack sudo[108565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:52 devstack sudo[108563]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:52 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-253f22cc-1970-42b0-95d9-f3228d5570bb tempest-ProjectMemberTests-1577701723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-5c22247d-2f5e-4d87-bd83-3ec60986e89d.info" returned: 0 in 0.253s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:52 devstack cinder-volume[86512]: WARNING cinder.volume.drivers.remotefs [None req-253f22cc-1970-42b0-95d9-f3228d5570bb tempest-ProjectMemberTests-1577701723 None] /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-5c22247d-2f5e-4d87-bd83-3ec60986e89d.info is being set with open permissions: ugo+rw Sep 29 18:39:52 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-253f22cc-1970-42b0-95d9-f3228d5570bb tempest-ProjectMemberTests-1577701723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-5c22247d-2f5e-4d87-bd83-3ec60986e89d.info {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:52 devstack sudo[108570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-5c22247d-2f5e-4d87-bd83-3ec60986e89d.info Sep 29 18:39:52 devstack sudo[108570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:52 devstack sudo[108565]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:52 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-5316711d-fb22-4bec-bf12-7466f13a45c9 tempest-SnapshotDependencyTests-315911834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-b102db0f-359d-4ad5-8ef3-9de9d149eff7.5e308abc-3698-4da7-abf5-7ee71f6e58f3" returned: 0 in 0.343s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:52 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-5316711d-fb22-4bec-bf12-7466f13a45c9 tempest-SnapshotDependencyTests-315911834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-b102db0f-359d-4ad5-8ef3-9de9d149eff7.5e308abc-3698-4da7-abf5-7ee71f6e58f3 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:52 devstack sudo[108573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-b102db0f-359d-4ad5-8ef3-9de9d149eff7.5e308abc-3698-4da7-abf5-7ee71f6e58f3 Sep 29 18:39:52 devstack sudo[108573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:52 devstack sudo[108570]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:52 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-253f22cc-1970-42b0-95d9-f3228d5570bb tempest-ProjectMemberTests-1577701723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-5c22247d-2f5e-4d87-bd83-3ec60986e89d.info" returned: 0 in 0.250s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:52 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-253f22cc-1970-42b0-95d9-f3228d5570bb tempest-ProjectMemberTests-1577701723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.960s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:39:52 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-253f22cc-1970-42b0-95d9-f3228d5570bb tempest-ProjectMemberTests-1577701723 None] Create snapshot completed successfully Sep 29 18:39:52 devstack sudo[108573]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:52 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-5316711d-fb22-4bec-bf12-7466f13a45c9 tempest-SnapshotDependencyTests-315911834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-b102db0f-359d-4ad5-8ef3-9de9d149eff7.5e308abc-3698-4da7-abf5-7ee71f6e58f3" returned: 0 in 0.271s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:52 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-5316711d-fb22-4bec-bf12-7466f13a45c9 tempest-SnapshotDependencyTests-315911834 None] Lock "cinder-quobyte-5e308abc-3698-4da7-abf5-7ee71f6e58f3" released by "_delete_snapshot" :: held 1.673s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:39:52 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-5316711d-fb22-4bec-bf12-7466f13a45c9 tempest-SnapshotDependencyTests-315911834 None] Lock "cinder-quobyte-b102db0f-359d-4ad5-8ef3-9de9d149eff7" released by "delete_snapshot" :: held 1.699s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:39:52 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-5316711d-fb22-4bec-bf12-7466f13a45c9 tempest-SnapshotDependencyTests-315911834 None] Created reservations ['7f7523e7-3b13-418b-b70f-9522a7a17803', '1312a809-5ab2-4a04-8f93-6114df671949', '2d2361b3-1585-4588-8be6-5eb77ecfe676', '0501353b-9766-4bea-959f-62841f1a723c'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:39:52 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-5316711d-fb22-4bec-bf12-7466f13a45c9 tempest-SnapshotDependencyTests-315911834 None] Delete snapshot completed successfully. Sep 29 18:39:52 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-5316711d-fb22-4bec-bf12-7466f13a45c9 tempest-SnapshotDependencyTests-315911834 None] Lock "cinder-5e308abc-3698-4da7-abf5-7ee71f6e58f3-delete_snapshot" released by "delete_snapshot" :: held 1.835s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:39:53 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-fba65113-59b7-4d1d-bb86-3e5545576267 tempest-SnapshotDependencyTests-315911834 None] Acquiring lock "cinder-b102db0f-359d-4ad5-8ef3-9de9d149eff7-delete_volume" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:39:53 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-fba65113-59b7-4d1d-bb86-3e5545576267 tempest-SnapshotDependencyTests-315911834 None] Lock "cinder-b102db0f-359d-4ad5-8ef3-9de9d149eff7-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:39:53 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-fba65113-59b7-4d1d-bb86-3e5545576267 tempest-SnapshotDependencyTests-315911834 None] Acquiring lock "cinder-quobyte-b102db0f-359d-4ad5-8ef3-9de9d149eff7" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:39:53 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-fba65113-59b7-4d1d-bb86-3e5545576267 tempest-SnapshotDependencyTests-315911834 None] Lock "cinder-quobyte-b102db0f-359d-4ad5-8ef3-9de9d149eff7" acquired by "delete_volume" :: waited 0.016s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:39:53 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[d69ac151-ceaa-45ce-a0c7-e870aa9dd991]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:39:53 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-fba65113-59b7-4d1d-bb86-3e5545576267 tempest-SnapshotDependencyTests-315911834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-b102db0f-359d-4ad5-8ef3-9de9d149eff7 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:53 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-a9348994-5464-4884-ba03-1330e2cdd7af tempest-ProjectMemberTests-1577701723 None] Acquiring lock "cinder-0bcb07d6-c07a-4c5b-9f00-f6093a3d775f-delete_snapshot" by "delete_snapshot" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:39:53 devstack sudo[108577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-b102db0f-359d-4ad5-8ef3-9de9d149eff7 Sep 29 18:39:53 devstack sudo[108577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:53 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-a9348994-5464-4884-ba03-1330e2cdd7af tempest-ProjectMemberTests-1577701723 None] Lock "cinder-0bcb07d6-c07a-4c5b-9f00-f6093a3d775f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:39:53 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-a9348994-5464-4884-ba03-1330e2cdd7af tempest-ProjectMemberTests-1577701723 None] Acquiring lock "cinder-quobyte-5c22247d-2f5e-4d87-bd83-3ec60986e89d" by "delete_snapshot" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:39:53 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-a9348994-5464-4884-ba03-1330e2cdd7af tempest-ProjectMemberTests-1577701723 None] Lock "cinder-quobyte-5c22247d-2f5e-4d87-bd83-3ec60986e89d" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:39:53 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-a9348994-5464-4884-ba03-1330e2cdd7af tempest-ProjectMemberTests-1577701723 None] Acquiring lock "cinder-quobyte-0bcb07d6-c07a-4c5b-9f00-f6093a3d775f" by "_delete_snapshot" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:39:53 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-a9348994-5464-4884-ba03-1330e2cdd7af tempest-ProjectMemberTests-1577701723 None] Lock "cinder-quobyte-0bcb07d6-c07a-4c5b-9f00-f6093a3d775f" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:39:53 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-a9348994-5464-4884-ba03-1330e2cdd7af tempest-ProjectMemberTests-1577701723 None] Deleting offline snapshot 0bcb07d6-c07a-4c5b-9f00-f6093a3d775f of volume 5c22247d-2f5e-4d87-bd83-3ec60986e89d {{(pid=86512) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 18:39:53 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-a9348994-5464-4884-ba03-1330e2cdd7af tempest-ProjectMemberTests-1577701723 None] snapshot_file for this snap is: volume-5c22247d-2f5e-4d87-bd83-3ec60986e89d.0bcb07d6-c07a-4c5b-9f00-f6093a3d775f {{(pid=86512) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 18:39:53 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9379da7-9081-47db-9201-209e5fd89438]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:39:53 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a9348994-5464-4884-ba03-1330e2cdd7af tempest-ProjectMemberTests-1577701723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-5c22247d-2f5e-4d87-bd83-3ec60986e89d.0bcb07d6-c07a-4c5b-9f00-f6093a3d775f {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:53 devstack sudo[108579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-5c22247d-2f5e-4d87-bd83-3ec60986e89d.0bcb07d6-c07a-4c5b-9f00-f6093a3d775f Sep 29 18:39:53 devstack sudo[108579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:53 devstack sudo[108577]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:53 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-fba65113-59b7-4d1d-bb86-3e5545576267 tempest-SnapshotDependencyTests-315911834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-b102db0f-359d-4ad5-8ef3-9de9d149eff7" returned: 0 in 0.407s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:53 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-fba65113-59b7-4d1d-bb86-3e5545576267 tempest-SnapshotDependencyTests-315911834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-b102db0f-359d-4ad5-8ef3-9de9d149eff7 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:53 devstack sudo[108585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-b102db0f-359d-4ad5-8ef3-9de9d149eff7 Sep 29 18:39:53 devstack sudo[108585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:54 devstack sudo[108579]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:54 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a9348994-5464-4884-ba03-1330e2cdd7af tempest-ProjectMemberTests-1577701723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-5c22247d-2f5e-4d87-bd83-3ec60986e89d.0bcb07d6-c07a-4c5b-9f00-f6093a3d775f" returned: 0 in 0.381s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:54 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-a9348994-5464-4884-ba03-1330e2cdd7af tempest-ProjectMemberTests-1577701723 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5c22247d-2f5e-4d87-bd83-3ec60986e89d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86512) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 18:39:54 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[c13bc90c-aa02-4a09-b580-aa050b4aa7b4]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:39:54 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a9348994-5464-4884-ba03-1330e2cdd7af tempest-ProjectMemberTests-1577701723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-5c22247d-2f5e-4d87-bd83-3ec60986e89d {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:54 devstack sudo[108585]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:54 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-fba65113-59b7-4d1d-bb86-3e5545576267 tempest-SnapshotDependencyTests-315911834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-b102db0f-359d-4ad5-8ef3-9de9d149eff7" returned: 0 in 0.285s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:54 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-fba65113-59b7-4d1d-bb86-3e5545576267 tempest-SnapshotDependencyTests-315911834 None] Lock "cinder-quobyte-b102db0f-359d-4ad5-8ef3-9de9d149eff7" released by "delete_volume" :: held 0.771s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:39:54 devstack sudo[108591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-5c22247d-2f5e-4d87-bd83-3ec60986e89d Sep 29 18:39:54 devstack sudo[108591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:54 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-fba65113-59b7-4d1d-bb86-3e5545576267 tempest-SnapshotDependencyTests-315911834 None] Created reservations ['7839e5a9-f4f7-4180-809e-563fa2ead5c2', 'b8c447a8-c58a-48b7-8328-39c8e06b5c48', '880b8f06-8d07-4593-b65f-961bbfaa00f9', '0034caef-beaf-4777-a4ab-df28f8b38900'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:39:54 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-fba65113-59b7-4d1d-bb86-3e5545576267 tempest-SnapshotDependencyTests-315911834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:39:54 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-fba65113-59b7-4d1d-bb86-3e5545576267 tempest-SnapshotDependencyTests-315911834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:39:54 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-fba65113-59b7-4d1d-bb86-3e5545576267 tempest-SnapshotDependencyTests-315911834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:39:54 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-fba65113-59b7-4d1d-bb86-3e5545576267 tempest-SnapshotDependencyTests-315911834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:39:54 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-fba65113-59b7-4d1d-bb86-3e5545576267 tempest-SnapshotDependencyTests-315911834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:39:54 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-fba65113-59b7-4d1d-bb86-3e5545576267 tempest-SnapshotDependencyTests-315911834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:54 devstack sudo[108594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:39:54 devstack sudo[108594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:54 devstack sudo[108591]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:54 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a9348994-5464-4884-ba03-1330e2cdd7af tempest-ProjectMemberTests-1577701723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-5c22247d-2f5e-4d87-bd83-3ec60986e89d" returned: 0 in 0.389s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:54 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a9348994-5464-4884-ba03-1330e2cdd7af tempest-ProjectMemberTests-1577701723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-5c22247d-2f5e-4d87-bd83-3ec60986e89d.0bcb07d6-c07a-4c5b-9f00-f6093a3d775f {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:54 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-d3dfd9fc-d9ba-4438-953c-02be1bc24b81 tempest-SnapshotDependencyTests-315911834 None] Acquiring lock "cinder-573cca87-d156-4ec5-bf19-45d4ea592766-delete_volume" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:39:54 devstack sudo[108599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-5c22247d-2f5e-4d87-bd83-3ec60986e89d.0bcb07d6-c07a-4c5b-9f00-f6093a3d775f Sep 29 18:39:54 devstack sudo[108599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:54 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-d3dfd9fc-d9ba-4438-953c-02be1bc24b81 tempest-SnapshotDependencyTests-315911834 None] Lock "cinder-573cca87-d156-4ec5-bf19-45d4ea592766-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:39:54 devstack sudo[108594]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:54 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-d3dfd9fc-d9ba-4438-953c-02be1bc24b81 tempest-SnapshotDependencyTests-315911834 None] Acquiring lock "cinder-quobyte-573cca87-d156-4ec5-bf19-45d4ea592766" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:39:54 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-fba65113-59b7-4d1d-bb86-3e5545576267 tempest-SnapshotDependencyTests-315911834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.299s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:54 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-fba65113-59b7-4d1d-bb86-3e5545576267 tempest-SnapshotDependencyTests-315911834 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:39:54 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-fba65113-59b7-4d1d-bb86-3e5545576267 tempest-SnapshotDependencyTests-315911834 None] Deleted volume successfully. Sep 29 18:39:54 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-d3dfd9fc-d9ba-4438-953c-02be1bc24b81 tempest-SnapshotDependencyTests-315911834 None] Lock "cinder-quobyte-573cca87-d156-4ec5-bf19-45d4ea592766" acquired by "delete_volume" :: waited 0.034s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:39:54 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-fba65113-59b7-4d1d-bb86-3e5545576267 tempest-SnapshotDependencyTests-315911834 None] Lock "cinder-b102db0f-359d-4ad5-8ef3-9de9d149eff7-delete_volume" released by "delete_volume" :: held 1.320s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:39:54 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3526904-776e-4862-9b84-2d30d32473e0]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:39:54 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-d3dfd9fc-d9ba-4438-953c-02be1bc24b81 tempest-SnapshotDependencyTests-315911834 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-573cca87-d156-4ec5-bf19-45d4ea592766 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:54 devstack sudo[108602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-573cca87-d156-4ec5-bf19-45d4ea592766 Sep 29 18:39:54 devstack sudo[108602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:54 devstack sudo[108599]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:54 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a9348994-5464-4884-ba03-1330e2cdd7af tempest-ProjectMemberTests-1577701723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-5c22247d-2f5e-4d87-bd83-3ec60986e89d.0bcb07d6-c07a-4c5b-9f00-f6093a3d775f" returned: 0 in 0.394s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:54 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a9348994-5464-4884-ba03-1330e2cdd7af tempest-ProjectMemberTests-1577701723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-5c22247d-2f5e-4d87-bd83-3ec60986e89d.0bcb07d6-c07a-4c5b-9f00-f6093a3d775f {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:54 devstack sudo[108607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-5c22247d-2f5e-4d87-bd83-3ec60986e89d.0bcb07d6-c07a-4c5b-9f00-f6093a3d775f Sep 29 18:39:54 devstack sudo[108607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:55 devstack sudo[108602]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:55 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-d3dfd9fc-d9ba-4438-953c-02be1bc24b81 tempest-SnapshotDependencyTests-315911834 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-573cca87-d156-4ec5-bf19-45d4ea592766" returned: 0 in 0.374s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:55 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-d3dfd9fc-d9ba-4438-953c-02be1bc24b81 tempest-SnapshotDependencyTests-315911834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-573cca87-d156-4ec5-bf19-45d4ea592766 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:55 devstack sudo[108612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-573cca87-d156-4ec5-bf19-45d4ea592766 Sep 29 18:39:55 devstack sudo[108612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:55 devstack sudo[108607]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:55 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-a9348994-5464-4884-ba03-1330e2cdd7af tempest-ProjectMemberTests-1577701723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-5c22247d-2f5e-4d87-bd83-3ec60986e89d.0bcb07d6-c07a-4c5b-9f00-f6093a3d775f" returned: 0 in 0.277s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:55 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-a9348994-5464-4884-ba03-1330e2cdd7af tempest-ProjectMemberTests-1577701723 None] Lock "cinder-quobyte-0bcb07d6-c07a-4c5b-9f00-f6093a3d775f" released by "_delete_snapshot" :: held 1.556s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:39:55 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-a9348994-5464-4884-ba03-1330e2cdd7af tempest-ProjectMemberTests-1577701723 None] Lock "cinder-quobyte-5c22247d-2f5e-4d87-bd83-3ec60986e89d" released by "delete_snapshot" :: held 1.583s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:39:55 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-a9348994-5464-4884-ba03-1330e2cdd7af tempest-ProjectMemberTests-1577701723 None] Created reservations ['7b4b06c4-9d8a-4860-b65c-f2e10415e0d1', 'f2eaeacc-d0b0-476f-9a1c-a5078bf6d011', '65cc0ef3-fafb-437a-a94a-f9b837187f48', '4b03320c-1545-450d-b165-a466c9a35767'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:39:55 devstack sudo[108612]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:55 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-d3dfd9fc-d9ba-4438-953c-02be1bc24b81 tempest-SnapshotDependencyTests-315911834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-573cca87-d156-4ec5-bf19-45d4ea592766" returned: 0 in 0.278s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:55 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-d3dfd9fc-d9ba-4438-953c-02be1bc24b81 tempest-SnapshotDependencyTests-315911834 None] Lock "cinder-quobyte-573cca87-d156-4ec5-bf19-45d4ea592766" released by "delete_volume" :: held 0.720s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:39:55 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-a9348994-5464-4884-ba03-1330e2cdd7af tempest-ProjectMemberTests-1577701723 None] Delete snapshot completed successfully. Sep 29 18:39:55 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-a9348994-5464-4884-ba03-1330e2cdd7af tempest-ProjectMemberTests-1577701723 None] Lock "cinder-0bcb07d6-c07a-4c5b-9f00-f6093a3d775f-delete_snapshot" released by "delete_snapshot" :: held 1.758s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:39:55 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-d3dfd9fc-d9ba-4438-953c-02be1bc24b81 tempest-SnapshotDependencyTests-315911834 None] Created reservations ['6855d851-02f4-4b45-b6f7-93515364dcd4', '392291b2-d896-42cd-bd7b-ec83ee6fbf19', '624a6e11-d605-4a6b-b08e-c958c57121dd', 'cc0cc45b-d595-4eec-8d69-da27d488be7d'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:39:55 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-d3dfd9fc-d9ba-4438-953c-02be1bc24b81 tempest-SnapshotDependencyTests-315911834 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:39:55 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-d3dfd9fc-d9ba-4438-953c-02be1bc24b81 tempest-SnapshotDependencyTests-315911834 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:39:55 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-d3dfd9fc-d9ba-4438-953c-02be1bc24b81 tempest-SnapshotDependencyTests-315911834 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:39:55 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-d3dfd9fc-d9ba-4438-953c-02be1bc24b81 tempest-SnapshotDependencyTests-315911834 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:39:55 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-d3dfd9fc-d9ba-4438-953c-02be1bc24b81 tempest-SnapshotDependencyTests-315911834 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:39:55 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-d3dfd9fc-d9ba-4438-953c-02be1bc24b81 tempest-SnapshotDependencyTests-315911834 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:55 devstack sudo[108616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:39:55 devstack sudo[108616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:55 devstack sudo[108616]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:55 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-d3dfd9fc-d9ba-4438-953c-02be1bc24b81 tempest-SnapshotDependencyTests-315911834 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.252s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:55 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-d3dfd9fc-d9ba-4438-953c-02be1bc24b81 tempest-SnapshotDependencyTests-315911834 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:39:55 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-d3dfd9fc-d9ba-4438-953c-02be1bc24b81 tempest-SnapshotDependencyTests-315911834 None] Deleted volume successfully. Sep 29 18:39:55 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-d3dfd9fc-d9ba-4438-953c-02be1bc24b81 tempest-SnapshotDependencyTests-315911834 None] Lock "cinder-573cca87-d156-4ec5-bf19-45d4ea592766-delete_volume" released by "delete_volume" :: held 1.202s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:39:55 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-f83fd324-d4b5-45ac-9ae5-5a24198f2773 tempest-ProjectMemberTests-1577701723 None] Acquiring lock "cinder-5c22247d-2f5e-4d87-bd83-3ec60986e89d-delete_volume" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:39:55 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-f83fd324-d4b5-45ac-9ae5-5a24198f2773 tempest-ProjectMemberTests-1577701723 None] Lock "cinder-5c22247d-2f5e-4d87-bd83-3ec60986e89d-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:39:55 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-f83fd324-d4b5-45ac-9ae5-5a24198f2773 tempest-ProjectMemberTests-1577701723 None] Acquiring lock "cinder-quobyte-5c22247d-2f5e-4d87-bd83-3ec60986e89d" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:39:55 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-f83fd324-d4b5-45ac-9ae5-5a24198f2773 tempest-ProjectMemberTests-1577701723 None] Lock "cinder-quobyte-5c22247d-2f5e-4d87-bd83-3ec60986e89d" acquired by "delete_volume" :: waited 0.014s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:39:55 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7ff3aa0-678a-454f-a29c-b4ddff2662f5]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:39:55 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-f83fd324-d4b5-45ac-9ae5-5a24198f2773 tempest-ProjectMemberTests-1577701723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-5c22247d-2f5e-4d87-bd83-3ec60986e89d {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:55 devstack sudo[108619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-5c22247d-2f5e-4d87-bd83-3ec60986e89d Sep 29 18:39:55 devstack sudo[108619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:56 devstack sudo[108619]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:56 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-f83fd324-d4b5-45ac-9ae5-5a24198f2773 tempest-ProjectMemberTests-1577701723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-5c22247d-2f5e-4d87-bd83-3ec60986e89d" returned: 0 in 0.404s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:56 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-f83fd324-d4b5-45ac-9ae5-5a24198f2773 tempest-ProjectMemberTests-1577701723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-5c22247d-2f5e-4d87-bd83-3ec60986e89d {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:56 devstack sudo[108624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-5c22247d-2f5e-4d87-bd83-3ec60986e89d Sep 29 18:39:56 devstack sudo[108624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:56 devstack sudo[108624]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:56 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-f83fd324-d4b5-45ac-9ae5-5a24198f2773 tempest-ProjectMemberTests-1577701723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-5c22247d-2f5e-4d87-bd83-3ec60986e89d" returned: 0 in 0.290s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:56 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-f83fd324-d4b5-45ac-9ae5-5a24198f2773 tempest-ProjectMemberTests-1577701723 None] Lock "cinder-quobyte-5c22247d-2f5e-4d87-bd83-3ec60986e89d" released by "delete_volume" :: held 0.768s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:39:56 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-f83fd324-d4b5-45ac-9ae5-5a24198f2773 tempest-ProjectMemberTests-1577701723 None] Created reservations ['767e7526-b0c7-46ae-95f2-20ee7d72d8c8', '95ab96b6-c146-401a-8545-6a91826c8517', '3725ede3-9eb9-4dc2-a422-6e82c7d550cc', '1e9547db-b26f-4f4b-9a5a-bbfbd755fc70'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:39:56 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-f83fd324-d4b5-45ac-9ae5-5a24198f2773 tempest-ProjectMemberTests-1577701723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:39:56 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-f83fd324-d4b5-45ac-9ae5-5a24198f2773 tempest-ProjectMemberTests-1577701723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:39:56 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-f83fd324-d4b5-45ac-9ae5-5a24198f2773 tempest-ProjectMemberTests-1577701723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:39:56 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-f83fd324-d4b5-45ac-9ae5-5a24198f2773 tempest-ProjectMemberTests-1577701723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:39:56 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-f83fd324-d4b5-45ac-9ae5-5a24198f2773 tempest-ProjectMemberTests-1577701723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:39:56 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-f83fd324-d4b5-45ac-9ae5-5a24198f2773 tempest-ProjectMemberTests-1577701723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:56 devstack sudo[108633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:39:56 devstack sudo[108633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:56 devstack sudo[108633]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:57 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-f83fd324-d4b5-45ac-9ae5-5a24198f2773 tempest-ProjectMemberTests-1577701723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.274s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:57 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-f83fd324-d4b5-45ac-9ae5-5a24198f2773 tempest-ProjectMemberTests-1577701723 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:39:57 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-f83fd324-d4b5-45ac-9ae5-5a24198f2773 tempest-ProjectMemberTests-1577701723 None] Deleted volume successfully. Sep 29 18:39:57 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-f83fd324-d4b5-45ac-9ae5-5a24198f2773 tempest-ProjectMemberTests-1577701723 None] Lock "cinder-5c22247d-2f5e-4d87-bd83-3ec60986e89d-delete_volume" released by "delete_volume" :: held 1.272s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:39:57 devstack cinder-volume[86512]: DEBUG cinder.volume.flows.manager.create_volume [None req-af2733dd-903d-402e-b3df-900f865b4df6 tempest-ProjectMemberTests-1577701723 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86512) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:39:57 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-af2733dd-903d-402e-b3df-900f865b4df6 tempest-ProjectMemberTests-1577701723 None] Flow 'volume_create_manager' (bbf0bbbd-ce9d-4f72-ba05-be19fc57b106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:39:57 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-af2733dd-903d-402e-b3df-900f865b4df6 tempest-ProjectMemberTests-1577701723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54e2e2ad-c2e2-42f7-adb5-b120c4ad7772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:39:57 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-af2733dd-903d-402e-b3df-900f865b4df6 tempest-ProjectMemberTests-1577701723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54e2e2ad-c2e2-42f7-adb5-b120c4ad7772) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:39:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-378867052',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fe25451-c2c9-46bc-9c90-d9fdbdcfee1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc5a83cdd1e34b24adfa899bf4067f0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:39:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:39:57Z,use_quota=True,user_id='671a2611e03549f08f718ec6a8379db0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:39:57 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-af2733dd-903d-402e-b3df-900f865b4df6 tempest-ProjectMemberTests-1577701723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ccb6ac1-e548-45e2-afd5-9bc00c123158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:39:57 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-af2733dd-903d-402e-b3df-900f865b4df6 tempest-ProjectMemberTests-1577701723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ccb6ac1-e548-45e2-afd5-9bc00c123158) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:39:57 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-af2733dd-903d-402e-b3df-900f865b4df6 tempest-ProjectMemberTests-1577701723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ebc70c0-93b8-4692-8d5d-4a62ef38658f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:39:57 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-af2733dd-903d-402e-b3df-900f865b4df6 tempest-ProjectMemberTests-1577701723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ebc70c0-93b8-4692-8d5d-4a62ef38658f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9fe25451-c2c9-46bc-9c90-d9fdbdcfee1d', 'volume_name': 'volume-9fe25451-c2c9-46bc-9c90-d9fdbdcfee1d', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:39:57 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-af2733dd-903d-402e-b3df-900f865b4df6 tempest-ProjectMemberTests-1577701723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a68bba84-1b2e-4f56-b35c-d3f2811c98cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:39:57 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-af2733dd-903d-402e-b3df-900f865b4df6 tempest-ProjectMemberTests-1577701723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a68bba84-1b2e-4f56-b35c-d3f2811c98cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:39:57 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-af2733dd-903d-402e-b3df-900f865b4df6 tempest-ProjectMemberTests-1577701723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d7417e8-4206-42be-aa16-823782fcda5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:39:57 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-af2733dd-903d-402e-b3df-900f865b4df6 tempest-ProjectMemberTests-1577701723 None] Volume 9fe25451-c2c9-46bc-9c90-d9fdbdcfee1d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9fe25451-c2c9-46bc-9c90-d9fdbdcfee1d', 'volume_size': 1} Sep 29 18:39:57 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-af2733dd-903d-402e-b3df-900f865b4df6 tempest-ProjectMemberTests-1577701723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:39:57 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-af2733dd-903d-402e-b3df-900f865b4df6 tempest-ProjectMemberTests-1577701723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:39:57 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-af2733dd-903d-402e-b3df-900f865b4df6 tempest-ProjectMemberTests-1577701723 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:39:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-378867052',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fe25451-c2c9-46bc-9c90-d9fdbdcfee1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc5a83cdd1e34b24adfa899bf4067f0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:39:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:39:57Z,use_quota=True,user_id='671a2611e03549f08f718ec6a8379db0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ab16e1c9-1a96-4aae-b0a6-15b66ce173db),volume_type_id=ab16e1c9-1a96-4aae-b0a6-15b66ce173db)}" {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:39:57 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-af2733dd-903d-402e-b3df-900f865b4df6 tempest-ProjectMemberTests-1577701723 None] Creating volume 9fe25451-c2c9-46bc-9c90-d9fdbdcfee1d {{(pid=86512) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:39:57 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-af2733dd-903d-402e-b3df-900f865b4df6 tempest-ProjectMemberTests-1577701723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:39:57 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-af2733dd-903d-402e-b3df-900f865b4df6 tempest-ProjectMemberTests-1577701723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:39:57 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-af2733dd-903d-402e-b3df-900f865b4df6 tempest-ProjectMemberTests-1577701723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:39:57 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-af2733dd-903d-402e-b3df-900f865b4df6 tempest-ProjectMemberTests-1577701723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:39:57 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-af2733dd-903d-402e-b3df-900f865b4df6 tempest-ProjectMemberTests-1577701723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:39:57 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-af2733dd-903d-402e-b3df-900f865b4df6 tempest-ProjectMemberTests-1577701723 None] Selected osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 as target Quobyte volume. {{(pid=86512) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:39:57 devstack cinder-volume[86512]: INFO cinder.volume.drivers.remotefs [None req-af2733dd-903d-402e-b3df-900f865b4df6 tempest-ProjectMemberTests-1577701723 None] casted to osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883 Sep 29 18:39:57 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-af2733dd-903d-402e-b3df-900f865b4df6 tempest-ProjectMemberTests-1577701723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-9fe25451-c2c9-46bc-9c90-d9fdbdcfee1d 1073741824 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:57 devstack sudo[108637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-9fe25451-c2c9-46bc-9c90-d9fdbdcfee1d 1073741824 Sep 29 18:39:57 devstack sudo[108637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:58 devstack sudo[108637]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:58 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-af2733dd-903d-402e-b3df-900f865b4df6 tempest-ProjectMemberTests-1577701723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-9fe25451-c2c9-46bc-9c90-d9fdbdcfee1d 1073741824" returned: 0 in 0.502s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:58 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-af2733dd-903d-402e-b3df-900f865b4df6 tempest-ProjectMemberTests-1577701723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-9fe25451-c2c9-46bc-9c90-d9fdbdcfee1d {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:58 devstack sudo[108643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-9fe25451-c2c9-46bc-9c90-d9fdbdcfee1d Sep 29 18:39:58 devstack sudo[108643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:58 devstack sudo[108643]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:58 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-af2733dd-903d-402e-b3df-900f865b4df6 tempest-ProjectMemberTests-1577701723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-9fe25451-c2c9-46bc-9c90-d9fdbdcfee1d" returned: 0 in 0.283s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:58 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-af2733dd-903d-402e-b3df-900f865b4df6 tempest-ProjectMemberTests-1577701723 None] <== create_volume: return (834ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'} {{(pid=86512) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:39:58 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-af2733dd-903d-402e-b3df-900f865b4df6 tempest-ProjectMemberTests-1577701723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.837s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:39:58 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-af2733dd-903d-402e-b3df-900f865b4df6 tempest-ProjectMemberTests-1577701723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d7417e8-4206-42be-aa16-823782fcda5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9fe25451-c2c9-46bc-9c90-d9fdbdcfee1d', 'volume_size': 1}' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:39:58 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-af2733dd-903d-402e-b3df-900f865b4df6 tempest-ProjectMemberTests-1577701723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5f49dc6-e993-487a-9737-6845c0ff7a40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:39:58 devstack cinder-volume[86512]: INFO cinder.volume.flows.manager.create_volume [None req-af2733dd-903d-402e-b3df-900f865b4df6 tempest-ProjectMemberTests-1577701723 None] Volume volume-9fe25451-c2c9-46bc-9c90-d9fdbdcfee1d (9fe25451-c2c9-46bc-9c90-d9fdbdcfee1d): created successfully Sep 29 18:39:58 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-af2733dd-903d-402e-b3df-900f865b4df6 tempest-ProjectMemberTests-1577701723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5f49dc6-e993-487a-9737-6845c0ff7a40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86512) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:39:58 devstack cinder-volume[86512]: DEBUG cinder.volume.manager [None req-af2733dd-903d-402e-b3df-900f865b4df6 tempest-ProjectMemberTests-1577701723 None] Flow 'volume_create_manager' (bbf0bbbd-ce9d-4f72-ba05-be19fc57b106) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86512) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:39:58 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-af2733dd-903d-402e-b3df-900f865b4df6 tempest-ProjectMemberTests-1577701723 None] Created volume successfully. Sep 29 18:39:59 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-2556b9f6-5f96-47c8-81ba-b9b31063bf63 tempest-ProjectMemberTests-1577701723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:39:59 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-2556b9f6-5f96-47c8-81ba-b9b31063bf63 tempest-ProjectMemberTests-1577701723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:39:59 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-2556b9f6-5f96-47c8-81ba-b9b31063bf63 tempest-ProjectMemberTests-1577701723 None] Creating offline snapshot 0f856421-c08b-4820-b70d-dc692d0144b0 of volume 9fe25451-c2c9-46bc-9c90-d9fdbdcfee1d {{(pid=86512) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 18:39:59 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[05e7b7c2-95d6-424f-8135-c7ab38fae34f]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:39:59 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-2556b9f6-5f96-47c8-81ba-b9b31063bf63 tempest-ProjectMemberTests-1577701723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-9fe25451-c2c9-46bc-9c90-d9fdbdcfee1d {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:59 devstack sudo[108647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-9fe25451-c2c9-46bc-9c90-d9fdbdcfee1d Sep 29 18:39:59 devstack sudo[108647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:40:00 devstack sudo[108647]: pam_unix(sudo:session): session closed for user root Sep 29 18:40:00 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-2556b9f6-5f96-47c8-81ba-b9b31063bf63 tempest-ProjectMemberTests-1577701723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-9fe25451-c2c9-46bc-9c90-d9fdbdcfee1d" returned: 0 in 0.396s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:40:00 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-2556b9f6-5f96-47c8-81ba-b9b31063bf63 tempest-ProjectMemberTests-1577701723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-9fe25451-c2c9-46bc-9c90-d9fdbdcfee1d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-9fe25451-c2c9-46bc-9c90-d9fdbdcfee1d.0f856421-c08b-4820-b70d-dc692d0144b0 1G {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:40:00 devstack sudo[108654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-9fe25451-c2c9-46bc-9c90-d9fdbdcfee1d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-9fe25451-c2c9-46bc-9c90-d9fdbdcfee1d.0f856421-c08b-4820-b70d-dc692d0144b0 1G Sep 29 18:40:00 devstack sudo[108654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:40:00 devstack sudo[108654]: pam_unix(sudo:session): session closed for user root Sep 29 18:40:00 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-2556b9f6-5f96-47c8-81ba-b9b31063bf63 tempest-ProjectMemberTests-1577701723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-9fe25451-c2c9-46bc-9c90-d9fdbdcfee1d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-9fe25451-c2c9-46bc-9c90-d9fdbdcfee1d.0f856421-c08b-4820-b70d-dc692d0144b0 1G" returned: 0 in 0.409s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:40:00 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-2556b9f6-5f96-47c8-81ba-b9b31063bf63 tempest-ProjectMemberTests-1577701723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9fe25451-c2c9-46bc-9c90-d9fdbdcfee1d -F qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-9fe25451-c2c9-46bc-9c90-d9fdbdcfee1d.0f856421-c08b-4820-b70d-dc692d0144b0 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:40:00 devstack sudo[108659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9fe25451-c2c9-46bc-9c90-d9fdbdcfee1d -F qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-9fe25451-c2c9-46bc-9c90-d9fdbdcfee1d.0f856421-c08b-4820-b70d-dc692d0144b0 Sep 29 18:40:00 devstack sudo[108659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:40:00 devstack sudo[108659]: pam_unix(sudo:session): session closed for user root Sep 29 18:40:00 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-2556b9f6-5f96-47c8-81ba-b9b31063bf63 tempest-ProjectMemberTests-1577701723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9fe25451-c2c9-46bc-9c90-d9fdbdcfee1d -F qcow2 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-9fe25451-c2c9-46bc-9c90-d9fdbdcfee1d.0f856421-c08b-4820-b70d-dc692d0144b0" returned: 0 in 0.327s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:40:00 devstack cinder-volume[86512]: WARNING cinder.volume.drivers.remotefs [None req-2556b9f6-5f96-47c8-81ba-b9b31063bf63 tempest-ProjectMemberTests-1577701723 None] /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-9fe25451-c2c9-46bc-9c90-d9fdbdcfee1d.0f856421-c08b-4820-b70d-dc692d0144b0 is being set with open permissions: ugo+rw Sep 29 18:40:00 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-2556b9f6-5f96-47c8-81ba-b9b31063bf63 tempest-ProjectMemberTests-1577701723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-9fe25451-c2c9-46bc-9c90-d9fdbdcfee1d.0f856421-c08b-4820-b70d-dc692d0144b0 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:40:00 devstack sudo[108665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-9fe25451-c2c9-46bc-9c90-d9fdbdcfee1d.0f856421-c08b-4820-b70d-dc692d0144b0 Sep 29 18:40:00 devstack sudo[108665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:40:01 devstack sudo[108665]: pam_unix(sudo:session): session closed for user root Sep 29 18:40:01 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-2556b9f6-5f96-47c8-81ba-b9b31063bf63 tempest-ProjectMemberTests-1577701723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-9fe25451-c2c9-46bc-9c90-d9fdbdcfee1d.0f856421-c08b-4820-b70d-dc692d0144b0" returned: 0 in 0.239s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:40:01 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-2556b9f6-5f96-47c8-81ba-b9b31063bf63 tempest-ProjectMemberTests-1577701723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-9fe25451-c2c9-46bc-9c90-d9fdbdcfee1d.info {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:40:01 devstack sudo[108668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-9fe25451-c2c9-46bc-9c90-d9fdbdcfee1d.info Sep 29 18:40:01 devstack sudo[108668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:40:01 devstack sudo[108668]: pam_unix(sudo:session): session closed for user root Sep 29 18:40:01 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-2556b9f6-5f96-47c8-81ba-b9b31063bf63 tempest-ProjectMemberTests-1577701723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-9fe25451-c2c9-46bc-9c90-d9fdbdcfee1d.info" returned: 0 in 0.240s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:40:01 devstack cinder-volume[86512]: WARNING cinder.volume.drivers.remotefs [None req-2556b9f6-5f96-47c8-81ba-b9b31063bf63 tempest-ProjectMemberTests-1577701723 None] /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-9fe25451-c2c9-46bc-9c90-d9fdbdcfee1d.info is being set with open permissions: ugo+rw Sep 29 18:40:01 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-2556b9f6-5f96-47c8-81ba-b9b31063bf63 tempest-ProjectMemberTests-1577701723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-9fe25451-c2c9-46bc-9c90-d9fdbdcfee1d.info {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:40:01 devstack sudo[108671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-9fe25451-c2c9-46bc-9c90-d9fdbdcfee1d.info Sep 29 18:40:01 devstack sudo[108671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:40:01 devstack sudo[108671]: pam_unix(sudo:session): session closed for user root Sep 29 18:40:01 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-2556b9f6-5f96-47c8-81ba-b9b31063bf63 tempest-ProjectMemberTests-1577701723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-9fe25451-c2c9-46bc-9c90-d9fdbdcfee1d.info" returned: 0 in 0.261s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:40:01 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-2556b9f6-5f96-47c8-81ba-b9b31063bf63 tempest-ProjectMemberTests-1577701723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.966s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:40:01 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-2556b9f6-5f96-47c8-81ba-b9b31063bf63 tempest-ProjectMemberTests-1577701723 None] Create snapshot completed successfully Sep 29 18:40:01 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-0370f33d-51f0-4265-9de1-52249aa78e4a tempest-ProjectMemberTests-1577701723 None] Acquiring lock "cinder-0f856421-c08b-4820-b70d-dc692d0144b0-delete_snapshot" by "delete_snapshot" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:40:01 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-0370f33d-51f0-4265-9de1-52249aa78e4a tempest-ProjectMemberTests-1577701723 None] Lock "cinder-0f856421-c08b-4820-b70d-dc692d0144b0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:40:01 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-0370f33d-51f0-4265-9de1-52249aa78e4a tempest-ProjectMemberTests-1577701723 None] Acquiring lock "cinder-quobyte-9fe25451-c2c9-46bc-9c90-d9fdbdcfee1d" by "delete_snapshot" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:40:01 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-0370f33d-51f0-4265-9de1-52249aa78e4a tempest-ProjectMemberTests-1577701723 None] Lock "cinder-quobyte-9fe25451-c2c9-46bc-9c90-d9fdbdcfee1d" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:40:01 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-0370f33d-51f0-4265-9de1-52249aa78e4a tempest-ProjectMemberTests-1577701723 None] Acquiring lock "cinder-quobyte-0f856421-c08b-4820-b70d-dc692d0144b0" by "_delete_snapshot" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:40:01 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-0370f33d-51f0-4265-9de1-52249aa78e4a tempest-ProjectMemberTests-1577701723 None] Lock "cinder-quobyte-0f856421-c08b-4820-b70d-dc692d0144b0" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:40:01 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-0370f33d-51f0-4265-9de1-52249aa78e4a tempest-ProjectMemberTests-1577701723 None] Deleting offline snapshot 0f856421-c08b-4820-b70d-dc692d0144b0 of volume 9fe25451-c2c9-46bc-9c90-d9fdbdcfee1d {{(pid=86512) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 18:40:01 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-0370f33d-51f0-4265-9de1-52249aa78e4a tempest-ProjectMemberTests-1577701723 None] snapshot_file for this snap is: volume-9fe25451-c2c9-46bc-9c90-d9fdbdcfee1d.0f856421-c08b-4820-b70d-dc692d0144b0 {{(pid=86512) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 18:40:02 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[09fdeec5-ae62-4e6b-bca0-f87e0f113c2f]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:40:02 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-0370f33d-51f0-4265-9de1-52249aa78e4a tempest-ProjectMemberTests-1577701723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-9fe25451-c2c9-46bc-9c90-d9fdbdcfee1d.0f856421-c08b-4820-b70d-dc692d0144b0 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:40:02 devstack sudo[108677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-9fe25451-c2c9-46bc-9c90-d9fdbdcfee1d.0f856421-c08b-4820-b70d-dc692d0144b0 Sep 29 18:40:02 devstack sudo[108677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:40:02 devstack sudo[108677]: pam_unix(sudo:session): session closed for user root Sep 29 18:40:02 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-0370f33d-51f0-4265-9de1-52249aa78e4a tempest-ProjectMemberTests-1577701723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-9fe25451-c2c9-46bc-9c90-d9fdbdcfee1d.0f856421-c08b-4820-b70d-dc692d0144b0" returned: 0 in 0.355s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:40:02 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.remotefs [None req-0370f33d-51f0-4265-9de1-52249aa78e4a tempest-ProjectMemberTests-1577701723 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9fe25451-c2c9-46bc-9c90-d9fdbdcfee1d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86512) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 18:40:02 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dfae71a-4e5c-4ca0-988a-aea42ac9d0a2]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:40:02 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-0370f33d-51f0-4265-9de1-52249aa78e4a tempest-ProjectMemberTests-1577701723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-9fe25451-c2c9-46bc-9c90-d9fdbdcfee1d {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:40:02 devstack sudo[108682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-9fe25451-c2c9-46bc-9c90-d9fdbdcfee1d Sep 29 18:40:02 devstack sudo[108682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:40:02 devstack sudo[108682]: pam_unix(sudo:session): session closed for user root Sep 29 18:40:02 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-0370f33d-51f0-4265-9de1-52249aa78e4a tempest-ProjectMemberTests-1577701723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-9fe25451-c2c9-46bc-9c90-d9fdbdcfee1d" returned: 0 in 0.394s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:40:02 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-0370f33d-51f0-4265-9de1-52249aa78e4a tempest-ProjectMemberTests-1577701723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-9fe25451-c2c9-46bc-9c90-d9fdbdcfee1d.0f856421-c08b-4820-b70d-dc692d0144b0 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:40:02 devstack sudo[108687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-9fe25451-c2c9-46bc-9c90-d9fdbdcfee1d.0f856421-c08b-4820-b70d-dc692d0144b0 Sep 29 18:40:02 devstack sudo[108687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:40:03 devstack sudo[108687]: pam_unix(sudo:session): session closed for user root Sep 29 18:40:03 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-0370f33d-51f0-4265-9de1-52249aa78e4a tempest-ProjectMemberTests-1577701723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-9fe25451-c2c9-46bc-9c90-d9fdbdcfee1d.0f856421-c08b-4820-b70d-dc692d0144b0" returned: 0 in 0.323s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:40:03 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-0370f33d-51f0-4265-9de1-52249aa78e4a tempest-ProjectMemberTests-1577701723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-9fe25451-c2c9-46bc-9c90-d9fdbdcfee1d.0f856421-c08b-4820-b70d-dc692d0144b0 {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:40:03 devstack sudo[108692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-9fe25451-c2c9-46bc-9c90-d9fdbdcfee1d.0f856421-c08b-4820-b70d-dc692d0144b0 Sep 29 18:40:03 devstack sudo[108692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:40:03 devstack sudo[108692]: pam_unix(sudo:session): session closed for user root Sep 29 18:40:03 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-0370f33d-51f0-4265-9de1-52249aa78e4a tempest-ProjectMemberTests-1577701723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-9fe25451-c2c9-46bc-9c90-d9fdbdcfee1d.0f856421-c08b-4820-b70d-dc692d0144b0" returned: 0 in 0.237s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:40:03 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-0370f33d-51f0-4265-9de1-52249aa78e4a tempest-ProjectMemberTests-1577701723 None] Lock "cinder-quobyte-0f856421-c08b-4820-b70d-dc692d0144b0" released by "_delete_snapshot" :: held 1.418s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:40:03 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-0370f33d-51f0-4265-9de1-52249aa78e4a tempest-ProjectMemberTests-1577701723 None] Lock "cinder-quobyte-9fe25451-c2c9-46bc-9c90-d9fdbdcfee1d" released by "delete_snapshot" :: held 1.440s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:40:03 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-0370f33d-51f0-4265-9de1-52249aa78e4a tempest-ProjectMemberTests-1577701723 None] Created reservations ['2262ec87-666f-474e-a5d4-7f21ecadbc7f', 'bb9bb09f-82d8-4dd6-96b6-d1ff116feb5f', 'd520d73f-0fb4-4b08-84af-90e483cf0f67', '8facd31a-8ac1-4cf7-84eb-6ebb840b1104'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:40:03 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-0370f33d-51f0-4265-9de1-52249aa78e4a tempest-ProjectMemberTests-1577701723 None] Delete snapshot completed successfully. Sep 29 18:40:03 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-0370f33d-51f0-4265-9de1-52249aa78e4a tempest-ProjectMemberTests-1577701723 None] Lock "cinder-0f856421-c08b-4820-b70d-dc692d0144b0-delete_snapshot" released by "delete_snapshot" :: held 1.588s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:40:04 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-3f4fb35c-aeac-449f-911d-0f98298173f1 tempest-ProjectMemberTests-1577701723 None] Acquiring lock "cinder-9fe25451-c2c9-46bc-9c90-d9fdbdcfee1d-delete_volume" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:40:04 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-3f4fb35c-aeac-449f-911d-0f98298173f1 tempest-ProjectMemberTests-1577701723 None] Lock "cinder-9fe25451-c2c9-46bc-9c90-d9fdbdcfee1d-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:40:04 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-3f4fb35c-aeac-449f-911d-0f98298173f1 tempest-ProjectMemberTests-1577701723 None] Acquiring lock "cinder-quobyte-9fe25451-c2c9-46bc-9c90-d9fdbdcfee1d" by "delete_volume" {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:40:04 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-3f4fb35c-aeac-449f-911d-0f98298173f1 tempest-ProjectMemberTests-1577701723 None] Lock "cinder-quobyte-9fe25451-c2c9-46bc-9c90-d9fdbdcfee1d" acquired by "delete_volume" :: waited 0.017s {{(pid=86512) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:40:04 devstack cinder-volume[86512]: DEBUG oslo.privsep.daemon [-] privsep: reply[56edade3-0a33-438a-8321-970b80480efb]: (4, 'qcow2') {{(pid=87936) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:40:04 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-3f4fb35c-aeac-449f-911d-0f98298173f1 tempest-ProjectMemberTests-1577701723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-9fe25451-c2c9-46bc-9c90-d9fdbdcfee1d {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:40:04 devstack sudo[108696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-9fe25451-c2c9-46bc-9c90-d9fdbdcfee1d Sep 29 18:40:04 devstack sudo[108696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:40:04 devstack sudo[108696]: pam_unix(sudo:session): session closed for user root Sep 29 18:40:04 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-3f4fb35c-aeac-449f-911d-0f98298173f1 tempest-ProjectMemberTests-1577701723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-9fe25451-c2c9-46bc-9c90-d9fdbdcfee1d" returned: 0 in 0.401s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:40:04 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-3f4fb35c-aeac-449f-911d-0f98298173f1 tempest-ProjectMemberTests-1577701723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-9fe25451-c2c9-46bc-9c90-d9fdbdcfee1d {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:40:04 devstack sudo[108702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-9fe25451-c2c9-46bc-9c90-d9fdbdcfee1d Sep 29 18:40:04 devstack sudo[108702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:40:04 devstack sudo[108702]: pam_unix(sudo:session): session closed for user root Sep 29 18:40:04 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-3f4fb35c-aeac-449f-911d-0f98298173f1 tempest-ProjectMemberTests-1577701723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe/volume-9fe25451-c2c9-46bc-9c90-d9fdbdcfee1d" returned: 0 in 0.255s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:40:04 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-3f4fb35c-aeac-449f-911d-0f98298173f1 tempest-ProjectMemberTests-1577701723 None] Lock "cinder-quobyte-9fe25451-c2c9-46bc-9c90-d9fdbdcfee1d" released by "delete_volume" :: held 0.744s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:40:04 devstack cinder-volume[86512]: DEBUG cinder.quota [None req-3f4fb35c-aeac-449f-911d-0f98298173f1 tempest-ProjectMemberTests-1577701723 None] Created reservations ['3abe18d0-7318-4e19-97c5-f2be88348458', 'ea703d55-98fd-47dd-84f2-d4e8497182f6', '00703ef4-6733-4329-b9b0-58ed3214d268', '781cc45d-29a9-4dae-8d8f-d6d442451ad4'] {{(pid=86512) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:40:05 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-3f4fb35c-aeac-449f-911d-0f98298173f1 tempest-ProjectMemberTests-1577701723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:40:05 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-3f4fb35c-aeac-449f-911d-0f98298173f1 tempest-ProjectMemberTests-1577701723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:40:05 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-3f4fb35c-aeac-449f-911d-0f98298173f1 tempest-ProjectMemberTests-1577701723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883': None} {{(pid=86512) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:40:05 devstack cinder-volume[86512]: DEBUG cinder.volume.drivers.quobyte [None req-3f4fb35c-aeac-449f-911d-0f98298173f1 tempest-ProjectMemberTests-1577701723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-0fa7fdb0-5070-45c5-8536-5dc237fff883'] {{(pid=86512) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:40:05 devstack cinder-volume[86512]: DEBUG oslo_concurrency.lockutils [None req-3f4fb35c-aeac-449f-911d-0f98298173f1 tempest-ProjectMemberTests-1577701723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86512) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:40:05 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-3f4fb35c-aeac-449f-911d-0f98298173f1 tempest-ProjectMemberTests-1577701723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:40:05 devstack sudo[108705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe Sep 29 18:40:05 devstack sudo[108705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:40:05 devstack sudo[108705]: pam_unix(sudo:session): session closed for user root Sep 29 18:40:05 devstack cinder-volume[86512]: DEBUG oslo_concurrency.processutils [None req-3f4fb35c-aeac-449f-911d-0f98298173f1 tempest-ProjectMemberTests-1577701723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3f6ed976aa725159479c933e90120bbe" returned: 0 in 0.257s {{(pid=86512) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:40:05 devstack cinder-volume[86512]: DEBUG cinder.manager [None req-3f4fb35c-aeac-449f-911d-0f98298173f1 tempest-ProjectMemberTests-1577701723 None] Notifying Schedulers of capabilities ... {{(pid=86512) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:40:05 devstack cinder-volume[86512]: INFO cinder.volume.manager [None req-3f4fb35c-aeac-449f-911d-0f98298173f1 tempest-ProjectMemberTests-1577701723 None] Deleted volume successfully. Sep 29 18:40:05 devstack cinder-volume[86512]: DEBUG cinder.coordination [None req-3f4fb35c-aeac-449f-911d-0f98298173f1 tempest-ProjectMemberTests-1577701723 None] Lock "cinder-9fe25451-c2c9-46bc-9c90-d9fdbdcfee1d-delete_volume" released by "delete_volume" :: held 1.214s {{(pid=86512) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:40:15 devstack cinder-volume[86512]: DEBUG dbcounter [-] [86512] Writing DB stats cinder:SELECT=92,cinder:INSERT=34,cinder:UPDATE=112,cinder:DELETE=7 {{(pid=86512) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 18:40:15 devstack cinder-volume[86512]: DEBUG dbcounter [-] [86512] Writing DB stats cinder:DELETE=12,cinder:SELECT=90,cinder:INSERT=30,cinder:UPDATE=118 {{(pid=86512) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}